Last active
November 19, 2021 02:12
-
-
Save vinothchandar/45f4209cc01daaba99324de390a97406 to your computer and use it in GitHub Desktop.
hudi table config update/delete
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
hudi:hoodie_benchmark->desc | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β basePath β file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β metaPath β file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β fileSystem β file β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β false β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.archivelog.folder β archived β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark->table update-configs --props-file /Users/vs/Cache/hudi-test-data/hoodie.properties | |
263781 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
263798 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie/hoodie.properties | |
263798 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=PARQUET) from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Old Value β New Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β hoodie.archivelog.folder β archived β archived123 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β false β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.x.y β null β z β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark->table delete-configs --comma-separated-configs hoodie.x.y,hoodie.a.b | |
277540 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
277554 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie/hoodie.properties | |
277555 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=PARQUET) from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Old Value β New Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β hoodie.archivelog.folder β archived123 β archived123 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.x.y β z β null β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark->table delete-configs --comma-separated-configs hoodie.x.y,hoodie.a.b | |
310549 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
310567 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie/hoodie.properties | |
310568 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=PARQUET) from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Old Value β New Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β hoodie.archivelog.folder β archived123 β archived123 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark->table update-configs --props-file /Users/vs/Cache/hudi-test-data/hoodie.properties.bkp | |
576087 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
576099 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie/hoodie.properties | |
576100 [Spring Shell] INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type MERGE_ON_READ(version=1, baseFileFormat=PARQUET) from file:///Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/ | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ€ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Old Value β New Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββͺββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β hoodie.archivelog.folder β archived123 β archived β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β true β false β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββΌββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ§ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark->desc | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ€βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
β Property β Value β | |
β ββββββββββββββββββββββββββββββββββββββββββββββββββͺβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | |
β basePath β file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β metaPath β file:/Users/vs/Cache/hudi-test-data/output-mor-smoke/org.apache.hudi/.hoodie β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β fileSystem β file β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.name β hoodie_benchmark β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.recordkey.fields β key β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.compaction.payload.class β org.apache.hudi.common.model.OverwriteWithLatestAvroPayload β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.type β MERGE_ON_READ β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.datasource.write.hive_style_partitioning β false β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.precombine.field β ts β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.partition.fields β partition β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.keygenerator.class β org.apache.hudi.keygen.SimpleKeyGenerator β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.populate.meta.fields β true β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.archivelog.folder β archived β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.base.file.format β PARQUET β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.timeline.layout.version β 1 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββΌβββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ’ | |
β hoodie.table.version β 3 β | |
βββββββββββββββββββββββββββββββββββββββββββββββββββ§βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | |
hudi:hoodie_benchmark-> | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment