09 09:04:06,390 INFO executor.Executor: Finished task 370.0 in stage 0.0 (TID 370). 1909 bytes result sent to driver
2024-12-09 09:04:06,427 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 419
2024-12-09 09:04:06,428 INFO executor.Executor: Running task 419.0 in stage 0.0 (TID 419)
2024-12-09 09:04:06,469 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
2024-12-09 09:04:06,469 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2024-12-09 09:04:06,469 INFO datasources.SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2024-12-09 09:04:06,469 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74529, range: 0-364611, partition values: [2024-11-21,08]
2024-12-09 09:04:06,627 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1927 records.
2024-12-09 09:04:06,629 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:06,645 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1478 records.
2024-12-09 09:04:06,646 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 1927
2024-12-09 09:04:06,646 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:06,714 INFO hadoop.InternalParquetRecordReader: block read in memory in 1129 ms. row count = 2214
2024-12-09 09:04:06,763 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74050, range: 0-491940, partition values: [2024-11-21,07]
2024-12-09 09:04:06,866 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74633, range: 0-575192, partition values: [2024-11-21,09]
2024-12-09 09:04:07,155 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1846 records.
2024-12-09 09:04:07,157 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,170 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2234 records.
2024-12-09 09:04:07,171 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,174 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 1846
2024-12-09 09:04:07,192 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 2234
2024-12-09 09:04:07,215 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1462 records.
2024-12-09 09:04:07,217 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,264 INFO hadoop.InternalParquetRecordReader: block read in memory in 618 ms. row count = 1478
2024-12-09 09:04:07,282 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74507, range: 0-491739, partition values: [2024-11-21,08]
2024-12-09 09:04:07,340 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73677, range: 0-574750, partition values: [2024-11-21,06]
2024-12-09 09:04:07,345 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74228, range: 0-380376, partition values: [2024-11-21,08]
2024-12-09 09:04:07,544 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2187 records.
2024-12-09 09:04:07,546 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,554 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1416 records.
2024-12-09 09:04:07,555 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,569 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 2187
2024-12-09 09:04:07,603 INFO hadoop.InternalParquetRecordReader: block read in memory in 48 ms. row count = 1416
2024-12-09 09:04:07,650 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1638 records.
2024-12-09 09:04:07,652 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,751 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74188, range: 0-380276, partition values: [2024-11-21,08]
2024-12-09 09:04:07,766 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73634, range: 0-574201, partition values: [2024-11-21,06]
2024-12-09 09:04:07,799 INFO hadoop.InternalParquetRecordReader: block read in memory in 582 ms. row count = 1462
2024-12-09 09:04:07,804 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1333 records.
2024-12-09 09:04:07,806 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,826 INFO hadoop.InternalParquetRecordReader: block read in memory in 174 ms. row count = 1638
2024-12-09 09:04:07,906 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74296, range: 0-401550, partition values: [2024-11-21,08]
2024-12-09 09:04:07,945 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74432, range: 0-406327, partition values: [2024-11-21,08]
2024-12-09 09:04:07,946 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1399 records.
2024-12-09 09:04:07,951 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:07,975 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 1399
2024-12-09 09:04:08,043 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1405 records.
2024-12-09 09:04:08,046 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,052 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1953 records.
2024-12-09 09:04:08,054 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,079 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1953
2024-12-09 09:04:08,088 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73875, range: 0-380143, partition values: [2024-11-21,07]
2024-12-09 09:04:08,178 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1540 records.
2024-12-09 09:04:08,180 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,197 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 1540
2024-12-09 09:04:08,226 INFO hadoop.InternalParquetRecordReader: block read in memory in 420 ms. row count = 1333
2024-12-09 09:04:08,228 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74039, range: 0-490426, partition values: [2024-11-21,07]
2024-12-09 09:04:08,229 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@28be012d
2024-12-09 09:04:08,229 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2024-12-09 09:04:08,229 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/_temporary/attempt_202412090854003314931490831769376_0000_m_000419_419/part-00419-7f91ce9e-374e-4d07-9d3c-09dc19378dfb-c000
2024-12-09 09:04:08,229 INFO codec.CodecConfig: Compression: SNAPPY
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Dictionary is on
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Validation is off
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2024-12-09 09:04:08,229 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2024-12-09 09:04:08,291 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1331 records.
2024-12-09 09:04:08,293 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,308 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73790, range: 0-401535, partition values: [2024-11-21,06]
2024-12-09 09:04:08,320 INFO hadoop.InternalParquetRecordReader: block read in memory in 27 ms. row count = 1331
2024-12-09 09:04:08,411 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74142, range: 0-380129, partition values: [2024-11-21,07]
2024-12-09 09:04:08,443 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2001 records.
2024-12-09 09:04:08,445 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,464 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@68b31a3f
2024-12-09 09:04:08,551 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74268, range: 0-364578, partition values: [2024-11-21,08]
2024-12-09 09:04:08,553 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1878 records.
2024-12-09 09:04:08,556 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,612 INFO hadoop.InternalParquetRecordReader: block read in memory in 56 ms. row count = 1878
2024-12-09 09:04:08,660 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1387 records.
2024-12-09 09:04:08,662 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,679 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 1387
2024-12-09 09:04:08,709 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1313 records.
2024-12-09 09:04:08,712 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,725 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 1313
2024-12-09 09:04:08,781 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73915, range: 0-380127, partition values: [2024-11-21,07]
2024-12-09 09:04:08,782 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74376, range: 0-490178, partition values: [2024-11-21,08]
2024-12-09 09:04:08,818 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74157, range: 0-364335, partition values: [2024-11-21,07]
2024-12-09 09:04:08,944 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1550 records.
2024-12-09 09:04:08,946 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:08,951 INFO hadoop.InternalParquetRecordReader: block read in memory in 506 ms. row count = 2001
2024-12-09 09:04:09,048 INFO hadoop.InternalParquetRecordReader: block read in memory in 1002 ms. row count = 1405
2024-12-09 09:04:09,126 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74158, range: 0-392065, partition values: [2024-11-21,07]
2024-12-09 09:04:09,132 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74630, range: 0-546847, partition values: [2024-11-21,09]
2024-12-09 09:04:09,134 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1407 records.
2024-12-09 09:04:09,136 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1949 records.
2024-12-09 09:04:09,137 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,138 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,147 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 1407
2024-12-09 09:04:09,158 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1949
2024-12-09 09:04:09,252 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73956, range: 0-380070, partition values: [2024-11-21,07]
2024-12-09 09:04:09,289 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74025, range: 0-489777, partition values: [2024-11-21,07]
2024-12-09 09:04:09,379 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1524 records.
2024-12-09 09:04:09,381 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,397 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 1524
2024-12-09 09:04:09,458 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2247 records.
2024-12-09 09:04:09,460 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,461 INFO hadoop.InternalParquetRecordReader: block read in memory in 515 ms. row count = 1550
2024-12-09 09:04:09,489 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73850, range: 0-392057, partition values: [2024-11-21,07]
2024-12-09 09:04:09,497 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1488 records.
2024-12-09 09:04:09,500 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,502 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1843 records.
2024-12-09 09:04:09,504 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:09,535 INFO hadoop.InternalParquetRecordReader: block read in memory in 75 ms. row count = 2247
2024-12-09 09:04:09,537 INFO hadoop.InternalParquetRecordReader: block read in memory in 37 ms. row count = 1488
2024-12-09 09:04:09,549 INFO hadoop.InternalParquetRecordReader: block read in memory in 45 ms. row count = 1843
2024-12-09 09:04:09,567 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74122, range: 0-406089, partition values: [2024-11-21,07]
2024-12-09 09:04:09,627 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74219, range: 0-379947, partition values: [2024-11-21,08]
2024-12-09 09:04:09,677 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73613, range: 0-574178, partition values: [2024-11-21,06]
2024-12-09 09:04:09,691 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73780, range: 0-489683, partition values: [2024-11-21,06]
2024-12-09 09:04:10,451 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1434 records.
2024-12-09 09:04:10,454 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:10,823 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1378 records.
2024-12-09 09:04:10,824 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:11,016 INFO hadoop.InternalParquetRecordReader: block read in memory in 562 ms. row count = 1434
2024-12-09 09:04:11,114 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74301, range: 0-401386, partition values: [2024-11-21,08]
2024-12-09 09:04:11,216 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1474 records.
2024-12-09 09:04:11,218 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:11,233 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1920 records.
2024-12-09 09:04:11,236 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:11,239 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 1474
2024-12-09 09:04:11,262 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 1920
2024-12-09 09:04:11,316 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73990, range: 0-391864, partition values: [2024-11-21,07]
2024-12-09 09:04:11,435 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73742, range: 0-489454, partition values: [2024-11-21,06]
2024-12-09 09:04:11,466 INFO hadoop.InternalParquetRecordReader: block read in memory in 642 ms. row count = 1378
2024-12-09 09:04:11,541 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74217, range: 0-364305, partition values: [2024-11-21,08]
2024-12-09 09:04:11,692 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1458 records.
2024-12-09 09:04:11,694 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:11,701 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2059 records.
2024-12-09 09:04:11,702 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:12,137 INFO hadoop.InternalParquetRecordReader: block read in memory in 435 ms. row count = 2059
2024-12-09 09:04:12,175 INFO hadoop.InternalParquetRecordReader: block read in memory in 481 ms. row count = 1458
2024-12-09 09:04:12,263 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74621, range: 0-546623, partition values: [2024-11-21,09]
2024-12-09 09:04:12,266 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74108, range: 0-379923, partition values: [2024-11-21,07]
2024-12-09 09:04:12,485 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2080 records.
2024-12-09 09:04:12,487 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:12,492 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1437 records.
2024-12-09 09:04:12,493 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:12,510 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 2080
2024-12-09 09:04:12,526 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 1437
2024-12-09 09:04:12,610 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74893, range: 0-379809, partition values: [2024-11-21,09]
2024-12-09 09:04:12,622 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1347 records.
2024-12-09 09:04:12,624 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:12,633 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1553 records.
2024-12-09 09:04:12,635 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:12,643 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74692, range: 0-546147, partition values: [2024-11-21,09]
2024-12-09 09:04:12,701 INFO hadoop.InternalParquetRecordReader: block read in memory in 66 ms. row count = 1553
2024-12-09 09:04:12,781 INFO hadoop.InternalParquetRecordReader: block read in memory in 157 ms. row count = 1347
2024-12-09 09:04:12,793 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73996, range: 0-406062, partition values: [2024-11-21,07]
2024-12-09 09:04:12,860 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73964, range: 0-364247, partition values: [2024-11-21,07]
2024-12-09 09:04:13,071 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2297 records.
2024-12-09 09:04:13,073 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,108 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1432 records.
2024-12-09 09:04:13,110 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,164 INFO hadoop.InternalParquetRecordReader: block read in memory in 91 ms. row count = 2297
2024-12-09 09:04:13,232 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1327 records.
2024-12-09 09:04:13,234 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,286 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 1327
2024-12-09 09:04:13,336 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73651, range: 0-573999, partition values: [2024-11-21,06]
2024-12-09 09:04:13,370 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74262, range: 0-364224, partition values: [2024-11-21,08]
2024-12-09 09:04:13,588 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1308 records.
2024-12-09 09:04:13,590 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,617 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2077 records.
2024-12-09 09:04:13,619 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,623 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 1308
2024-12-09 09:04:13,651 INFO hadoop.InternalParquetRecordReader: block read in memory in 32 ms. row count = 2077
2024-12-09 09:04:13,695 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73907, range: 0-364086, partition values: [2024-11-21,07]
2024-12-09 09:04:13,774 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74662, range: 0-573798, partition values: [2024-11-21,09]
2024-12-09 09:04:13,843 INFO hadoop.InternalParquetRecordReader: block read in memory in 733 ms. row count = 1432
2024-12-09 09:04:13,883 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1425 records.
2024-12-09 09:04:13,885 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:13,951 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74287, range: 0-401341, partition values: [2024-11-21,08]
2024-12-09 09:04:14,160 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1463 records.
2024-12-09 09:04:14,162 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:14,393 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1303 records.
2024-12-09 09:04:14,395 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:14,479 INFO hadoop.InternalParquetRecordReader: block read in memory in 84 ms. row count = 1303
2024-12-09 09:04:14,573 INFO hadoop.InternalParquetRecordReader: block read in memory in 688 ms. row count = 1425
2024-12-09 09:04:14,587 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74096, range: 0-364074, partition values: [2024-11-21,07]
2024-12-09 09:04:14,653 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74004, range: 0-379735, partition values: [2024-11-21,07]
2024-12-09 09:04:14,712 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1878 records.
2024-12-09 09:04:14,714 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:15,029 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1454 records.
2024-12-09 09:04:15,030 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:15,052 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1454
2024-12-09 09:04:15,135 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73926, range: 0-379600, partition values: [2024-11-21,07]
2024-12-09 09:04:15,332 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1371 records.
2024-12-09 09:04:15,334 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:15,344 INFO hadoop.InternalParquetRecordReader: block read in memory in 1182 ms. row count = 1463
2024-12-09 09:04:15,352 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 1371
2024-12-09 09:04:15,425 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74361, range: 0-391590, partition values: [2024-11-21,08]
2024-12-09 09:04:15,433 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74092, range: 0-379083, partition values: [2024-11-21,07]
2024-12-09 09:04:15,541 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2047 records.
2024-12-09 09:04:15,543 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:15,778 INFO hadoop.InternalParquetRecordReader: block read in memory in 1064 ms. row count = 1878
2024-12-09 09:04:15,844 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1375 records.
2024-12-09 09:04:15,846 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:15,871 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1375
2024-12-09 09:04:15,892 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74048, range: 0-489356, partition values: [2024-11-21,07]
2024-12-09 09:04:15,955 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74892, range: 0-391294, partition values: [2024-11-21,09]
2024-12-09 09:04:16,539 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1548 records.
2024-12-09 09:04:16,541 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:16,973 INFO hadoop.InternalParquetRecordReader: block read in memory in 1430 ms. row count = 2047
2024-12-09 09:04:17,049 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1546 records.
2024-12-09 09:04:17,051 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:17,100 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1284 records.
2024-12-09 09:04:17,102 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:17,110 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74583, range: 0-546113, partition values: [2024-11-21,09]
2024-12-09 09:04:17,125 INFO hadoop.InternalParquetRecordReader: block read in memory in 74 ms. row count = 1546
2024-12-09 09:04:17,134 INFO hadoop.InternalParquetRecordReader: block read in memory in 32 ms. row count = 1284
2024-12-09 09:04:17,208 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74199, range: 0-363298, partition values: [2024-11-21,08]
2024-12-09 09:04:17,210 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73959, range: 0-401261, partition values: [2024-11-21,07]
2024-12-09 09:04:17,311 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1534 records.
2024-12-09 09:04:17,313 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:17,331 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 1534
2024-12-09 09:04:17,409 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74112, range: 0-401023, partition values: [2024-11-21,07]
2024-12-09 09:04:17,500 INFO hadoop.InternalParquetRecordReader: block read in memory in 959 ms. row count = 1548
2024-12-09 09:04:17,595 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73836, range: 0-405994, partition values: [2024-11-21,07]
2024-12-09 09:04:17,821 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1476 records.
2024-12-09 09:04:17,823 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:17,840 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 1476
2024-12-09 09:04:17,843 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2236 records.
2024-12-09 09:04:17,844 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:17,927 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73955, range: 0-405544, partition values: [2024-11-21,07]
2024-12-09 09:04:18,144 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2069 records.
2024-12-09 09:04:18,146 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,155 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1518 records.
2024-12-09 09:04:18,156 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,179 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 2069
2024-12-09 09:04:18,190 INFO hadoop.InternalParquetRecordReader: block read in memory in 34 ms. row count = 1518
2024-12-09 09:04:18,270 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1361 records.
2024-12-09 09:04:18,273 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,284 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74288, range: 0-400695, partition values: [2024-11-21,08]
2024-12-09 09:04:18,379 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1881 records.
2024-12-09 09:04:18,381 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,392 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74684, range: 0-545927, partition values: [2024-11-21,09]
2024-12-09 09:04:18,405 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 1881
2024-12-09 09:04:18,476 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1627 records.
2024-12-09 09:04:18,478 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,498 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1627
2024-12-09 09:04:18,544 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 19165232
2024-12-09 09:04:18,602 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1501 records.
2024-12-09 09:04:18,602 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73883, range: 0-400670, partition values: [2024-11-21,07]
2024-12-09 09:04:18,604 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:18,696 INFO hadoop.InternalParquetRecordReader: block read in memory in 92 ms. row count = 1501
2024-12-09 09:04:18,803 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74236, range: 0-391092, partition values: [2024-11-21,08]
2024-12-09 09:04:18,832 INFO hadoop.InternalParquetRecordReader: block read in memory in 988 ms. row count = 2236
2024-12-09 09:04:19,000 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1445 records.
2024-12-09 09:04:19,006 INFO hadoop.InternalParquetRecordReader: block read in memory in 733 ms. row count = 1361
2024-12-09 09:04:19,009 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:19,037 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 1445
2024-12-09 09:04:19,047 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74617, range: 0-572783, partition values: [2024-11-21,09]
2024-12-09 09:04:19,104 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73971, range: 0-378799, partition values: [2024-11-21,07]
2024-12-09 09:04:19,160 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74277, range: 0-390934, partition values: [2024-11-21,08]
2024-12-09 09:04:19,451 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1301 records.
2024-12-09 09:04:19,453 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:19,987 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854002365497375168308889_0000_m_000395_395' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854002365497375168308889_0000_m_000395
2024-12-09 09:04:19,988 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854002365497375168308889_0000_m_000395_395: Committed
2024-12-09 09:04:19,989 INFO executor.Executor: Finished task 395.0 in stage 0.0 (TID 395). 1909 bytes result sent to driver
2024-12-09 09:04:20,701 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2169 records.
2024-12-09 09:04:20,704 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:20,793 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1499 records.
2024-12-09 09:04:20,795 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:20,916 INFO hadoop.InternalParquetRecordReader: block read in memory in 1463 ms. row count = 1301
2024-12-09 09:04:21,013 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74191, range: 0-362931, partition values: [2024-11-21,08]
2024-12-09 09:04:21,062 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1447 records.
2024-12-09 09:04:21,064 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:21,689 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1345 records.
2024-12-09 09:04:21,692 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:21,718 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 1345
2024-12-09 09:04:21,828 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73949, range: 0-362865, partition values: [2024-11-21,07]
2024-12-09 09:04:21,850 INFO hadoop.InternalParquetRecordReader: block read in memory in 1055 ms. row count = 1499
2024-12-09 09:04:21,951 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74223, range: 0-405466, partition values: [2024-11-21,08]
2024-12-09 09:04:22,330 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1337 records.
2024-12-09 09:04:22,332 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:22,399 INFO hadoop.InternalParquetRecordReader: block read in memory in 67 ms. row count = 1337
2024-12-09 09:04:22,529 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74270, range: 0-362841, partition values: [2024-11-21,08]
2024-12-09 09:04:22,559 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2026 records.
2024-12-09 09:04:22,561 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:22,876 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1320 records.
2024-12-09 09:04:22,879 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:22,976 INFO hadoop.InternalParquetRecordReader: block read in memory in 97 ms. row count = 1320
2024-12-09 09:04:23,095 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=19/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-78140, range: 0-362694, partition values: [2024-11-21,19]
2024-12-09 09:04:23,344 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1381 records.
2024-12-09 09:04:23,347 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:23,363 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1423 records.
2024-12-09 09:04:23,365 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:23,368 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 1381
2024-12-09 09:04:23,460 INFO hadoop.InternalParquetRecordReader: block read in memory in 899 ms. row count = 2026
2024-12-09 09:04:23,472 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74282, range: 0-362627, partition values: [2024-11-21,08]
2024-12-09 09:04:23,660 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73662, range: 0-545820, partition values: [2024-11-21,06]
2024-12-09 09:04:23,815 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1315 records.
2024-12-09 09:04:23,821 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:23,841 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1994 records.
2024-12-09 09:04:23,843 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:23,847 INFO hadoop.InternalParquetRecordReader: block read in memory in 3143 ms. row count = 2169
2024-12-09 09:04:23,859 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 1994
2024-12-09 09:04:23,866 INFO hadoop.InternalParquetRecordReader: block read in memory in 45 ms. row count = 1315
2024-12-09 09:04:23,944 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73936, range: 0-362255, partition values: [2024-11-21,07]
2024-12-09 09:04:24,000 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74553, range: 0-572544, partition values: [2024-11-21,09]
2024-12-09 09:04:24,002 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=21/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-79227, range: 0-545444, partition values: [2024-11-21,21]
2024-12-09 09:04:24,124 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1267 records.
2024-12-09 09:04:24,126 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:24,154 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 1267
2024-12-09 09:04:24,187 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2255 records.
2024-12-09 09:04:24,189 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:24,206 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 2255
2024-12-09 09:04:24,230 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74152, range: 0-361863, partition values: [2024-11-21,07]
2024-12-09 09:04:24,334 INFO hadoop.InternalParquetRecordReader: block read in memory in 969 ms. row count = 1423
2024-12-09 09:04:24,394 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74729, range: 0-572117, partition values: [2024-11-21,09]
2024-12-09 09:04:24,412 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1339 records.
2024-12-09 09:04:24,414 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:24,416 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74116, range: 0-378777, partition values: [2024-11-21,07]
2024-12-09 09:04:24,435 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 1339
2024-12-09 09:04:24,464 INFO hadoop.InternalParquetRecordReader: block read in memory in 3400 ms. row count = 1447
2024-12-09 09:04:24,510 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=10/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-75255, range: 0-361498, partition values: [2024-11-21,10]
2024-12-09 09:04:24,548 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73884, range: 0-400465, partition values: [2024-11-21,07]
2024-12-09 09:04:24,761 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1417 records.
2024-12-09 09:04:24,763 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:24,784 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 1417
2024-12-09 09:04:24,871 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74001, range: 0-400205, partition values: [2024-11-21,07]
2024-12-09 09:04:24,982 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1520 records.
2024-12-09 09:04:24,984 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:25,166 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1542 records.
2024-12-09 09:04:25,168 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:25,234 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1566 records.
2024-12-09 09:04:25,236 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:25,261 INFO hadoop.InternalParquetRecordReader: block read in memory in 93 ms. row count = 1542
2024-12-09 09:04:25,266 INFO hadoop.InternalParquetRecordReader: block read in memory in 30 ms. row count = 1566
2024-12-09 09:04:25,350 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73994, range: 0-405382, partition values: [2024-11-21,07]
2024-12-09 09:04:25,386 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73900, range: 0-399932, partition values: [2024-11-21,07]
2024-12-09 09:04:25,760 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1409 records.
2024-12-09 09:04:25,761 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:25,901 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1540 records.
2024-12-09 09:04:25,903 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:25,907 INFO hadoop.InternalParquetRecordReader: block read in memory in 146 ms. row count = 1409
2024-12-09 09:04:25,987 INFO hadoop.InternalParquetRecordReader: block read in memory in 84 ms. row count = 1540
2024-12-09 09:04:25,996 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74081, range: 0-399907, partition values: [2024-11-21,07]
2024-12-09 09:04:26,057 INFO hadoop.InternalParquetRecordReader: block read in memory in 1073 ms. row count = 1520
2024-12-09 09:04:26,069 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1403 records.
2024-12-09 09:04:26,071 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:26,078 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74211, range: 0-405372, partition values: [2024-11-21,08]
2024-12-09 09:04:26,129 INFO hadoop.InternalParquetRecordReader: block read in memory in 58 ms. row count = 1403
2024-12-09 09:04:26,187 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74216, range: 0-390894, partition values: [2024-11-21,08]
2024-12-09 09:04:26,281 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74126, range: 0-378654, partition values: [2024-11-21,07]
2024-12-09 09:04:26,368 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2223 records.
2024-12-09 09:04:26,371 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:26,450 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1369 records.
2024-12-09 09:04:26,452 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:26,468 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 1369
2024-12-09 09:04:26,486 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1541 records.
2024-12-09 09:04:26,487 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:26,513 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 1541
2024-12-09 09:04:26,550 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73961, range: 0-361400, partition values: [2024-11-21,07]
2024-12-09 09:04:26,629 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73968, range: 0-405269, partition values: [2024-11-21,07]
2024-12-09 09:04:27,087 INFO hadoop.InternalParquetRecordReader: block read in memory in 716 ms. row count = 2223
2024-12-09 09:04:27,146 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2184 records.
2024-12-09 09:04:27,148 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:27,234 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73635, range: 0-545410, partition values: [2024-11-21,06]
2024-12-09 09:04:27,561 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1425 records.
2024-12-09 09:04:27,563 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:27,762 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2202 records.
2024-12-09 09:04:27,764 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:27,806 INFO hadoop.InternalParquetRecordReader: block read in memory in 42 ms. row count = 2202
2024-12-09 09:04:27,810 INFO hadoop.InternalParquetRecordReader: block read in memory in 662 ms. row count = 2184
2024-12-09 09:04:27,926 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74657, range: 0-544504, partition values: [2024-11-21,09]
2024-12-09 09:04:27,954 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 20182457
2024-12-09 09:04:28,087 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2112 records.
2024-12-09 09:04:28,089 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,150 INFO hadoop.InternalParquetRecordReader: block read in memory in 61 ms. row count = 2112
2024-12-09 09:04:28,272 INFO hadoop.InternalParquetRecordReader: block read in memory in 709 ms. row count = 1425
2024-12-09 09:04:28,280 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73706, range: 0-543953, partition values: [2024-11-21,06]
2024-12-09 09:04:28,379 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73886, range: 0-390852, partition values: [2024-11-21,07]
2024-12-09 09:04:28,435 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1284 records.
2024-12-09 09:04:28,437 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,483 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2110 records.
2024-12-09 09:04:28,484 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,539 INFO hadoop.InternalParquetRecordReader: block read in memory in 55 ms. row count = 2110
2024-12-09 09:04:28,579 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1387 records.
2024-12-09 09:04:28,581 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,603 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1387
2024-12-09 09:04:28,672 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1432 records.
2024-12-09 09:04:28,674 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,687 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74214, range: 0-390639, partition values: [2024-11-21,08]
2024-12-09 09:04:28,700 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=06/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73695, range: 0-543587, partition values: [2024-11-21,06]
2024-12-09 09:04:28,733 INFO hadoop.InternalParquetRecordReader: block read in memory in 59 ms. row count = 1432
2024-12-09 09:04:28,775 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1433 records.
2024-12-09 09:04:28,777 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,810 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 1433
2024-12-09 09:04:28,821 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73896, range: 0-378570, partition values: [2024-11-21,07]
2024-12-09 09:04:28,902 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2049 records.
2024-12-09 09:04:28,904 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:28,924 INFO hadoop.InternalParquetRecordReader: block read in memory in 486 ms. row count = 1284
2024-12-09 09:04:28,946 INFO hadoop.InternalParquetRecordReader: block read in memory in 42 ms. row count = 2049
2024-12-09 09:04:28,949 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74350, range: 0-399696, partition values: [2024-11-21,08]
2024-12-09 09:04:29,004 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74185, range: 0-360831, partition values: [2024-11-21,08]
2024-12-09 09:04:29,078 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 20620691
2024-12-09 09:04:29,117 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1513 records.
2024-12-09 09:04:29,119 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:29,143 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1442 records.
2024-12-09 09:04:29,145 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:29,159 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 1442
2024-12-09 09:04:29,186 INFO hadoop.InternalParquetRecordReader: block read in memory in 66 ms. row count = 1513
2024-12-09 09:04:29,267 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74439, range: 0-399644, partition values: [2024-11-21,08]
2024-12-09 09:04:29,271 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74239, range: 0-390558, partition values: [2024-11-21,08]
2024-12-09 09:04:29,274 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1565 records.
2024-12-09 09:04:29,275 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:29,422 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1352 records.
2024-12-09 09:04:29,424 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:29,444 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1352
2024-12-09 09:04:29,512 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854004901765109924209510_0000_m_000387_387' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854004901765109924209510_0000_m_000387
2024-12-09 09:04:29,512 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854004901765109924209510_0000_m_000387_387: Committed
2024-12-09 09:04:29,514 INFO executor.Executor: Finished task 387.0 in stage 0.0 (TID 387). 1909 bytes result sent to driver
2024-12-09 09:04:29,532 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=09/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74894, range: 0-378017, partition values: [2024-11-21,09]
2024-12-09 09:04:29,688 INFO hadoop.InternalParquetRecordReader: block read in memory in 413 ms. row count = 1565
2024-12-09 09:04:29,762 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1425 records.
2024-12-09 09:04:29,764 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:29,777 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 1425
2024-12-09 09:04:29,787 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854001727069578805932680_0000_m_000391_391' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854001727069578805932680_0000_m_000391
2024-12-09 09:04:29,787 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854001727069578805932680_0000_m_000391_391: Committed
2024-12-09 09:04:29,789 INFO executor.Executor: Finished task 391.0 in stage 0.0 (TID 391). 1909 bytes result sent to driver
2024-12-09 09:04:29,798 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74086, range: 0-405260, partition values: [2024-11-21,07]
2024-12-09 09:04:29,892 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74077, range: 0-377927, partition values: [2024-11-21,07]
2024-12-09 09:04:29,980 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1460 records.
2024-12-09 09:04:29,982 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,007 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1460
2024-12-09 09:04:30,033 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1301 records.
2024-12-09 09:04:30,037 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,050 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1311 records.
2024-12-09 09:04:30,052 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,061 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 1301
2024-12-09 09:04:30,091 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73979, range: 0-405208, partition values: [2024-11-21,07]
2024-12-09 09:04:30,114 INFO hadoop.InternalParquetRecordReader: block read in memory in 62 ms. row count = 1311
2024-12-09 09:04:30,157 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74286, range: 0-377848, partition values: [2024-11-21,08]
2024-12-09 09:04:30,209 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74115, range: 0-360804, partition values: [2024-11-21,07]
2024-12-09 09:04:30,373 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1524 records.
2024-12-09 09:04:30,376 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,421 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1340 records.
2024-12-09 09:04:30,424 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,430 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1434 records.
2024-12-09 09:04:30,432 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,443 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 1340
2024-12-09 09:04:30,446 INFO hadoop.InternalParquetRecordReader: block read in memory in 70 ms. row count = 1524
2024-12-09 09:04:30,595 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74220, range: 0-360797, partition values: [2024-11-21,08]
2024-12-09 09:04:30,646 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74400, range: 0-405080, partition values: [2024-11-21,08]
2024-12-09 09:04:30,866 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1336 records.
2024-12-09 09:04:30,869 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,890 INFO hadoop.InternalParquetRecordReader: block read in memory in 458 ms. row count = 1434
2024-12-09 09:04:30,913 INFO hadoop.InternalParquetRecordReader: block read in memory in 44 ms. row count = 1336
2024-12-09 09:04:30,914 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1484 records.
2024-12-09 09:04:30,917 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,968 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1512 records.
2024-12-09 09:04:30,970 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:30,974 INFO hadoop.InternalParquetRecordReader: block read in memory in 57 ms. row count = 1484
2024-12-09 09:04:30,978 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74087, range: 0-399607, partition values: [2024-11-21,07]
2024-12-09 09:04:31,015 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74264, range: 0-360733, partition values: [2024-11-21,08]
2024-12-09 09:04:31,039 INFO hadoop.InternalParquetRecordReader: block read in memory in 68 ms. row count = 1512
2024-12-09 09:04:31,114 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73877, range: 0-390438, partition values: [2024-11-21,07]
2024-12-09 09:04:31,160 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73888, range: 0-404904, partition values: [2024-11-21,07]
2024-12-09 09:04:31,163 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1489 records.
2024-12-09 09:04:31,165 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,180 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1346 records.
2024-12-09 09:04:31,182 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,185 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1489
2024-12-09 09:04:31,200 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 1346
2024-12-09 09:04:31,285 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73931, range: 0-399032, partition values: [2024-11-21,07]
2024-12-09 09:04:31,333 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74285, range: 0-360594, partition values: [2024-11-21,08]
2024-12-09 09:04:31,487 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1477 records.
2024-12-09 09:04:31,489 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,561 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1514 records.
2024-12-09 09:04:31,564 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,594 INFO hadoop.InternalParquetRecordReader: block read in memory in 105 ms. row count = 1477
2024-12-09 09:04:31,627 INFO hadoop.InternalParquetRecordReader: block read in memory in 63 ms. row count = 1514
2024-12-09 09:04:31,641 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1314 records.
2024-12-09 09:04:31,646 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,718 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74273, range: 0-399019, partition values: [2024-11-21,08]
2024-12-09 09:04:31,751 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74379, range: 0-404442, partition values: [2024-11-21,08]
2024-12-09 09:04:31,822 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1402 records.
2024-12-09 09:04:31,825 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,852 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1396 records.
2024-12-09 09:04:31,855 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:31,937 INFO hadoop.InternalParquetRecordReader: block read in memory in 291 ms. row count = 1314
2024-12-09 09:04:32,054 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74252, range: 0-360394, partition values: [2024-11-21,08]
2024-12-09 09:04:32,175 INFO hadoop.InternalParquetRecordReader: block read in memory in 320 ms. row count = 1396
2024-12-09 09:04:32,281 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73929, range: 0-389580, partition values: [2024-11-21,07]
2024-12-09 09:04:32,325 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1344 records.
2024-12-09 09:04:32,328 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,359 INFO hadoop.InternalParquetRecordReader: block read in memory in 31 ms. row count = 1344
2024-12-09 09:04:32,462 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1522 records.
2024-12-09 09:04:32,462 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1471 records.
2024-12-09 09:04:32,464 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,464 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,493 INFO hadoop.InternalParquetRecordReader: block read in memory in 29 ms. row count = 1522
2024-12-09 09:04:32,507 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74163, range: 0-360330, partition values: [2024-11-21,07]
2024-12-09 09:04:32,510 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1460 records.
2024-12-09 09:04:32,512 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,513 INFO hadoop.InternalParquetRecordReader: block read in memory in 49 ms. row count = 1471
2024-12-09 09:04:32,531 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 1460
2024-12-09 09:04:32,560 INFO hadoop.InternalParquetRecordReader: block read in memory in 735 ms. row count = 1402
2024-12-09 09:04:32,594 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74138, range: 0-398979, partition values: [2024-11-21,07]
2024-12-09 09:04:32,612 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73952, range: 0-404406, partition values: [2024-11-21,07]
2024-12-09 09:04:32,644 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73939, range: 0-389445, partition values: [2024-11-21,07]
2024-12-09 09:04:32,649 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73988, range: 0-377262, partition values: [2024-11-21,07]
2024-12-09 09:04:32,662 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1298 records.
2024-12-09 09:04:32,666 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,688 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1298
2024-12-09 09:04:32,788 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74204, range: 0-360317, partition values: [2024-11-21,08]
2024-12-09 09:04:32,804 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1531 records.
2024-12-09 09:04:32,805 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,825 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1531
2024-12-09 09:04:32,897 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1321 records.
2024-12-09 09:04:32,899 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:32,912 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 1321
2024-12-09 09:04:32,919 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74007, range: 0-404217, partition values: [2024-11-21,07]
2024-12-09 09:04:32,995 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74160, range: 0-359669, partition values: [2024-11-21,07]
2024-12-09 09:04:33,150 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1478 records.
2024-12-09 09:04:33,153 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:33,174 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 1478
2024-12-09 09:04:33,278 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74201, range: 0-403748, partition values: [2024-11-21,08]
2024-12-09 09:04:33,481 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1606 records.
2024-12-09 09:04:33,484 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:33,506 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1606
2024-12-09 09:04:33,630 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74438, range: 0-403697, partition values: [2024-11-21,08]
2024-12-09 09:04:33,765 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1463 records.
2024-12-09 09:04:33,769 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:33,793 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 1463
2024-12-09 09:04:33,907 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73950, range: 0-403680, partition values: [2024-11-21,07]
2024-12-09 09:04:34,117 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1568 records.
2024-12-09 09:04:34,118 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,129 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1535 records.
2024-12-09 09:04:34,132 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,147 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 1535
2024-12-09 09:04:34,169 INFO hadoop.InternalParquetRecordReader: block read in memory in 50 ms. row count = 1568
2024-12-09 09:04:34,314 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74431, range: 0-403636, partition values: [2024-11-21,08]
2024-12-09 09:04:34,318 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74089, range: 0-398891, partition values: [2024-11-21,07]
2024-12-09 09:04:34,400 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1484 records.
2024-12-09 09:04:34,401 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,403 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1431 records.
2024-12-09 09:04:34,405 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,581 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1497 records.
2024-12-09 09:04:34,583 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,660 INFO hadoop.InternalParquetRecordReader: block read in memory in 77 ms. row count = 1497
2024-12-09 09:04:34,748 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74312, range: 0-403516, partition values: [2024-11-21,08]
2024-12-09 09:04:34,900 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1604 records.
2024-12-09 09:04:34,902 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:34,915 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 1604
2024-12-09 09:04:35,007 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74184, range: 0-403295, partition values: [2024-11-21,08]
2024-12-09 09:04:35,017 INFO hadoop.InternalParquetRecordReader: block read in memory in 615 ms. row count = 1484
2024-12-09 09:04:35,114 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74396, range: 0-389324, partition values: [2024-11-21,08]
2024-12-09 09:04:35,123 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1541 records.
2024-12-09 09:04:35,124 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,157 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 1541
2024-12-09 09:04:35,162 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1469 records.
2024-12-09 09:04:35,164 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,222 INFO hadoop.InternalParquetRecordReader: block read in memory in 817 ms. row count = 1431
2024-12-09 09:04:35,253 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 15871522
2024-12-09 09:04:35,265 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1331 records.
2024-12-09 09:04:35,267 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,283 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 1331
2024-12-09 09:04:35,304 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74148, range: 0-377108, partition values: [2024-11-21,07]
2024-12-09 09:04:35,360 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74162, range: 0-359369, partition values: [2024-11-21,07]
2024-12-09 09:04:35,434 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1429 records.
2024-12-09 09:04:35,436 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,460 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 1429
2024-12-09 09:04:35,542 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74253, range: 0-376895, partition values: [2024-11-21,08]
2024-12-09 09:04:35,594 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1354 records.
2024-12-09 09:04:35,595 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,621 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 1354
2024-12-09 09:04:35,740 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73963, range: 0-359199, partition values: [2024-11-21,07]
2024-12-09 09:04:35,761 INFO hadoop.InternalParquetRecordReader: block read in memory in 597 ms. row count = 1469
2024-12-09 09:04:35,835 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1438 records.
2024-12-09 09:04:35,837 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,855 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74289, range: 0-398491, partition values: [2024-11-21,08]
2024-12-09 09:04:35,947 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1276 records.
2024-12-09 09:04:35,949 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:35,968 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 1276
2024-12-09 09:04:36,042 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73969, range: 0-358827, partition values: [2024-11-21,07]
2024-12-09 09:04:36,183 INFO hadoop.InternalParquetRecordReader: block read in memory in 346 ms. row count = 1438
2024-12-09 09:04:36,256 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1506 records.
2024-12-09 09:04:36,258 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:36,266 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73845, range: 0-389165, partition values: [2024-11-21,07]
2024-12-09 09:04:36,315 INFO hadoop.InternalParquetRecordReader: block read in memory in 57 ms. row count = 1506
2024-12-09 09:04:36,401 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74218, range: 0-398332, partition values: [2024-11-21,08]
2024-12-09 09:04:36,433 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1346 records.
2024-12-09 09:04:36,434 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:36,458 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1317 records.
2024-12-09 09:04:36,460 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:36,462 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854001903881054662989784_0000_m_000411_411' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854001903881054662989784_0000_m_000411
2024-12-09 09:04:36,462 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854001903881054662989784_0000_m_000411_411: Committed
2024-12-09 09:04:36,464 INFO executor.Executor: Finished task 411.0 in stage 0.0 (TID 411). 1909 bytes result sent to driver
2024-12-09 09:04:36,483 INFO hadoop.InternalParquetRecordReader: block read in memory in 49 ms. row count = 1346
2024-12-09 09:04:36,489 INFO hadoop.InternalParquetRecordReader: block read in memory in 29 ms. row count = 1317
2024-12-09 09:04:36,554 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74293, range: 0-376656, partition values: [2024-11-21,08]
2024-12-09 09:04:36,605 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73917, range: 0-389151, partition values: [2024-11-21,07]
2024-12-09 09:04:37,122 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1479 records.
2024-12-09 09:04:37,123 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,172 INFO hadoop.InternalParquetRecordReader: block read in memory in 49 ms. row count = 1479
2024-12-09 09:04:37,241 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1411 records.
2024-12-09 09:04:37,243 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,255 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74093, range: 0-398297, partition values: [2024-11-21,07]
2024-12-09 09:04:37,266 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1372 records.
2024-12-09 09:04:37,267 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,341 INFO hadoop.InternalParquetRecordReader: block read in memory in 74 ms. row count = 1372
2024-12-09 09:04:37,421 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74133, range: 0-376483, partition values: [2024-11-21,07]
2024-12-09 09:04:37,488 INFO hadoop.InternalParquetRecordReader: block read in memory in 245 ms. row count = 1411
2024-12-09 09:04:37,539 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1300 records.
2024-12-09 09:04:37,541 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,568 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=15/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-77061, range: 0-388827, partition values: [2024-11-21,15]
2024-12-09 09:04:37,748 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1380 records.
2024-12-09 09:04:37,750 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,775 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1380
2024-12-09 09:04:37,790 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1494 records.
2024-12-09 09:04:37,792 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:37,851 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74132, range: 0-376288, partition values: [2024-11-21,07]
2024-12-09 09:04:37,874 INFO hadoop.InternalParquetRecordReader: block read in memory in 82 ms. row count = 1494
2024-12-09 09:04:38,004 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73978, range: 0-398218, partition values: [2024-11-21,07]
2024-12-09 09:04:38,123 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1431 records.
2024-12-09 09:04:38,127 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:38,152 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1431
2024-12-09 09:04:38,218 INFO hadoop.InternalParquetRecordReader: block read in memory in 677 ms. row count = 1300
2024-12-09 09:04:38,238 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74118, range: 0-388816, partition values: [2024-11-21,07]
2024-12-09 09:04:38,326 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 14052405
2024-12-09 09:04:38,430 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1551 records.
2024-12-09 09:04:38,432 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:38,454 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1551
2024-12-09 09:04:38,541 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74302, range: 0-388228, partition values: [2024-11-21,08]
2024-12-09 09:04:38,871 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1411 records.
2024-12-09 09:04:38,873 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:38,924 INFO hadoop.InternalParquetRecordReader: block read in memory in 51 ms. row count = 1411
2024-12-09 09:04:39,004 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854003314931490831769376_0000_m_000419_419' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854003314931490831769376_0000_m_000419
2024-12-09 09:04:39,004 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854003314931490831769376_0000_m_000419_419: Committed
2024-12-09 09:04:39,006 INFO executor.Executor: Finished task 419.0 in stage 0.0 (TID 419). 1909 bytes result sent to driver
2024-12-09 09:04:39,008 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74249, range: 0-388140, partition values: [2024-11-21,08]
2024-12-09 09:04:39,082 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1460 records.
2024-12-09 09:04:39,084 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:39,246 INFO hadoop.InternalParquetRecordReader: block read in memory in 161 ms. row count = 1460
2024-12-09 09:04:39,278 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1522 records.
2024-12-09 09:04:39,280 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:39,314 INFO hadoop.InternalParquetRecordReader: block read in memory in 34 ms. row count = 1522
2024-12-09 09:04:39,337 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74237, range: 0-376227, partition values: [2024-11-21,08]
2024-12-09 09:04:39,402 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 15834930
2024-12-09 09:04:39,806 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1390 records.
2024-12-09 09:04:39,808 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:39,968 INFO hadoop.InternalParquetRecordReader: block read in memory in 160 ms. row count = 1390
2024-12-09 09:04:40,055 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 14769831
2024-12-09 09:04:40,629 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854005058490748882591327_0000_m_000412_412' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854005058490748882591327_0000_m_000412
2024-12-09 09:04:40,629 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854005058490748882591327_0000_m_000412_412: Committed
2024-12-09 09:04:40,635 INFO executor.Executor: Finished task 412.0 in stage 0.0 (TID 412). 1952 bytes result sent to driver
2024-12-09 09:04:41,172 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1455 records.
2024-12-09 09:04:41,174 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:41,266 INFO hadoop.InternalParquetRecordReader: block read in memory in 92 ms. row count = 1455
2024-12-09 09:04:41,347 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74215, range: 0-387915, partition values: [2024-11-21,08]
2024-12-09 09:04:41,379 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854005654721855441589274_0000_m_000416_416' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854005654721855441589274_0000_m_000416
2024-12-09 09:04:41,379 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854005654721855441589274_0000_m_000416_416: Committed
2024-12-09 09:04:41,380 INFO executor.Executor: Finished task 416.0 in stage 0.0 (TID 416). 1909 bytes result sent to driver
2024-12-09 09:04:42,805 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1461 records.
2024-12-09 09:04:42,807 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:43,270 INFO hadoop.InternalParquetRecordReader: block read in memory in 463 ms. row count = 1461
2024-12-09 09:04:43,357 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=07/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-73983, range: 0-387860, partition values: [2024-11-21,07]
2024-12-09 09:04:43,581 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1453 records.
2024-12-09 09:04:43,583 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:43,603 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 1453
2024-12-09 09:04:43,700 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74240, range: 0-387829, partition values: [2024-11-21,08]
2024-12-09 09:04:44,489 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1498 records.
2024-12-09 09:04:44,491 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:44,608 INFO hadoop.InternalParquetRecordReader: block read in memory in 117 ms. row count = 1498
2024-12-09 09:04:44,699 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=10/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74894, range: 0-387761, partition values: [2024-11-21,10]
2024-12-09 09:04:44,941 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1515 records.
2024-12-09 09:04:44,943 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:44,978 INFO hadoop.InternalParquetRecordReader: block read in memory in 35 ms. row count = 1515
2024-12-09 09:04:45,087 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play/dt=2024-11-21/hr=08/part-b83a9391-095a-4417-be8a-f07f74d1a990-0-74181, range: 0-387640, partition values: [2024-11-21,08]
2024-12-09 09:04:46,797 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1383 records.
2024-12-09 09:04:46,800 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-09 09:04:47,292 INFO hadoop.InternalParquetRecordReader: block read in memory in 492 ms. row count = 1383
2024-12-09 09:04:47,387 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 15405459
2024-12-09 09:04:49,055 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412090854001836530946668702718_0000_m_000414_414' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play/app_play_2024-11-21/.hive-staging_hive_2024-12-09_08-53-58_649_1236918605474118385-1/-ext-10000/_temporary/0/task_202412090854001836530946668702718_0000_m_000414
2024-12-09 09:04:49,055 INFO mapred.SparkHadoopMapRedUtil: attempt_202412090854001836530946668702718_0000_m_000414_414: Committed
2024-12-09 09:04:49,056 INFO executor.Executor: Finished task 414.0 in stage 0.0 (TID 414). 1909 bytes result sent to driver
2024-12-09 09:13:13,390 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
. 1909 bytes result sent to driver