FO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=22/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-98066, range: 0-5134, partition values: [2024-10-27,22]
2024-11-02 23:28:03,551 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:03,552 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:03,573 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 4
2024-11-02 23:28:03,573 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94511, range: 0-4913, partition values: [2024-10-27,12]
2024-11-02 23:28:03,702 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:03,704 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:03,707 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 5
2024-11-02 23:28:03,708 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=17/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-96181, range: 0-5089, partition values: [2024-10-27,17]
2024-11-02 23:28:03,888 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:03,889 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:03,891 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 5
2024-11-02 23:28:03,891 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92660, range: 0-5088, partition values: [2024-10-27,05]
2024-11-02 23:28:04,939 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:04,941 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:04,960 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:04,962 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:04,994 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 4
2024-11-02 23:28:04,995 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 28463
2024-11-02 23:28:05,020 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:05,021 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,033 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 3
2024-11-02 23:28:05,034 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95538, range: 0-4913, partition values: [2024-10-27,15]
2024-11-02 23:28:05,054 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:05,057 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,247 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:05,248 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,335 INFO hadoop.InternalParquetRecordReader: block read in memory in 373 ms. row count = 4
2024-11-02 23:28:05,336 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92139, range: 0-5165, partition values: [2024-10-27,03]
2024-11-02 23:28:05,358 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:05,359 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,386 INFO hadoop.InternalParquetRecordReader: block read in memory in 329 ms. row count = 3
2024-11-02 23:28:05,386 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=07/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93207, range: 0-5058, partition values: [2024-10-27,07]
2024-11-02 23:28:05,415 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:05,417 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,418 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 5
2024-11-02 23:28:05,419 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94031, range: 0-4911, partition values: [2024-10-27,10]
2024-11-02 23:28:05,432 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:05,434 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,434 INFO hadoop.InternalParquetRecordReader: block read in memory in 74 ms. row count = 2
2024-11-02 23:28:05,434 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92805, range: 0-4710, partition values: [2024-10-27,05]
2024-11-02 23:28:05,449 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 6 records.
2024-11-02 23:28:05,451 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,498 INFO hadoop.InternalParquetRecordReader: block read in memory in 250 ms. row count = 2
2024-11-02 23:28:05,499 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94135, range: 0-5110, partition values: [2024-10-27,11]
2024-11-02 23:28:05,506 INFO hadoop.InternalParquetRecordReader: block read in memory in 72 ms. row count = 2
2024-11-02 23:28:05,506 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91875, range: 0-5156, partition values: [2024-10-27,02]
2024-11-02 23:28:05,540 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:05,542 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,545 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 4
2024-11-02 23:28:05,545 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 29810
2024-11-02 23:28:05,577 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:05,578 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,580 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 3
2024-11-02 23:28:05,580 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94225, range: 0-5058, partition values: [2024-10-27,11]
2024-11-02 23:28:05,586 INFO hadoop.InternalParquetRecordReader: block read in memory in 135 ms. row count = 6
2024-11-02 23:28:05,586 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=22/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-98307, range: 0-5134, partition values: [2024-10-27,22]
2024-11-02 23:28:05,687 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:05,689 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,691 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 5
2024-11-02 23:28:05,691 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92243, range: 0-5156, partition values: [2024-10-27,03]
2024-11-02 23:28:05,704 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:05,706 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,707 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 4
2024-11-02 23:28:05,708 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94337, range: 0-5110, partition values: [2024-10-27,11]
2024-11-02 23:28:05,800 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 6 records.
2024-11-02 23:28:05,802 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,804 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 6
2024-11-02 23:28:05,805 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 29571
2024-11-02 23:28:05,820 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:05,821 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:05,823 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 4
2024-11-02 23:28:05,823 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92719, range: 0-5156, partition values: [2024-10-27,05]
2024-11-02 23:28:05,909 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325198551401663022881462_0000_m_000198_198' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325198551401663022881462_0000_m_000198
2024-11-02 23:28:05,909 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325198551401663022881462_0000_m_000198_198: Committed
2024-11-02 23:28:05,911 INFO executor.Executor: Finished task 198.0 in stage 0.0 (TID 198). 1907 bytes result sent to driver
2024-11-02 23:28:05,952 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 240
2024-11-02 23:28:05,952 INFO executor.Executor: Running task 240.0 in stage 0.0 (TID 240)
2024-11-02 23:28:06,000 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
2024-11-02 23:28:06,000 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2024-11-02 23:28:06,000 INFO datasources.SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2024-11-02 23:28:06,000 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92638, range: 0-4464, partition values: [2024-10-27,04]
2024-11-02 23:28:06,034 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:06,035 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,045 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-11-02 23:28:06,045 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94441, range: 0-5156, partition values: [2024-10-27,12]
2024-11-02 23:28:06,170 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:06,172 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,174 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 4
2024-11-02 23:28:06,174 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92311, range: 0-5155, partition values: [2024-10-27,03]
2024-11-02 23:28:06,225 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325196308768429936844578_0000_m_000191_191' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325196308768429936844578_0000_m_000191
2024-11-02 23:28:06,225 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325196308768429936844578_0000_m_000191_191: Committed
2024-11-02 23:28:06,227 INFO executor.Executor: Finished task 191.0 in stage 0.0 (TID 191). 1907 bytes result sent to driver
2024-11-02 23:28:06,266 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 241
2024-11-02 23:28:06,267 INFO executor.Executor: Running task 241.0 in stage 0.0 (TID 241)
2024-11-02 23:28:06,294 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
2024-11-02 23:28:06,294 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2024-11-02 23:28:06,294 INFO datasources.SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2024-11-02 23:28:06,294 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=08/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93513, range: 0-4430, partition values: [2024-10-27,08]
2024-11-02 23:28:06,403 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:06,406 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,408 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 4
2024-11-02 23:28:06,409 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 29958
2024-11-02 23:28:06,500 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325191115166084950001290_0000_m_000194_194' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325191115166084950001290_0000_m_000194
2024-11-02 23:28:06,500 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325191115166084950001290_0000_m_000194_194: Committed
2024-11-02 23:28:06,502 INFO executor.Executor: Finished task 194.0 in stage 0.0 (TID 194). 1907 bytes result sent to driver
2024-11-02 23:28:06,520 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:06,522 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,542 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 242
2024-11-02 23:28:06,542 INFO executor.Executor: Running task 242.0 in stage 0.0 (TID 242)
2024-11-02 23:28:06,573 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
2024-11-02 23:28:06,573 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2024-11-02 23:28:06,573 INFO datasources.SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2024-11-02 23:28:06,573 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=23/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-98382, range: 0-4403, partition values: [2024-10-27,23]
2024-11-02 23:28:06,597 INFO hadoop.InternalParquetRecordReader: block read in memory in 75 ms. row count = 3
2024-11-02 23:28:06,597 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93920, range: 0-4710, partition values: [2024-10-27,10]
2024-11-02 23:28:06,696 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:06,698 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,734 INFO hadoop.InternalParquetRecordReader: block read in memory in 36 ms. row count = 3
2024-11-02 23:28:06,735 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95637, range: 0-4911, partition values: [2024-10-27,15]
2024-11-02 23:28:06,861 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:06,863 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,882 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:06,884 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,886 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 3
2024-11-02 23:28:06,886 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=01/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91444, range: 0-4709, partition values: [2024-10-27,01]
2024-11-02 23:28:06,903 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 2
2024-11-02 23:28:06,904 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@2018311a
2024-11-02 23:28:06,905 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2024-11-02 23:28:06,905 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/_temporary/attempt_202411022325195614165963318480805_0000_m_000242_242/part-00242-1f68510b-2c0d-455c-afe1-676bac428d41-c000
2024-11-02 23:28:06,905 INFO codec.CodecConfig: Compression: SNAPPY
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Dictionary is on
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Validation is off
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2024-11-02 23:28:06,905 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2024-11-02 23:28:06,924 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:06,926 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:06,932 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 4
2024-11-02 23:28:06,933 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91933, range: 0-4910, partition values: [2024-10-27,02]
2024-11-02 23:28:06,994 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@5b7be09a
2024-11-02 23:28:06,996 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92330, range: 0-4401, partition values: [2024-10-27,03]
2024-11-02 23:28:07,096 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:07,098 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,100 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 3
2024-11-02 23:28:07,100 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92837, range: 0-4709, partition values: [2024-10-27,05]
2024-11-02 23:28:07,168 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:07,170 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,172 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 4
2024-11-02 23:28:07,173 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92142, range: 0-4908, partition values: [2024-10-27,03]
2024-11-02 23:28:07,200 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:07,202 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,216 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 5
2024-11-02 23:28:07,217 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 28368
2024-11-02 23:28:07,231 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:07,233 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,234 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:07,235 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=07/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93328, range: 0-4401, partition values: [2024-10-27,07]
2024-11-02 23:28:07,342 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325192219060191727522940_0000_m_000192_192' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325192219060191727522940_0000_m_000192
2024-11-02 23:28:07,342 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325192219060191727522940_0000_m_000192_192: Committed
2024-11-02 23:28:07,343 INFO executor.Executor: Finished task 192.0 in stage 0.0 (TID 192). 1907 bytes result sent to driver
2024-11-02 23:28:07,507 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:07,509 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,522 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 2
2024-11-02 23:28:07,522 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94366, range: 0-5058, partition values: [2024-10-27,11]
2024-11-02 23:28:07,545 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:07,548 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,554 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-11-02 23:28:07,556 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@33ffb52e
2024-11-02 23:28:07,556 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2024-11-02 23:28:07,556 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/_temporary/attempt_202411022325193233574858127214375_0000_m_000241_241/part-00241-1f68510b-2c0d-455c-afe1-676bac428d41-c000
2024-11-02 23:28:07,556 INFO codec.CodecConfig: Compression: SNAPPY
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Dictionary is on
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Validation is off
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2024-11-02 23:28:07,556 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2024-11-02 23:28:07,594 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@17c606d6
2024-11-02 23:28:07,595 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92329, range: 0-4428, partition values: [2024-10-27,03]
2024-11-02 23:28:07,731 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 5 records.
2024-11-02 23:28:07,732 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,734 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 5
2024-11-02 23:28:07,734 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=13/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94859, range: 0-5058, partition values: [2024-10-27,13]
2024-11-02 23:28:07,854 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:07,855 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:07,857 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:07,858 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93746, range: 0-4428, partition values: [2024-10-27,09]
2024-11-02 23:28:07,892 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325193842061387979942808_0000_m_000196_196' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325193842061387979942808_0000_m_000196
2024-11-02 23:28:07,892 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325193842061387979942808_0000_m_000196_196: Committed
2024-11-02 23:28:07,894 INFO executor.Executor: Finished task 196.0 in stage 0.0 (TID 196). 1907 bytes result sent to driver
2024-11-02 23:28:08,140 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:08,142 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,143 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:08,144 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92283, range: 0-4427, partition values: [2024-10-27,03]
2024-11-02 23:28:08,308 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:08,309 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,311 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:08,314 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,316 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:08,316 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94241, range: 0-4427, partition values: [2024-10-27,11]
2024-11-02 23:28:08,318 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-11-02 23:28:08,318 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=08/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93520, range: 0-4709, partition values: [2024-10-27,08]
2024-11-02 23:28:08,333 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:08,334 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,389 INFO hadoop.InternalParquetRecordReader: block read in memory in 55 ms. row count = 4
2024-11-02 23:28:08,390 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 24696
2024-11-02 23:28:08,430 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:08,432 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,433 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 3
2024-11-02 23:28:08,434 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94363, range: 0-4709, partition values: [2024-10-27,11]
2024-11-02 23:28:08,587 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:08,589 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,591 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 3
2024-11-02 23:28:08,591 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92339, range: 0-4708, partition values: [2024-10-27,03]
2024-11-02 23:28:08,594 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:08,596 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,609 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 2
2024-11-02 23:28:08,610 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@24733802
2024-11-02 23:28:08,610 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2024-11-02 23:28:08,610 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/_temporary/attempt_202411022325191054766001733730203_0000_m_000240_240/part-00240-1f68510b-2c0d-455c-afe1-676bac428d41-c000
2024-11-02 23:28:08,610 INFO codec.CodecConfig: Compression: SNAPPY
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Dictionary is on
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Validation is off
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2024-11-02 23:28:08,610 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2024-11-02 23:28:08,694 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@219ef957
2024-11-02 23:28:08,695 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94437, range: 0-4463, partition values: [2024-10-27,12]
2024-11-02 23:28:08,972 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:08,974 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:08,984 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 4
2024-11-02 23:28:08,985 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92712, range: 0-4908, partition values: [2024-10-27,05]
2024-11-02 23:28:09,184 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325195722854411235334998_0000_m_000201_201' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325195722854411235334998_0000_m_000201
2024-11-02 23:28:09,184 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325195722854411235334998_0000_m_000201_201: Committed
2024-11-02 23:28:09,186 INFO executor.Executor: Finished task 201.0 in stage 0.0 (TID 201). 1907 bytes result sent to driver
2024-11-02 23:28:09,436 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:09,437 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:09,595 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:09,597 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:09,612 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 2
2024-11-02 23:28:09,613 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92007, range: 0-4425, partition values: [2024-10-27,03]
2024-11-02 23:28:09,933 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:09,935 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:09,958 INFO hadoop.InternalParquetRecordReader: block read in memory in 521 ms. row count = 2
2024-11-02 23:28:09,958 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93596, range: 0-4401, partition values: [2024-10-27,09]
2024-11-02 23:28:10,014 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:10,016 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,025 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,026 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,027 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:10,028 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94552, range: 0-4425, partition values: [2024-10-27,12]
2024-11-02 23:28:10,067 INFO hadoop.InternalParquetRecordReader: block read in memory in 51 ms. row count = 3
2024-11-02 23:28:10,068 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93829, range: 0-4708, partition values: [2024-10-27,10]
2024-11-02 23:28:10,269 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,271 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,283 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 2
2024-11-02 23:28:10,284 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94621, range: 0-4908, partition values: [2024-10-27,12]
2024-11-02 23:28:10,368 INFO hadoop.InternalParquetRecordReader: block read in memory in 433 ms. row count = 2
2024-11-02 23:28:10,369 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94513, range: 0-4463, partition values: [2024-10-27,12]
2024-11-02 23:28:10,434 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,434 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,436 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,437 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,438 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:10,438 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93879, range: 0-4401, partition values: [2024-10-27,10]
2024-11-02 23:28:10,439 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:10,439 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95588, range: 0-4425, partition values: [2024-10-27,15]
2024-11-02 23:28:10,602 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,604 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,606 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:10,607 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=22/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-98319, range: 0-4908, partition values: [2024-10-27,22]
2024-11-02 23:28:10,638 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,640 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,642 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:10,643 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=13/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94972, range: 0-4401, partition values: [2024-10-27,13]
2024-11-02 23:28:10,809 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,811 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,814 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:10,814 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92034, range: 0-4907, partition values: [2024-10-27,03]
2024-11-02 23:28:10,849 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:10,850 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:10,853 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:10,853 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93870, range: 0-4399, partition values: [2024-10-27,10]
2024-11-02 23:28:11,234 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:11,237 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:11,268 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:11,270 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:11,398 INFO hadoop.InternalParquetRecordReader: block read in memory in 161 ms. row count = 3
2024-11-02 23:28:11,399 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92278, range: 0-4707, partition values: [2024-10-27,03]
2024-11-02 23:28:11,457 INFO hadoop.InternalParquetRecordReader: block read in memory in 187 ms. row count = 2
2024-11-02 23:28:11,457 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92381, range: 0-4424, partition values: [2024-10-27,04]
2024-11-02 23:28:11,610 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:11,612 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:11,613 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:11,613 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91846, range: 0-4422, partition values: [2024-10-27,02]
2024-11-02 23:28:12,053 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:12,055 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:12,315 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:12,316 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:12,323 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 3
2024-11-02 23:28:12,324 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93830, range: 0-4907, partition values: [2024-10-27,10]
2024-11-02 23:28:12,824 INFO hadoop.InternalParquetRecordReader: block read in memory in 769 ms. row count = 2
2024-11-02 23:28:12,825 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94269, range: 0-4461, partition values: [2024-10-27,11]
2024-11-02 23:28:13,121 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,123 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,262 INFO hadoop.InternalParquetRecordReader: block read in memory in 139 ms. row count = 2
2024-11-02 23:28:13,263 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=14/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95234, range: 0-4461, partition values: [2024-10-27,14]
2024-11-02 23:28:13,315 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:13,317 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,330 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 3
2024-11-02 23:28:13,330 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92500, range: 0-4707, partition values: [2024-10-27,04]
2024-11-02 23:28:13,443 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,445 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,447 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:13,447 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94518, range: 0-4460, partition values: [2024-10-27,12]
2024-11-02 23:28:13,579 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,581 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,609 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,610 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,612 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:13,612 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92563, range: 0-4458, partition values: [2024-10-27,04]
2024-11-02 23:28:13,615 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,616 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,671 INFO hadoop.InternalParquetRecordReader: block read in memory in 90 ms. row count = 2
2024-11-02 23:28:13,671 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93719, range: 0-4422, partition values: [2024-10-27,09]
2024-11-02 23:28:13,685 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,686 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,794 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,796 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,798 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:13,798 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93750, range: 0-4422, partition values: [2024-10-27,09]
2024-11-02 23:28:13,837 INFO hadoop.InternalParquetRecordReader: block read in memory in 151 ms. row count = 2
2024-11-02 23:28:13,838 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95759, range: 0-4706, partition values: [2024-10-27,15]
2024-11-02 23:28:13,948 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:13,950 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,952 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:13,952 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=20/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-97323, range: 0-4422, partition values: [2024-10-27,20]
2024-11-02 23:28:13,982 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:13,984 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:13,986 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 3
2024-11-02 23:28:13,987 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93625, range: 0-4704, partition values: [2024-10-27,09]
2024-11-02 23:28:14,070 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:14,073 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:14,080 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-11-02 23:28:14,080 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94104, range: 0-4421, partition values: [2024-10-27,11]
2024-11-02 23:28:14,177 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:14,179 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:14,180 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 4
2024-11-02 23:28:14,180 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93800, range: 0-4704, partition values: [2024-10-27,10]
2024-11-02 23:28:14,331 INFO hadoop.InternalParquetRecordReader: block read in memory in 715 ms. row count = 2
2024-11-02 23:28:14,332 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91987, range: 0-4398, partition values: [2024-10-27,02]
2024-11-02 23:28:14,746 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:14,749 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:14,754 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-11-02 23:28:14,754 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93743, range: 0-4398, partition values: [2024-10-27,09]
2024-11-02 23:28:14,933 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:14,935 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:14,938 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:14,938 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93922, range: 0-4398, partition values: [2024-10-27,10]
2024-11-02 23:28:15,116 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:15,118 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:15,120 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:15,120 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94243, range: 0-4398, partition values: [2024-10-27,11]
2024-11-02 23:28:15,178 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:15,180 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:15,192 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 3
2024-11-02 23:28:15,192 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95682, range: 0-4703, partition values: [2024-10-27,15]
2024-11-02 23:28:15,445 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:15,448 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:15,468 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:15,470 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:15,473 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 3
2024-11-02 23:28:15,473 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92368, range: 0-4702, partition values: [2024-10-27,04]
2024-11-02 23:28:15,577 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:15,579 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:16,251 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:16,254 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:16,598 INFO hadoop.InternalParquetRecordReader: block read in memory in 1150 ms. row count = 3
2024-11-02 23:28:16,599 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=07/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93333, range: 0-4906, partition values: [2024-10-27,07]
2024-11-02 23:28:16,629 INFO hadoop.InternalParquetRecordReader: block read in memory in 1050 ms. row count = 2
2024-11-02 23:28:16,629 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93951, range: 0-4457, partition values: [2024-10-27,10]
2024-11-02 23:28:16,775 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:16,777 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:16,779 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 3
2024-11-02 23:28:16,780 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92065, range: 0-4905, partition values: [2024-10-27,03]
2024-11-02 23:28:16,943 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:16,946 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:16,947 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 3
2024-11-02 23:28:16,948 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=07/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93356, range: 0-4905, partition values: [2024-10-27,07]
2024-11-02 23:28:17,305 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:17,307 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:17,312 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-11-02 23:28:17,312 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=13/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94772, range: 0-4702, partition values: [2024-10-27,13]
2024-11-02 23:28:17,614 INFO hadoop.InternalParquetRecordReader: block read in memory in 1360 ms. row count = 2
2024-11-02 23:28:17,614 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92822, range: 0-4420, partition values: [2024-10-27,05]
2024-11-02 23:28:17,717 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:17,719 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:17,755 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:17,757 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:17,759 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:17,760 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=21/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-97713, range: 0-4420, partition values: [2024-10-27,21]
2024-11-02 23:28:17,767 INFO hadoop.InternalParquetRecordReader: block read in memory in 48 ms. row count = 3
2024-11-02 23:28:17,767 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 21036
2024-11-02 23:28:17,949 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:17,951 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:17,953 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:17,954 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93741, range: 0-4419, partition values: [2024-10-27,09]
2024-11-02 23:28:18,104 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:18,106 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:18,114 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:18,116 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:18,118 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:18,118 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92397, range: 0-4418, partition values: [2024-10-27,04]
2024-11-02 23:28:18,622 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:18,624 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:18,683 INFO hadoop.InternalParquetRecordReader: block read in memory in 59 ms. row count = 2
2024-11-02 23:28:18,684 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93861, range: 0-4417, partition values: [2024-10-27,10]
2024-11-02 23:28:18,685 INFO hadoop.InternalParquetRecordReader: block read in memory in 579 ms. row count = 2
2024-11-02 23:28:18,685 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94387, range: 0-4455, partition values: [2024-10-27,12]
2024-11-02 23:28:18,834 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325198454004788330916734_0000_m_000232_232' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325198454004788330916734_0000_m_000232
2024-11-02 23:28:18,834 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325198454004788330916734_0000_m_000232_232: Committed
2024-11-02 23:28:18,836 INFO executor.Executor: Finished task 232.0 in stage 0.0 (TID 232). 1907 bytes result sent to driver
2024-11-02 23:28:18,855 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:18,858 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:18,861 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 3
2024-11-02 23:28:18,861 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=21/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-97611, range: 0-4416, partition values: [2024-10-27,21]
2024-11-02 23:28:18,964 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:18,967 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:18,969 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:18,969 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=21/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-97720, range: 0-4415, partition values: [2024-10-27,21]
2024-11-02 23:28:19,159 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:19,161 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:19,163 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:19,163 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93840, range: 0-4413, partition values: [2024-10-27,10]
2024-11-02 23:28:19,192 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-11-02 23:28:19,194 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:19,732 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:19,734 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:20,092 INFO hadoop.InternalParquetRecordReader: block read in memory in 898 ms. row count = 3
2024-11-02 23:28:20,092 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93981, range: 0-4905, partition values: [2024-10-27,10]
2024-11-02 23:28:20,396 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:20,398 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:20,400 INFO hadoop.InternalParquetRecordReader: block read in memory in 666 ms. row count = 2
2024-11-02 23:28:20,401 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93796, range: 0-4395, partition values: [2024-10-27,10]
2024-11-02 23:28:20,885 INFO hadoop.InternalParquetRecordReader: block read in memory in 487 ms. row count = 2
2024-11-02 23:28:20,885 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=01/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91483, range: 0-4452, partition values: [2024-10-27,01]
2024-11-02 23:28:21,296 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:21,298 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:21,300 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:21,301 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94256, range: 0-4395, partition values: [2024-10-27,11]
2024-11-02 23:28:21,302 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:21,305 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:21,307 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 4
2024-11-02 23:28:21,307 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=13/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94824, range: 0-4905, partition values: [2024-10-27,13]
2024-11-02 23:28:21,452 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:21,454 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:21,456 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:21,456 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92374, range: 0-4394, partition values: [2024-10-27,04]
2024-11-02 23:28:21,658 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:21,660 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:21,662 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:21,662 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=08/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93386, range: 0-4394, partition values: [2024-10-27,08]
2024-11-02 23:28:21,785 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:21,788 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:21,789 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:21,790 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94704, range: 0-4392, partition values: [2024-10-27,12]
2024-11-02 23:28:22,254 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-11-02 23:28:22,256 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:22,260 INFO hadoop.InternalParquetRecordReader: block read in memory in 4 ms. row count = 4
2024-11-02 23:28:22,261 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 25657
2024-11-02 23:28:22,928 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:22,931 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:23,017 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325192344466603373695338_0000_m_000215_215' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325192344466603373695338_0000_m_000215
2024-11-02 23:28:23,017 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325192344466603373695338_0000_m_000215_215: Committed
2024-11-02 23:28:23,019 INFO executor.Executor: Finished task 215.0 in stage 0.0 (TID 215). 1907 bytes result sent to driver
2024-11-02 23:28:23,251 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:23,252 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:23,324 INFO hadoop.InternalParquetRecordReader: block read in memory in 393 ms. row count = 2
2024-11-02 23:28:23,325 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94275, range: 0-4413, partition values: [2024-10-27,11]
2024-11-02 23:28:23,505 INFO hadoop.InternalParquetRecordReader: block read in memory in 253 ms. row count = 2
2024-11-02 23:28:23,505 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92813, range: 0-4452, partition values: [2024-10-27,05]
2024-11-02 23:28:23,906 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:23,908 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,305 INFO hadoop.InternalParquetRecordReader: block read in memory in 397 ms. row count = 2
2024-11-02 23:28:24,306 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92448, range: 0-4391, partition values: [2024-10-27,04]
2024-11-02 23:28:24,413 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,415 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,463 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,464 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,475 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,477 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,481 INFO hadoop.InternalParquetRecordReader: block read in memory in 4 ms. row count = 2
2024-11-02 23:28:24,481 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92375, range: 0-4389, partition values: [2024-10-27,04]
2024-11-02 23:28:24,529 INFO hadoop.InternalParquetRecordReader: block read in memory in 114 ms. row count = 2
2024-11-02 23:28:24,529 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93798, range: 0-4410, partition values: [2024-10-27,10]
2024-11-02 23:28:24,637 INFO hadoop.InternalParquetRecordReader: block read in memory in 173 ms. row count = 2
2024-11-02 23:28:24,638 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94300, range: 0-4449, partition values: [2024-10-27,11]
2024-11-02 23:28:24,686 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,688 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,690 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:24,690 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92566, range: 0-4389, partition values: [2024-10-27,04]
2024-11-02 23:28:24,782 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,784 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,789 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-11-02 23:28:24,790 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94044, range: 0-4410, partition values: [2024-10-27,10]
2024-11-02 23:28:24,836 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,837 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,839 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:24,839 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93909, range: 0-4386, partition values: [2024-10-27,10]
2024-11-02 23:28:24,927 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,928 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,932 INFO hadoop.InternalParquetRecordReader: block read in memory in 4 ms. row count = 2
2024-11-02 23:28:24,932 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92619, range: 0-4407, partition values: [2024-10-27,04]
2024-11-02 23:28:24,984 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:24,986 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:24,987 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:24,988 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92458, range: 0-4385, partition values: [2024-10-27,04]
2024-11-02 23:28:25,111 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,117 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,125 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,126 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,128 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:25,128 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92760, range: 0-4383, partition values: [2024-10-27,05]
2024-11-02 23:28:25,187 INFO hadoop.InternalParquetRecordReader: block read in memory in 70 ms. row count = 2
2024-11-02 23:28:25,188 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94661, range: 0-4448, partition values: [2024-10-27,12]
2024-11-02 23:28:25,280 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,282 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,283 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:25,284 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=20/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-97399, range: 0-4383, partition values: [2024-10-27,20]
2024-11-02 23:28:25,311 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,313 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,385 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,387 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,388 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:25,388 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92815, range: 0-4446, partition values: [2024-10-27,05]
2024-11-02 23:28:25,408 INFO hadoop.InternalParquetRecordReader: block read in memory in 95 ms. row count = 2
2024-11-02 23:28:25,409 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=17/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-96332, range: 0-4407, partition values: [2024-10-27,17]
2024-11-02 23:28:25,771 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:25,774 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:25,776 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:25,777 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=07/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93156, range: 0-4382, partition values: [2024-10-27,07]
2024-11-02 23:28:26,397 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:26,399 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:26,400 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:26,401 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92355, range: 0-4406, partition values: [2024-10-27,03]
2024-11-02 23:28:26,412 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:26,414 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:26,416 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:26,416 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93890, range: 0-4445, partition values: [2024-10-27,10]
2024-11-02 23:28:26,627 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:26,629 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:26,641 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 2
2024-11-02 23:28:26,641 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=06/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92946, range: 0-4381, partition values: [2024-10-27,06]
2024-11-02 23:28:26,726 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:26,728 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:26,730 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:26,730 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=09/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93736, range: 0-4404, partition values: [2024-10-27,09]
2024-11-02 23:28:26,859 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:26,861 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:26,864 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:26,864 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=10/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-93822, range: 0-4404, partition values: [2024-10-27,10]
2024-11-02 23:28:28,136 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:28,137 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:29,036 INFO hadoop.InternalParquetRecordReader: block read in memory in 899 ms. row count = 2
2024-11-02 23:28:29,037 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=13/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94785, range: 0-4404, partition values: [2024-10-27,13]
2024-11-02 23:28:29,048 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:29,050 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:29,119 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:29,120 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:29,244 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:29,245 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:29,248 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:29,248 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=15/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95809, range: 0-4404, partition values: [2024-10-27,15]
2024-11-02 23:28:30,021 INFO hadoop.InternalParquetRecordReader: block read in memory in 971 ms. row count = 2
2024-11-02 23:28:30,021 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92214, range: 0-4443, partition values: [2024-10-27,03]
2024-11-02 23:28:30,075 INFO hadoop.InternalParquetRecordReader: block read in memory in 955 ms. row count = 2
2024-11-02 23:28:30,075 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92714, range: 0-4380, partition values: [2024-10-27,05]
2024-11-02 23:28:30,275 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:30,276 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:30,278 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:30,279 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92798, range: 0-4380, partition values: [2024-10-27,05]
2024-11-02 23:28:31,452 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:31,454 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:31,475 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 2
2024-11-02 23:28:31,476 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 16392
2024-11-02 23:28:31,554 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:31,555 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:31,568 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 2
2024-11-02 23:28:31,569 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92506, range: 0-4377, partition values: [2024-10-27,04]
2024-11-02 23:28:31,784 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:31,786 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:31,787 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:31,788 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94072, range: 0-4377, partition values: [2024-10-27,11]
2024-11-02 23:28:31,841 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325193233574858127214375_0000_m_000241_241' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325193233574858127214375_0000_m_000241
2024-11-02 23:28:31,842 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325193233574858127214375_0000_m_000241_241: Committed
2024-11-02 23:28:31,843 INFO executor.Executor: Finished task 241.0 in stage 0.0 (TID 241). 1864 bytes result sent to driver
2024-11-02 23:28:31,996 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:31,998 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,000 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:32,000 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92370, range: 0-4376, partition values: [2024-10-27,04]
2024-11-02 23:28:32,154 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:32,156 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,158 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:32,158 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92382, range: 0-4376, partition values: [2024-10-27,04]
2024-11-02 23:28:32,306 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:32,309 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,314 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-11-02 23:28:32,315 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=12/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94566, range: 0-4374, partition values: [2024-10-27,12]
2024-11-02 23:28:32,343 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:32,344 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,400 INFO hadoop.InternalParquetRecordReader: block read in memory in 56 ms. row count = 2
2024-11-02 23:28:32,400 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92357, range: 0-4443, partition values: [2024-10-27,03]
2024-11-02 23:28:32,409 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:32,411 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,412 INFO hadoop.InternalParquetRecordReader: block read in memory in 1 ms. row count = 2
2024-11-02 23:28:32,413 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 16113
2024-11-02 23:28:32,680 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:32,683 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:32,686 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:32,686 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=05/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92861, range: 0-4443, partition values: [2024-10-27,05]
2024-11-02 23:28:32,942 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325195614165963318480805_0000_m_000242_242' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325195614165963318480805_0000_m_000242
2024-11-02 23:28:32,942 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325195614165963318480805_0000_m_000242_242: Committed
2024-11-02 23:28:32,943 INFO executor.Executor: Finished task 242.0 in stage 0.0 (TID 242). 1864 bytes result sent to driver
2024-11-02 23:28:33,521 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:33,523 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:33,759 INFO hadoop.InternalParquetRecordReader: block read in memory in 236 ms. row count = 2
2024-11-02 23:28:33,759 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92341, range: 0-4442, partition values: [2024-10-27,03]
2024-11-02 23:28:33,868 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:33,871 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:33,873 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:33,873 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=18/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-96747, range: 0-4442, partition values: [2024-10-27,18]
2024-11-02 23:28:34,009 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:34,011 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:34,013 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:34,013 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92508, range: 0-4439, partition values: [2024-10-27,04]
2024-11-02 23:28:34,753 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:34,756 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:34,779 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 2
2024-11-02 23:28:34,779 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=16/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-96033, range: 0-4439, partition values: [2024-10-27,16]
2024-11-02 23:28:35,372 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:35,374 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:35,593 INFO hadoop.InternalParquetRecordReader: block read in memory in 219 ms. row count = 2
2024-11-02 23:28:35,593 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=01/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91328, range: 0-4437, partition values: [2024-10-27,01]
2024-11-02 23:28:35,776 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:35,778 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:35,780 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:35,780 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=11/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-94085, range: 0-4437, partition values: [2024-10-27,11]
2024-11-02 23:28:35,985 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:35,987 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:35,990 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:35,990 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92166, range: 0-4436, partition values: [2024-10-27,03]
2024-11-02 23:28:36,177 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:36,179 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:36,182 INFO hadoop.InternalParquetRecordReader: block read in memory in 3 ms. row count = 2
2024-11-02 23:28:36,183 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=18/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-96527, range: 0-4436, partition values: [2024-10-27,18]
2024-11-02 23:28:37,309 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:37,311 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:38,101 INFO hadoop.InternalParquetRecordReader: block read in memory in 790 ms. row count = 2
2024-11-02 23:28:38,101 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91842, range: 0-4434, partition values: [2024-10-27,02]
2024-11-02 23:28:38,233 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:38,235 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:38,237 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:38,238 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=02/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-91919, range: 0-4434, partition values: [2024-10-27,02]
2024-11-02 23:28:40,030 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:40,031 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:40,042 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-11-02 23:28:40,043 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=03/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92249, range: 0-4431, partition values: [2024-10-27,03]
2024-11-02 23:28:40,201 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:40,203 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:40,205 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:40,206 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=04/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92538, range: 0-4431, partition values: [2024-10-27,04]
2024-11-02 23:28:40,526 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:40,528 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:40,534 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-11-02 23:28:40,534 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=06/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-92919, range: 0-4431, partition values: [2024-10-27,06]
2024-11-02 23:28:41,233 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:41,236 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:41,292 INFO hadoop.InternalParquetRecordReader: block read in memory in 56 ms. row count = 2
2024-11-02 23:28:41,293 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_play_web/dt=2024-10-27/hr=16/part-e41aea02-a96b-4d80-b5be-92baf499eda5-0-95938, range: 0-4431, partition values: [2024-10-27,16]
2024-11-02 23:28:41,598 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-11-02 23:28:41,599 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-11-02 23:28:41,601 INFO hadoop.InternalParquetRecordReader: block read in memory in 2 ms. row count = 2
2024-11-02 23:28:41,601 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 16991
2024-11-02 23:28:42,533 INFO output.FileOutputCommitter: Saved output of task 'attempt_202411022325191054766001733730203_0000_m_000240_240' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_play_web/app_play_web_2024-10-27/.hive-staging_hive_2024-11-02_23-25-17_100_1017585159733135835-1/-ext-10000/_temporary/0/task_202411022325191054766001733730203_0000_m_000240
2024-11-02 23:28:42,533 INFO mapred.SparkHadoopMapRedUtil: attempt_202411022325191054766001733730203_0000_m_000240_240: Committed
2024-11-02 23:28:42,534 INFO executor.Executor: Finished task 240.0 in stage 0.0 (TID 240). 1864 bytes result sent to driver
2024-11-02 23:30:18,622 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown
2024-11-02 23:30:18,629 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown