Showing 102400 Bytes: 1185516 - 1287916 of 1287916
/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59808, range: 0-4821, partition values: [2024-11-28,06]
2024-12-10 04:17:20,379 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:20,380 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:20,389 INFO hadoop.InternalParquetRecordReader: block read in memory in 60 ms. row count = 2
2024-12-10 04:17:20,390 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=12/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61618, range: 0-4520, partition values: [2024-11-28,12]
2024-12-10 04:17:20,402 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 3
2024-12-10 04:17:20,402 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59746, range: 0-4905, partition values: [2024-11-28,05]
2024-12-10 04:17:20,665 INFO hadoop.InternalParquetRecordReader: block read in memory in 1285 ms. row count = 4
2024-12-10 04:17:20,666 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59831, range: 0-5105, partition values: [2024-11-28,06]
2024-12-10 04:17:20,879 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:20,882 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:20,933 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:20,934 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:20,935 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:20,935 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59885, range: 0-4518, partition values: [2024-11-28,06]
2024-12-10 04:17:20,945 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 3
2024-12-10 04:17:20,946 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60416, range: 0-4821, partition values: [2024-11-28,08]
2024-12-10 04:17:20,969 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:20,971 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:20,978 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-12-10 04:17:20,980 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:20,982 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-12-10 04:17:20,983 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60966, range: 0-4615, partition values: [2024-11-28,10]
2024-12-10 04:17:21,057 INFO hadoop.InternalParquetRecordReader: block read in memory in 77 ms. row count = 4
2024-12-10 04:17:21,058 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62293, range: 0-5105, partition values: [2024-11-28,13]
2024-12-10 04:17:21,066 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:21,067 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,095 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:21,097 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,182 INFO hadoop.InternalParquetRecordReader: block read in memory in 85 ms. row count = 3
2024-12-10 04:17:21,182 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59987, range: 0-4796, partition values: [2024-11-28,06]
2024-12-10 04:17:21,252 INFO hadoop.InternalParquetRecordReader: block read in memory in 185 ms. row count = 3
2024-12-10 04:17:21,252 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59790, range: 0-4905, partition values: [2024-11-28,06]
2024-12-10 04:17:21,353 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:21,354 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,396 INFO hadoop.InternalParquetRecordReader: block read in memory in 42 ms. row count = 2
2024-12-10 04:17:21,396 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61054, range: 0-4615, partition values: [2024-11-28,10]
2024-12-10 04:17:21,455 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:21,456 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,482 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:21,484 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,490 INFO hadoop.InternalParquetRecordReader: block read in memory in 34 ms. row count = 3
2024-12-10 04:17:21,491 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59638, range: 0-4793, partition values: [2024-11-28,05]
2024-12-10 04:17:21,504 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-12-10 04:17:21,506 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,516 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 4
2024-12-10 04:17:21,517 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 31438
2024-12-10 04:17:21,608 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:21,610 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,625 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:21,627 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,634 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 3
2024-12-10 04:17:21,634 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60004, range: 0-4905, partition values: [2024-11-28,06]
2024-12-10 04:17:21,680 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:21,680 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61104, range: 0-4518, partition values: [2024-11-28,10]
2024-12-10 04:17:21,912 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:21,913 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,915 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:21,916 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:21,930 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 2
2024-12-10 04:17:21,930 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60116, range: 0-4517, partition values: [2024-11-28,07]
2024-12-10 04:17:21,934 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 3
2024-12-10 04:17:21,935 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60350, range: 0-4905, partition values: [2024-11-28,07]
2024-12-10 04:17:22,026 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:22,027 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:22,080 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:22,081 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61135, range: 0-4793, partition values: [2024-11-28,10]
2024-12-10 04:17:22,126 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:22,127 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:22,137 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:22,137 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59917, range: 0-4614, partition values: [2024-11-28,06]
2024-12-10 04:17:22,376 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:22,378 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:22,385 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:22,386 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60652, range: 0-4614, partition values: [2024-11-28,09]
2024-12-10 04:17:22,615 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:22,617 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:22,670 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:22,672 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:22,694 INFO hadoop.InternalParquetRecordReader: block read in memory in 77 ms. row count = 3
2024-12-10 04:17:22,695 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60636, range: 0-4904, partition values: [2024-11-28,09]
2024-12-10 04:17:22,766 INFO hadoop.InternalParquetRecordReader: block read in memory in 94 ms. row count = 2
2024-12-10 04:17:22,766 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61539, range: 0-4517, partition values: [2024-11-28,11]
2024-12-10 04:17:23,089 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,090 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,102 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410445125816003317378807_0000_m_000221_221' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410445125816003317378807_0000_m_000221
2024-12-10 04:17:23,102 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410445125816003317378807_0000_m_000221_221: Committed
2024-12-10 04:17:23,103 INFO executor.Executor: Finished task 221.0 in stage 0.0 (TID 221). 1907 bytes result sent to driver
2024-12-10 04:17:23,125 INFO hadoop.InternalParquetRecordReader: block read in memory in 1641 ms. row count = 2
2024-12-10 04:17:23,126 INFO hadoop.InternalParquetRecordReader: block read in memory in 36 ms. row count = 2
2024-12-10 04:17:23,126 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59114, range: 0-4516, partition values: [2024-11-28,04]
2024-12-10 04:17:23,126 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@10be449f
2024-12-10 04:17:23,127 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2024-12-10 04:17:23,127 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/_temporary/attempt_202412100410441380330046363944166_0000_m_000260_260/part-00260-342a48c1-394e-438a-8a6a-2c3b0d5dfad1-c000
2024-12-10 04:17:23,127 INFO codec.CodecConfig: Compression: SNAPPY
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Dictionary is on
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Validation is off
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2024-12-10 04:17:23,127 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2024-12-10 04:17:23,129 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:23,131 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,146 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 3
2024-12-10 04:17:23,147 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60948, range: 0-4904, partition values: [2024-11-28,10]
2024-12-10 04:17:23,262 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@10808da8
2024-12-10 04:17:23,263 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60389, range: 0-4471, partition values: [2024-11-28,08]
2024-12-10 04:17:23,431 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,433 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,439 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-12-10 04:17:23,439 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59416, range: 0-4470, partition values: [2024-11-28,04]
2024-12-10 04:17:23,447 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,448 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,457 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:23,457 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59775, range: 0-4516, partition values: [2024-11-28,06]
2024-12-10 04:17:23,675 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,677 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,722 INFO hadoop.InternalParquetRecordReader: block read in memory in 45 ms. row count = 2
2024-12-10 04:17:23,722 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60084, range: 0-4516, partition values: [2024-11-28,07]
2024-12-10 04:17:23,737 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,738 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,750 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 2
2024-12-10 04:17:23,751 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59434, range: 0-4470, partition values: [2024-11-28,05]
2024-12-10 04:17:23,887 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,889 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,893 INFO hadoop.InternalParquetRecordReader: block read in memory in 4 ms. row count = 2
2024-12-10 04:17:23,894 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61221, range: 0-4470, partition values: [2024-11-28,10]
2024-12-10 04:17:23,940 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:23,941 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:23,952 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-12-10 04:17:23,952 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=00/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-57625, range: 0-4514, partition values: [2024-11-28,00]
2024-12-10 04:17:24,050 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,052 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,110 INFO hadoop.InternalParquetRecordReader: block read in memory in 58 ms. row count = 2
2024-12-10 04:17:24,110 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61113, range: 0-4580, partition values: [2024-11-28,10]
2024-12-10 04:17:24,135 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,137 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,154 INFO hadoop.InternalParquetRecordReader: block read in memory in 17 ms. row count = 2
2024-12-10 04:17:24,154 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60387, range: 0-4514, partition values: [2024-11-28,08]
2024-12-10 04:17:24,484 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,485 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,501 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 2
2024-12-10 04:17:24,501 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60458, range: 0-4514, partition values: [2024-11-28,08]
2024-12-10 04:17:24,593 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,595 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,646 INFO hadoop.InternalParquetRecordReader: block read in memory in 51 ms. row count = 2
2024-12-10 04:17:24,647 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59881, range: 0-4467, partition values: [2024-11-28,06]
2024-12-10 04:17:24,786 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,787 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,858 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:24,859 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:24,872 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 2
2024-12-10 04:17:24,872 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=22/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-65586, range: 0-4514, partition values: [2024-11-28,22]
2024-12-10 04:17:25,629 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:25,630 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:26,266 INFO hadoop.InternalParquetRecordReader: block read in memory in 1479 ms. row count = 2
2024-12-10 04:17:26,266 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61560, range: 0-4821, partition values: [2024-11-28,11]
2024-12-10 04:17:26,283 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:26,284 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:26,291 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:26,291 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=16/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-63212, range: 0-4614, partition values: [2024-11-28,16]
2024-12-10 04:17:26,585 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:26,587 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:26,609 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 2
2024-12-10 04:17:26,609 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59623, range: 0-4820, partition values: [2024-11-28,05]
2024-12-10 04:17:26,702 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:26,704 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:26,711 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:26,712 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=03/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-58887, range: 0-4613, partition values: [2024-11-28,03]
2024-12-10 04:17:26,857 INFO hadoop.InternalParquetRecordReader: block read in memory in 1227 ms. row count = 2
2024-12-10 04:17:26,857 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61139, range: 0-4793, partition values: [2024-11-28,10]
2024-12-10 04:17:27,014 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,016 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,027 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-12-10 04:17:27,027 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60828, range: 0-4613, partition values: [2024-11-28,09]
2024-12-10 04:17:27,098 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:27,100 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,104 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:27,106 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,113 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 3
2024-12-10 04:17:27,114 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60861, range: 0-4792, partition values: [2024-11-28,09]
2024-12-10 04:17:27,167 INFO hadoop.InternalParquetRecordReader: block read in memory in 67 ms. row count = 3
2024-12-10 04:17:27,168 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59507, range: 0-4903, partition values: [2024-11-28,05]
2024-12-10 04:17:27,248 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,250 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,567 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,569 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,602 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 2
2024-12-10 04:17:27,603 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60609, range: 0-4467, partition values: [2024-11-28,08]
2024-12-10 04:17:27,643 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,644 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,717 INFO hadoop.InternalParquetRecordReader: block read in memory in 73 ms. row count = 2
2024-12-10 04:17:27,718 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61044, range: 0-4613, partition values: [2024-11-28,10]
2024-12-10 04:17:27,867 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,869 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,879 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,880 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,887 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:27,887 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60894, range: 0-4467, partition values: [2024-11-28,09]
2024-12-10 04:17:27,922 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:27,923 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59609, range: 0-4513, partition values: [2024-11-28,05]
2024-12-10 04:17:27,948 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:27,949 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:27,959 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:27,960 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59345, range: 0-4611, partition values: [2024-11-28,04]
2024-12-10 04:17:28,215 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:28,216 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:28,232 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 2
2024-12-10 04:17:28,233 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60078, range: 0-4611, partition values: [2024-11-28,06]
2024-12-10 04:17:28,497 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:28,499 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:28,503 INFO hadoop.InternalParquetRecordReader: block read in memory in 1253 ms. row count = 2
2024-12-10 04:17:28,504 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59992, range: 0-4579, partition values: [2024-11-28,06]
2024-12-10 04:17:28,510 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-12-10 04:17:28,510 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61121, range: 0-4611, partition values: [2024-11-28,10]
2024-12-10 04:17:29,511 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:29,513 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:29,938 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1 records.
2024-12-10 04:17:29,939 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:29,948 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 1
2024-12-10 04:17:29,948 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60430, range: 0-4903, partition values: [2024-11-28,08]
2024-12-10 04:17:30,140 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:30,142 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:30,143 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:30,145 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:30,159 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 2
2024-12-10 04:17:30,159 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60613, range: 0-4903, partition values: [2024-11-28,08]
2024-12-10 04:17:30,785 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1 records.
2024-12-10 04:17:30,788 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:30,795 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 1
2024-12-10 04:17:30,795 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61201, range: 0-4903, partition values: [2024-11-28,10]
2024-12-10 04:17:30,820 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:30,822 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:30,831 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:30,831 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=00/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-57926, range: 0-4511, partition values: [2024-11-28,00]
2024-12-10 04:17:30,874 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:30,876 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:30,883 INFO hadoop.InternalParquetRecordReader: block read in memory in 1370 ms. row count = 3
2024-12-10 04:17:30,884 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61337, range: 0-4820, partition values: [2024-11-28,11]
2024-12-10 04:17:30,954 INFO hadoop.InternalParquetRecordReader: block read in memory in 78 ms. row count = 2
2024-12-10 04:17:30,954 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60955, range: 0-4464, partition values: [2024-11-28,10]
2024-12-10 04:17:30,999 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:31,001 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,013 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 3
2024-12-10 04:17:31,013 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62323, range: 0-4903, partition values: [2024-11-28,13]
2024-12-10 04:17:31,273 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,275 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,289 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 2
2024-12-10 04:17:31,290 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59247, range: 0-4819, partition values: [2024-11-28,04]
2024-12-10 04:17:31,412 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,413 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,495 INFO hadoop.InternalParquetRecordReader: block read in memory in 82 ms. row count = 2
2024-12-10 04:17:31,495 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60165, range: 0-4463, partition values: [2024-11-28,07]
2024-12-10 04:17:31,499 INFO hadoop.InternalParquetRecordReader: block read in memory in 1357 ms. row count = 2
2024-12-10 04:17:31,500 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60549, range: 0-4791, partition values: [2024-11-28,08]
2024-12-10 04:17:31,555 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,556 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,566 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:31,566 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60394, range: 0-4609, partition values: [2024-11-28,08]
2024-12-10 04:17:31,630 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,632 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,661 INFO hadoop.InternalParquetRecordReader: block read in memory in 29 ms. row count = 2
2024-12-10 04:17:31,662 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=15/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62700, range: 0-4579, partition values: [2024-11-28,15]
2024-12-10 04:17:31,723 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:31,725 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,740 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 3
2024-12-10 04:17:31,740 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59564, range: 0-4819, partition values: [2024-11-28,05]
2024-12-10 04:17:31,770 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,772 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,781 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:31,782 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60864, range: 0-4790, partition values: [2024-11-28,09]
2024-12-10 04:17:31,957 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:31,959 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:31,980 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 2
2024-12-10 04:17:31,980 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60052, range: 0-4608, partition values: [2024-11-28,06]
2024-12-10 04:17:32,028 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,029 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,082 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,083 INFO hadoop.InternalParquetRecordReader: block read in memory in 54 ms. row count = 2
2024-12-10 04:17:32,084 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60272, range: 0-4458, partition values: [2024-11-28,07]
2024-12-10 04:17:32,084 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,112 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 2
2024-12-10 04:17:32,112 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59448, range: 0-4578, partition values: [2024-11-28,05]
2024-12-10 04:17:32,342 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:32,344 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,396 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 3
2024-12-10 04:17:32,397 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59634, range: 0-4819, partition values: [2024-11-28,05]
2024-12-10 04:17:32,423 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,424 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,430 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-12-10 04:17:32,430 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60324, range: 0-4457, partition values: [2024-11-28,07]
2024-12-10 04:17:32,560 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,561 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,615 INFO hadoop.InternalParquetRecordReader: block read in memory in 54 ms. row count = 2
2024-12-10 04:17:32,615 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60431, range: 0-4789, partition values: [2024-11-28,08]
2024-12-10 04:17:32,713 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,715 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,758 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:32,760 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,774 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 2
2024-12-10 04:17:32,775 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59879, range: 0-4819, partition values: [2024-11-28,06]
2024-12-10 04:17:32,817 INFO hadoop.InternalParquetRecordReader: block read in memory in 102 ms. row count = 2
2024-12-10 04:17:32,818 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59939, range: 0-4456, partition values: [2024-11-28,06]
2024-12-10 04:17:32,973 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:32,975 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:32,994 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 3
2024-12-10 04:17:32,994 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60831, range: 0-4789, partition values: [2024-11-28,09]
2024-12-10 04:17:33,098 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:33,099 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,125 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 3
2024-12-10 04:17:33,125 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60227, range: 0-4819, partition values: [2024-11-28,07]
2024-12-10 04:17:33,141 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:33,143 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,162 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 2
2024-12-10 04:17:33,163 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59682, range: 0-4455, partition values: [2024-11-28,05]
2024-12-10 04:17:33,220 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:33,221 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,235 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 3
2024-12-10 04:17:33,235 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61983, range: 0-4789, partition values: [2024-11-28,13]
2024-12-10 04:17:33,321 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:33,322 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,327 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 3
2024-12-10 04:17:33,327 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60952, range: 0-4819, partition values: [2024-11-28,10]
2024-12-10 04:17:33,524 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:33,525 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,531 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-12-10 04:17:33,531 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60634, range: 0-4818, partition values: [2024-11-28,09]
2024-12-10 04:17:33,548 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:33,549 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,577 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 2
2024-12-10 04:17:33,577 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62026, range: 0-4788, partition values: [2024-11-28,13]
2024-12-10 04:17:33,589 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:33,591 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,637 INFO hadoop.InternalParquetRecordReader: block read in memory in 46 ms. row count = 2
2024-12-10 04:17:33,637 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60935, range: 0-4455, partition values: [2024-11-28,10]
2024-12-10 04:17:33,754 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 4 records.
2024-12-10 04:17:33,756 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,927 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:33,929 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,934 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:33,936 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:33,942 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 3
2024-12-10 04:17:33,942 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59833, range: 0-4817, partition values: [2024-11-28,06]
2024-12-10 04:17:33,949 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 3
2024-12-10 04:17:33,949 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59954, range: 0-4787, partition values: [2024-11-28,06]
2024-12-10 04:17:34,251 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:34,253 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:34,282 INFO hadoop.InternalParquetRecordReader: block read in memory in 29 ms. row count = 3
2024-12-10 04:17:34,283 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59342, range: 0-4816, partition values: [2024-11-28,04]
2024-12-10 04:17:34,562 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:34,564 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:34,576 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 3
2024-12-10 04:17:34,576 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59612, range: 0-4816, partition values: [2024-11-28,05]
2024-12-10 04:17:34,712 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:34,714 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:34,723 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:34,723 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60196, range: 0-4608, partition values: [2024-11-28,07]
2024-12-10 04:17:34,872 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:34,874 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:34,890 INFO hadoop.InternalParquetRecordReader: block read in memory in 16 ms. row count = 2
2024-12-10 04:17:34,890 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60627, range: 0-4608, partition values: [2024-11-28,09]
2024-12-10 04:17:34,920 INFO hadoop.InternalParquetRecordReader: block read in memory in 1164 ms. row count = 4
2024-12-10 04:17:34,921 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 24128
2024-12-10 04:17:34,943 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:34,944 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:34,998 INFO hadoop.InternalParquetRecordReader: block read in memory in 54 ms. row count = 2
2024-12-10 04:17:34,998 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60867, range: 0-4816, partition values: [2024-11-28,09]
2024-12-10 04:17:35,081 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:35,083 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:35,788 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:35,789 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:36,063 INFO hadoop.InternalParquetRecordReader: block read in memory in 980 ms. row count = 2
2024-12-10 04:17:36,064 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59688, range: 0-4578, partition values: [2024-11-28,05]
2024-12-10 04:17:36,111 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:36,113 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:36,218 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410446262718340272649745_0000_m_000236_236' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410446262718340272649745_0000_m_000236
2024-12-10 04:17:36,218 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410446262718340272649745_0000_m_000236_236: Committed
2024-12-10 04:17:36,220 INFO executor.Executor: Finished task 236.0 in stage 0.0 (TID 236). 1864 bytes result sent to driver
2024-12-10 04:17:36,350 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:36,351 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:36,376 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 2
2024-12-10 04:17:36,377 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60510, range: 0-4578, partition values: [2024-11-28,08]
2024-12-10 04:17:36,552 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:36,553 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:36,563 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 3
2024-12-10 04:17:36,563 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61399, range: 0-4786, partition values: [2024-11-28,11]
2024-12-10 04:17:36,588 INFO hadoop.InternalParquetRecordReader: block read in memory in 799 ms. row count = 2
2024-12-10 04:17:36,589 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59386, range: 0-4506, partition values: [2024-11-28,04]
2024-12-10 04:17:36,994 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:36,996 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:37,010 INFO hadoop.InternalParquetRecordReader: block read in memory in 897 ms. row count = 2
2024-12-10 04:17:37,010 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59308, range: 0-4449, partition values: [2024-11-28,04]
2024-12-10 04:17:37,022 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 3
2024-12-10 04:17:37,022 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59789, range: 0-4784, partition values: [2024-11-28,06]
2024-12-10 04:17:37,120 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:37,122 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:37,262 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:37,264 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:37,271 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:37,272 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60217, range: 0-4449, partition values: [2024-11-28,07]
2024-12-10 04:17:37,274 INFO hadoop.InternalParquetRecordReader: block read in memory in 152 ms. row count = 2
2024-12-10 04:17:37,274 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59918, range: 0-4506, partition values: [2024-11-28,06]
2024-12-10 04:17:37,659 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:37,661 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:37,669 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:17:37,669 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60790, range: 0-4506, partition values: [2024-11-28,09]
2024-12-10 04:17:37,931 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:37,932 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:37,935 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:37,936 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,058 INFO hadoop.InternalParquetRecordReader: block read in memory in 126 ms. row count = 2
2024-12-10 04:17:38,059 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60385, range: 0-4447, partition values: [2024-11-28,08]
2024-12-10 04:17:38,111 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:38,112 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,127 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 2
2024-12-10 04:17:38,127 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60889, range: 0-4506, partition values: [2024-11-28,09]
2024-12-10 04:17:38,390 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:38,392 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,407 INFO hadoop.InternalParquetRecordReader: block read in memory in 15 ms. row count = 2
2024-12-10 04:17:38,408 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=00/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-57824, range: 0-4446, partition values: [2024-11-28,00]
2024-12-10 04:17:38,410 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:38,412 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,432 INFO hadoop.InternalParquetRecordReader: block read in memory in 20 ms. row count = 2
2024-12-10 04:17:38,432 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=16/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-63152, range: 0-4506, partition values: [2024-11-28,16]
2024-12-10 04:17:38,677 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:38,679 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,689 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:38,690 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59527, range: 0-4577, partition values: [2024-11-28,05]
2024-12-10 04:17:38,703 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:38,705 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:38,711 INFO hadoop.InternalParquetRecordReader: block read in memory in 6 ms. row count = 2
2024-12-10 04:17:38,711 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61083, range: 0-4446, partition values: [2024-11-28,10]
2024-12-10 04:17:39,003 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:39,005 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:39,050 INFO hadoop.InternalParquetRecordReader: block read in memory in 1114 ms. row count = 3
2024-12-10 04:17:39,051 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60932, range: 0-4816, partition values: [2024-11-28,10]
2024-12-10 04:17:39,362 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:39,364 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:39,372 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 3
2024-12-10 04:17:39,373 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61982, range: 0-4816, partition values: [2024-11-28,13]
2024-12-10 04:17:39,506 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:39,507 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:39,640 INFO hadoop.InternalParquetRecordReader: block read in memory in 132 ms. row count = 3
2024-12-10 04:17:39,641 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61374, range: 0-4784, partition values: [2024-11-28,11]
2024-12-10 04:17:40,009 INFO hadoop.InternalParquetRecordReader: block read in memory in 1004 ms. row count = 2
2024-12-10 04:17:40,009 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60813, range: 0-4607, partition values: [2024-11-28,09]
2024-12-10 04:17:40,908 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:40,910 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:40,963 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:40,963 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60870, range: 0-4504, partition values: [2024-11-28,09]
2024-12-10 04:17:41,199 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,201 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,216 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,217 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,269 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 2
2024-12-10 04:17:41,269 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60380, range: 0-4443, partition values: [2024-11-28,08]
2024-12-10 04:17:41,670 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,676 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,688 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 2
2024-12-10 04:17:41,688 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61170, range: 0-4504, partition values: [2024-11-28,10]
2024-12-10 04:17:41,709 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,711 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,724 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 2
2024-12-10 04:17:41,724 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60114, range: 0-4438, partition values: [2024-11-28,07]
2024-12-10 04:17:41,908 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,910 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,924 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 2
2024-12-10 04:17:41,924 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60090, range: 0-4783, partition values: [2024-11-28,07]
2024-12-10 04:17:41,956 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:41,957 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:41,967 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:41,968 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60536, range: 0-4503, partition values: [2024-11-28,08]
2024-12-10 04:17:42,102 INFO hadoop.InternalParquetRecordReader: block read in memory in 901 ms. row count = 2
2024-12-10 04:17:42,103 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60007, range: 0-4577, partition values: [2024-11-28,06]
2024-12-10 04:17:43,239 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:43,240 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:43,265 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
2024-12-10 04:17:43,267 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:43,293 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 3
2024-12-10 04:17:43,293 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62080, range: 0-4783, partition values: [2024-11-28,13]
2024-12-10 04:17:43,566 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:43,568 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:43,911 INFO hadoop.InternalParquetRecordReader: block read in memory in 644 ms. row count = 3
2024-12-10 04:17:43,912 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 24362
2024-12-10 04:17:44,147 INFO hadoop.InternalParquetRecordReader: block read in memory in 579 ms. row count = 2
2024-12-10 04:17:44,148 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61266, range: 0-4606, partition values: [2024-11-28,11]
2024-12-10 04:17:44,181 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:44,183 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:44,236 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:44,237 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60741, range: 0-4503, partition values: [2024-11-28,09]
2024-12-10 04:17:44,384 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:44,385 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:44,392 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:44,393 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 22584
2024-12-10 04:17:44,396 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:44,398 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:44,408 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:44,408 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60703, range: 0-4434, partition values: [2024-11-28,09]
2024-12-10 04:17:44,644 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:44,646 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:44,651 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-12-10 04:17:44,651 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60417, range: 0-4576, partition values: [2024-11-28,08]
2024-12-10 04:17:45,599 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:45,601 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:45,610 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:45,610 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=13/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-62292, range: 0-4605, partition values: [2024-11-28,13]
2024-12-10 04:17:46,171 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:46,172 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:46,257 INFO hadoop.InternalParquetRecordReader: block read in memory in 85 ms. row count = 2
2024-12-10 04:17:46,258 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61318, range: 0-4503, partition values: [2024-11-28,11]
2024-12-10 04:17:46,489 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:46,490 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:46,523 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 2
2024-12-10 04:17:46,524 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60543, range: 0-4576, partition values: [2024-11-28,08]
2024-12-10 04:17:46,532 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:46,534 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:46,541 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:46,542 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60749, range: 0-4434, partition values: [2024-11-28,09]
2024-12-10 04:17:47,405 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:47,406 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:47,415 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:47,416 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59084, range: 0-4603, partition values: [2024-11-28,04]
2024-12-10 04:17:48,778 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:48,780 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:48,787 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:48,788 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60312, range: 0-4500, partition values: [2024-11-28,07]
2024-12-10 04:17:48,952 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:48,953 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:48,958 INFO hadoop.InternalParquetRecordReader: block read in memory in 5 ms. row count = 2
2024-12-10 04:17:48,959 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59901, range: 0-4433, partition values: [2024-11-28,06]
2024-12-10 04:17:49,333 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:49,334 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:49,344 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:17:49,344 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60203, range: 0-4575, partition values: [2024-11-28,07]
2024-12-10 04:17:49,470 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410445960612168575038261_0000_m_000243_243' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410445960612168575038261_0000_m_000243
2024-12-10 04:17:49,470 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410445960612168575038261_0000_m_000243_243: Committed
2024-12-10 04:17:49,471 INFO executor.Executor: Finished task 243.0 in stage 0.0 (TID 243). 1864 bytes result sent to driver
2024-12-10 04:17:50,540 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410447495947124304455462_0000_m_000245_245' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410447495947124304455462_0000_m_000245
2024-12-10 04:17:50,540 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410447495947124304455462_0000_m_000245_245: Committed
2024-12-10 04:17:50,542 INFO executor.Executor: Finished task 245.0 in stage 0.0 (TID 245). 1864 bytes result sent to driver
2024-12-10 04:17:51,069 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:51,071 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:51,079 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:17:51,079 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60924, range: 0-4432, partition values: [2024-11-28,10]
2024-12-10 04:17:51,132 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:51,133 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:51,142 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:51,142 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59962, range: 0-4602, partition values: [2024-11-28,06]
2024-12-10 04:17:51,348 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:51,350 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:51,507 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:51,508 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:51,516 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:17:51,517 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61058, range: 0-4500, partition values: [2024-11-28,10]
2024-12-10 04:17:51,520 INFO hadoop.InternalParquetRecordReader: block read in memory in 170 ms. row count = 2
2024-12-10 04:17:51,520 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60303, range: 0-4575, partition values: [2024-11-28,07]
2024-12-10 04:17:54,039 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:54,041 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:54,046 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:54,048 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:54,050 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:17:54,050 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=03/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-58834, range: 0-4499, partition values: [2024-11-28,03]
2024-12-10 04:17:54,089 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:54,091 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:54,105 INFO hadoop.InternalParquetRecordReader: block read in memory in 57 ms. row count = 2
2024-12-10 04:17:54,106 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60779, range: 0-4574, partition values: [2024-11-28,09]
2024-12-10 04:17:54,235 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:54,237 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:54,260 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 2
2024-12-10 04:17:54,261 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=08/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60610, range: 0-4430, partition values: [2024-11-28,08]
2024-12-10 04:17:54,458 INFO hadoop.InternalParquetRecordReader: block read in memory in 367 ms. row count = 2
2024-12-10 04:17:54,459 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60144, range: 0-4602, partition values: [2024-11-28,07]
2024-12-10 04:17:56,377 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:56,379 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:56,397 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 2
2024-12-10 04:17:56,398 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59275, range: 0-4499, partition values: [2024-11-28,04]
2024-12-10 04:17:56,439 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:56,441 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:56,448 INFO hadoop.InternalParquetRecordReader: block read in memory in 7 ms. row count = 2
2024-12-10 04:17:56,448 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=01/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-58129, range: 0-4600, partition values: [2024-11-28,01]
2024-12-10 04:17:56,873 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:56,874 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:56,941 INFO hadoop.InternalParquetRecordReader: block read in memory in 67 ms. row count = 2
2024-12-10 04:17:56,941 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60913, range: 0-4429, partition values: [2024-11-28,10]
2024-12-10 04:17:57,073 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:57,075 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:57,128 INFO hadoop.InternalParquetRecordReader: block read in memory in 53 ms. row count = 2
2024-12-10 04:17:57,128 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59262, range: 0-4573, partition values: [2024-11-28,04]
2024-12-10 04:17:58,907 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:58,909 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:58,909 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:58,911 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:58,931 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 2
2024-12-10 04:17:58,931 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60691, range: 0-4599, partition values: [2024-11-28,09]
2024-12-10 04:17:58,935 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 2
2024-12-10 04:17:58,935 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=09/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60682, range: 0-4573, partition values: [2024-11-28,09]
2024-12-10 04:17:58,942 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:58,943 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:58,989 INFO hadoop.InternalParquetRecordReader: block read in memory in 46 ms. row count = 2
2024-12-10 04:17:58,989 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 18620
2024-12-10 04:17:59,046 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:59,048 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:59,100 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 2
2024-12-10 04:17:59,100 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=11/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61501, range: 0-4428, partition values: [2024-11-28,11]
2024-12-10 04:17:59,703 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:17:59,704 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:17:59,716 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 2
2024-12-10 04:17:59,716 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=12/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61954, range: 0-4428, partition values: [2024-11-28,12]
2024-12-10 04:18:00,093 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:00,094 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:00,149 INFO hadoop.InternalParquetRecordReader: block read in memory in 55 ms. row count = 2
2024-12-10 04:18:00,149 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=23/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-65661, range: 0-4573, partition values: [2024-11-28,23]
2024-12-10 04:18:00,384 INFO output.FileOutputCommitter: Saved output of task 'attempt_20241210041044162326242586159366_0000_m_000258_258' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_20241210041044162326242586159366_0000_m_000258
2024-12-10 04:18:00,384 INFO mapred.SparkHadoopMapRedUtil: attempt_20241210041044162326242586159366_0000_m_000258_258: Committed
2024-12-10 04:18:00,385 INFO executor.Executor: Finished task 258.0 in stage 0.0 (TID 258). 1864 bytes result sent to driver
2024-12-10 04:18:00,753 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:00,754 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:00,884 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:00,885 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:01,017 INFO hadoop.InternalParquetRecordReader: block read in memory in 263 ms. row count = 2
2024-12-10 04:18:01,017 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61238, range: 0-4599, partition values: [2024-11-28,10]
2024-12-10 04:18:01,257 INFO hadoop.InternalParquetRecordReader: block read in memory in 372 ms. row count = 2
2024-12-10 04:18:01,257 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60251, range: 0-4419, partition values: [2024-11-28,07]
2024-12-10 04:18:01,434 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:01,436 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:01,445 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:18:01,445 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59886, range: 0-4417, partition values: [2024-11-28,06]
2024-12-10 04:18:01,551 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:01,553 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:01,584 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:01,585 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:01,649 INFO hadoop.InternalParquetRecordReader: block read in memory in 64 ms. row count = 2
2024-12-10 04:18:01,649 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 19040
2024-12-10 04:18:02,025 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:02,026 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:02,037 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 2
2024-12-10 04:18:02,037 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 18220
2024-12-10 04:18:02,068 INFO hadoop.InternalParquetRecordReader: block read in memory in 515 ms. row count = 2
2024-12-10 04:18:02,069 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61049, range: 0-4570, partition values: [2024-11-28,10]
2024-12-10 04:18:02,414 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:02,415 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:02,434 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 2
2024-12-10 04:18:02,435 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60199, range: 0-4567, partition values: [2024-11-28,07]
2024-12-10 04:18:02,634 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410443121077451943462873_0000_m_000253_253' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410443121077451943462873_0000_m_000253
2024-12-10 04:18:02,634 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410443121077451943462873_0000_m_000253_253: Committed
2024-12-10 04:18:02,635 INFO executor.Executor: Finished task 253.0 in stage 0.0 (TID 253). 1864 bytes result sent to driver
2024-12-10 04:18:02,692 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410441380330046363944166_0000_m_000260_260' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410441380330046363944166_0000_m_000260
2024-12-10 04:18:02,692 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410441380330046363944166_0000_m_000260_260: Committed
2024-12-10 04:18:02,693 INFO executor.Executor: Finished task 260.0 in stage 0.0 (TID 260). 1864 bytes result sent to driver
2024-12-10 04:18:02,749 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:02,751 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:02,761 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:18:02,761 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60182, range: 0-4566, partition values: [2024-11-28,07]
2024-12-10 04:18:03,254 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:03,255 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:03,327 INFO hadoop.InternalParquetRecordReader: block read in memory in 72 ms. row count = 2
2024-12-10 04:18:03,327 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60260, range: 0-4566, partition values: [2024-11-28,07]
2024-12-10 04:18:03,831 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:03,833 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:03,843 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 2
2024-12-10 04:18:03,843 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=10/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-61193, range: 0-4566, partition values: [2024-11-28,10]
2024-12-10 04:18:04,393 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:04,395 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:04,470 INFO hadoop.InternalParquetRecordReader: block read in memory in 75 ms. row count = 2
2024-12-10 04:18:04,470 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=04/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59314, range: 0-4564, partition values: [2024-11-28,04]
2024-12-10 04:18:05,002 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:05,004 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:05,012 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:18:05,013 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59747, range: 0-4563, partition values: [2024-11-28,05]
2024-12-10 04:18:05,345 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:05,347 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:05,361 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 2
2024-12-10 04:18:05,362 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=05/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-59593, range: 0-4562, partition values: [2024-11-28,05]
2024-12-10 04:18:05,633 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:05,635 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:05,643 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:18:05,643 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=06/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60008, range: 0-4561, partition values: [2024-11-28,06]
2024-12-10 04:18:05,856 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:05,857 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:05,866 INFO hadoop.InternalParquetRecordReader: block read in memory in 9 ms. row count = 2
2024-12-10 04:18:05,866 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/app_network_web/dt=2024-11-28/hr=07/part-bb2a1d4c-7d70-4f27-9ac7-bc68b10a7ead-0-60204, range: 0-4561, partition values: [2024-11-28,07]
2024-12-10 04:18:06,126 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 2 records.
2024-12-10 04:18:06,128 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2024-12-10 04:18:06,136 INFO hadoop.InternalParquetRecordReader: block read in memory in 8 ms. row count = 2
2024-12-10 04:18:06,136 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 18190
2024-12-10 04:18:06,784 INFO output.FileOutputCommitter: Saved output of task 'attempt_202412100410444923240707288505151_0000_m_000255_255' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/app_network_web/app_network_web_2024-11-28/.hive-staging_hive_2024-12-10_04-10-42_388_1543581349368998369-1/-ext-10000/_temporary/0/task_202412100410444923240707288505151_0000_m_000255
2024-12-10 04:18:06,784 INFO mapred.SparkHadoopMapRedUtil: attempt_202412100410444923240707288505151_0000_m_000255_255: Committed
2024-12-10 04:18:06,786 INFO executor.Executor: Finished task 255.0 in stage 0.0 (TID 255). 1864 bytes result sent to driver
2024-12-10 04:20:02,469 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown
2024-12-10 04:20:02,487 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown