13 09:21:03,540 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56464, range: 0-62349, partition values: [2025-01-19,08]
2025-02-13 09:21:03,542 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=14/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1987, range: 0-81476, partition values: [2025-01-19,14]
2025-02-13 09:21:03,704 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1034 records.
2025-02-13 09:21:03,707 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:03,743 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1038 records.
2025-02-13 09:21:03,746 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:03,754 INFO hadoop.InternalParquetRecordReader: block read in memory in 47 ms. row count = 1034
2025-02-13 09:21:03,780 INFO hadoop.InternalParquetRecordReader: block read in memory in 34 ms. row count = 1038
2025-02-13 09:21:03,791 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56159, range: 0-81412, partition values: [2025-01-19,07]
2025-02-13 09:21:03,812 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56241, range: 0-74938, partition values: [2025-01-19,07]
2025-02-13 09:21:03,938 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1155 records.
2025-02-13 09:21:03,940 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:03,990 INFO hadoop.InternalParquetRecordReader: block read in memory in 50 ms. row count = 1155
2025-02-13 09:21:04,025 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56124, range: 0-81319, partition values: [2025-01-19,07]
2025-02-13 09:21:04,140 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1048 records.
2025-02-13 09:21:04,142 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:04,194 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 1048
2025-02-13 09:21:04,219 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56204, range: 0-74904, partition values: [2025-01-19,07]
2025-02-13 09:21:04,452 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1070 records.
2025-02-13 09:21:04,453 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:04,497 INFO hadoop.InternalParquetRecordReader: block read in memory in 44 ms. row count = 1070
2025-02-13 09:21:04,530 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-620, range: 0-74844, partition values: [2025-01-19,10]
2025-02-13 09:21:04,759 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1014 records.
2025-02-13 09:21:04,761 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:04,803 INFO hadoop.InternalParquetRecordReader: block read in memory in 42 ms. row count = 1014
2025-02-13 09:21:04,837 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56217, range: 0-74738, partition values: [2025-01-19,07]
2025-02-13 09:21:05,209 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1061 records.
2025-02-13 09:21:05,211 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:05,220 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 792 records.
2025-02-13 09:21:05,222 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:05,223 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1204 records.
2025-02-13 09:21:05,225 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:05,270 INFO hadoop.InternalParquetRecordReader: block read in memory in 59 ms. row count = 1061
2025-02-13 09:21:05,304 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56203, range: 0-74618, partition values: [2025-01-19,07]
2025-02-13 09:21:05,381 INFO hadoop.InternalParquetRecordReader: block read in memory in 159 ms. row count = 792
2025-02-13 09:21:05,410 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-653, range: 0-58454, partition values: [2025-01-19,10]
2025-02-13 09:21:05,848 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 795 records.
2025-02-13 09:21:05,850 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:05,912 INFO hadoop.InternalParquetRecordReader: block read in memory in 62 ms. row count = 795
2025-02-13 09:21:05,945 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-278, range: 0-58445, partition values: [2025-01-19,09]
2025-02-13 09:21:05,990 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 699 records.
2025-02-13 09:21:05,992 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,193 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 770 records.
2025-02-13 09:21:06,195 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,230 INFO hadoop.InternalParquetRecordReader: block read in memory in 35 ms. row count = 770
2025-02-13 09:21:06,254 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56460, range: 0-58426, partition values: [2025-01-19,08]
2025-02-13 09:21:06,365 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1100 records.
2025-02-13 09:21:06,367 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,527 INFO hadoop.InternalParquetRecordReader: block read in memory in 160 ms. row count = 1100
2025-02-13 09:21:06,562 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-661, range: 0-75953, partition values: [2025-01-19,10]
2025-02-13 09:21:06,618 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 654 records.
2025-02-13 09:21:06,621 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,641 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 810 records.
2025-02-13 09:21:06,643 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,745 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 838 records.
2025-02-13 09:21:06,747 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:06,771 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 838
2025-02-13 09:21:06,778 INFO hadoop.InternalParquetRecordReader: block read in memory in 135 ms. row count = 810
2025-02-13 09:21:06,797 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-74, range: 0-62340, partition values: [2025-01-19,09]
2025-02-13 09:21:06,801 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-476, range: 0-58425, partition values: [2025-01-19,10]
2025-02-13 09:21:06,973 INFO hadoop.InternalParquetRecordReader: block read in memory in 1748 ms. row count = 1204
2025-02-13 09:21:07,003 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 5205965
2025-02-13 09:21:07,037 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 772 records.
2025-02-13 09:21:07,039 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:07,075 INFO hadoop.InternalParquetRecordReader: block read in memory in 36 ms. row count = 772
2025-02-13 09:21:07,094 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56410, range: 0-58358, partition values: [2025-01-19,08]
2025-02-13 09:21:07,348 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 812 records.
2025-02-13 09:21:07,350 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:07,385 INFO hadoop.InternalParquetRecordReader: block read in memory in 35 ms. row count = 812
2025-02-13 09:21:07,410 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 841 records.
2025-02-13 09:21:07,411 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:07,418 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1168 records.
2025-02-13 09:21:07,419 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-459, range: 0-58285, partition values: [2025-01-19,10]
2025-02-13 09:21:07,419 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:07,557 INFO hadoop.InternalParquetRecordReader: block read in memory in 146 ms. row count = 841
2025-02-13 09:21:07,578 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-26, range: 0-62323, partition values: [2025-01-19,09]
2025-02-13 09:21:07,590 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 802 records.
2025-02-13 09:21:07,592 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:07,626 INFO hadoop.InternalParquetRecordReader: block read in memory in 34 ms. row count = 802
2025-02-13 09:21:07,645 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-462, range: 0-58280, partition values: [2025-01-19,10]
2025-02-13 09:21:07,712 INFO hadoop.InternalParquetRecordReader: block read in memory in 1720 ms. row count = 699
2025-02-13 09:21:07,731 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-202, range: 0-51949, partition values: [2025-01-19,09]
2025-02-13 09:21:08,005 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 701 records.
2025-02-13 09:21:08,008 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,032 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 701
2025-02-13 09:21:08,073 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-66, range: 0-51907, partition values: [2025-01-19,09]
2025-02-13 09:21:08,134 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910533864976324885444163_0000_m_000242_242' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910533864976324885444163_0000_m_000242
2025-02-13 09:21:08,134 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910533864976324885444163_0000_m_000242_242: Committed
2025-02-13 09:21:08,135 INFO executor.Executor: Finished task 242.0 in stage 0.0 (TID 242). 1909 bytes result sent to driver
2025-02-13 09:21:08,173 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 279
2025-02-13 09:21:08,173 INFO executor.Executor: Running task 279.0 in stage 0.0 (TID 279)
2025-02-13 09:21:08,196 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
2025-02-13 09:21:08,196 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2025-02-13 09:21:08,196 INFO datasources.SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2025-02-13 09:21:08,196 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-520, range: 0-19670, partition values: [2025-01-19,10]
2025-02-13 09:21:08,205 INFO hadoop.InternalParquetRecordReader: block read in memory in 1584 ms. row count = 654
2025-02-13 09:21:08,221 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=19/part-2be60997-94f5-48af-925d-191579d7a0a2-0-3729, range: 0-48794, partition values: [2025-01-19,19]
2025-02-13 09:21:08,241 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 852 records.
2025-02-13 09:21:08,242 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,244 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 768 records.
2025-02-13 09:21:08,246 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,398 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 636 records.
2025-02-13 09:21:08,400 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,425 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 636
2025-02-13 09:21:08,427 INFO hadoop.InternalParquetRecordReader: block read in memory in 185 ms. row count = 852
2025-02-13 09:21:08,431 INFO hadoop.InternalParquetRecordReader: block read in memory in 185 ms. row count = 768
2025-02-13 09:21:08,445 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-139, range: 0-48734, partition values: [2025-01-19,09]
2025-02-13 09:21:08,453 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=00/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-53470, range: 0-62276, partition values: [2025-01-19,00]
2025-02-13 09:21:08,453 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56508, range: 0-58278, partition values: [2025-01-19,08]
2025-02-13 09:21:08,554 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 622 records.
2025-02-13 09:21:08,556 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,582 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 622
2025-02-13 09:21:08,598 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-255, range: 0-48694, partition values: [2025-01-19,09]
2025-02-13 09:21:08,701 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 637 records.
2025-02-13 09:21:08,703 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:08,729 INFO hadoop.InternalParquetRecordReader: block read in memory in 26 ms. row count = 637
2025-02-13 09:21:08,747 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-13, range: 0-48638, partition values: [2025-01-19,09]
2025-02-13 09:21:09,096 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 853 records.
2025-02-13 09:21:09,098 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:09,263 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 821 records.
2025-02-13 09:21:09,265 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:09,272 INFO hadoop.InternalParquetRecordReader: block read in memory in 174 ms. row count = 853
2025-02-13 09:21:09,294 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56429, range: 0-62262, partition values: [2025-01-19,08]
2025-02-13 09:21:09,306 INFO hadoop.InternalParquetRecordReader: block read in memory in 41 ms. row count = 821
2025-02-13 09:21:09,326 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56459, range: 0-58242, partition values: [2025-01-19,08]
2025-02-13 09:21:09,530 INFO hadoop.InternalParquetRecordReader: block read in memory in 2111 ms. row count = 1168
2025-02-13 09:21:09,569 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56188, range: 0-81314, partition values: [2025-01-19,07]
2025-02-13 09:21:09,911 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 856 records.
2025-02-13 09:21:09,914 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:09,984 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1155 records.
2025-02-13 09:21:09,985 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:10,007 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 1155
2025-02-13 09:21:10,037 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56123, range: 0-81303, partition values: [2025-01-19,07]
2025-02-13 09:21:10,140 INFO hadoop.InternalParquetRecordReader: block read in memory in 226 ms. row count = 856
2025-02-13 09:21:10,166 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-458, range: 0-62257, partition values: [2025-01-19,10]
2025-02-13 09:21:10,690 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1057 records.
2025-02-13 09:21:10,692 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:19,381 INFO hadoop.InternalParquetRecordReader: block read in memory in 8689 ms. row count = 1057
2025-02-13 09:21:19,411 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-639, range: 0-74542, partition values: [2025-01-19,10]
2025-02-13 09:21:19,551 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1043 records.
2025-02-13 09:21:19,554 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:19,579 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 1043
2025-02-13 09:21:19,614 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56164, range: 0-74526, partition values: [2025-01-19,07]
2025-02-13 09:21:20,064 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1049 records.
2025-02-13 09:21:20,067 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:20,115 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 211 records.
2025-02-13 09:21:20,117 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:20,131 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 211
2025-02-13 09:21:20,132 INFO parquet.MapredParquetOutputFormat: creating new record writer...org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat@669a98a8
2025-02-13 09:21:20,132 INFO write.ParquetRecordWriterWrapper: initialize serde with table properties.
2025-02-13 09:21:20,132 INFO write.ParquetRecordWriterWrapper: creating real writer to write at hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/_temporary/attempt_202502130910535133283502389795248_0000_m_000279_279/part-00279-e7ea67c7-675e-44d5-9f31-87546eedb080-c000
2025-02-13 09:21:20,133 INFO codec.CodecConfig: Compression: SNAPPY
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Parquet block size to 134217728
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Parquet page size to 1048576
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Parquet dictionary page size to 1048576
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Dictionary is on
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Validation is off
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Writer version is: PARQUET_1_0
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Maximum row group padding size is 8388608 bytes
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Page size checking is: estimated
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Min row count for page size check is: 100
2025-02-13 09:21:20,133 INFO hadoop.ParquetOutputFormat: Max row count for page size check is: 10000
2025-02-13 09:21:20,177 INFO write.ParquetRecordWriterWrapper: real writer: org.apache.parquet.hadoop.ParquetRecordWriter@6d2da47f
2025-02-13 09:21:20,184 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-604, range: 0-18698, partition values: [2025-01-19,10]
2025-02-13 09:21:20,200 INFO hadoop.InternalParquetRecordReader: block read in memory in 133 ms. row count = 1049
2025-02-13 09:21:20,225 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-668, range: 0-74443, partition values: [2025-01-19,10]
2025-02-13 09:21:20,325 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1012 records.
2025-02-13 09:21:20,327 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:20,345 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 1012
2025-02-13 09:21:20,375 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=06/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-55810, range: 0-74382, partition values: [2025-01-19,06]
2025-02-13 09:21:20,575 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1061 records.
2025-02-13 09:21:20,577 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:20,625 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 185 records.
2025-02-13 09:21:20,627 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:20,641 INFO hadoop.InternalParquetRecordReader: block read in memory in 14 ms. row count = 185
2025-02-13 09:21:20,648 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-53, range: 0-18623, partition values: [2025-01-19,09]
2025-02-13 09:21:20,663 INFO hadoop.InternalParquetRecordReader: block read in memory in 86 ms. row count = 1061
2025-02-13 09:21:20,701 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56250, range: 0-74337, partition values: [2025-01-19,07]
2025-02-13 09:21:22,219 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 210 records.
2025-02-13 09:21:22,221 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:22,225 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1050 records.
2025-02-13 09:21:22,227 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:22,243 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 210
2025-02-13 09:21:22,250 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 1050
2025-02-13 09:21:22,252 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-134, range: 0-18382, partition values: [2025-01-19,09]
2025-02-13 09:21:22,287 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56295, range: 0-74269, partition values: [2025-01-19,07]
2025-02-13 09:21:22,491 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 180 records.
2025-02-13 09:21:22,493 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:22,526 INFO hadoop.InternalParquetRecordReader: block read in memory in 32 ms. row count = 180
2025-02-13 09:21:22,533 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-42, range: 0-18248, partition values: [2025-01-19,09]
2025-02-13 09:21:22,725 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1045 records.
2025-02-13 09:21:22,726 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:22,854 INFO hadoop.InternalParquetRecordReader: block read in memory in 128 ms. row count = 1045
2025-02-13 09:21:22,886 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56361, range: 0-74258, partition values: [2025-01-19,08]
2025-02-13 09:21:25,296 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 674 records.
2025-02-13 09:21:25,298 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:32,988 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1185 records.
2025-02-13 09:21:32,990 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:33,144 INFO hadoop.InternalParquetRecordReader: block read in memory in 154 ms. row count = 1185
2025-02-13 09:21:33,188 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=13/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1614, range: 0-81250, partition values: [2025-01-19,13]
2025-02-13 09:21:33,336 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1100 records.
2025-02-13 09:21:33,339 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:33,463 INFO hadoop.InternalParquetRecordReader: block read in memory in 124 ms. row count = 1100
2025-02-13 09:21:33,509 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-461, range: 0-81217, partition values: [2025-01-19,10]
2025-02-13 09:21:33,647 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1117 records.
2025-02-13 09:21:33,649 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:33,667 INFO hadoop.InternalParquetRecordReader: block read in memory in 18 ms. row count = 1117
2025-02-13 09:21:33,708 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56173, range: 0-81173, partition values: [2025-01-19,07]
2025-02-13 09:21:35,121 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 839 records.
2025-02-13 09:21:35,123 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:35,832 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1046 records.
2025-02-13 09:21:35,834 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:39,056 INFO hadoop.InternalParquetRecordReader: block read in memory in 13758 ms. row count = 674
2025-02-13 09:21:39,072 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-120, range: 0-48629, partition values: [2025-01-19,09]
2025-02-13 09:21:39,254 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 645 records.
2025-02-13 09:21:39,256 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:39,283 INFO hadoop.InternalParquetRecordReader: block read in memory in 27 ms. row count = 645
2025-02-13 09:21:39,303 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=00/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-53719, range: 0-48605, partition values: [2025-01-19,00]
2025-02-13 09:21:39,549 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 587 records.
2025-02-13 09:21:39,550 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:39,583 INFO hadoop.InternalParquetRecordReader: block read in memory in 33 ms. row count = 587
2025-02-13 09:21:39,599 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-85, range: 0-48569, partition values: [2025-01-19,09]
2025-02-13 09:21:39,980 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 664 records.
2025-02-13 09:21:39,981 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:40,089 INFO hadoop.InternalParquetRecordReader: block read in memory in 107 ms. row count = 664
2025-02-13 09:21:40,105 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-88, range: 0-48428, partition values: [2025-01-19,09]
2025-02-13 09:21:40,741 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 647 records.
2025-02-13 09:21:40,742 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:40,817 INFO hadoop.InternalParquetRecordReader: block read in memory in 75 ms. row count = 647
2025-02-13 09:21:40,836 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=01/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-53822, range: 0-48390, partition values: [2025-01-19,01]
2025-02-13 09:21:42,029 INFO hadoop.InternalParquetRecordReader: block read in memory in 6906 ms. row count = 839
2025-02-13 09:21:42,050 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-393, range: 0-62247, partition values: [2025-01-19,10]
2025-02-13 09:21:42,246 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 840 records.
2025-02-13 09:21:42,248 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:42,276 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 705 records.
2025-02-13 09:21:42,277 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:42,290 INFO hadoop.InternalParquetRecordReader: block read in memory in 6456 ms. row count = 1046
2025-02-13 09:21:42,317 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56219, range: 0-75900, partition values: [2025-01-19,07]
2025-02-13 09:21:42,324 INFO hadoop.InternalParquetRecordReader: block read in memory in 76 ms. row count = 840
2025-02-13 09:21:42,346 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56477, range: 0-62211, partition values: [2025-01-19,08]
2025-02-13 09:21:42,813 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1072 records.
2025-02-13 09:21:42,815 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:42,826 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 1072
2025-02-13 09:21:42,853 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-673, range: 0-75833, partition values: [2025-01-19,10]
2025-02-13 09:21:43,009 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1011 records.
2025-02-13 09:21:43,011 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:43,022 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 1011
2025-02-13 09:21:43,054 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56236, range: 0-75827, partition values: [2025-01-19,07]
2025-02-13 09:21:43,067 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 855 records.
2025-02-13 09:21:43,069 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:43,151 INFO hadoop.InternalParquetRecordReader: block read in memory in 82 ms. row count = 855
2025-02-13 09:21:43,185 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-455, range: 0-62166, partition values: [2025-01-19,10]
2025-02-13 09:21:43,747 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 185 records.
2025-02-13 09:21:43,749 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:43,842 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1071 records.
2025-02-13 09:21:43,844 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:43,873 INFO hadoop.InternalParquetRecordReader: block read in memory in 124 ms. row count = 185
2025-02-13 09:21:43,878 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=12/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1123, range: 0-18227, partition values: [2025-01-19,12]
2025-02-13 09:21:43,936 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 844 records.
2025-02-13 09:21:43,938 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:44,123 INFO hadoop.InternalParquetRecordReader: block read in memory in 185 ms. row count = 844
2025-02-13 09:21:44,146 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-477, range: 0-62162, partition values: [2025-01-19,10]
2025-02-13 09:21:44,288 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 848 records.
2025-02-13 09:21:44,290 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:44,309 INFO hadoop.InternalParquetRecordReader: block read in memory in 19 ms. row count = 848
2025-02-13 09:21:44,337 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-453, range: 0-62161, partition values: [2025-01-19,10]
2025-02-13 09:21:44,348 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 176 records.
2025-02-13 09:21:44,350 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:44,453 INFO hadoop.InternalParquetRecordReader: block read in memory in 103 ms. row count = 176
2025-02-13 09:21:44,459 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=13/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1762, range: 0-18203, partition values: [2025-01-19,13]
2025-02-13 09:21:44,585 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 840 records.
2025-02-13 09:21:44,587 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:44,615 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 840
2025-02-13 09:21:44,642 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-385, range: 0-62111, partition values: [2025-01-19,10]
2025-02-13 09:21:45,001 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 838 records.
2025-02-13 09:21:45,003 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:45,060 INFO hadoop.InternalParquetRecordReader: block read in memory in 57 ms. row count = 838
2025-02-13 09:21:45,092 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-490, range: 0-62106, partition values: [2025-01-19,10]
2025-02-13 09:21:45,111 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 813 records.
2025-02-13 09:21:45,113 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:45,410 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 837 records.
2025-02-13 09:21:45,413 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:45,436 INFO hadoop.InternalParquetRecordReader: block read in memory in 23 ms. row count = 837
2025-02-13 09:21:45,471 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56452, range: 0-62083, partition values: [2025-01-19,08]
2025-02-13 09:21:45,977 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1145 records.
2025-02-13 09:21:45,979 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:45,992 INFO hadoop.InternalParquetRecordReader: block read in memory in 13 ms. row count = 1145
2025-02-13 09:21:46,037 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56139, range: 0-81141, partition values: [2025-01-19,07]
2025-02-13 09:21:46,325 INFO hadoop.InternalParquetRecordReader: block read in memory in 4048 ms. row count = 705
2025-02-13 09:21:46,347 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-36, range: 0-51898, partition values: [2025-01-19,09]
2025-02-13 09:21:46,988 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 715 records.
2025-02-13 09:21:46,990 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:47,012 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 715
2025-02-13 09:21:47,038 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-78, range: 0-51845, partition values: [2025-01-19,09]
2025-02-13 09:21:47,613 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 682 records.
2025-02-13 09:21:47,614 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:47,627 INFO hadoop.InternalParquetRecordReader: block read in memory in 12 ms. row count = 682
2025-02-13 09:21:47,655 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-208, range: 0-51830, partition values: [2025-01-19,09]
2025-02-13 09:21:47,744 INFO hadoop.InternalParquetRecordReader: block read in memory in 3900 ms. row count = 1071
2025-02-13 09:21:47,785 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56280, range: 0-74184, partition values: [2025-01-19,07]
2025-02-13 09:21:48,569 INFO hadoop.InternalParquetRecordReader: block read in memory in 3456 ms. row count = 813
2025-02-13 09:21:48,595 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-412, range: 0-58239, partition values: [2025-01-19,10]
2025-02-13 09:21:50,295 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 822 records.
2025-02-13 09:21:50,298 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:50,305 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1159 records.
2025-02-13 09:21:50,308 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:50,378 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 713 records.
2025-02-13 09:21:50,379 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:50,506 INFO hadoop.InternalParquetRecordReader: block read in memory in 127 ms. row count = 713
2025-02-13 09:21:50,527 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1040 records.
2025-02-13 09:21:50,529 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:50,531 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-200, range: 0-51797, partition values: [2025-01-19,09]
2025-02-13 09:21:50,557 INFO hadoop.InternalParquetRecordReader: block read in memory in 28 ms. row count = 1040
2025-02-13 09:21:50,591 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=12/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1360, range: 0-74052, partition values: [2025-01-19,12]
2025-02-13 09:21:50,756 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 686 records.
2025-02-13 09:21:50,758 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:50,836 INFO hadoop.InternalParquetRecordReader: block read in memory in 78 ms. row count = 686
2025-02-13 09:21:50,863 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-442, range: 0-51785, partition values: [2025-01-19,10]
2025-02-13 09:21:51,116 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 789 records.
2025-02-13 09:21:51,119 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:51,191 INFO hadoop.InternalParquetRecordReader: block read in memory in 72 ms. row count = 789
2025-02-13 09:21:51,226 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-478, range: 0-58236, partition values: [2025-01-19,10]
2025-02-13 09:21:51,309 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 650 records.
2025-02-13 09:21:51,313 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:51,366 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1018 records.
2025-02-13 09:21:51,369 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:51,509 INFO hadoop.InternalParquetRecordReader: block read in memory in 140 ms. row count = 1018
2025-02-13 09:21:51,551 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 4538951
2025-02-13 09:21:51,610 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 772 records.
2025-02-13 09:21:51,612 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:51,645 INFO hadoop.InternalParquetRecordReader: block read in memory in 1347 ms. row count = 822
2025-02-13 09:21:51,648 INFO hadoop.InternalParquetRecordReader: block read in memory in 1340 ms. row count = 1159
2025-02-13 09:21:51,680 INFO hadoop.InternalParquetRecordReader: block read in memory in 68 ms. row count = 772
2025-02-13 09:21:51,684 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-471, range: 0-62080, partition values: [2025-01-19,10]
2025-02-13 09:21:51,693 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-751, range: 0-81129, partition values: [2025-01-19,11]
2025-02-13 09:21:51,738 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-343, range: 0-58214, partition values: [2025-01-19,10]
2025-02-13 09:21:51,955 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1068 records.
2025-02-13 09:21:51,957 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:52,030 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1129 records.
2025-02-13 09:21:52,032 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:52,233 INFO hadoop.InternalParquetRecordReader: block read in memory in 201 ms. row count = 1129
2025-02-13 09:21:52,271 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-55998, range: 0-81054, partition values: [2025-01-19,07]
2025-02-13 09:21:52,306 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 183 records.
2025-02-13 09:21:52,308 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:52,657 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1163 records.
2025-02-13 09:21:52,660 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:52,713 INFO hadoop.InternalParquetRecordReader: block read in memory in 1400 ms. row count = 650
2025-02-13 09:21:52,740 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-143, range: 0-48322, partition values: [2025-01-19,09]
2025-02-13 09:21:52,779 INFO hadoop.InternalParquetRecordReader: block read in memory in 119 ms. row count = 1163
2025-02-13 09:21:52,812 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 793 records.
2025-02-13 09:21:52,813 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:52,823 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56149, range: 0-81053, partition values: [2025-01-19,07]
2025-02-13 09:21:52,980 INFO hadoop.InternalParquetRecordReader: block read in memory in 167 ms. row count = 793
2025-02-13 09:21:53,006 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-290, range: 0-58053, partition values: [2025-01-19,09]
2025-02-13 09:21:53,066 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910537322758527612161076_0000_m_000248_248' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910537322758527612161076_0000_m_000248
2025-02-13 09:21:53,066 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910537322758527612161076_0000_m_000248_248: Committed
2025-02-13 09:21:53,068 INFO executor.Executor: Finished task 248.0 in stage 0.0 (TID 248). 1909 bytes result sent to driver
2025-02-13 09:21:53,101 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1165 records.
2025-02-13 09:21:53,103 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:53,239 INFO hadoop.InternalParquetRecordReader: block read in memory in 136 ms. row count = 1165
2025-02-13 09:21:53,267 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-354, range: 0-80989, partition values: [2025-01-19,10]
2025-02-13 09:21:53,267 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 652 records.
2025-02-13 09:21:53,269 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:53,343 INFO hadoop.InternalParquetRecordReader: block read in memory in 74 ms. row count = 652
2025-02-13 09:21:53,364 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-191, range: 0-48209, partition values: [2025-01-19,09]
2025-02-13 09:21:53,374 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 776 records.
2025-02-13 09:21:53,376 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:53,398 INFO hadoop.InternalParquetRecordReader: block read in memory in 22 ms. row count = 776
2025-02-13 09:21:53,423 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-332, range: 0-57994, partition values: [2025-01-19,10]
2025-02-13 09:21:53,428 INFO hadoop.InternalParquetRecordReader: block read in memory in 1471 ms. row count = 1068
2025-02-13 09:21:53,457 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-607, range: 0-75820, partition values: [2025-01-19,10]
2025-02-13 09:21:53,877 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1097 records.
2025-02-13 09:21:53,878 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:53,908 INFO hadoop.InternalParquetRecordReader: block read in memory in 1600 ms. row count = 183
2025-02-13 09:21:53,916 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-64, range: 0-17907, partition values: [2025-01-19,09]
2025-02-13 09:21:53,956 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 802 records.
2025-02-13 09:21:53,957 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:53,962 INFO hadoop.InternalParquetRecordReader: block read in memory in 84 ms. row count = 1097
2025-02-13 09:21:53,992 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 4982626
2025-02-13 09:21:53,998 INFO hadoop.InternalParquetRecordReader: block read in memory in 41 ms. row count = 802
2025-02-13 09:21:54,006 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1042 records.
2025-02-13 09:21:54,008 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:54,017 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-262, range: 0-57992, partition values: [2025-01-19,09]
2025-02-13 09:21:54,137 INFO hadoop.InternalParquetRecordReader: block read in memory in 129 ms. row count = 1042
2025-02-13 09:21:54,169 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-663, range: 0-75654, partition values: [2025-01-19,10]
2025-02-13 09:21:54,342 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 190 records.
2025-02-13 09:21:54,343 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:54,387 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 778 records.
2025-02-13 09:21:54,389 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:54,436 INFO hadoop.InternalParquetRecordReader: block read in memory in 93 ms. row count = 190
2025-02-13 09:21:54,443 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-353, range: 0-17237, partition values: [2025-01-19,10]
2025-02-13 09:21:54,583 INFO hadoop.InternalParquetRecordReader: block read in memory in 194 ms. row count = 778
2025-02-13 09:21:54,602 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 3503878
2025-02-13 09:21:54,960 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 179 records.
2025-02-13 09:21:54,961 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:55,081 INFO hadoop.InternalParquetRecordReader: block read in memory in 120 ms. row count = 179
2025-02-13 09:21:55,086 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=12/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1403, range: 0-17177, partition values: [2025-01-19,12]
2025-02-13 09:21:55,261 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 1045 records.
2025-02-13 09:21:55,263 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:55,405 INFO hadoop.InternalParquetRecordReader: block read in memory in 142 ms. row count = 1045
2025-02-13 09:21:55,445 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 4622980
2025-02-13 09:21:55,611 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 832 records.
2025-02-13 09:21:55,612 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:55,694 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 176 records.
2025-02-13 09:21:55,695 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:55,739 INFO hadoop.InternalParquetRecordReader: block read in memory in 44 ms. row count = 176
2025-02-13 09:21:55,745 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-158, range: 0-16562, partition values: [2025-01-19,09]
2025-02-13 09:21:55,949 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910535438585629777297762_0000_m_000264_264' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910535438585629777297762_0000_m_000264
2025-02-13 09:21:55,949 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910536397664321129920575_0000_m_000244_244' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910536397664321129920575_0000_m_000244
2025-02-13 09:21:55,950 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910535438585629777297762_0000_m_000264_264: Committed
2025-02-13 09:21:55,950 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910536397664321129920575_0000_m_000244_244: Committed
2025-02-13 09:21:55,951 INFO executor.Executor: Finished task 264.0 in stage 0.0 (TID 264). 1909 bytes result sent to driver
2025-02-13 09:21:55,961 INFO executor.Executor: Finished task 244.0 in stage 0.0 (TID 244). 1952 bytes result sent to driver
2025-02-13 09:21:56,367 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 153 records.
2025-02-13 09:21:56,368 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:56,505 INFO hadoop.InternalParquetRecordReader: block read in memory in 137 ms. row count = 153
2025-02-13 09:21:56,509 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-417, range: 0-16393, partition values: [2025-01-19,10]
2025-02-13 09:21:56,524 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910537580081973941083586_0000_m_000247_247' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910537580081973941083586_0000_m_000247
2025-02-13 09:21:56,524 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910537580081973941083586_0000_m_000247_247: Committed
2025-02-13 09:21:56,526 INFO executor.Executor: Finished task 247.0 in stage 0.0 (TID 247). 1909 bytes result sent to driver
2025-02-13 09:21:56,892 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 155 records.
2025-02-13 09:21:56,893 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:57,071 INFO hadoop.InternalParquetRecordReader: block read in memory in 178 ms. row count = 155
2025-02-13 09:21:57,075 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-194, range: 0-16322, partition values: [2025-01-19,09]
2025-02-13 09:21:57,276 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 163 records.
2025-02-13 09:21:57,277 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:57,402 INFO hadoop.InternalParquetRecordReader: block read in memory in 125 ms. row count = 163
2025-02-13 09:21:57,406 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=07/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-55982, range: 0-16177, partition values: [2025-01-19,07]
2025-02-13 09:21:57,637 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 177 records.
2025-02-13 09:21:57,638 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:57,682 INFO hadoop.InternalParquetRecordReader: block read in memory in 44 ms. row count = 177
2025-02-13 09:21:57,687 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-576, range: 0-16083, partition values: [2025-01-19,10]
2025-02-13 09:21:58,217 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 140 records.
2025-02-13 09:21:58,219 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:58,235 INFO hadoop.InternalParquetRecordReader: block read in memory in 2623 ms. row count = 832
2025-02-13 09:21:58,256 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-431, range: 0-62024, partition values: [2025-01-19,10]
2025-02-13 09:21:58,358 INFO hadoop.InternalParquetRecordReader: block read in memory in 139 ms. row count = 140
2025-02-13 09:21:58,362 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-7, range: 0-15969, partition values: [2025-01-19,09]
2025-02-13 09:21:58,753 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 843 records.
2025-02-13 09:21:58,755 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:58,765 INFO hadoop.InternalParquetRecordReader: block read in memory in 10 ms. row count = 843
2025-02-13 09:21:58,787 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56382, range: 0-61997, partition values: [2025-01-19,08]
2025-02-13 09:21:59,166 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 868 records.
2025-02-13 09:21:59,167 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:59,203 INFO hadoop.InternalParquetRecordReader: block read in memory in 36 ms. row count = 868
2025-02-13 09:21:59,225 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56479, range: 0-61988, partition values: [2025-01-19,08]
2025-02-13 09:21:59,281 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 652 records.
2025-02-13 09:21:59,283 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:59,298 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 691 records.
2025-02-13 09:21:59,300 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:59,883 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 851 records.
2025-02-13 09:21:59,885 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:21:59,912 INFO hadoop.InternalParquetRecordReader: block read in memory in 27 ms. row count = 851
2025-02-13 09:21:59,934 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-220, range: 0-61962, partition values: [2025-01-19,09]
2025-02-13 09:22:00,404 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 853 records.
2025-02-13 09:22:00,406 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:00,497 INFO hadoop.InternalParquetRecordReader: block read in memory in 91 ms. row count = 853
2025-02-13 09:22:00,528 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56434, range: 0-61922, partition values: [2025-01-19,08]
2025-02-13 09:22:01,429 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 853 records.
2025-02-13 09:22:01,431 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:01,533 INFO hadoop.InternalParquetRecordReader: block read in memory in 2250 ms. row count = 652
2025-02-13 09:22:01,549 INFO hadoop.InternalParquetRecordReader: block read in memory in 118 ms. row count = 853
2025-02-13 09:22:01,555 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-935, range: 0-48082, partition values: [2025-01-19,11]
2025-02-13 09:22:01,561 INFO hadoop.InternalParquetRecordReader: block read in memory in 2261 ms. row count = 691
2025-02-13 09:22:01,574 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 3760481
2025-02-13 09:22:01,579 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-160, range: 0-51782, partition values: [2025-01-19,09]
2025-02-13 09:22:02,173 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 684 records.
2025-02-13 09:22:02,175 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:02,274 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 634 records.
2025-02-13 09:22:02,276 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:02,284 INFO hadoop.InternalParquetRecordReader: block read in memory in 109 ms. row count = 684
2025-02-13 09:22:02,302 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-265, range: 0-51710, partition values: [2025-01-19,09]
2025-02-13 09:22:02,423 INFO hadoop.InternalParquetRecordReader: block read in memory in 147 ms. row count = 634
2025-02-13 09:22:02,440 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-465, range: 0-47934, partition values: [2025-01-19,10]
2025-02-13 09:22:02,607 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 692 records.
2025-02-13 09:22:02,609 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:02,929 INFO hadoop.InternalParquetRecordReader: block read in memory in 320 ms. row count = 692
2025-02-13 09:22:02,940 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 630 records.
2025-02-13 09:22:02,942 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:02,955 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-122, range: 0-51681, partition values: [2025-01-19,09]
2025-02-13 09:22:03,015 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 141 records.
2025-02-13 09:22:03,017 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:03,089 INFO hadoop.InternalParquetRecordReader: block read in memory in 71 ms. row count = 141
2025-02-13 09:22:03,095 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-328, range: 0-15669, partition values: [2025-01-19,09]
2025-02-13 09:22:03,109 INFO hadoop.InternalParquetRecordReader: block read in memory in 167 ms. row count = 630
2025-02-13 09:22:03,133 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-153, range: 0-47871, partition values: [2025-01-19,09]
2025-02-13 09:22:03,534 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910534168790167778269552_0000_m_000260_260' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910534168790167778269552_0000_m_000260
2025-02-13 09:22:03,534 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910534168790167778269552_0000_m_000260_260: Committed
2025-02-13 09:22:03,536 INFO executor.Executor: Finished task 260.0 in stage 0.0 (TID 260). 1909 bytes result sent to driver
2025-02-13 09:22:03,728 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 689 records.
2025-02-13 09:22:03,731 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:03,881 INFO hadoop.InternalParquetRecordReader: block read in memory in 150 ms. row count = 689
2025-02-13 09:22:03,906 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-140, range: 0-51665, partition values: [2025-01-19,09]
2025-02-13 09:22:04,017 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 619 records.
2025-02-13 09:22:04,020 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:04,220 INFO hadoop.InternalParquetRecordReader: block read in memory in 200 ms. row count = 619
2025-02-13 09:22:04,241 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-505, range: 0-47863, partition values: [2025-01-19,10]
2025-02-13 09:22:04,506 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 693 records.
2025-02-13 09:22:04,508 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:04,559 INFO hadoop.InternalParquetRecordReader: block read in memory in 51 ms. row count = 693
2025-02-13 09:22:04,571 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 635 records.
2025-02-13 09:22:04,573 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:04,578 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-715, range: 0-51664, partition values: [2025-01-19,11]
2025-02-13 09:22:04,701 INFO hadoop.InternalParquetRecordReader: block read in memory in 128 ms. row count = 635
2025-02-13 09:22:04,723 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-46, range: 0-47860, partition values: [2025-01-19,09]
2025-02-13 09:22:05,084 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 643 records.
2025-02-13 09:22:05,086 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:05,192 INFO hadoop.InternalParquetRecordReader: block read in memory in 106 ms. row count = 643
2025-02-13 09:22:05,217 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-112, range: 0-47804, partition values: [2025-01-19,09]
2025-02-13 09:22:05,295 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 669 records.
2025-02-13 09:22:05,298 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:05,383 INFO hadoop.InternalParquetRecordReader: block read in memory in 85 ms. row count = 669
2025-02-13 09:22:05,414 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-172, range: 0-51634, partition values: [2025-01-19,09]
2025-02-13 09:22:06,028 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 139 records.
2025-02-13 09:22:06,029 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:06,171 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 694 records.
2025-02-13 09:22:06,172 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:06,263 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 625 records.
2025-02-13 09:22:06,264 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:06,302 INFO hadoop.InternalParquetRecordReader: block read in memory in 273 ms. row count = 139
2025-02-13 09:22:06,306 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-812, range: 0-15357, partition values: [2025-01-19,11]
2025-02-13 09:22:06,351 INFO hadoop.InternalParquetRecordReader: block read in memory in 179 ms. row count = 694
2025-02-13 09:22:06,352 INFO hadoop.InternalParquetRecordReader: block read in memory in 88 ms. row count = 625
2025-02-13 09:22:06,367 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-421, range: 0-47665, partition values: [2025-01-19,10]
2025-02-13 09:22:06,369 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-103, range: 0-51512, partition values: [2025-01-19,09]
2025-02-13 09:22:07,229 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 140 records.
2025-02-13 09:22:07,231 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:07,275 INFO hadoop.InternalParquetRecordReader: block read in memory in 44 ms. row count = 140
2025-02-13 09:22:07,279 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-647, range: 0-15352, partition values: [2025-01-19,10]
2025-02-13 09:22:07,591 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 142 records.
2025-02-13 09:22:07,592 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:07,737 INFO hadoop.InternalParquetRecordReader: block read in memory in 145 ms. row count = 142
2025-02-13 09:22:07,746 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-589, range: 0-15103, partition values: [2025-01-19,10]
2025-02-13 09:22:08,335 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 621 records.
2025-02-13 09:22:08,337 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:08,509 INFO hadoop.InternalParquetRecordReader: block read in memory in 172 ms. row count = 621
2025-02-13 09:22:08,525 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-179, range: 0-47595, partition values: [2025-01-19,09]
2025-02-13 09:22:08,781 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 627 records.
2025-02-13 09:22:08,783 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:08,859 INFO hadoop.InternalParquetRecordReader: block read in memory in 76 ms. row count = 627
2025-02-13 09:22:08,876 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-429, range: 0-47398, partition values: [2025-01-19,10]
2025-02-13 09:22:09,301 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 635 records.
2025-02-13 09:22:09,303 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:09,380 INFO hadoop.InternalParquetRecordReader: block read in memory in 77 ms. row count = 635
2025-02-13 09:22:09,399 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-190, range: 0-47344, partition values: [2025-01-19,09]
2025-02-13 09:22:09,744 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 640 records.
2025-02-13 09:22:09,745 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:09,797 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 640
2025-02-13 09:22:09,814 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-205, range: 0-47312, partition values: [2025-01-19,09]
2025-02-13 09:22:10,063 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 634 records.
2025-02-13 09:22:10,064 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:10,190 INFO hadoop.InternalParquetRecordReader: block read in memory in 126 ms. row count = 634
2025-02-13 09:22:10,206 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-542, range: 0-47246, partition values: [2025-01-19,10]
2025-02-13 09:22:11,080 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 626 records.
2025-02-13 09:22:11,082 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:11,132 INFO hadoop.InternalParquetRecordReader: block read in memory in 50 ms. row count = 626
2025-02-13 09:22:11,147 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56497, range: 0-47209, partition values: [2025-01-19,08]
2025-02-13 09:22:11,196 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 697 records.
2025-02-13 09:22:11,197 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:12,146 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 130 records.
2025-02-13 09:22:12,148 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:12,219 INFO hadoop.InternalParquetRecordReader: block read in memory in 71 ms. row count = 130
2025-02-13 09:22:12,222 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-986, range: 0-14968, partition values: [2025-01-19,11]
2025-02-13 09:22:12,486 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 133 records.
2025-02-13 09:22:12,487 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:12,589 INFO hadoop.InternalParquetRecordReader: block read in memory in 102 ms. row count = 133
2025-02-13 09:22:12,593 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-211, range: 0-14218, partition values: [2025-01-19,09]
2025-02-13 09:22:12,945 INFO hadoop.InternalParquetRecordReader: block read in memory in 1748 ms. row count = 697
2025-02-13 09:22:12,963 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-310, range: 0-51491, partition values: [2025-01-19,09]
2025-02-13 09:22:13,085 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 151 records.
2025-02-13 09:22:13,087 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:13,157 INFO hadoop.InternalParquetRecordReader: block read in memory in 70 ms. row count = 151
2025-02-13 09:22:13,161 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1041, range: 0-13709, partition values: [2025-01-19,11]
2025-02-13 09:22:13,333 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 684 records.
2025-02-13 09:22:13,334 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:13,404 INFO hadoop.InternalParquetRecordReader: block read in memory in 70 ms. row count = 684
2025-02-13 09:22:13,421 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-241, range: 0-51485, partition values: [2025-01-19,09]
2025-02-13 09:22:13,518 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 129 records.
2025-02-13 09:22:13,520 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:13,614 INFO hadoop.InternalParquetRecordReader: block read in memory in 94 ms. row count = 129
2025-02-13 09:22:13,619 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-6, range: 0-13405, partition values: [2025-01-19,09]
2025-02-13 09:22:14,305 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 694 records.
2025-02-13 09:22:14,307 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:14,362 INFO hadoop.InternalParquetRecordReader: block read in memory in 55 ms. row count = 694
2025-02-13 09:22:14,386 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-145, range: 0-51450, partition values: [2025-01-19,09]
2025-02-13 09:22:14,599 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 108 records.
2025-02-13 09:22:14,600 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:14,732 INFO hadoop.InternalParquetRecordReader: block read in memory in 132 ms. row count = 108
2025-02-13 09:22:14,736 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=04/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-54899, range: 0-12888, partition values: [2025-01-19,04]
2025-02-13 09:22:15,747 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 115 records.
2025-02-13 09:22:15,750 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:15,774 INFO hadoop.InternalParquetRecordReader: block read in memory in 24 ms. row count = 115
2025-02-13 09:22:15,782 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=10/part-2be60997-94f5-48af-925d-191579d7a0a2-0-367, range: 0-12420, partition values: [2025-01-19,10]
2025-02-13 09:22:16,852 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 639 records.
2025-02-13 09:22:16,854 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:17,328 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 113 records.
2025-02-13 09:22:17,330 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:17,607 INFO hadoop.InternalParquetRecordReader: block read in memory in 277 ms. row count = 113
2025-02-13 09:22:17,611 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=08/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-56514, range: 0-12325, partition values: [2025-01-19,08]
2025-02-13 09:22:18,461 INFO hadoop.InternalParquetRecordReader: block read in memory in 1607 ms. row count = 639
2025-02-13 09:22:18,489 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-215, range: 0-47087, partition values: [2025-01-19,09]
2025-02-13 09:22:18,769 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 603 records.
2025-02-13 09:22:18,771 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:18,807 INFO hadoop.InternalParquetRecordReader: block read in memory in 36 ms. row count = 603
2025-02-13 09:22:18,824 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-102, range: 0-47053, partition values: [2025-01-19,09]
2025-02-13 09:22:19,619 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 692 records.
2025-02-13 09:22:19,621 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:20,853 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 104 records.
2025-02-13 09:22:20,855 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:20,876 INFO hadoop.InternalParquetRecordReader: block read in memory in 21 ms. row count = 104
2025-02-13 09:22:20,881 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=14/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1765, range: 0-12270, partition values: [2025-01-19,14]
2025-02-13 09:22:21,035 INFO hadoop.InternalParquetRecordReader: block read in memory in 1414 ms. row count = 692
2025-02-13 09:22:21,064 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-289, range: 0-51444, partition values: [2025-01-19,09]
2025-02-13 09:22:21,234 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 96 records.
2025-02-13 09:22:21,237 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:21,355 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 691 records.
2025-02-13 09:22:21,357 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:21,360 INFO hadoop.InternalParquetRecordReader: block read in memory in 123 ms. row count = 96
2025-02-13 09:22:21,365 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-1045, range: 0-11874, partition values: [2025-01-19,11]
2025-02-13 09:22:21,368 INFO hadoop.InternalParquetRecordReader: block read in memory in 11 ms. row count = 691
2025-02-13 09:22:21,389 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-167, range: 0-51435, partition values: [2025-01-19,09]
2025-02-13 09:22:21,743 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 697 records.
2025-02-13 09:22:21,745 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:21,770 INFO hadoop.InternalParquetRecordReader: block read in memory in 25 ms. row count = 697
2025-02-13 09:22:21,790 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-196, range: 0-51300, partition values: [2025-01-19,09]
2025-02-13 09:22:22,025 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 619 records.
2025-02-13 09:22:22,027 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:22,269 INFO hadoop.InternalParquetRecordReader: block read in memory in 242 ms. row count = 619
2025-02-13 09:22:22,295 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-231, range: 0-46769, partition values: [2025-01-19,09]
2025-02-13 09:22:22,542 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 695 records.
2025-02-13 09:22:22,545 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:22,713 INFO hadoop.InternalParquetRecordReader: block read in memory in 168 ms. row count = 695
2025-02-13 09:22:22,741 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-197, range: 0-51263, partition values: [2025-01-19,09]
2025-02-13 09:22:22,856 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 616 records.
2025-02-13 09:22:22,858 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:22,939 INFO hadoop.InternalParquetRecordReader: block read in memory in 81 ms. row count = 616
2025-02-13 09:22:22,960 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-94, range: 0-46742, partition values: [2025-01-19,09]
2025-02-13 09:22:24,075 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 105 records.
2025-02-13 09:22:24,077 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:24,159 INFO hadoop.InternalParquetRecordReader: block read in memory in 82 ms. row count = 105
2025-02-13 09:22:24,164 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=21/part-2be60997-94f5-48af-925d-191579d7a0a2-0-4603, range: 0-11626, partition values: [2025-01-19,21]
2025-02-13 09:22:24,608 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 100 records.
2025-02-13 09:22:24,610 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:24,695 INFO hadoop.InternalParquetRecordReader: block read in memory in 85 ms. row count = 100
2025-02-13 09:22:24,700 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=03/part-e8c6815a-44f3-4241-b477-3e8927ad984b-0-54899, range: 0-11470, partition values: [2025-01-19,03]
2025-02-13 09:22:25,321 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 96 records.
2025-02-13 09:22:25,323 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:25,375 INFO hadoop.InternalParquetRecordReader: block read in memory in 52 ms. row count = 96
2025-02-13 09:22:25,379 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=11/part-2be60997-94f5-48af-925d-191579d7a0a2-0-857, range: 0-11233, partition values: [2025-01-19,11]
2025-02-13 09:22:25,530 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 676 records.
2025-02-13 09:22:25,531 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:25,615 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 632 records.
2025-02-13 09:22:25,617 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:25,675 INFO hadoop.InternalParquetRecordReader: block read in memory in 58 ms. row count = 632
2025-02-13 09:22:25,700 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-18, range: 0-46307, partition values: [2025-01-19,09]
2025-02-13 09:22:26,220 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 86 records.
2025-02-13 09:22:26,222 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:26,471 INFO hadoop.InternalParquetRecordReader: block read in memory in 249 ms. row count = 86
2025-02-13 09:22:26,475 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 702187
2025-02-13 09:22:26,550 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 621 records.
2025-02-13 09:22:26,552 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:26,671 INFO hadoop.InternalParquetRecordReader: block read in memory in 1140 ms. row count = 676
2025-02-13 09:22:26,682 INFO hadoop.InternalParquetRecordReader: block read in memory in 130 ms. row count = 621
2025-02-13 09:22:26,698 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-293, range: 0-51226, partition values: [2025-01-19,09]
2025-02-13 09:22:26,705 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-68, range: 0-46075, partition values: [2025-01-19,09]
2025-02-13 09:22:27,441 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 688 records.
2025-02-13 09:22:27,443 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:27,594 INFO hadoop.InternalParquetRecordReader: block read in memory in 151 ms. row count = 688
2025-02-13 09:22:27,615 INFO datasources.FileScanRDD: Reading File path: hdfs://namenodes-cluster/user/hive/warehouse/record.db/adserver_report/dt=2025-01-19/hr=09/part-2be60997-94f5-48af-925d-191579d7a0a2-0-114, range: 0-51210, partition values: [2025-01-19,09]
2025-02-13 09:22:27,749 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910535133283502389795248_0000_m_000279_279' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910535133283502389795248_0000_m_000279
2025-02-13 09:22:27,749 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910535133283502389795248_0000_m_000279_279: Committed
2025-02-13 09:22:27,751 INFO executor.Executor: Finished task 279.0 in stage 0.0 (TID 279). 1907 bytes result sent to driver
2025-02-13 09:22:29,436 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 630 records.
2025-02-13 09:22:29,438 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:29,803 INFO hadoop.InternalParquetRecordReader: RecordReader initialized will read a total of 689 records.
2025-02-13 09:22:29,805 INFO hadoop.InternalParquetRecordReader: block read in memory in 367 ms. row count = 630
2025-02-13 09:22:29,806 INFO hadoop.InternalParquetRecordReader: at row 0. reading next block
2025-02-13 09:22:29,830 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 2869696
2025-02-13 09:22:29,931 INFO hadoop.InternalParquetRecordReader: block read in memory in 125 ms. row count = 689
2025-02-13 09:22:29,952 INFO hadoop.InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 3036507
2025-02-13 09:22:31,232 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910531851142684000325628_0000_m_000275_275' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910531851142684000325628_0000_m_000275
2025-02-13 09:22:31,232 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910531851142684000325628_0000_m_000275_275: Committed
2025-02-13 09:22:31,234 INFO executor.Executor: Finished task 275.0 in stage 0.0 (TID 275). 1909 bytes result sent to driver
2025-02-13 09:22:31,864 INFO output.FileOutputCommitter: Saved output of task 'attempt_202502130910532847768378272459564_0000_m_000272_272' to hdfs://namenodes-cluster/home/hadoop/hive_backup/record/adserver_report/adserver_report_2025-01-19/.hive-staging_hive_2025-02-13_09-10-50_914_6818771980525548434-1/-ext-10000/_temporary/0/task_202502130910532847768378272459564_0000_m_000272
2025-02-13 09:22:31,865 INFO mapred.SparkHadoopMapRedUtil: attempt_202502130910532847768378272459564_0000_m_000272_272: Committed
2025-02-13 09:22:31,867 INFO executor.Executor: Finished task 272.0 in stage 0.0 (TID 272). 1909 bytes result sent to driver
2025-02-13 09:25:45,379 INFO executor.CoarseGrainedExecutorBackend: Driver commanded a shutdown
2025-02-13 09:25:45,431 ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown