doris查询 CATALOG hive 数据，全量查询和分区分批查询总和数据量不一致

Viewed 15
query

doris查询 CATALOG hive 数据，查询sql：SELECT SUM(cnt) FROM ( SELECT COUNT(*) AS cnt FROM hive.database.table WHERE dt >= 20250301 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' ) t;
上面查询出来的结果是2683，但是下面这种查询：分区每3个月分批查询出来的结果相加是 6370，和在原本里面hive查询出来的结果一致

SELECT SUM(cnt) FROM ( SELECT COUNT() AS cnt FROM hive.database.table WHERE dt >= 20250301 AND dt <= 20250531 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' UNION ALL SELECT COUNT() AS cnt FROM hive.database.table WHERE dt >= 20250601 AND dt <= 20250831 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' UNION ALL SELECT COUNT() AS cnt FROM hive.database.table WHERE dt >= 20250901 AND dt <= 20251130 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' UNION ALL SELECT COUNT() AS cnt FROM hive.database.table WHERE dt >= 20251201 AND dt <= 20260228 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' UNION ALL SELECT COUNT(*) AS cnt FROM hive.database.table WHERE dt >= 20260301 AND pf = 'TG' AND group_id IN ('xxx','xxxx','xxxxx') AND media_type = 'document' ) t;

这个doris有什么配置能解决这个问题吗？是否能够不采用分批查询的方式，也能结果返回正常

2 Answers

两次查询的profile信息如下，是否能够不采用分批查询的方式，也能结果返回正常？：

全量查询的 profiles

MergedProfile:
     Fragments:
       Fragment 0:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 293.397us, max 293.397us, min 293.397us
           RESULT_SINK_OPERATOR(id=2147483647):
             CommonCounters:
                - ExecTime: avg 344.53us, max 344.53us, min 344.53us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
           AGGREGATION_OPERATOR(nereids_id=275)(id=4):
              - PlanInfo
                 - output: sum(cnt)[#22]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 119.755us, max 119.755us, min 119.755us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 15sec503ms, max 15sec503ms, min 15sec503ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 339.982us, max 339.982us, min 339.982us
           AGGREGATION_SINK_OPERATOR(nereids_id=275)(id=4):
             CommonCounters:
                - ExecTime: avg 144.218us, max 144.218us, min 144.218us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           AGGREGATION_OPERATOR(nereids_id=271)(id=3):
              - PlanInfo
                 - output: count(partial_count(*))[#21]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 65.204us, max 65.204us, min 65.204us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 15sec502ms, max 15sec502ms, min 15sec502ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 2(instance_num=1):
            - WaitWorkerTime: avg 3.984ms, max 3.984ms, min 3.984ms
           AGGREGATION_SINK_OPERATOR(nereids_id=271)(id=3):
             CommonCounters:
                - ExecTime: avg 1.551ms, max 1.551ms, min 1.551ms
                - InputRows: sum 72, avg 72, max 72, min 72
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=2):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 72, avg 72, max 72, min 72
                - ExecTime: avg 1.824ms, max 1.824ms, min 1.824ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - RowsProduced: sum 72, avg 72, max 72, min 72
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 15sec491ms, max 15sec491ms, min 15sec491ms
       Fragment 1:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 214.689us, max 448.618us, min 76.81us
           DATA_STREAM_SINK_OPERATOR(dest_id=2):
             CommonCounters:
                - ExecTime: avg 246.483us, max 714.200us, min 52.749us
                - InputRows: sum 72, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 3.00 KB, avg 42.00 B, max 64.00 B, min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
           AGGREGATION_OPERATOR(nereids_id=263)(id=1):
              - PlanInfo
                 - output: partial_count(*)[#20]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 72, avg 1, max 1, min 1
                - ExecTime: avg 33.848us, max 139.446us, min 18.923us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 72, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 13sec451ms, max 15sec502ms, min 10sec560ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 2.385ms, max 6.737ms, min 1.331ms
           AGGREGATION_SINK_OPERATOR(nereids_id=263)(id=1):
             CommonCounters:
                - ExecTime: avg 602.141us, max 4.147ms, min 175.262us
                - InputRows: sum 2.683K (2683), avg 37, max 64, min 15
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=0. nereids_id=251. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20250301), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=41702, totalFileSize=256267855359, scanRanges=41702
                 - partition=479/2114
                 - cardinality=1950321016, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 1
             CommonCounters:
                - BlocksProduced: sum 1.356K (1356), avg 18, max 30, min 10
                - ExecTime: avg 13sec448ms, max 15sec500ms, min 10sec556ms
                - MemoryUsage: sum 19.69 KB, avg 280.00 B, max 512.00 B, min 128.00 B
                - MemoryUsagePeak: sum 24.56 KB, avg 349.00 B, max 576.00 B, min 192.00 B
                - RowsProduced: sum 2.683K (2683), avg 37, max 64, min 15
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 12sec785ms, max 14sec895ms, min 9sec821ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 7.09 GB, avg 100.83 MB, max 142.35 MB, min 59.05 MB
                - ScanRows: sum 4.537481522B (4537481522), avg 63.020576M (63020576), max 86.10864M (86108640), min 36.746143M (36746143)

分批查询的profile信息

MergedProfile:
     Fragments:
       Fragment 0:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 150.703us, max 150.703us, min 150.703us
           RESULT_SINK_OPERATOR(id=2147483647):
             CommonCounters:
                - ExecTime: avg 288.713us, max 288.713us, min 288.713us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
           AGGREGATION_OPERATOR(nereids_id=1149)(id=28):
              - PlanInfo
                 - output: sum(partial_sum(cnt))[#112]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 74.217us, max 74.217us, min 74.217us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 35sec742ms, max 35sec742ms, min 35sec742ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 236.435us, max 236.435us, min 236.435us
           AGGREGATION_SINK_OPERATOR(nereids_id=1149)(id=28):
             CommonCounters:
                - ExecTime: avg 209.504us, max 209.504us, min 209.504us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=27):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 69.32us, max 69.32us, min 69.32us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 35sec742ms, max 35sec742ms, min 35sec742ms
       Fragment 1:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 180.667us, max 180.667us, min 180.667us
           DATA_STREAM_SINK_OPERATOR(dest_id=27):
             CommonCounters:
                - ExecTime: avg 85.614us, max 85.614us, min 85.614us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
           AGGREGATION_OPERATOR(nereids_id=1141)(id=26):
              - PlanInfo
                 - output: partial_sum(cnt)[#111]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 35.742us, max 35.742us, min 35.742us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 35sec742ms, max 35sec742ms, min 35sec742ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 345.988us, max 345.988us, min 345.988us
           AGGREGATION_SINK_OPERATOR(nereids_id=1141)(id=26):
             CommonCounters:
                - ExecTime: avg 257.50us, max 257.50us, min 257.50us
                - InputRows: sum 5, avg 5, max 5, min 5
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           UNION_OPERATOR(nereids_id=1137)(id=25):
              - PlanInfo
                 - 
             CommonCounters:
                - BlocksProduced: sum 5, avg 5, max 5, min 5
                - ExecTime: avg 49.363us, max 49.363us, min 49.363us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 5, avg 5, max 5, min 5
                - WaitForDependency[UNION_OPERATOR_DEPENDENCY]Time: avg 35sec742ms, max 35sec742ms, min 35sec742ms
             CustomCounters:
         Pipeline 2(instance_num=1):
            - WaitWorkerTime: avg 205.393us, max 205.393us, min 205.393us
           UNION_SINK_OPERATOR(nereids_id=1137)(id=25):
             CommonCounters:
                - ExecTime: avg 92.322us, max 92.322us, min 92.322us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[UNION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
           EXCHANGE_OPERATOR(id=4):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 73.756us, max 73.756us, min 73.756us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 51.00 B, avg 51.00 B, max 51.00 B, min 51.00 B
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 25sec504ms, max 25sec504ms, min 25sec504ms
         Pipeline 3(instance_num=1):
            - WaitWorkerTime: avg 333.559us, max 333.559us, min 333.559us
           UNION_SINK_OPERATOR(nereids_id=1137)(id=25):
             CommonCounters:
                - ExecTime: avg 36.487us, max 36.487us, min 36.487us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[UNION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
           EXCHANGE_OPERATOR(id=9):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 52.447us, max 52.447us, min 52.447us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 51.00 B, avg 51.00 B, max 51.00 B, min 51.00 B
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 30sec184ms, max 30sec184ms, min 30sec184ms
         Pipeline 4(instance_num=1):
            - WaitWorkerTime: avg 380.936us, max 380.936us, min 380.936us
           UNION_SINK_OPERATOR(nereids_id=1137)(id=25):
             CommonCounters:
                - ExecTime: avg 55.973us, max 55.973us, min 55.973us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[UNION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
           EXCHANGE_OPERATOR(id=14):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 63.593us, max 63.593us, min 63.593us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 4.00 KB, avg 4.00 KB, max 4.00 KB, min 4.00 KB
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 31sec197ms, max 31sec197ms, min 31sec197ms
         Pipeline 5(instance_num=1):
            - WaitWorkerTime: avg 402.465us, max 402.465us, min 402.465us
           UNION_SINK_OPERATOR(nereids_id=1137)(id=25):
             CommonCounters:
                - ExecTime: avg 95.251us, max 95.251us, min 95.251us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[UNION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
           EXCHANGE_OPERATOR(id=19):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 62.998us, max 62.998us, min 62.998us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 51.00 B, avg 51.00 B, max 51.00 B, min 51.00 B
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 35sec742ms, max 35sec742ms, min 35sec742ms
         Pipeline 6(instance_num=1):
            - WaitWorkerTime: avg 193.351us, max 193.351us, min 193.351us
           UNION_SINK_OPERATOR(nereids_id=1137)(id=25):
             CommonCounters:
                - ExecTime: avg 56.828us, max 56.828us, min 56.828us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[UNION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
           EXCHANGE_OPERATOR(id=24):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 65.762us, max 65.762us, min 65.762us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 51.00 B, avg 51.00 B, max 51.00 B, min 51.00 B
                - RowsProduced: sum 1, avg 1, max 1, min 1
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 30sec158ms, max 30sec158ms, min 30sec158ms
       Fragment 2:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 324.18us, max 324.18us, min 324.18us
           DATA_STREAM_SINK_OPERATOR(dest_id=24):
             CommonCounters:
                - ExecTime: avg 261.899us, max 261.899us, min 261.899us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 2, avg 2, max 2, min 2
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 615.890us, max 615.890us, min 615.890us
           AGGREGATION_OPERATOR(nereids_id=1129)(id=23):
              - PlanInfo
                 - output: count(partial_count(*))[#109]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 47.902us, max 47.902us, min 47.902us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 30sec157ms, max 30sec157ms, min 30sec157ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 4.784ms, max 4.784ms, min 4.784ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1129)(id=23):
             CommonCounters:
                - ExecTime: avg 823.342us, max 823.342us, min 823.342us
                - InputRows: sum 72, avg 72, max 72, min 72
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=22):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 72, avg 72, max 72, min 72
                - ExecTime: avg 1.482ms, max 1.482ms, min 1.482ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 115.00 B, avg 115.00 B, max 115.00 B, min 115.00 B
                - RowsProduced: sum 72, avg 72, max 72, min 72
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 30sec147ms, max 30sec147ms, min 30sec147ms
       Fragment 3:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 221.216us, max 4.56ms, min 59.2us
           DATA_STREAM_SINK_OPERATOR(dest_id=22):
             CommonCounters:
                - ExecTime: avg 256.848us, max 1.981ms, min 52.30us
                - InputRows: sum 72, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 3.00 KB, avg 42.00 B, max 64.00 B, min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 19.276ms, max 26.55ms, min 12.497ms
           AGGREGATION_OPERATOR(nereids_id=1121)(id=21):
              - PlanInfo
                 - output: partial_count(*)[#108]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 72, avg 1, max 1, min 1
                - ExecTime: avg 51.508us, max 1.389ms, min 21.441us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 72, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 27sec4ms, max 30sec156ms, min 25sec331ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 26.632ms, max 896.8ms, min 971.501us
           AGGREGATION_SINK_OPERATOR(nereids_id=1121)(id=21):
             CommonCounters:
                - ExecTime: avg 664.696us, max 4.186ms, min 112.462us
                - InputRows: sum 1.076K (1076), avg 14, max 31, min 5
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=20. nereids_id=1109. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20260301), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=11400, totalFileSize=58636576033, scanRanges=11400
                 - partition=114/2114
                 - cardinality=2086704934, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 17
             CommonCounters:
                - BlocksProduced: sum 530, avg 7, max 14, min 3
                - ExecTime: avg 26sec976ms, max 29sec259ms, min 25sec326ms
                - MemoryUsage: sum 41.13 KB, avg 584.00 B, max 960.00 B, min 256.00 B
                - MemoryUsagePeak: sum 41.81 KB, avg 594.00 B, max 960.00 B, min 256.00 B
                - RowsProduced: sum 1.076K (1076), avg 14, max 31, min 5
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 26sec492ms, max 29sec228ms, min 25sec185ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 4.12 GB, avg 58.57 MB, max 61.44 MB, min 56.55 MB
                - ScanRows: sum 4.641554462B (4641554462), avg 64.466034M (64466034), max 85.262931M (85262931), min 56.561742M (56561742)
       Fragment 4:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 820.725us, max 820.725us, min 820.725us
           DATA_STREAM_SINK_OPERATOR(dest_id=19):
             CommonCounters:
                - ExecTime: avg 251.624us, max 251.624us, min 251.624us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 2, avg 2, max 2, min 2
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 657.880us, max 657.880us, min 657.880us
           AGGREGATION_OPERATOR(nereids_id=1104)(id=18):
              - PlanInfo
                 - output: count(partial_count(*))[#87]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 36.123us, max 36.123us, min 36.123us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 35sec740ms, max 35sec740ms, min 35sec740ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 6.932ms, max 6.932ms, min 6.932ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1104)(id=18):
             CommonCounters:
                - ExecTime: avg 900.364us, max 900.364us, min 900.364us
                - InputRows: sum 66, avg 66, max 66, min 66
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=17):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 66, avg 66, max 66, min 66
                - ExecTime: avg 1.716ms, max 1.716ms, min 1.716ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 102.00 B, avg 102.00 B, max 102.00 B, min 102.00 B
                - RowsProduced: sum 66, avg 66, max 66, min 66
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 35sec726ms, max 35sec726ms, min 35sec726ms
       Fragment 5:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 146.871ms, max 935.536ms, min 67.533us
           DATA_STREAM_SINK_OPERATOR(dest_id=17):
             CommonCounters:
                - ExecTime: avg 228.348us, max 1.116ms, min 29.214us
                - InputRows: sum 66, avg 0, max 1, min 0
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 2.88 KB, avg 40.00 B, max 64.00 B, min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 18.924ms, max 21.628ms, min 16.219ms
           AGGREGATION_OPERATOR(nereids_id=1096)(id=16):
              - PlanInfo
                 - output: partial_count(*)[#86]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 66, avg 0, max 1, min 0
                - ExecTime: avg 35.314us, max 170.749us, min 15.303us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 66, avg 0, max 1, min 0
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 28sec203ms, max 35sec739ms, min 25sec515ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 156.655ms, max 940.7ms, min 616.222us
           AGGREGATION_SINK_OPERATOR(nereids_id=1096)(id=16):
             CommonCounters:
                - ExecTime: avg 367.258us, max 3.200ms, min 35.5us
                - InputRows: sum 202, avg 2, max 8, min 0
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=15. nereids_id=1084. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20251201), (dt <= 20260228), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=12100, totalFileSize=68303519396, scanRanges=12100
                 - partition=90/2114
                 - cardinality=2086704934, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 13
             CommonCounters:
                - BlocksProduced: sum 151, avg 2, max 5, min 0
                - ExecTime: avg 28sec192ms, max 35sec739ms, min 25sec517ms
                - MemoryUsage: sum 9.63 KB, avg 136.00 B, max 320.00 B, min 0.00 
                - MemoryUsagePeak: sum 9.94 KB, avg 141.00 B, max 320.00 B, min 0.00 
                - RowsProduced: sum 202, avg 2, max 8, min 0
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 27sec494ms, max 34sec777ms, min 24sec644ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 4.83 GB, avg 68.65 MB, max 70.35 MB, min 66.95 MB
                - ScanRows: sum 3.983071398B (3983071398), avg 55.320436M (55320436), max 64.069479M (64069479), min 46.681017M (46681017)
       Fragment 6:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 126.405us, max 126.405us, min 126.405us
           DATA_STREAM_SINK_OPERATOR(dest_id=14):
             CommonCounters:
                - ExecTime: avg 83.346us, max 83.346us, min 83.346us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
           AGGREGATION_OPERATOR(nereids_id=1079)(id=13):
              - PlanInfo
                 - output: count(partial_count(*))[#65]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 54.882us, max 54.882us, min 54.882us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 31sec196ms, max 31sec196ms, min 31sec196ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 3.743ms, max 3.743ms, min 3.743ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1079)(id=13):
             CommonCounters:
                - ExecTime: avg 1.73ms, max 1.73ms, min 1.73ms
                - InputRows: sum 72, avg 72, max 72, min 72
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=12):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 72, avg 72, max 72, min 72
                - ExecTime: avg 1.720ms, max 1.720ms, min 1.720ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - RowsProduced: sum 72, avg 72, max 72, min 72
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 31sec186ms, max 31sec186ms, min 31sec186ms
       Fragment 7:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 535.724ms, max 950.488ms, min 66.271us
           DATA_STREAM_SINK_OPERATOR(dest_id=12):
             CommonCounters:
                - ExecTime: avg 189.147us, max 470.46us, min 43.648us
                - InputRows: sum 72, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 3.00 KB, avg 42.00 B, max 64.00 B, min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
           AGGREGATION_OPERATOR(nereids_id=1071)(id=11):
              - PlanInfo
                 - output: partial_count(*)[#64]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 72, avg 1, max 1, min 1
                - ExecTime: avg 29.421us, max 55.482us, min 18.516us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 72, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 26sec608ms, max 30sec263ms, min 11sec10ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 544.215ms, max 952.353ms, min 883.689us
           AGGREGATION_SINK_OPERATOR(nereids_id=1071)(id=11):
             CommonCounters:
                - ExecTime: avg 205.371us, max 1.410ms, min 105.78us
                - InputRows: sum 1.15K (1150), avg 15, max 38, min 6
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=10. nereids_id=1059. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20250901), (dt <= 20251130), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=7640, totalFileSize=72926698291, scanRanges=7640
                 - partition=91/2114
                 - cardinality=2086704934, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 9
             CommonCounters:
                - BlocksProduced: sum 611, avg 8, max 15, min 5
                - ExecTime: avg 26sec599ms, max 30sec253ms, min 11sec814ms
                - MemoryUsage: sum 49.44 KB, avg 703.00 B, max 1.25 KB, min 256.00 B
                - MemoryUsagePeak: sum 50.25 KB, avg 714.00 B, max 1.25 KB, min 320.00 B
                - RowsProduced: sum 1.15K (1150), avg 15, max 38, min 6
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 26sec233ms, max 30sec231ms, min 10sec982ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 5.17 GB, avg 73.52 MB, max 84.02 MB, min 62.93 MB
                - ScanRows: sum 1.824156162B (1824156162), avg 25.335502M (25335502), max 28.73815M (28738150), min 22.107628M (22107628)
       Fragment 8:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 929.900ms, max 929.900ms, min 929.900ms
           DATA_STREAM_SINK_OPERATOR(dest_id=9):
             CommonCounters:
                - ExecTime: avg 223.681us, max 223.681us, min 223.681us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 2, avg 2, max 2, min 2
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 531.344us, max 531.344us, min 531.344us
           AGGREGATION_OPERATOR(nereids_id=1054)(id=8):
              - PlanInfo
                 - output: count(partial_count(*))[#43]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 31.33us, max 31.33us, min 31.33us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 29sec252ms, max 29sec252ms, min 29sec252ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 936.576ms, max 936.576ms, min 936.576ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1054)(id=8):
             CommonCounters:
                - ExecTime: avg 715.999us, max 715.999us, min 715.999us
                - InputRows: sum 72, avg 72, max 72, min 72
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=7):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 72, avg 72, max 72, min 72
                - ExecTime: avg 1.670ms, max 1.670ms, min 1.670ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 115.00 B, avg 115.00 B, max 115.00 B, min 115.00 B
                - RowsProduced: sum 72, avg 72, max 72, min 72
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 29sec240ms, max 29sec240ms, min 29sec240ms
       Fragment 9:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 688.510ms, max 949.938ms, min 115.202us
           DATA_STREAM_SINK_OPERATOR(dest_id=7):
             CommonCounters:
                - ExecTime: avg 203.904us, max 717.182us, min 48.959us
                - InputRows: sum 72, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 3.00 KB, avg 42.00 B, max 64.00 B, min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 14.234ms, max 14.855ms, min 13.613ms
           AGGREGATION_OPERATOR(nereids_id=1046)(id=6):
              - PlanInfo
                 - output: partial_count(*)[#42]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 72, avg 1, max 1, min 1
                - ExecTime: avg 30.365us, max 54.647us, min 19.250us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 72, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 27sec33ms, max 30sec135ms, min 9sec918ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 712.242ms, max 953.123ms, min 1.268ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1046)(id=6):
             CommonCounters:
                - ExecTime: avg 302.950us, max 881.789us, min 175.796us
                - InputRows: sum 3.942K (3942), avg 54, max 89, min 37
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=5. nereids_id=1034. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20250601), (dt <= 20250831), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=6630, totalFileSize=35576217595, scanRanges=6630
                 - partition=92/2114
                 - cardinality=2086704934, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 5
             CommonCounters:
                - BlocksProduced: sum 1.326K (1326), avg 18, max 30, min 14
                - ExecTime: avg 27sec8ms, max 30sec12ms, min 10sec807ms
                - MemoryUsage: sum 121.25 KB, avg 1.68 KB, max 2.19 KB, min 1.31 KB
                - MemoryUsagePeak: sum 122.19 KB, avg 1.70 KB, max 2.19 KB, min 1.31 KB
                - RowsProduced: sum 3.942K (3942), avg 54, max 89, min 37
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 26sec793ms, max 29sec253ms, min 9sec914ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 2.81 GB, avg 40.03 MB, max 44.81 MB, min 36.55 MB
                - ScanRows: sum 959.768197M (959768197), avg 13.330113M (13330113), max 15.543405M (15543405), min 11.751162M (11751162)
       Fragment 10:
         Pipeline 0(instance_num=1):
            - WaitWorkerTime: avg 894.605ms, max 894.605ms, min 894.605ms
           DATA_STREAM_SINK_OPERATOR(dest_id=4):
             CommonCounters:
                - ExecTime: avg 246.76us, max 246.76us, min 246.76us
                - InputRows: sum 1, avg 1, max 1, min 1
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 64.00 B, avg 64.00 B, max 64.00 B, min 64.00 B
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 2, avg 2, max 2, min 2
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 681.786us, max 681.786us, min 681.786us
           AGGREGATION_OPERATOR(nereids_id=1029)(id=3):
              - PlanInfo
                 - output: count(partial_count(*))[#21]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 1, avg 1, max 1, min 1
                - ExecTime: avg 32.226us, max 32.226us, min 32.226us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 1, avg 1, max 1, min 1
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 24sec607ms, max 24sec607ms, min 24sec607ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=1):
            - WaitWorkerTime: avg 907.366ms, max 907.366ms, min 907.366ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1029)(id=3):
             CommonCounters:
                - ExecTime: avg 57.282us, max 57.282us, min 57.282us
                - InputRows: sum 0, avg 0, max 0, min 0
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           EXCHANGE_OPERATOR(id=2):
              - PlanInfo
                 - offset: 0
             CommonCounters:
                - BlocksProduced: sum 0, avg 0, max 0, min 0
                - ExecTime: avg 83.917us, max 83.917us, min 83.917us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 0, avg 0, max 0, min 0
             CustomCounters:
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForData0: avg 24sec594ms, max 24sec594ms, min 24sec594ms
       Fragment 11:
         Pipeline 0(instance_num=72):
            - WaitWorkerTime: avg 733.388ms, max 949.972ms, min 211.626us
           DATA_STREAM_SINK_OPERATOR(dest_id=2):
             CommonCounters:
                - ExecTime: avg 218.577us, max 565.526us, min 26.769us
                - InputRows: sum 0, avg 0, max 0, min 0
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
                  - WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - BlocksProduced: sum 120, avg 1, max 2, min 1
                - OverallThroughput: sum 0.0 /sec, avg 0.0 /sec, max 0.0 /sec, min 0.0 /sec
                - RpcMaxTime: avg 23.759ms, max 27.883ms, min 19.636ms
           AGGREGATION_OPERATOR(nereids_id=1021)(id=1):
              - PlanInfo
                 - output: partial_count(*)[#20]
                 - group by: 
                 - sortByGroupKey:false
                 - cardinality=1
             CommonCounters:
                - BlocksProduced: sum 0, avg 0, max 0, min 0
                - ExecTime: avg 20.931us, max 102.114us, min 13.198us
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 0, avg 0, max 0, min 0
                - WaitForDependency[AGGREGATION_OPERATOR_DEPENDENCY]Time: avg 15sec666ms, max 24sec601ms, min 6sec511ms
             CustomCounters:
                - HashTableInputCount: sum 0, avg 0, max 0, min 0
                - HashTableSize: sum 0, avg 0, max 0, min 0
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
         Pipeline 1(instance_num=72):
            - WaitWorkerTime: avg 804.215ms, max 951.674ms, min 2.252ms
           AGGREGATION_SINK_OPERATOR(nereids_id=1021)(id=1):
             CommonCounters:
                - ExecTime: avg 74.624us, max 727.833us, min 36.19us
                - InputRows: sum 0, avg 0, max 0, min 0
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - WaitForDependency[AGGREGATION_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
             CustomCounters:
                - MemoryUsageHashTable: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsageSerializeKeyArena: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
           FILE_SCAN_OPERATOR (id=0. nereids_id=1009. table name = dwd_cont_media_info_d):
              - PlanInfo
                 - table: hive.database.table
                 - predicates: (dt >= 20250301), (dt <= 20250531), (pf = 'TG'), group_id IN ('xxx', 'xxxx', 'xxxxx'), (media_type = 'document')
                 - inputSplitNum=3932, totalFileSize=20824844044, scanRanges=3932
                 - partition=92/2114
                 - cardinality=2086704934, numNodes=3
                 - pushdown agg=NONE
                 - projections: 1
                 - project output tuple id: 1
             CommonCounters:
                - BlocksProduced: sum 0, avg 0, max 0, min 0
                - ExecTime: avg 15sec595ms, max 24sec596ms, min 6sec519ms
                - MemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - MemoryUsagePeak: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - RowsProduced: sum 0, avg 0, max 0, min 0
                - WaitForDependency[FILE_SCAN_OPERATOR_DEPENDENCY]Time: avg 15sec474ms, max 24sec581ms, min 6sec514ms
             CustomCounters:
                - RuntimeFilterInfo: sum , avg , max , min 
                - ScanBytes: sum 0.00 , avg 0.00 , max 0.00 , min 0.00 
                - ScanRows: sum 0, avg 0, max 0, min 0
tutu1

你需要贴完整的profile。 里面有plan的信息。 另外，需要提供一下版本。

____291
Related Questions
doris查询 CATALOG hive 数据，全量查询和分区分批查询总和数据量不一致
2 answers
doris 4.0.5疑似page cache bug
2 answers
SQL Error [1105] [HY000]: errCode =2, detailMessage= type UNSUPPORTED is unsupported for Nereids
2 answers
分区表查询延迟
1 answers
如何通过flink cdc来实时获取doris中的数据？
1 answers
升级Doris4.1 集群 doris_cluster 发生 Critical (default) 告警
2 answers