请问下,从2.0升级到2.1.10后,doris的性能变很差,datax导入任务一直卡在写入,查询效率也变慢了,我应该怎么排查问题?

Viewed 30

[INFO] 2025-07-21 03:04:37.855 +0000 - -> 2025-07-21 11:04:37.134 [job-0] INFO StandAloneJobContainerCommunicator - Total 118336 records, 38910607 bytes | Speed 1.71MB/s, 5452 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.018s | All Task WaitReaderTime 18.265s | Percentage 0.00%
[INFO] 2025-07-21 03:04:47.856 +0000 - -> 2025-07-21 11:04:47.135 [job-0] INFO StandAloneJobContainerCommunicator - Total 178400 records, 58681225 bytes | Speed 1.89MB/s, 6006 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.023s | All Task WaitReaderTime 27.437s | Percentage 0.00%
[INFO] 2025-07-21 03:04:57.857 +0000 - -> 2025-07-21 11:04:57.136 [job-0] INFO StandAloneJobContainerCommunicator - Total 242912 records, 79929739 bytes | Speed 2.03MB/s, 6451 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.028s | All Task WaitReaderTime 36.530s | Percentage 0.00%
[INFO] 2025-07-21 03:05:17.862 +0000 - -> 2025-07-21 11:05:17.137 [job-0] INFO StandAloneJobContainerCommunicator - Total 356192 records, 117341580 bytes | Speed 1.78MB/s, 5664 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.036s | All Task WaitReaderTime 54.966s | Percentage 0.00%
[INFO] 2025-07-21 03:05:27.863 +0000 - -> 2025-07-21 11:05:27.138 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 462.20KB/s, 1436 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:05:37.864 +0000 - -> 2025-07-21 11:05:37.139 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:05:47.865 +0000 - -> 2025-07-21 11:05:47.140 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:07.867 +0000 - -> 2025-07-21 11:06:07.141 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:17.869 +0000 - -> 2025-07-21 11:06:17.142 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:27.870 +0000 - -> 2025-07-21 11:06:27.144 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:37.872 +0000 - -> 2025-07-21 11:06:37.843 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:47.873 +0000 - -> 2025-07-21 11:06:47.844 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:06:57.874 +0000 - -> 2025-07-21 11:06:57.845 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:07:07.875 +0000 - -> 2025-07-21 11:07:07.846 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:07:17.877 +0000 - -> 2025-07-21 11:07:17.847 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%
[INFO] 2025-07-21 03:07:27.878 +0000 - -> 2025-07-21 11:07:27.848 [job-0] INFO StandAloneJobContainerCommunicator - Total 370560 records, 122074534 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.037s | All Task WaitReaderTime 57.173s | Percentage 0.00%

1 Answers
  1. 查看集群负载是否异常cpu 、 mem、io 这些
  2. show variables like "%parallel_fragment_exec_instance_num%"; 看看之前的并发是多少。然后将 parallel_pipeline_task_num 全局调整下。可能是并发太大。

或者您也可以加我主页微信我们一起看看