业务高峰期,并发大的时候查询很慢

Viewed 25

部署的是3台机器,每个16C64G机器都有1个FE和BE,每个表都是BUCKETS 24,数据量大概2000到3000万。
CPU和内存都是不高,只有带宽较其他时间很高,怀疑是BUCKETS过多导致带宽很高,减少BUCKETS可以解决问题吗?或者只部署一台机器,把一台机器的配置拉高。
I20260106 09:53:19.864423 22472 fragment_mgr.cpp:804] Query 4cdeeb0818774e42-8e304b3dc8510d1e start execution
I20260106 09:53:19.864509 23429 workload_group_manager.cpp:242]
Workload Group normal: mem limit: 16.94 GB, mem used: 9.01 GB, weighted mem limit: 15.03 GB, used ratio: 0.5995252673688773, query count: 41, query spill threshold: 375.44 MB
Query Memory Summary:
MemTracker Label=Query#Id=96eaaad50aa4107-91db2a4532d52642, Parent Label=-, Used=218.98 MB, SpillThreshold=375.44 MB, Peak=235.10 MB
MemTracker Label=Query#Id=6bf0dd31ca6441fb-ac888ea77eddf183, Parent Label=-, Used=62.25 MB, SpillThreshold=375.44 MB, Peak=151.59 MB
MemTracker Label=Query#Id=369d1e38d47843b1-9201d315d3cf433d, Parent Label=-, Used=225.91 MB, SpillThreshold=375.44 MB, Peak=237.14 MB
MemTracker Label=Query#Id=4b5dd7314bf34010-98845748c7a1b76d, Parent Label=-, Used=584.65 MB, SpillThreshold=375.44 MB, Peak=778.49 MB
MemTracker Label=Query#Id=68b7015f6cfa4279-bf10ea79efc5d917, Parent Label=-, Used=234.07 MB, SpillThreshold=375.44 MB, Peak=270.24 MB
MemTracker Label=Query#Id=7bc39c4f43e24415-9eb48af82b2a7ce7, Parent Label=-, Used=550.35 MB, SpillThreshold=375.44 MB, Peak=735.47 MB
MemTracker Label=Query#Id=ffc5219bfe344b6c-b870e1f2daa9e620, Parent Label=-, Used=505.83 MB, SpillThreshold=375.44 MB, Peak=693.80 MB
MemTracker Label=Query#Id=2f8098c46ed5402f-b11e556c53a0bcda, Parent Label=-, Used=272.41 MB, SpillThreshold=375.44 MB, Peak=360.03 MB
MemTracker Label=Query#Id=39aebb16ab9140cb-924b79d8912807f3, Parent Label=-, Used=205.73 MB, SpillThreshold=375.44 MB, Peak=233.26 MB
MemTracker Label=Query#Id=c30fd4ea5a904b44-8a80ce9250b55eaf, Parent Label=-, Used=505.47 MB, SpillThreshold=375.44 MB, Peak=621.36 MB
MemTracker Label=Query#Id=39e82b4aa9b84cdb-a7469a84a3ca0197, Parent Label=-, Used=4.00 KB, SpillThreshold=375.44 MB, Peak=157.21 MB
MemTracker Label=Query#Id=c8c2908c35fc4f61-bf57e4c7259ace40, Parent Label=-, Used=177.13 MB, SpillThreshold=375.44 MB, Peak=199.10 MB
MemTracker Label=Query#Id=f81bc226bbd54000-bd53cc276e242d8b, Parent Label=-, Used=547.20 MB, SpillThreshold=375.44 MB, Peak=734.20 MB
MemTracker Label=Query#Id=17af32aa8e1141bd-b2d8ad3d8cb1e436, Parent Label=-, Used=67.89 MB, SpillThreshold=375.44 MB, Peak=158.88 MB
MemTracker Label=Query#Id=b0d1856d9564442f-b7d340b0c0d6a2a2, Parent Label=-, Used=234.24 MB, SpillThreshold=375.44 MB, Peak=275.46 MB
MemTracker Label=Query#Id=df7c029897da4a52-8a80f79dfcaab69c, Parent Label=-, Used=63.22 MB, SpillThreshold=375.44 MB, Peak=168.76 MB
MemTracker Label=Query#Id=5a18cefa334d49eb-b4c918911794df4e, Parent Label=-, Used=1.05 MB, SpillThreshold=375.44 MB, Peak=1.14 MB
MemTracker Label=Query#Id=6f7af87deff848a8-a5700e4fe088d6df, Parent Label=-, Used=512.14 MB, SpillThreshold=375.44 MB, Peak=636.58 MB
MemTracker Label=Query#Id=6a20eaf252ec4cc1-b915a5646b4e6740, Parent Label=-, Used=508.17 MB, SpillThreshold=375.44 MB, Peak=652.67 MB
MemTracker Label=Query#Id=cb0a157736f04402-8246322486c53552, Parent Label=-, Used=602.62 KB, SpillThreshold=375.44 MB, Peak=721.19 KB
MemTracker Label=Query#Id=4cdeeb0818774e42-8e304b3dc8510d1e, Parent Label=-, Used=477.75 KB, SpillThreshold=375.44 MB, Peak=477.75 KB
MemTracker Label=Query#Id=7cfce48436544765-b56b9f487a8c23c2, Parent Label=-, Used=85.99 MB, SpillThreshold=375.44 MB, Peak=140.76 MB
MemTracker Label=Query#Id=a44fcd7070a746b3-90b9193b6a65f7ad, Parent Label=-, Used=66.69 MB, SpillThreshold=375.44 MB, Peak=152.34 MB
MemTracker Label=Query#Id=484bdf4abee24b32-873f1c88f0edcad4, Parent Label=-, Used=64.09 MB, SpillThreshold=375.44 MB, Peak=122.32 MB
MemTracker Label=Query#Id=babd8afe003e4d07-9b2ce975e19a72ca, Parent Label=-, Used=223.95 MB, SpillThreshold=375.44 MB, Peak=247.01 MB
MemTracker Label=Query#Id=bd3d995ed45149cb-946b35f240aa2532, Parent Label=-, Used=1.21 MB, SpillThreshold=375.44 MB, Peak=718.61 MB
MemTracker Label=Query#Id=75bc5b15af74252-955caf8355bc99f5, Parent Label=-, Used=552.21 MB, SpillThreshold=375.44 MB, Peak=820.44 MB
MemTracker Label=Query#Id=ba37ed0e1e4348e4-80f0329a9b0e55f9, Parent Label=-, Used=80.41 MB, SpillThreshold=375.44 MB, Peak=137.24 MB
MemTracker Label=Query#Id=3241a5b9bb084e7e-afc553c23ade4467, Parent Label=-, Used=258.12 MB, SpillThreshold=375.44 MB, Peak=271.64 MB
MemTracker Label=Query#Id=11d2c9db84ff4ed8-9f0cc8cc819b139f, Parent Label=-, Used=106.73 MB, SpillThreshold=375.44 MB, Peak=265.73 MB
MemTracker Label=Query#Id=7dc03b0586cb4902-ba6613b5ff66cd26, Parent Label=-, Used=219.42 MB, SpillThreshold=375.44 MB, Peak=262.24 MB
MemTracker Label=Query#Id=d5c96f3c309c4ba2-af51bc3926f9d530, Parent Label=-, Used=287.16 MB, SpillThreshold=375.44 MB, Peak=301.50 MB
MemTracker Label=Query#Id=97922af1f0f141bb-950e5eb741c1d798, Parent Label=-, Used=63.26 MB, SpillThreshold=375.44 MB, Peak=152.11 MB
MemTracker Label=Query#Id=7223a7802bd948bf-b2a414fadacaceca, Parent Label=-, Used=274.29 MB, SpillThreshold=375.44 MB, Peak=358.87 MB
MemTracker Label=Query#Id=e7ce1365f9614e72-a7ccd7b79955266c, Parent Label=-, Used=580.04 MB, SpillThreshold=375.44 MB, Peak=784.92 MB
MemTracker Label=Query#Id=50c42740e7244ae8-b36739a981372cbc, Parent Label=-, Used=63.36 MB, SpillThreshold=375.44 MB, Peak=153.73 MB
MemTracker Label=Query#Id=7d44392b53594815-a6f7c186918ae308, Parent Label=-, Used=76.01 MB, SpillThreshold=375.44 MB, Peak=171.11 MB
MemTracker Label=Query#Id=40dc21da0711488b-aa6fabe497e844d3, Parent Label=-, Used=130.24 MB, SpillThreshold=375.44 MB, Peak=192.32 MB
MemTracker Label=Query#Id=14375a637ea64a57-86f54397f7304a43, Parent Label=-, Used=53.23 MB, SpillThreshold=375.44 MB, Peak=172.87 MB
MemTracker Label=Query#Id=901f799d4b7847b0-ace3b93a9be4192b, Parent Label=-, Used=56.96 MB, SpillThreshold=375.44 MB, Peak=134.67 MB
MemTracker Label=Query#Id=14dd0f5a74b34374-9cac616b3690547d, Parent Label=-, Used=507.34 MB, SpillThreshold=375.44 MB, Peak=764.23 MB
I20260106 09:53:19.970136 22481 tablets_channel.cpp:136] open tablets channel (load_id=cd4351c8cbc965af-bf41e44d9f22db80, index_id=32847928), tablets num: 8 timeout(s): 259200
I20260106 09:53:19.970446 22481 tablets_channel.cpp:165] txn 53981897: TabletsChannel of index 32847928 init senders 1 with incremental off
W20260106 09:53:20.014194 23154 ref_count_closure.h:119] RPC meet error status: [INVALID_ARGUMENT]PStatus: (172.16.100.45)[INVALID_ARGUMENT]query-id: 97922af1f0f141bb-950e5eb741c1d798

0 Answers