Workload Group 不生效

Viewed 6

4.0.2 版本中 的 Workload Group 设置不生效,我通过

-- alter workload group normal properties('min_cpu_percent'='30%');
-- alter workload group normal properties('max_cpu_percent'='30%');
-- alter workload group normal properties('min_memory_percent'='30%');
-- alter workload group normal properties('max_memory_percent'='30%');

设置了normal的资源限制,但是在四台4核16G的机器上,内存看起来并不正常image.png
但是最终因为内存报错了,报错日志:

errCode = 2, detailMessage = (192.168.126.76)[MEM_LIMIT_EXCEEDED]PreCatch error code:11, [E11] Allocator sys memory check failed: Cannot alloc:8.50 GB, consuming tracker:, peak used 8.25 GB, current used 6.12 GB, reserved 0, exec node:, sys physical memory 15.25 GB. process memory used 7.67 GB(= 7.67 GB[vm/rss] + 0[reserved] + 0B[waiting_refresh]), limit 13.72 GB, soft limit 12.35 GB. sys available memory 7.18 GB(= 7.18 GB[proc/available] - 0[reserved] - 0B[waiting_refresh]), low water mark 780.78 MB, warning water mark 1.52 GB.
Alloc Stacktrace:

0# doris::Allocator::sys_memory_exceed(unsigned long, std::__cxx11::basic_string, std::allocator >*) const at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/basic_string.h:2462
1# doris::Allocator::sys_memory_check(unsigned long) const at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:132
2# doris::Allocator::alloc(unsigned long, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:247
3# phmap::priv::raw_hash_set >, HashCRC32 >, doris::EqualTo >, doris::vectorized::Allocator_ > >::resize(unsigned long) at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1984
4# phmap::priv::raw_hash_set >, HashCRC32 >, doris::EqualTo >, doris::vectorized::Allocator_ > >::prepare_insert(unsigned long) at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2199
5# doris::vectorized::AggregateFunctionUniq<(doris::PrimitiveType)10, doris::vectorized::AggregateFunctionUniqExactData<(doris::PrimitiveType)10> >::add_batch(unsigned long, char**, unsigned long, doris::vectorized::IColumn const**, doris::vectorized::Arena&, bool) const at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2218
6# doris::vectorized::AggregateFunctionNullUnaryInline >, false>::add_batch(unsigned long, char**, unsigned long, doris::vectorized::IColumn const**, doris::vectorized::Arena&, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/vec/aggregate_functions/aggregate_function_null.h:306
7# doris::vectorized::AggFnEvaluator::execute_batch_add(doris::vectorized::Block*, unsigned long, char**, doris::vectorized::Arena&, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:369
8# doris::pipeline::AggSinkLocalState::_execute_with_serialized_key_helper(doris::vectorized::Block*)::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
9# doris::Status doris::pipeline::AggSinkLocalState::_execute_with_serialized_key_helper(doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
10# doris::pipeline::AggSinkLocalState::_execute_with_serialized_key(doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/runtime/thread_context.h:302
11# doris::pipeline::AggSinkLocalState::Executor::execute(doris::pipeline::AggSinkLocalState*, doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/aggregation_sink_operator.h:63
12# doris::pipeline::AggSinkOperatorX::sink(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
13# doris::pipeline::PipelineTask::execute(bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/pipeline_task.cpp:599
14# doris::pipeline::TaskScheduler::_do_work(int) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/task_scheduler.cpp:153
15# doris::ThreadPool::dispatch_thread() at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:1097
16# doris::Thread::supervise_thread(void*) at /usr/local/ldb-toolchain-v0.26/bin/../usr/include/pthread.h:562
17# start_thread
18# __clone


0# doris::Exception::Exception(int, std::basic_string_view > const&, bool) at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/unique_ptr.h:193
1# doris::Exception::Exception(int, std::basic_string_view > const&) at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/basic_string.h:239
2# doris::Allocator::sys_memory_check(unsigned long) const at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:179
3# doris::Allocator::alloc(unsigned long, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:247
4# phmap::priv::raw_hash_set >, HashCRC32 >, doris::EqualTo >, doris::vectorized::Allocator_ > >::resize(unsigned long) at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:1984
5# phmap::priv::raw_hash_set >, HashCRC32 >, doris::EqualTo >, doris::vectorized::Allocator_ > >::prepare_insert(unsigned long) at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2199
6# doris::vectorized::AggregateFunctionUniq<(doris::PrimitiveType)10, doris::vectorized::AggregateFunctionUniqExactData<(doris::PrimitiveType)10> >::add_batch(unsigned long, char**, unsigned long, doris::vectorized::IColumn const**, doris::vectorized::Arena&, bool) const at /home/zcp/repo_center/doris_release/doris/thirdparty/installed/include/parallel_hashmap/phmap.h:2218
7# doris::vectorized::AggregateFunctionNullUnaryInline >, false>::add_batch(unsigned long, char**, unsigned long, doris::vectorized::IColumn const**, doris::vectorized::Arena&, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/vec/aggregate_functions/aggregate_function_null.h:306
8# doris::vectorized::AggFnEvaluator::execute_batch_add(doris::vectorized::Block*, unsigned long, char**, doris::vectorized::Arena&, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:369
9# doris::pipeline::AggSinkLocalState::_execute_with_serialized_key_helper(doris::vectorized::Block*)::{lambda()#1}::operator()() const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
10# doris::Status doris::pipeline::AggSinkLocalState::_execute_with_serialized_key_helper(doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
11# doris::pipeline::AggSinkLocalState::_execute_with_serialized_key(doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/runtime/thread_context.h:302
12# doris::pipeline::AggSinkLocalState::Executor::execute(doris::pipeline::AggSinkLocalState*, doris::vectorized::Block*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/aggregation_sink_operator.h:63
13# doris::pipeline::AggSinkOperatorX::sink(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
14# doris::pipeline::PipelineTask::execute(bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/pipeline_task.cpp:599
15# doris::pipeline::TaskScheduler::_do_work(int) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/task_scheduler.cpp:153
16# doris::ThreadPool::dispatch_thread() at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:1097
17# doris::Thread::supervise_thread(void*) at /usr/local/ldb-toolchain-v0.26/bin/../usr/include/pthread.h:562
18# start_thread
19# __clone
, __FILE__:/home/zcp/repo_center/doris_release/doris/be/src/pipeline/task_scheduler.cpp, __LINE__:170, __FUNCTION__:void doris::pipeline::TaskScheduler::_do_work(int)

不清楚是达到什么参数限制了。
想了解参数配置是否正确

0 Answers