routine load 订阅kafka阻塞

Viewed 7

doris-2.0.6 routine load阻塞,新数据不能入表,pause/resume job会报错,怀疑是特殊脏数据?
跳过2条数据之后才能正常插入,是不是已知bug?

2025-06-11 14:13:43,804 INFO (thrift-server-pool-14|260) [DatabaseTransactionMgr.abortTransaction():1405] abort transaction: TransactionState. transaction id: 18444056, label: 5687e8bf29354a3a-9d1d75eb2cc9b740, db id: 30760, table id list: 0, callback id: 2563016, coordinator: FE: 10.22.6.13, transaction status: ABORTED, error replicas num: 0, replica ids: , prepare time: 1749622423784, commit time: -1, finish time: 1749622423803, reason: [INTERNAL_ERROR]empty data

        0#  doris::io::MultiTablePipe::dispatch(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, char const*, unsigned long, doris::Status (doris::io::KafkaConsumerPipe::*)(char const*, unsigned long)) at /home/zcp/repo_center/doris_release/doris/be/src/io/fs/multi_table_pipe.cpp:133
        1#  doris::io::MultiTablePipe::append_json(char const*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/io/fs/multi_table_pipe.cpp:0
        2#  doris::KafkaDataConsumerGroup::start_all(std::shared_ptr<doris::StreamLoadContext>, std::shared_ptr<doris::io::KafkaConsumerPipe>) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:445
        3#  doris::RoutineLoadTaskExecutor::exec_task(std::shared_ptr<doris::StreamLoadContext>, doris::DataConsumerPool*, std::function<void (std::shared_ptr<doris::StreamLoadContext>)>) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
        4#  std::_Function_handler<void (), std::_Bind_result<void, void (doris::RoutineLoadTaskExecutor::*(doris::RoutineLoadTaskExecutor*, std::shared_ptr<doris::StreamLoadContext>, doris::DataConsumerPool*, doris::RoutineLoadTaskExecutor::submit_task(doris::TRoutineLoadTask const&)::$_0))(std::shared_ptr<doris::StreamLoadContext>, doris::DataConsumerPool*, std::function<void (std::shared_ptr<doris::StreamLoadContext>)>)> >::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:244
        5#  doris::WorkThreadPool<true>::work_thread(int) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/atomic_base.h:646
        6#  execute_native_thread_routine at /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:85
        7#  ?
        8#  clone
 attactment: RLTaskTxnCommitAttachment [filteredRows=0, loadedRows=0, unselectedRows=0, receivedBytes=0, taskExecutionTimeMs=0, taskId=TUniqueId(hi:6235208116845496890, lo:-7125409382501075136), jobId=2563016, progress=KafkaProgress [partitionIdToOffset=0_1002]] successfully
0 Answers