求助!x2doris同步经常中断

Viewed 4

x2doris从doris同步到doris,doris版本是2.1.8,x2doris版本是selectdb-x2doris-1.0.5_2.12。
在同步一张几千万行的表时,经常同步一段时间后就会中断,试了很多次都是这样。调整过写入批次数量也不行
有时偶尔也能同步成功

x2doris报错:

2025-09-13 15:31:01 |INFO | launcher-proc-23 | org.apache.spark.launcher.app.huaneng_group_new.group_private_data:64] com.selectdb.x2doris.shaded.org.apache.thrift.protocol.TProtocolException: Required field 'status_code' was not present! Struct: TStatus(status_code:null, error_msgs:[(192.168.200.110)[E-230]missed_versions is empty, spec_version 42768, max_version 42826, tablet_id 11037])
4556
2025-09-13 15:31:01 |INFO | launcher-proc-23 | org.apache.spark.launcher.app.huaneng_group_new.group_private_data:64] at com.selectdb.x2doris.connector.doris.thrift.TStatus.validate(TStatus.java:390)
4557
2025-09-13 15:31:01 |INFO | launcher-proc-23 | org.apache.spark.launcher.app.huaneng_group_new.group_private_data:64] at com.selectdb.x2doris.connector.doris.thrift.TStatus$TStatusStandardScheme.read(TStatus.java:463)
4558
2025-09-13 15:31:01 |INFO | launcher-proc-23 | org.apache.spark.launcher.app.huaneng_group_new.group_private_data:64] at com.selectdb.x2doris.connector.doris.thrift.TStatus$TStatusStandardScheme.read(TStatus.java:417)
4559
2025-09-13 15:31:01 |INFO | launcher-proc-23 | org.apache.spark.launcher.app.huaneng_group_new.group_private_data:64] at com.selectdb.x2doris.connector.doris.thrift.TStatus.read(TStatus.java:354)

报错be的日志:

W20250913 15:31:01.368898 311927 status.h:415] meet error status: [INTERNAL_ERROR]fail to find path in version_graph. spec_version: 0-42768

        0#  doris::VersionGraph::capture_consistent_versions(doris::Version const&, std::vector<doris::Version, std::allocator<doris::Versi
on> >*) const at /home/zcp/repo_center/doris_release/doris/be/src/olap/version_graph.cpp:627
        1#  doris::TimestampedVersionTracker::capture_consistent_versions(doris::Version const&, std::vector<doris::Version, std::allocator
<doris::Version> >*) const at /home/zcp/repo_center/doris_release/doris/be/src/olap/version_graph.cpp:330
        2#  doris::Tablet::capture_consistent_versions(doris::Version const&, std::vector<doris::Version, std::allocator<doris::Version> >*
, bool, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        3#  doris::Tablet::capture_rs_readers(doris::Version const&, std::vector<doris::RowSetSplits, std::allocator<doris::RowSetSplits> >
*, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        4#  doris::vectorized::NewOlapScanner::init() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        5#  doris::vectorized::ScannerScheduler::_scanner_scan(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:380
        6#  std::_Function_handler<void (), doris::vectorized::ScannerScheduler::submit(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>)::$_1::operator()() const::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
        7#  doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
        8#  doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562
        9#  ?
        10# __clone
W20250913 15:31:01.369002 311927 tablet.cpp:966] tablet:11037, version already has been merged. spec_version: [0-42768], max_version: [42826-42826]
W20250913 15:31:01.369035 311927 status.h:415] meet error status: [E-230]missed_versions is empty, spec_version 42768, max_version 42826, tablet_id 11037


        0#  doris::Tablet::capture_consistent_versions(doris::Version const&, std::vector<doris::Version, std::allocator<doris::Version> >*, bool, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:380
        1#  doris::Tablet::capture_rs_readers(doris::Version const&, std::vector<doris::RowSetSplits, std::allocator<doris::RowSetSplits> >*, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        2#  doris::vectorized::NewOlapScanner::init() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        3#  doris::vectorized::ScannerScheduler::_scanner_scan(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:380
        4#  std::_Function_handler<void (), doris::vectorized::ScannerScheduler::submit(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>)::$_1::operator()() const::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
        5#  doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
        6#  doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562
        7#  ?
        8#  __clone
W20250913 15:31:01.369052 311927 new_olap_scanner.cpp:191] fail to init reader.res=[E-230]missed_versions is empty, spec_version 42768, max_version 42826, tablet_id 11037

        0#  doris::Tablet::capture_consistent_versions(doris::Version const&, std::vector<doris::Version, std::allocator<doris::Version> >*, bool, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:380
        1#  doris::Tablet::capture_rs_readers(doris::Version const&, std::vector<doris::RowSetSplits, std::allocator<doris::RowSetSplits> >*, bool) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        2#  doris::vectorized::NewOlapScanner::init() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:494
        3#  doris::vectorized::ScannerScheduler::_scanner_scan(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:380
        4#  std::_Function_handler<void (), doris::vectorized::ScannerScheduler::submit(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>)::$_1::operator()() const::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:701
        5#  doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
        6#  doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562
        7#  ?
        8#  __clone
W20250913 15:31:01.369189 2192144 backend_service.cpp:868] fragment_instance_id [c74f12b09c93fc76-98da7bca57899d89] fetch result status [[E-230]missed_versions is empty, spec_version 42768, max_version 42826, tablet_id 11037


1 Answers

tablet_rowset_stale_sweep_time_sec 这个参数调高可以了。
请问这个是磁盘速度慢导致的吗?或者是local模式的x2doris导入太慢的原因?