3.0.4 存算分离 K8S 部署 Operator 25.2.1 BE 无法启动

Viewed 22

第一次部署 apploy ddc.yaml 之后 BE 无法启动

我是之前升级失败,还在测试阶段所以准备重装,谈起看可能跟之前升级的报错很像:
https://doris-forum.org.cn/questions/D1Kv3/k8s-bu-shu-ddc-3-0-3-sheng-ji-3-0-4-be-yi-zhi-zhong-qi

BE日志如下,因为超长所以删掉了中间一部分,如需复现或完整日志可随时与我联系:
WX:【ljytsdzh】,谢谢!

oc get ddc -n hd-dev-doris-v1 dev-disaggregated-cluster 
NAME                        CLUSTERHEALTH   MSPHASE   FEPHASE   CGCOUNT   CGAVAILABLECOUNT   CGFULLAVAILABLECOUNT
dev-disaggregated-cluster   red             Ready     Ready     1     
[Mon Apr 28 14:52:49 CST 2025] [info] the host machine support avx2 instruction set.
[Mon Apr 28 14:52:49 CST 2025] [info] Process conf file be.conf ...
/opt/apache-doris/be_disaggregated_entrypoint.sh: line 73: /opt/apache-doris/be/conf/: Is a directory
[Mon Apr 28 14:52:50 CST 2025] [info] use root no password show backends result 1745822108833	dev-disaggregated-cluster-cg1-0.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local	9050	-1	-1	-1	-1	NULL	NULL	false	false	0	0.000 	0.000 	1.000 B	0.000 	0.00 %	0.00 %	0.000 	{"cloud_unique_id" : "1:1837630261:b5fjQdUP", "compute_group_status" : "NORMAL", "private_endpoint" : "", "compute_group_name" : "cg1", "location" : "default", "public_endpoint" : "", "compute_group_id" : "jyc94owj"}	java.net.UnknownHostException: dev-disaggregated-cluster-cg1-0.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local		{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false,"isActive":true,"currentFragmentNum":0,"lastFragmentUpdateTime":0}	3		1	0.00 
1745822108834	dev-disaggregated-cluster-cg1-1.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local	9050	-1	-1	-1	-1	NULL	NULL	false	false	0	0.000 	0.000 	1.000 B	0.000 	0.00 %	0.00 %	0.000 	{"cloud_unique_id" : "1:1837630261:sCIceL73", "compute_group_status" : "NORMAL", "private_endpoint" : "", "compute_group_name" : "cg1", "location" : "default", "public_endpoint" : "", "compute_group_id" : "jyc94owj"}	java.net.UnknownHostException: dev-disaggregated-cluster-cg1-1.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local		{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false,"isActive":true,"currentFragmentNum":0,"lastFragmentUpdateTime":0}	3		1	0.00 
1745822108835	dev-disaggregated-cluster-cg1-2.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local	9050	-1	-1	-1	-1	NULL	NULL	false	false	0	0.000 	0.000 	1.000 B	0.000 	0.00 %	0.00 %	0.000 	{"cloud_unique_id" : "1:1837630261:kbGbAfh4", "compute_group_status" : "NORMAL", "private_endpoint" : "", "compute_group_name" : "cg1", "location" : "default", "public_endpoint" : "", "compute_group_id" : "jyc94owj"}	java.net.UnknownHostException: dev-disaggregated-cluster-cg1-2.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local		{"lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false,"isActive":true,"currentFragmentNum":0,"lastFragmentUpdateTime":0}	3		1	0.00  .
[Mon Apr 28 14:52:50 CST 2025] [info] Check myself (dev-disaggregated-cluster-cg1-0.dev-disaggregated-cluster-cg1.hd-dev-doris-v1.svc.cluster.local:9050) exist in FE, start be directly ...
/etc/podinfo/annotationsis not exists.
[Mon Apr 28 14:52:50 CST 2025] run start_be.sh
StdoutLogger 2025-04-28 14:52:50,762 Start time: Mon Apr 28 14:52:50 CST 2025
RuntimeLogger I20250428 14:52:51.513200   138 doris_main.cpp:388]  version doris-3.0.4-rc02(AVX2) RELEASE (build git://vm-241@39f9074cec769a10a0a93658b35d16ce59630e1e)
Built on Fri, 21 Feb 2025 16:31:22 1Z by vm-241
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
RuntimeLogger I20250428 14:52:53.107558   138 doris_main.cpp:496] Doris backend JNI is initialized.
[WARNING!] /sys/kernel/mm/transparent_hugepage/enabled: [always] madvise never, Doris not recommend turning on THP, which may cause the BE process to use more memory and cannot be freed in time. Turn off THP: `echo madvise | sudo tee /sys/kernel/mm/transparent_hugepage/enabled`
RuntimeLogger I20250428 14:52:53.109813   138 mem_info.cpp:378] Physical Memory: 2164198039552, BE Available Physical Memory(consider cgroup): 53687091200, Mem Limit: 45.00 GB, origin config value: 90%, System Mem Available Min Reserve: 2.50 GB, Vm Min Free KBytes: 179.58 MB, Vm Overcommit Memory: 1
RuntimeLogger I20250428 14:52:53.109841   138 doris_main.cpp:514] Cpu Info:
  Model: Intel(R) Xeon(R) Gold 6330 CPU @ 2.00GHz
  Cores: 112
  Max Possible Cores: 112
  L1 Cache: 48.00 KB (Line: 64.00 B)
  L2 Cache: 1.25 MB (Line: 64.00 B)
  L3 Cache: 42.00 MB (Line: 64.00 B)
  Hardware Supports:
    ssse3
    sse4_1
    sse4_2
    popcnt
    avx
    avx2
  Numa Nodes: 2
  Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 | 7->0 | 8->0 | 9->0 | 10->0 | 11->0 | 12->0 | 13->0 | 14->0 | 15->0 | 16->0 | 17->0 | 18->0 | 19->0 | 20->0 | 21->0 | 22->0 | 23->0 | 24->0 | 25->0 | 26->0 | 27->0 | 28->1 | 29->1 | 30->1 | 31->1 | 32->1 | 33->1 | 34->1 | 35->1 | 36->1 | 37->1 | 38->1 | 39->1 | 40->1 | 41->1 | 42->1 | 43->1 | 44->1 | 45->1 | 46->1 | 47->1 | 48->1 | 49->1 | 50->1 | 51->1 | 52->1 | 53->1 | 54->1 | 55->1 | 56->0 | 57->0 | 58->0 | 59->0 | 60->0 | 61->0 | 62->0 | 63->0 | 64->0 | 65->0 | 66->0 | 67->0 | 68->0 | 69->0 | 70->0 | 71->0 | 72->0 | 73->0 | 74->0 | 75->0 | 76->0 | 77->0 | 78->0 | 79->0 | 80->0 | 81->0 | 82->0 | 83->0 | 84->1 | 85->1 | 86->1 | 87->1 | 88->1 | 89->1 | 90->1 | 91->1 | 92->1 | 93->1 | 94->1 | 95->1 | 96->1 | 97->1 | 98->1 | 99->1 | 100->1 | 101->1 | 102->1 | 103->1 | 104->1 | 105->1 | 106->1 | 107->1 | 108->1 | 109->1 | 110->1 | 111->1 |
RuntimeLogger I20250428 14:52:53.109869   138 doris_main.cpp:515] Disk Info: 
  Num disks 35: sdc, sda, sdb, sdd, dm-, loop, sde, sdf, sdg, sdh, sdi, sdj, sdk, sdl, sdm, sdn, sdo, sdp, sdq, sdr, sds, sdt, sdu, sdv, sdw, sdx, rbd, sdy, sdz, sdaa, sdab, sdac, sdad, sdae, sdaf
RuntimeLogger I20250428 14:52:53.109876   138 doris_main.cpp:516] Physical Memory: 53687091200
Memory Limt: 48318382080
CGroup Info: Process CGroup Memory Info (cgroups path: /sys/fs/cgroup, cgroup version: v2): memory limit: 53687091200, memory usage: 598421992
RuntimeLogger I20250428 14:52:53.110508   138 backend_options.cpp:62] local host ip=172.51.18.15
RuntimeLogger W20250428 14:52:53.213459   138 timezone_utils.cpp:98] Meet illegal tzdata file: iso3166.tab. skipped
RuntimeLogger W20250428 14:52:53.213631   138 timezone_utils.cpp:98] Meet illegal tzdata file: leap-seconds.list. skipped
RuntimeLogger W20250428 14:52:53.213655   138 timezone_utils.cpp:98] Meet illegal tzdata file: leapseconds. skipped
RuntimeLogger W20250428 14:52:53.214071   138 timezone_utils.cpp:98] Meet illegal tzdata file: tzdata.zi. skipped
RuntimeLogger W20250428 14:52:53.214092   138 timezone_utils.cpp:98] Meet illegal tzdata file: zone.tab. skipped
RuntimeLogger W20250428 14:52:53.214115   138 timezone_utils.cpp:98] Meet illegal tzdata file: zone1970.tab. skipped
RuntimeLogger W20250428 14:52:53.214135   138 timezone_utils.cpp:98] Meet illegal tzdata file: zonenow.tab. skipped
RuntimeLogger I20250428 14:52:53.214346   138 timezone_utils.cpp:115] Preloaded657 timezones.
RuntimeLogger I20250428 14:52:53.275337   138 cgroup_cpu_ctl.cpp:68] [cgroup_init_path]doris cgroup home path is not specify, if you not use workload group, you can ignore this log.
RuntimeLogger I20250428 14:52:53.275401   138 exec_env_init.cpp:362] pipeline executors_size set |size=112
RuntimeLogger I20250428 14:52:53.290024   138 task_scheduler.cpp:61] TaskScheduler set cores|size=112
RuntimeLogger I20250428 14:52:53.293148   416 fragment_mgr.cpp:976] FragmentMgr cancel worker start working.
RuntimeLogger I20250428 14:52:53.620013   138 load_path_mgr.cpp:67] Load path configured to []
RuntimeLogger I20250428 14:52:53.620066   460 result_buffer_mgr.cpp:192] result buffer manager cancel thread begin.
RuntimeLogger I20250428 14:52:53.651324   138 cache_manager.h:47] Register Cache DataPageCache
RuntimeLogger E20250428 14:52:53.651419   138 variable.cpp:179] Already exposed `doris_cache_data_page_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651459   138 variable.cpp:179] Already exposed `doris_cache_data_page_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651468   138 cache_manager.h:47] Register Cache IndexPageCache
RuntimeLogger E20250428 14:52:53.651527   138 variable.cpp:179] Already exposed `doris_cache_index_page_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651535   138 variable.cpp:179] Already exposed `doris_cache_index_page_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651540   138 cache_manager.h:47] Register Cache PKIndexPageCache
RuntimeLogger E20250428 14:52:53.651594   138 variable.cpp:179] Already exposed `doris_cache_pkindex_page_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651602   138 variable.cpp:179] Already exposed `doris_cache_pkindex_page_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651607   138 exec_env_init.cpp:476] Storage page cache memory limit: 9.00 GB, origin config value: 20%
RuntimeLogger I20250428 14:52:53.651620   138 cache_manager.h:47] Register Cache PointQueryRowCache
RuntimeLogger E20250428 14:52:53.651651   138 variable.cpp:179] Already exposed `doris_cache_point_query_row_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651657   138 variable.cpp:179] Already exposed `doris_cache_point_query_row_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651664   138 exec_env_init.cpp:489] Row cache memory limit: 9.00 GB, origin config value: 20%
RuntimeLogger I20250428 14:52:53.651669   138 cache_manager.h:47] Register Cache SegmentCache
RuntimeLogger E20250428 14:52:53.651687   138 variable.cpp:179] Already exposed `doris_cache_segment_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651693   138 variable.cpp:179] Already exposed `doris_cache_segment_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651700   138 exec_env_init.cpp:514] segment_cache_capacity <= fd_number * 1 / 5, fd_number: 1048576 segment_cache_capacity: 209700 min_segment_cache_mem_limit 2415919100
RuntimeLogger I20250428 14:52:53.651702   138 cache_manager.h:47] Register Cache SchemaCache
RuntimeLogger E20250428 14:52:53.651718   138 variable.cpp:179] Already exposed `doris_cache_schema_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651724   138 variable.cpp:179] Already exposed `doris_cache_schema_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651731   138 exec_env_init.cpp:522] max file reader cache size is: 349525, resource hard limit is: 1048576, config file_cache_max_file_reader_cache_size is: 1000000
RuntimeLogger I20250428 14:52:53.651733   138 cache_manager.h:47] Register Cache CommonObjLRUCache
RuntimeLogger E20250428 14:52:53.651747   138 variable.cpp:179] Already exposed `doris_cache_common_obj_lrucache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651752   138 variable.cpp:179] Already exposed `doris_cache_common_obj_lrucache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651760   138 cache_manager.h:47] Register Cache PointQueryLookupConnectionCache
RuntimeLogger E20250428 14:52:53.651774   138 variable.cpp:179] Already exposed `doris_cache_point_query_lookup_connection_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651780   138 variable.cpp:179] Already exposed `doris_cache_point_query_lookup_connection_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651786   138 inverted_index_cache.cpp:59] fd_number: 1048576, inverted index open searcher limit: 209715
RuntimeLogger I20250428 14:52:53.651790   138 cache_manager.h:47] Register Cache InvertedIndexSearcherCache
RuntimeLogger E20250428 14:52:53.651832   138 variable.cpp:179] Already exposed `doris_cache_inverted_index_searcher_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651840   138 variable.cpp:179] Already exposed `doris_cache_inverted_index_searcher_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651847   138 exec_env_init.cpp:543] Inverted index searcher cache memory limit: 4.50 GB, origin config value: 10%
RuntimeLogger I20250428 14:52:53.651859   138 cache_manager.h:47] Register Cache InvertedIndexQueryCache
RuntimeLogger E20250428 14:52:53.651902   138 variable.cpp:179] Already exposed `doris_cache_inverted_index_query_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651909   138 variable.cpp:179] Already exposed `doris_cache_inverted_index_query_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651916   138 exec_env_init.cpp:557] Inverted index query match cache memory limit: 4.50 GB, origin config value: 10%
RuntimeLogger I20250428 14:52:53.651919   138 cache_manager.h:47] Register Cache QueryCache
RuntimeLogger E20250428 14:52:53.651932   138 variable.cpp:179] Already exposed `doris_cache_query_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651937   138 variable.cpp:179] Already exposed `doris_cache_query_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.651942   138 exec_env_init.cpp:566] query cache memory limit: 512MB
RuntimeLogger I20250428 14:52:53.651949   138 cache_manager.h:47] Register Cache LastSuccessChannelCache
RuntimeLogger E20250428 14:52:53.651964   138 variable.cpp:179] Already exposed `doris_cache_last_success_channel_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.651970   138 variable.cpp:179] Already exposed `doris_cache_last_success_channel_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.652032   138 wal_manager.cpp:116] wal_dir:/opt/apache-doris/be/storage/wal, tmp_dir:/opt/apache-doris/be/storage/wal/tmp
RuntimeLogger I20250428 14:52:53.652349   138 cache_manager.h:47] Register Cache TabletSchemaCache
RuntimeLogger E20250428 14:52:53.652375   138 variable.cpp:179] Already exposed `doris_cache_tablet_schema_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.652387   138 variable.cpp:179] Already exposed `doris_cache_tablet_schema_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.652395   138 cache_manager.h:47] Register Cache TabletColumnObjectPool
RuntimeLogger E20250428 14:52:53.652413   138 variable.cpp:179] Already exposed `doris_cache_tablet_column_object_pool' whose value is `0'
RuntimeLogger E20250428 14:52:53.652419   138 variable.cpp:179] Already exposed `doris_cache_tablet_column_object_pool_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.652490   138 exec_env_init.cpp:634] The file deploy_mode doesn't exist, create it.
start BE in local mode
RuntimeLogger I20250428 14:52:53.652505   919 wal_manager.cpp:479] Sleep 1s to wait for storage engine init.
RuntimeLogger I20250428 14:52:53.652825   138 cache_manager.h:47] Register Cache MowTabletVersionCache
RuntimeLogger E20250428 14:52:53.652860   138 variable.cpp:179] Already exposed `doris_cache_mow_tablet_version_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.652873   138 variable.cpp:179] Already exposed `doris_cache_mow_tablet_version_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.652884   138 cache_manager.h:47] Register Cache CreateTabletRRIdxCache
RuntimeLogger E20250428 14:52:53.652897   138 variable.cpp:179] Already exposed `doris_cache_create_tablet_rridx_cache' whose value is `0'
RuntimeLogger E20250428 14:52:53.652904   138 variable.cpp:179] Already exposed `doris_cache_create_tablet_rridx_cache_persecond' whose value is `0'
RuntimeLogger I20250428 14:52:53.652915   138 storage_engine.cpp:200] starting backend using uid:f7401edbba981d07-0f333cd5cc6cf896
RuntimeLogger I20250428 14:52:53.653007   921 data_dir.cpp:856] path: /opt/apache-doris/be/storage total capacity: 958650499072, available capacity: 337133568000, usage: 0.648325, in_use: 0
RuntimeLogger I20250428 14:52:53.678179   921 data_dir.cpp:201] path: /opt/apache-doris/be/storage, hash: 9484523775432414062
RuntimeLogger I20250428 14:52:53.679198   921 olap_meta.cpp:73] [Rocksdb] RocksDB version: 5.14.2
RuntimeLogger I20250428 14:52:53.679210   921 olap_meta.cpp:73] [Rocksdb] Git sha rocksdb_build_git_sha:0525ed7d2851b762266956c97e33a961f36a8e47
RuntimeLogger I20250428 14:52:53.679239   921 olap_meta.cpp:73] [Rocksdb] Compile date Dec  6 2024
RuntimeLogger I20250428 14:52:53.679242   921 olap_meta.cpp:73] [Rocksdb] DB SUMMARY
RuntimeLogger I20250428 14:52:53.679250   921 olap_meta.cpp:73] [Rocksdb] [ERROR] Error when reading /opt/apache-doris/be/storage/meta dir
RuntimeLogger I20250428 14:52:53.679253   921 olap_meta.cpp:73] [Rocksdb] SST files in /opt/apache-doris/be/storage/meta dir, Total Num: 0, files: 
RuntimeLogger I20250428 14:52:53.679257   921 olap_meta.cpp:73] [Rocksdb] Write Ahead Log file in /opt/apache-doris/be/storage/meta: 
RuntimeLogger I20250428 14:52:53.679260   921 olap_meta.cpp:73] [Rocksdb]                         Options.error_if_exists: 0
RuntimeLogger I20250428 14:52:53.679263   921 olap_meta.cpp:73] [Rocksdb]                       Options.create_if_missing: 1
RuntimeLogger I20250428 14:52:53.679266   921 olap_meta.cpp:73] [Rocksdb]                         Options.paranoid_checks: 1
RuntimeLogger I20250428 14:52:53.679270   921 olap_meta.cpp:73] [Rocksdb]                                     Options.env: 0x55827e131520
RuntimeLogger I20250428 14:52:53.679272   921 olap_meta.cpp:73] [Rocksdb]                                Options.info_log: 0x7fbea7083380
RuntimeLogger I20250428 14:52:53.679275   921 olap_meta.cpp:73] [Rocksdb]                Options.max_file_opening_threads: 16
RuntimeLogger I20250428 14:52:53.679279   921 olap_meta.cpp:73] [Rocksdb]                              Options.statistics: (nil)
RuntimeLogger I20250428 14:52:53.679282   921 olap_meta.cpp:73] [Rocksdb]                               Options.use_fsync: 0
RuntimeLogger I20250428 14:52:53.679286   921 olap_meta.cpp:73] [Rocksdb]                       Options.max_log_file_size: 0
RuntimeLogger I20250428 14:52:53.679288   921 olap_meta.cpp:73] [Rocksdb]                  Options.max_manifest_file_size: 18446744073709551615
RuntimeLogger I20250428 14:52:53.679488   921 olap_meta.cpp:73] [Rocksdb] 	kBZip2Compression supported: 1
RuntimeLogger I20250428 14:52:53.679491   921 olap_meta.cpp:73] [Rocksdb] 	kZSTDNotFinalCompression supported: 1
RuntimeLogger I20250428 14:52:53.679495   921 olap_meta.cpp:73] [Rocksdb] 	kLZ4Compression supported: 1
RuntimeLogger I20250428 14:52:53.679498   921 olap_meta.cpp:73] [Rocksdb] 	kZlibCompression supported: 1
RuntimeLogger I20250428 14:52:53.679502   921 olap_meta.cpp:73] [Rocksdb] 	kLZ4HCCompression supported: 1
RuntimeLogger I20250428 14:52:53.679507   921 olap_meta.cpp:73] [Rocksdb] 	kSnappyCompression supported: 1
RuntimeLogger I20250428 14:52:53.679510   921 olap_meta.cpp:73] [Rocksdb] Fast CRC32 supported: Not supported on x86
RuntimeLogger I20250428 14:52:53.679598   921 olap_meta.cpp:73] [Rocksdb] [db/db_impl_open.cc:222] Creating manifest 1 
RuntimeLogger I20250428 14:52:53.680358   921 olap_meta.cpp:73] [Rocksdb] [db/version_set.cc:3084] Recovering from manifest file: MANIFEST-000001
RuntimeLogger I20250428 14:52:53.680397   921 olap_meta.cpp:73] [Rocksdb] [db/column_family.cc:473] --------------- Options for column family [default]:
RuntimeLogger I20250428 14:52:53.680404   921 olap_meta.cpp:73] [Rocksdb]               Options.comparator: leveldb.BytewiseComparator
RuntimeLogger I20250428 14:52:53.680408   921 olap_meta.cpp:73] [Rocksdb]           Options.merge_operator: None
RuntimeLogger I20250428 14:52:53.680413   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter: None
RuntimeLogger I20250428 14:52:53.680415   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter_factory: None
RuntimeLogger I20250428 14:52:53.680419   921 olap_meta.cpp:73] [Rocksdb]         Options.memtable_factory: SkipListFactory
RuntimeLogger I20250428 14:52:53.680423   921 olap_meta.cpp:73] [Rocksdb]            Options.table_factory: BlockBasedTable
RuntimeLogger I20250428 14:52:53.680444   921 olap_meta.cpp:73] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fbea7094008)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7fbea707b050
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
RuntimeLogger I20250428 14:52:53.680449   921 olap_meta.cpp:73] [Rocksdb]        Options.write_buffer_size: 67108864
RuntimeLogger I20250428 14:52:53.680451   921 olap_meta.cpp:73] [Rocksdb]  Options.max_write_buffer_number: 2
RuntimeLogger I20250428 14:52:53.680454   921 olap_meta.cpp:73] [Rocksdb]          Options.compression: Snappy
RuntimeLogger I20250428 14:52:53.680459   921 olap_meta.cpp:73] [Rocksdb]                  Options.bottommost_compression: Disabled
RuntimeLogger I20250428 14:52:53.680461   921 olap_meta.cpp:73] [Rocksdb]       Options.prefix_extractor: nullptr
RuntimeLogger I20250428 14:52:53.680480   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
RuntimeLogger I20250428 14:52:53.680482   921 olap_meta.cpp:73] [Rocksdb]             Options.num_levels: 7
RuntimeLogger I20250428 14:52:53.680485   921 olap_meta.cpp:73] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
RuntimeLogger I20250428 14:52:53.680490   921 olap_meta.cpp:73] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
RuntimeLogger I20250428 14:52:53.680492   921 olap_meta.cpp:73] [Rocksdb]            Options.compression_opts.window_bits: -14
RuntimeLogger I20250428 14:52:53.680496   921 olap_meta.cpp:73] [Rocksdb]                  Options.compression_opts.level: -1
RuntimeLogger I20250428 14:52:53.680500   921 olap_meta.cpp:73] [Rocksdb]               Options.compression_opts.strategy: 0
RuntimeLogger I20250428 14:52:53.680502   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
RuntimeLogger I20250428 14:52:53.680505   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
RuntimeLogger I20250428 14:52:53.680509   921 olap_meta.cpp:73] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
RuntimeLogger I20250428 14:52:53.680512   921 olap_meta.cpp:73] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
RuntimeLogger I20250428 14:52:53.680516   921 olap_meta.cpp:73] [Rocksdb]              Options.level0_stop_writes_trigger: 36
RuntimeLogger I20250428 14:52:53.680519   921 olap_meta.cpp:73] [Rocksdb]                   Options.target_file_size_base: 67108864
RuntimeLogger I20250428 14:52:53.680523   921 olap_meta.cpp:73] [Rocksdb]             Options.target_file_size_multiplier: 1
RuntimeLogger I20250428 14:52:53.680526   921 olap_meta.cpp:73] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
RuntimeLogger I20250428 14:52:53.680529   921 olap_meta.cpp:73] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
RuntimeLogger I20250428 14:52:53.680534   921 olap_meta.cpp:73] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
RuntimeLogger I20250428 14:52:53.680537   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
RuntimeLogger I20250428 14:52:53.680541   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
RuntimeLogger I20250428 14:52:53.680543   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
RuntimeLogger I20250428 14:52:53.680546   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
RuntimeLogger I20250428 14:52:53.680549   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
RuntimeLogger I20250428 14:52:53.680552   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
RuntimeLogger I20250428 14:52:53.680555   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
RuntimeLogger I20250428 14:52:53.680558   921 olap_meta.cpp:73] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
RuntimeLogger I20250428 14:52:53.680562   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
RuntimeLogger I20250428 14:52:53.680565   921 olap_meta.cpp:73] [Rocksdb]                        Options.arena_block_size: 8388608
RuntimeLogger I20250428 14:52:53.680568   921 olap_meta.cpp:73] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
RuntimeLogger I20250428 14:52:53.680572   921 olap_meta.cpp:73] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
RuntimeLogger I20250428 14:52:53.680574   921 olap_meta.cpp:73] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
RuntimeLogger I20250428 14:52:53.680577   921 olap_meta.cpp:73] [Rocksdb]                Options.disable_auto_compactions: 0
RuntimeLogger I20250428 14:52:53.680583   921 olap_meta.cpp:73] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
RuntimeLogger I20250428 14:52:53.680590   921 olap_meta.cpp:73] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
RuntimeLogger I20250428 14:52:53.680594   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
RuntimeLogger I20250428 14:52:53.680596   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
RuntimeLogger I20250428 14:52:53.680603   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
RuntimeLogger I20250428 14:52:53.680605   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
RuntimeLogger I20250428 14:52:53.680608   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
RuntimeLogger I20250428 14:52:53.680611   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
RuntimeLogger I20250428 14:52:53.680614   921 olap_meta.cpp:73] [Rocksdb] 
RuntimeLogger I20250428 14:52:53.680635   921 olap_meta.cpp:73] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
RuntimeLogger I20250428 14:52:53.680639   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_huge_page_size: 0
RuntimeLogger I20250428 14:52:53.680642   921 olap_meta.cpp:73] [Rocksdb]                           Options.bloom_locality: 0
RuntimeLogger I20250428 14:52:53.680645   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_successive_merges: 0
RuntimeLogger I20250428 14:52:53.680648   921 olap_meta.cpp:73] [Rocksdb]                Options.optimize_filters_for_hits: 0
RuntimeLogger I20250428 14:52:53.680651   921 olap_meta.cpp:73] [Rocksdb]                Options.paranoid_file_checks: 0
RuntimeLogger I20250428 14:52:53.680655   921 olap_meta.cpp:73] [Rocksdb]                Options.force_consistency_checks: 0
RuntimeLogger I20250428 14:52:53.680658   921 olap_meta.cpp:73] [Rocksdb]                Options.report_bg_io_stats: 0
RuntimeLogger I20250428 14:52:53.680661   921 olap_meta.cpp:73] [Rocksdb]                               Options.ttl: 0
RuntimeLogger I20250428 14:52:53.681633   921 olap_meta.cpp:73] [Rocksdb] [db/version_set.cc:3350] Recovered from manifest file:/opt/apache-doris/be/storage/meta/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
RuntimeLogger I20250428 14:52:53.681645   921 olap_meta.cpp:73] [Rocksdb] [db/version_set.cc:3367] Column family [default] (ID 0), log number is 0
RuntimeLogger I20250428 14:52:53.681728   921 olap_meta.cpp:73] [Rocksdb] [db/version_set.cc:2846] Creating manifest 4
RuntimeLogger I20250428 14:52:53.681854   921 olap_meta.cpp:73] [Rocksdb] [db/column_family.cc:473] --------------- Options for column family [doris]:
RuntimeLogger I20250428 14:52:53.681861   921 olap_meta.cpp:73] [Rocksdb]               Options.comparator: leveldb.BytewiseComparator
RuntimeLogger I20250428 14:52:53.681865   921 olap_meta.cpp:73] [Rocksdb]           Options.merge_operator: None
RuntimeLogger I20250428 14:52:53.681869   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter: None
RuntimeLogger I20250428 14:52:53.681874   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter_factory: None
RuntimeLogger I20250428 14:52:53.681888   921 olap_meta.cpp:73] [Rocksdb]         Options.memtable_factory: SkipListFactory
RuntimeLogger I20250428 14:52:53.681891   921 olap_meta.cpp:73] [Rocksdb]            Options.table_factory: BlockBasedTable
RuntimeLogger I20250428 14:52:53.681908   921 olap_meta.cpp:73] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fbea7094010)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7fbea707b0c0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
RuntimeLogger I20250428 14:52:53.681912   921 olap_meta.cpp:73] [Rocksdb]        Options.write_buffer_size: 67108864
RuntimeLogger I20250428 14:52:53.681915   921 olap_meta.cpp:73] [Rocksdb]  Options.max_write_buffer_number: 2
RuntimeLogger I20250428 14:52:53.681919   921 olap_meta.cpp:73] [Rocksdb]          Options.compression: Snappy
RuntimeLogger I20250428 14:52:53.681922   921 olap_meta.cpp:73] [Rocksdb]                  Options.bottommost_compression: Disabled
RuntimeLogger I20250428 14:52:53.681926   921 olap_meta.cpp:73] [Rocksdb]       Options.prefix_extractor: nullptr
RuntimeLogger I20250428 14:52:53.681928   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
RuntimeLogger I20250428 14:52:53.681932   921 olap_meta.cpp:73] [Rocksdb]             Options.num_levels: 7
RuntimeLogger I20250428 14:52:53.681936   921 olap_meta.cpp:73] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
RuntimeLogger I20250428 14:52:53.681939   921 olap_meta.cpp:73] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
RuntimeLogger I20250428 14:52:53.681942   921 olap_meta.cpp:73] [Rocksdb]            Options.compression_opts.window_bits: -14
RuntimeLogger I20250428 14:52:53.681946   921 olap_meta.cpp:73] [Rocksdb]                  Options.compression_opts.level: -1
RuntimeLogger I20250428 14:52:53.681949   921 olap_meta.cpp:73] [Rocksdb]               Options.compression_opts.strategy: 0
RuntimeLogger I20250428 14:52:53.681952   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
RuntimeLogger I20250428 14:52:53.681955   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
RuntimeLogger I20250428 14:52:53.681958   921 olap_meta.cpp:73] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
RuntimeLogger I20250428 14:52:53.681962   921 olap_meta.cpp:73] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
RuntimeLogger I20250428 14:52:53.681964   921 olap_meta.cpp:73] [Rocksdb]              Options.level0_stop_writes_trigger: 36
RuntimeLogger I20250428 14:52:53.681967   921 olap_meta.cpp:73] [Rocksdb]                   Options.target_file_size_base: 67108864
RuntimeLogger I20250428 14:52:53.681970   921 olap_meta.cpp:73] [Rocksdb]             Options.target_file_size_multiplier: 1
RuntimeLogger I20250428 14:52:53.681974   921 olap_meta.cpp:73] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
RuntimeLogger I20250428 14:52:53.681977   921 olap_meta.cpp:73] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
RuntimeLogger I20250428 14:52:53.681981   921 olap_meta.cpp:73] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
RuntimeLogger I20250428 14:52:53.681984   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
RuntimeLogger I20250428 14:52:53.681993   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
RuntimeLogger I20250428 14:52:53.681995   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
RuntimeLogger I20250428 14:52:53.681998   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
RuntimeLogger I20250428 14:52:53.682003   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
RuntimeLogger I20250428 14:52:53.682005   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
RuntimeLogger I20250428 14:52:53.682008   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
RuntimeLogger I20250428 14:52:53.682011   921 olap_meta.cpp:73] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
RuntimeLogger I20250428 14:52:53.682015   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
RuntimeLogger I20250428 14:52:53.682018   921 olap_meta.cpp:73] [Rocksdb]                        Options.arena_block_size: 8388608
RuntimeLogger I20250428 14:52:53.682022   921 olap_meta.cpp:73] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
RuntimeLogger I20250428 14:52:53.682025   921 olap_meta.cpp:73] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
RuntimeLogger I20250428 14:52:53.682029   921 olap_meta.cpp:73] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
RuntimeLogger I20250428 14:52:53.682032   921 olap_meta.cpp:73] [Rocksdb]                Options.disable_auto_compactions: 0
RuntimeLogger I20250428 14:52:53.682036   921 olap_meta.cpp:73] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
RuntimeLogger I20250428 14:52:53.682040   921 olap_meta.cpp:73] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
RuntimeLogger I20250428 14:52:53.682044   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
RuntimeLogger I20250428 14:52:53.682046   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
RuntimeLogger I20250428 14:52:53.682049   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
RuntimeLogger I20250428 14:52:53.682052   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
RuntimeLogger I20250428 14:52:53.682056   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
RuntimeLogger I20250428 14:52:53.682060   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
RuntimeLogger I20250428 14:52:53.682063   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824
RuntimeLogger I20250428 14:52:53.682066   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0
RuntimeLogger I20250428 14:52:53.682070   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.ttl: 0
RuntimeLogger I20250428 14:52:53.682072   921 olap_meta.cpp:73] [Rocksdb]                   Options.table_properties_collectors: 
RuntimeLogger I20250428 14:52:53.682075   921 olap_meta.cpp:73] [Rocksdb]                   Options.inplace_update_support: 0
RuntimeLogger I20250428 14:52:53.682078   921 olap_meta.cpp:73] [Rocksdb]                 Options.inplace_update_num_locks: 10000
RuntimeLogger I20250428 14:52:53.682082   921 olap_meta.cpp:73] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
RuntimeLogger I20250428 14:52:53.682085   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_huge_page_size: 0
RuntimeLogger I20250428 14:52:53.682088   921 olap_meta.cpp:73] [Rocksdb]                           Options.bloom_locality: 0
RuntimeLogger I20250428 14:52:53.682091   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_successive_merges: 0
RuntimeLogger I20250428 14:52:53.682107   921 olap_meta.cpp:73] [Rocksdb]                Options.optimize_filters_for_hits: 0
RuntimeLogger I20250428 14:52:53.682111   921 olap_meta.cpp:73] [Rocksdb]                Options.paranoid_file_checks: 0
RuntimeLogger I20250428 14:52:53.682113   921 olap_meta.cpp:73] [Rocksdb]                Options.force_consistency_checks: 0
RuntimeLogger I20250428 14:52:53.682116   921 olap_meta.cpp:73] [Rocksdb]                Options.report_bg_io_stats: 0
RuntimeLogger I20250428 14:52:53.682121   921 olap_meta.cpp:73] [Rocksdb]                               Options.ttl: 0
RuntimeLogger I20250428 14:52:53.682158   921 olap_meta.cpp:73] [Rocksdb] [db/db_impl.cc:1394] Created column family [doris] (ID 1)
RuntimeLogger I20250428 14:52:53.682869   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter: None
RuntimeLogger I20250428 14:52:53.682873   921 olap_meta.cpp:73] [Rocksdb]        Options.compaction_filter_factory: None
RuntimeLogger I20250428 14:52:53.682875   921 olap_meta.cpp:73] [Rocksdb]         Options.memtable_factory: SkipListFactory
RuntimeLogger I20250428 14:52:53.682878   921 olap_meta.cpp:73] [Rocksdb]            Options.table_factory: BlockBasedTable
RuntimeLogger I20250428 14:52:53.682889   921 olap_meta.cpp:73] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fbea7094018)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7fbea707b130
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
RuntimeLogger I20250428 14:52:53.682893   921 olap_meta.cpp:73] [Rocksdb]        Options.write_buffer_size: 67108864
RuntimeLogger I20250428 14:52:53.682896   921 olap_meta.cpp:73] [Rocksdb]  Options.max_write_buffer_number: 5
RuntimeLogger I20250428 14:52:53.682900   921 olap_meta.cpp:73] [Rocksdb]          Options.compression: Snappy
RuntimeLogger I20250428 14:52:53.682904   921 olap_meta.cpp:73] [Rocksdb]                  Options.bottommost_compression: Disabled
RuntimeLogger I20250428 14:52:53.682906   921 olap_meta.cpp:73] [Rocksdb]       Options.prefix_extractor: rocksdb.FixedPrefix.4
RuntimeLogger I20250428 14:52:53.682909   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
RuntimeLogger I20250428 14:52:53.682912   921 olap_meta.cpp:73] [Rocksdb]             Options.num_levels: 7
RuntimeLogger I20250428 14:52:53.682915   921 olap_meta.cpp:73] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
RuntimeLogger I20250428 14:52:53.682919   921 olap_meta.cpp:73] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
RuntimeLogger I20250428 14:52:53.682922   921 olap_meta.cpp:73] [Rocksdb]            Options.compression_opts.window_bits: -14
RuntimeLogger I20250428 14:52:53.682925   921 olap_meta.cpp:73] [Rocksdb]                  Options.compression_opts.level: -1
RuntimeLogger I20250428 14:52:53.682927   921 olap_meta.cpp:73] [Rocksdb]               Options.compression_opts.strategy: 0
RuntimeLogger I20250428 14:52:53.682940   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
RuntimeLogger I20250428 14:52:53.682945   921 olap_meta.cpp:73] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
RuntimeLogger I20250428 14:52:53.682947   921 olap_meta.cpp:73] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
RuntimeLogger I20250428 14:52:53.682950   921 olap_meta.cpp:73] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
RuntimeLogger I20250428 14:52:53.682953   921 olap_meta.cpp:73] [Rocksdb]              Options.level0_stop_writes_trigger: 36
RuntimeLogger I20250428 14:52:53.682956   921 olap_meta.cpp:73] [Rocksdb]                   Options.target_file_size_base: 67108864
RuntimeLogger I20250428 14:52:53.682960   921 olap_meta.cpp:73] [Rocksdb]             Options.target_file_size_multiplier: 1
RuntimeLogger I20250428 14:52:53.682961   921 olap_meta.cpp:73] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
RuntimeLogger I20250428 14:52:53.682965   921 olap_meta.cpp:73] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
RuntimeLogger I20250428 14:52:53.682968   921 olap_meta.cpp:73] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
RuntimeLogger I20250428 14:52:53.682971   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
RuntimeLogger I20250428 14:52:53.682974   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
RuntimeLogger I20250428 14:52:53.682977   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
RuntimeLogger I20250428 14:52:53.682981   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
RuntimeLogger I20250428 14:52:53.682983   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
RuntimeLogger I20250428 14:52:53.682986   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
RuntimeLogger I20250428 14:52:53.682989   921 olap_meta.cpp:73] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
RuntimeLogger I20250428 14:52:53.682992   921 olap_meta.cpp:73] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
RuntimeLogger I20250428 14:52:53.682996   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
RuntimeLogger I20250428 14:52:53.682998   921 olap_meta.cpp:73] [Rocksdb]                        Options.arena_block_size: 8388608
RuntimeLogger I20250428 14:52:53.683002   921 olap_meta.cpp:73] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
RuntimeLogger I20250428 14:52:53.683005   921 olap_meta.cpp:73] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
RuntimeLogger I20250428 14:52:53.683008   921 olap_meta.cpp:73] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
RuntimeLogger I20250428 14:52:53.683012   921 olap_meta.cpp:73] [Rocksdb]                Options.disable_auto_compactions: 0
RuntimeLogger I20250428 14:52:53.683014   921 olap_meta.cpp:73] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
RuntimeLogger I20250428 14:52:53.683017   921 olap_meta.cpp:73] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
RuntimeLogger I20250428 14:52:53.683020   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
RuntimeLogger I20250428 14:52:53.683023   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
RuntimeLogger I20250428 14:52:53.683027   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
RuntimeLogger I20250428 14:52:53.683030   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
RuntimeLogger I20250428 14:52:53.683033   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
RuntimeLogger I20250428 14:52:53.683036   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
RuntimeLogger I20250428 14:52:53.683043   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824
RuntimeLogger I20250428 14:52:53.683046   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0
RuntimeLogger I20250428 14:52:53.683049   921 olap_meta.cpp:73] [Rocksdb] Options.compaction_options_fifo.ttl: 0
RuntimeLogger I20250428 14:52:53.683053   921 olap_meta.cpp:73] [Rocksdb]                   Options.table_properties_collectors: 
RuntimeLogger I20250428 14:52:53.683055   921 olap_meta.cpp:73] [Rocksdb]                   Options.inplace_update_support: 0
RuntimeLogger I20250428 14:52:53.683058   921 olap_meta.cpp:73] [Rocksdb]                 Options.inplace_update_num_locks: 10000
RuntimeLogger I20250428 14:52:53.683061   921 olap_meta.cpp:73] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
RuntimeLogger I20250428 14:52:53.683064   921 olap_meta.cpp:73] [Rocksdb]   Options.memtable_huge_page_size: 0
RuntimeLogger I20250428 14:52:53.683068   921 olap_meta.cpp:73] [Rocksdb]                           Options.bloom_locality: 0
RuntimeLogger I20250428 14:52:53.683070   921 olap_meta.cpp:73] [Rocksdb]                    Options.max_successive_merges: 0
RuntimeLogger I20250428 14:52:53.683073   921 olap_meta.cpp:73] [Rocksdb]                Options.optimize_filters_for_hits: 0
RuntimeLogger I20250428 14:52:53.683076   921 olap_meta.cpp:73] [Rocksdb]                Options.paranoid_file_checks: 0
RuntimeLogger I20250428 14:52:53.683079   921 olap_meta.cpp:73] [Rocksdb]                Options.force_consistency_checks: 0
RuntimeLogger I20250428 14:52:53.683082   921 olap_meta.cpp:73] [Rocksdb]                Options.report_bg_io_stats: 0
RuntimeLogger I20250428 14:52:53.683085   921 olap_meta.cpp:73] [Rocksdb]                               Options.ttl: 0
RuntimeLogger I20250428 14:52:53.683142   921 olap_meta.cpp:73] [Rocksdb] [db/db_impl.cc:1394] Created column family [meta] (ID 2)
RuntimeLogger I20250428 14:52:53.684798   921 olap_meta.cpp:73] [Rocksdb] [db/db_impl_open.cc:1219] DB pointer 0x7fbea70d9000
RuntimeLogger I20250428 14:52:53.685024   138 storage_engine.cpp:134] stream load record path: /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.687826   138 storage_engine.cpp:471] will check 'ulimit' value.
RuntimeLogger I20250428 14:52:53.687966   975 data_dir.cpp:346] start to load tablets from /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.688016   975 data_dir.cpp:339] successfully check incompatible old format meta /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.688024   975 data_dir.cpp:357] begin loading rowset from meta
RuntimeLogger I20250428 14:52:53.688030   975 data_dir.cpp:411] load rowset from meta finished, data dir: /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.688032   975 data_dir.cpp:416] begin loading tablet from meta
RuntimeLogger I20250428 14:52:53.688037   975 data_dir.cpp:462] load tablet from meta finished, loaded tablet: 0, error tablet: 0, path: /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.688043   975 data_dir.cpp:637] finish to load tablets from /opt/apache-doris/be/storage, total rowset meta: 0, invalid rowset num: 0
RuntimeLogger I20250428 14:52:53.688683   138 storage_engine.cpp:202] success to init storage engine.
RuntimeLogger I20250428 14:52:53.688731   138 olap_server.cpp:218] unused rowset monitor thread started
RuntimeLogger I20250428 14:52:53.688786   138 olap_server.cpp:224] evict quering thread started
RuntimeLogger I20250428 14:52:53.688802   989 storage_engine.cpp:1186] start to delete unused rowset, size: 0
RuntimeLogger I20250428 14:52:53.688820   989 storage_engine.cpp:1214] collected 0 unused rowsets to remove, skipped 0 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
RuntimeLogger I20250428 14:52:53.688827   989 storage_engine.cpp:1231] removed all collected unused rowsets
RuntimeLogger I20250428 14:52:53.688829   138 olap_server.cpp:230] garbage sweeper thread started
RuntimeLogger I20250428 14:52:53.688915   138 olap_server.cpp:236] disk stat monitor thread started
RuntimeLogger I20250428 14:52:53.688927   991 storage_engine.cpp:807] start trash and snapshot sweep. is_clean=0
RuntimeLogger I20250428 14:52:53.688959   991 storage_engine.cpp:431] get root path info cost: 0 ms. tablet counter: 0
RuntimeLogger I20250428 14:52:53.688966   991 storage_engine.cpp:831] Start to sweep path /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.689082   991 storage_engine.cpp:953] remove 0 invalid rowset meta from dir: /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.689091   991 storage_engine.cpp:987] remove 0 invalid binlog meta from dir: /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.689108   991 storage_engine.cpp:1014] removed invalid delete bitmap from dir: /opt/apache-doris/be/storage, deleted tablets size: 0
RuntimeLogger I20250428 14:52:53.689114   991 storage_engine.cpp:1039] removed invalid pending publish info from dir: /opt/apache-doris/be/storage, deleted pending publish info size: 0
RuntimeLogger I20250428 14:52:53.689203   991 data_dir.cpp:872] path: /opt/apache-doris/be/storage trash capacity: 0
RuntimeLogger I20250428 14:52:53.691210  1020 olap_server.cpp:473] try to perform path gc! disk remain [0.351675] internal [14400]
RuntimeLogger I20250428 14:52:53.691217   138 olap_server.cpp:322] cooldown thread pool started
RuntimeLogger I20250428 14:52:53.691218  1020 data_dir.cpp:780] start to gc data dir /opt/apache-doris/be/storage
RuntimeLogger I20250428 14:52:53.691287   138 olap_server.cpp:328] cooldown tasks producer thread started
RuntimeLogger I20250428 14:52:53.691331   138 olap_server.cpp:334] remove unused remote files thread started
RuntimeLogger I20250428 14:52:53.691391   138 olap_server.cpp:340] cold data compaction producer thread started
RuntimeLogger I20250428 14:52:53.691385  1027 olap_server.cpp:1186] cooldown producer get tablet num: 0
RuntimeLogger I20250428 14:52:53.693634   138 olap_server.cpp:351] async publish thread started
RuntimeLogger I20250428 14:52:53.693689   138 olap_server.cpp:357] check tablet delete bitmap score thread started
RuntimeLogger I20250428 14:52:53.693694   138 olap_server.cpp:359] all storage engine's background threads are started.
RuntimeLogger I20250428 14:52:53.693730  1063 olap_server.cpp:1621] try to start check tablet delete bitmap score!
RuntimeLogger I20250428 14:52:53.693737   138 workload_sched_policy_mgr.cpp:35] start workload scheduler 
RuntimeLogger I20250428 14:52:53.693758   138 spill_stream_manager.cpp:51] init spill stream manager
RuntimeLogger I20250428 14:52:53.693804   138 spill_stream_manager.cpp:322] spill storage path: /opt/apache-doris/be/storage, capacity: 892.81 GB, limit: 160.71 GB, available: 313.91 GB
RuntimeLogger I20250428 14:52:53.702515  1020 data_dir.cpp:848] gc data dir path: /opt/apache-doris/be/storage finished
RuntimeLogger I20250428 14:52:53.703935   138 spill_stream_manager.cpp:85] spill gc thread started
RuntimeLogger I20250428 14:52:53.704124   138 agent_server.cpp:59] Register workload group listener
RuntimeLogger I20250428 14:52:53.704131   138 agent_server.cpp:65] Register workload scheduler policy listener
RuntimeLogger I20250428 14:52:53.708272   138 backend_service.cpp:638] Doris BackendService listening on 9060
RuntimeLogger I20250428 14:52:53.708287   138 backend_service.cpp:642] ingest binlog thread pool size is -1, so we will in sync mode
RuntimeLogger I20250428 14:52:53.708506   138 thrift_server.cpp:404] ThriftServer 'backend' started on port: 9060
RuntimeLogger I20250428 14:52:53.817417   138 brpc_service.cpp:92] BRPC server bind to host: 0.0.0.0, port: 8060
RuntimeLogger W20250428 14:52:53.840389   138 task_control.cpp:202] Fail to create _workers[237], Resource temporarily unavailable
RuntimeLogger I20250428 14:52:53.841449   138 server.cpp:1106] Server[doris::PInternalServiceImpl] is serving on port=8060.
RuntimeLogger I20250428 14:52:53.841462   138 server.cpp:1109] Check out http://dev-disaggregated-cluster-cg1-0:8060 in web browser.
RuntimeLogger W20250428 14:52:54.631880   138 status.h:424] meet error status: [RUNTIME_ERROR]Could not create thread. (error 11) Resource temporarily unavailable

	0#  doris::Thread::start_thread(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::function<void ()> const&, unsigned long, scoped_refptr<doris::Thread>*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:445
	1#  doris::ThreadPool::create_thread() at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:244
	2#  doris::ThreadPool::init() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:502
	3#  doris::Status doris::ThreadPoolBuilder::build<doris::ThreadPool>(std::unique_ptr<doris::ThreadPool, std::default_delete<doris::ThreadPool> >*) const at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:502
	4#  doris::DownloadAction::DownloadAction(doris::ExecEnv*, std::shared_ptr<bufferevent_rate_limit_group>, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, int) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:360
	5#  doris::HttpService::register_local_handler(doris::StorageEngine&) at /home/zcp/repo_center/doris_release/doris/be/src/service/http_service.cpp:0
	6#  doris::HttpService::start() at /home/zcp/repo_center/doris_release/doris/be/src/service/http_service.cpp:0
	7#  main at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:389
	8#  ?
	9#  __libc_start_main
	10# _start
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1745823174 (unix time) try "date -d @1745823174" if you are using GNU date ***
*** Current BE git commitID: 39f9074cec ***
*** SIGSEGV address not mapped to object (@0x8) received by PID 138 (TID 138 OR 0x7fbecd000a00) from PID 8; stack trace: ***
RuntimeLogger I20250428 14:52:54.652720   919 wal_manager.cpp:485] Scheduled(every 10s) WAL info: [/opt/apache-doris/be/storage/wal: limit 33705537536 Bytes, used 0 Bytes, estimated wal bytes 0 Bytes, available 33705537536 Bytes.];
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /usr/lib/jvm/java/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java/lib/server/libjvm.so
 3# 0x00007FBECD156520 in /lib/x86_64-linux-gnu/libc.so.6
 4# std::_Hashtable<std::shared_ptr<doris::MetricEntity>, std::pair<std::shared_ptr<doris::MetricEntity> const, int>, std::allocator<std::pair<std::shared_ptr<doris::MetricEntity> const, int> >, std::__detail::_Select1st, doris::MetricEntityEqualTo, doris::MetricEntityHash, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >::find(std::shared_ptr<doris::MetricEntity> const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/hashtable.h:1570
 5# doris::MetricRegistry::deregister_entity(std::shared_ptr<doris::MetricEntity> const&) in /opt/apache-doris/be/lib/doris_be
 6# doris::ThreadPool::shutdown() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:330
 7# doris::ThreadPool::init() in /opt/apache-doris/be/lib/doris_be
 8# doris::Status doris::ThreadPoolBuilder::build<doris::ThreadPool>(std::unique_ptr<doris::ThreadPool, std::default_delete<doris::ThreadPool> >*) const at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.h:125
 9# doris::DownloadAction::DownloadAction(doris::ExecEnv*, std::shared_ptr<bufferevent_rate_limit_group>, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, int) at /home/zcp/repo_center/doris_release/doris/be/src/http/action/download_action.cpp:59
10# doris::HttpService::register_local_handler(doris::StorageEngine&) in /opt/apache-doris/be/lib/doris_be
11# doris::HttpService::start() in /opt/apache-doris/be/lib/doris_be
12# main at /home/zcp/repo_center/doris_release/doris/be/src/service/doris_main.cpp:576
13# 0x00007FBECD13DD90 in /lib/x86_64-linux-gnu/libc.so.6
14# __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6
15# _start in /opt/apache-doris/be/lib/doris_be

K8S SS Event 报错

(combined from similar events): Startup probe errored: rpc error: code = Unknown desc = command error: runtime/cgo: pthread_create failed: Resource temporarily unavailable SIGABRT: abort PC=0x7f38d8ea154c m=0 sigcode=18446744073709551610 goroutine 0 [idle]: runtime: g 0: unknown pc 0x7f38d8ea154c stack: frame={sp:0x7ffe0f076ba0, fp:0x0} stack=[0x7ffe0e878120,0x7ffe0f077130) 0x00007ffe0f076aa0: 0x00005581eb4a4800 <runtime.mmap.func1+0x0000000000000000> 0x00007ffe0f076a98 0x00007ffe0f076ab0: 0x00007f38b3e00000 0x0000000000407000 0x00007ffe0f076ac0: 0x0000003200000003 0x00000000ffffffff 0x00007ffe0f076ad0: 0x00007ffe0f076b18 0x00005581eb4b8a39 <runtime.sysMapOS+0x0000000000000039> 0x00007ffe0f076ae0: 0x00007f38b1ceb000 0x00005581eb4a4800 <runtime.mmap.func1+0x0000000000000000> 0x00007ffe0f076af0: 0x00005581eb4b89c5 <runtime.sysHugePageOS+0x0000000000000065> 0x00007f38b3e00000 0x00007ffe0f076b00: 0x0000000000400000 0x000000000000000e 0x00007ffe0f076b10: 0x00007f3800000000 0x00007ffe0f076b48 0x00007ffe0f076b20: 0x00005581eb4b88c7 <runtime.sysUsedOS+0x0000000000000027> 0x00005581eb895bf0 0x00007ffe0f076b30: 0x0000000000407000 0x00005581eb50abbe <runtime.callCgoMmap+0x000000000000003e> 0x00007ffe0f076b40: 0x00007ffe0f076b40 0x00007ffe0f076bb8 0x00007ffe0f076b50: 0x00007ffe0f076b90 0x00005581eb895bf0 0x00007ffe0f076b60: 0x00007f38d8e9cb70 0x000000001c000004 0x00007ffe0f076b70: 0x00007f38d8e54df0 0x00007f38d8eaebc9 0x00007ffe0f076b80: 0x0000000000000000 0x0000000000000011 0x00007ffe0f076b90: 0x0000000000000130 0x00007f38d8ea153e 0x00007ffe0f076ba0: <0x0000000000000120 0x0000000000000000 0x00007ffe0f076bb0: 0x0000000000000013 0x0000000000000000 0x00007ffe0f076bc0: 0x00007ffe0f076df8 0x0000000000000004 0x00007ffe0f076bd0: 0x0000003400000013 0x00007f38d8f4f481 0x00007ffe0f076be0: 0x00007f38b1bea640 0x00007ffe0f076eb0 0x00007ffe0f076bf0: 0x00007ffe0f076d1e 0x00007ffe0f076d1f 0x00007ffe0f076c00: 0x00007f38b1bea640 0x00007f38d8e9f435 0x00007ffe0f076c10: 0x00007f38d8ffac80 0x0000000000000120 0x00007ffe0f076c20: 0x00000000003d0f00 0xa6cecfd9765d4000 0x00007ffe0f076c30: 0x00007f38d9204740 0x0000000000000006 0x00007ffe0f076c40: 0x00005581eb95251b 0x00007ffe0f076ef0 0x00007ffe0f076c50: 0x00005581ebd44800 0x00007f38d8e54d46 0x00007ffe0f076c60: 0x00007f38d8ffbe90 0x00007f38d8e287f3 0x00007ffe0f076c70: 0x0000000000000020 0xa6cecfd9765d4000 0x00007ffe0f076c80: 0x00007f38b13ea000 0x00007f38b1bea640 0x00007ffe0f076c90: 0x0000000000000000 0x000000000000000b runtime: g 0: unknown pc 0x7f38d8ea154c stack: frame={sp:0x7ffe0f076ba0, fp:0x0} stack=[0x7ffe0e878120,0x7ffe0f077130) 0x00007ffe0f076aa0: 0x00005581eb4a4800 <runtime.mmap.func1+0x0000000000000000> 0x00007ffe0f076a98 0x00007ffe0f076ab0: 0x00007f38b3e00000 0x0000000000407000 0x00007ffe0f076ac0: 0x0000003200000003 0x00000000ffffffff 0x00007ffe0f076ad0: 0x00007ffe0f076b18 0x00005581eb4b8a39 <runtime.sysMapOS+0x0000000000000039> 0x00007ffe0f076ae0: 0x00007f38b1ceb000 0x00005581eb4a4800 <runtime.mmap.func1+0x0000000000000000> 0x00007ffe0f076af0: 0x00005581eb4b89c5 <runtime.sysHugePageOS+0x0000000000000065> 0x00007f38b3e00000 0x00007ffe0f076b00: 0x0000000000400000 0x000000000000000e 0x00007ffe0f076b10: 0x00007f3800000000 0x00007ffe0f076b48 0x00007ffe0f076b20: 0x00005581eb4b88c7 <runtime.sysUsedOS+0x0000000000000027> 0x00005581eb895bf0 0x00007ffe0f076b30: 0x0000000000407000 0x00005581eb50abbe <runtime.callCgoMmap+0x000000000000003e> 0x00007ffe0f076b40: 0x00007ffe0f076b40 0x00007ffe0f076bb8 0x00007ffe0f076b50: 0x00007ffe0f076b90 0x00005581eb895bf0 0x00007ffe0f076b60: 0x00007f38d8e9cb70 0x000000001c000004 0x00007ffe0f076b70: 0x00007f38d8e54df0 0x00007f38d8eaebc9 0x00007ffe0f076b80: 0x0000000000000000 0x0000000000000011 0x00007ffe0f076b90: 0x0000000000000130 0x00007f38d8ea153e 0x00007ffe0f076ba0: <0x0000000000000120 0x0000000000000000 0x00007ffe0f076bb0: 0x0000000000000013 0x0000000000000000 0x00007ffe0f076bc0: 0x00007ffe0f076df8 0x0000000000000004 0x00007ffe0f076bd0: 0x0000003400000013 0x00007f38d8f4f481 0x00007ffe0f076be0: 0x00007f38b1bea640 0x00007ffe0f076eb0 0x00007ffe0f076bf0: 0x00007ffe0f076d1e 0x00007ffe0f076d1f 0x00007ffe0f076c00: 0x00007f38b1bea640 0x00007f38d8e9f435 0x00007ffe0f076c10: 0x00007f38d8ffac80 0x0000000000000120 0x00007ffe0f076c20: 0x00000000003d0f00 0xa6cecfd9765d4000 0x00007ffe0f076c30: 0x00007f38d9204740 0x0000000000000006 0x00007ffe0f076c40: 0x00005581eb95251b 0x00007ffe0f076ef0 0x00007ffe0f076c50: 0x00005581ebd44800 0x00007f38d8e54d46 0x00007ffe0f076c60: 0x00007f38d8ffbe90 0x00007f38d8e287f3 0x00007ffe0f076c70: 0x0000000000000020 0xa6cecfd9765d4000 0x00007ffe0f076c80: 0x00007f38b13ea000 0x00007f38b1bea640 0x00007ffe0f076c90: 0x0000000000000000 0x000000000000000b goroutine 1 [running]: runtime.systemstack_switch() /usr/lib/golang/src/runtime/asm_amd64.s:463 fp=0xc000144780 sp=0xc000144778 pc=0x5581eb506b40 runtime.main() /usr/lib/golang/src/runtime/proc.go:170 +0x6d fp=0xc0001447e0 sp=0xc000144780 pc=0x5581eb4d85ed runtime.goexit() /usr/lib/golang/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001447e8 sp=0xc0001447e0 pc=0x5581eb508de1 rax 0x0 rbx 0x7f38d9204740 rcx 0x7f38d8ea154c rdx 0x6 rdi 0x132c rsi 0x132c rbp 0x132c rsp 0x7ffe0f076ba0 r8 0x7ffe0f076c70 r9 0x7f38d8fb14e0 r10 0x8 r11 0x246 r12 0x6 r13 0x7ffe0f076ef0 r14 0x5581ebd44800 r15 0x1 rip 0x7f38d8ea154c rflags 0x246 cs 0x33 fs 0x0 gs 0x0 time="2025-05-07T16:25:41+08:00" level=error msg="exec failed: unable to start container process: read init-p: connection reset by peer" , stdout: , stderr: , exit code -1
1 Answers

看着是资源的问题呀
[RUNTIME_ERROR]Could not create thread. (error 11) Resource temporarily unavailable

将BE所在容器的 max user processes改大些。

通过ulimit -a 看,零时修改:ulimit -u 655355 后启动试试

持久化修改:sudo vim /etc/security/limits.conf

修改后重新查看是否生效:cat /proc//limits | grep "max processes"