调整be.conf的这个参数没有效果 JAVA_OPTS="-Xmx2048m -XX:+UseG1GC"
paimon版本是1.1的,parquet 是几M大小。
报错日志:
errCode = 2, detailMessage = (10.130.66.108)[INTERNAL_ERROR]failed to init reader, err: [JNI_ERROR]Failed to get JNIEnv: it is nullptr.
0# doris::JniUtil::GetJNIEnv(JNIEnv_**) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:0
1# doris::vectorized::JniConnector::open(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
2# doris::vectorized::PaimonJniReader::init_reader(std::unordered_map, std::allocator >, std::variant, doris::ColumnValueRange<(doris::PrimitiveType)4>, doris::ColumnValueRange<(doris::PrimitiveType)5>, doris::ColumnValueRange<(doris::PrimitiveType)6>, doris::ColumnValueRange<(doris::PrimitiveType)7>, doris::ColumnValueRange<(doris::PrimitiveType)8>, doris::ColumnValueRange<(doris::PrimitiveType)9>, doris::ColumnValueRange<(doris::PrimitiveType)36>, doris::ColumnValueRange<(doris::PrimitiveType)37>, doris::ColumnValueRange<(doris::PrimitiveType)15>, doris::ColumnValueRange<(doris::PrimitiveType)10>, doris::ColumnValueRange<(doris::PrimitiveType)23>, doris::ColumnValueRange<(doris::PrimitiveType)11>,
执行计划:Summary:
- Profile ID: 57a8a650ea0c4e08-b227a0484b03d7c7
- Task Type: QUERY
- Start Time: 2025-12-04 10:45:08
- End Time: 2025-12-04 10:45:11
- Total: 3sec578ms
- Task State: JNI_ERROR
- User: root
- Default Catalog: paimon_fs
- Default Db: paimon_oss_pro
- Sql Statement: SELECT rid, entity_id FROM t_base_ent_change_info WHERE entity_id = '477235540' LIMIT 1000
- Distributed Plan: N/A
Execution Summary: - Workload Group: normal
- Parse SQL Time: 0ms
- Plan Time: 409ms
- Garbage Collect During Plan Time: 0ms
- Nereids Lock Table Time: 1ms
- Nereids Analysis Time: 1ms
- Nereids Rewrite Time: 1ms
- Nereids Fold Const By BE Time: 0ms
- Nereids Collect Table Partition Time: 0ms
- Nereids Pre Rewrite By Mv Time: N/A
- Nereids Optimize Time: N/A
- Nereids Translate Time: 405ms
- Init Scan Node Time: 0ms
- Finalize Scan Node Time: 404ms
- Get Splits Time: 384ms
- Get Partitions Time: N/A
- Get Partition Files Time: N/A
- Create Scan Range Time: 20ms
- Nereids Distribute Time: 1ms
- Get Meta Version Time: N/A
- Get Partition Version Time: N/A
- Get Partition Version Count (hasData): N/A
- Get Partition Version Count: N/A
- Get Table Version Time: N/A
- Get Table Version Count: N/A
- Schedule Time: 33ms
- Fragment Assign Time: 1ms
- Fragment Serialize Time: 2ms
- Fragment RPC Phase1 Time: 21ms
- Fragment RPC Phase2 Time: 9ms
- Fragment Compressed Size: 1.84 MB
- Fragment RPC Count: 6
- Schedule Time Of BE: {"phase1":{"10.130.66.109: 8060":{"RPC Work Time":"9ms","RPC Latency From FE To BE":"2ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"9ms"},"10.130.66.115: 8060":{"RPC Work Time":"6ms","RPC Latency From FE To BE":"4ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"10ms"},"10.130.66.108: 8060":{"RPC Work Time":"13ms","RPC Latency From FE To BE":"9ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"-1ms"}},"phase2":{"10.130.66.109: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"0ms","RPC Work Queue Time":"1ms","RPC Latency From BE To FE":"8ms"},"10.130.66.115: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"2ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"7ms"},"10.130.66.108: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"5ms","RPC Work Queue Time":"4ms","RPC Latency From BE To FE":"0ms"}}}
- Wait and Fetch Result Time: N/A
- Fetch Result Time: 0ms
- Write Result Time: 0ms
- Doris Version: doris-4.0.1-rc02-791725594d
- Is Nereids: Yes
- Is Cached: No
- Total Instances Num: 4
- Instances Num Per BE: 10.130.66.108:8060:1,10.130.66.115:8060:1,10.130.66.109:8060:2
- Parallel Fragment Exec Instance Num: 12
- Trace ID: ebcfa037-251e-4b56-ab73-462d2c8098fc
- Transaction Commit Time: N/A
- System Message: This profile is not complete, since its collection does not finish in time. Maybe increase profile_waiting_time_for_spill_secs in fe.conf current val: 10
- Executed By Frontend: N/A
- Splits Assignment Weight: N/A
ChangedSessionVariables:
[
{
"VarName": "character_set_results",
"CurrentValue": "NULL",
"DefaultValue": "utf8mb4"
},
{
"VarName": "enable_profile",
"CurrentValue": "true",
"DefaultValue": "false"
},
{
"VarName": "sql_mode",
"CurrentValue": "ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES",
"DefaultValue": "ONLY_FULL_GROUP_BY"
},
{
"VarName": "session_context",
"CurrentValue": "trace_id:ebcfa037-251e-4b56-ab73-462d2c8098fc",
"DefaultValue": ""
},
{
"VarName": "lower_case_table_names",
"CurrentValue": "1",
"DefaultValue": "0"
}
]
MergedProfile:
Fragments:
Fragment 0:
Fragment 1:
DetailProfile(57a8a650ea0c4e08-b227a0484b03d7c7):
Fragments:
Fragment 0:
Fragment 1:
LoadChannels:
Appendix:
PhysicalPlan:
PhysicalResultSink[146] ( outputExprs=[rid#0, entity_id#1] )
+--PhysicalLimit[142]@4 ( limit=1000, offset=0, phase=GLOBAL, stats=1,000 )
+--PhysicalDistribute[138]@3 ( stats=1,000, distributionSpec=DistributionSpecGather )
+--PhysicalLimit[134]@3 ( limit=1000, offset=0, phase=LOCAL, stats=1,000 )
+--PhysicalProject[130]@2 ( stats=386,116,022, projects=[rid#0, entity_id#1] )
+--PhysicalFilter[126]@1 ( stats=386,116,022, predicates=(entity_id#1 = '477235540') )
+--PhysicalFileScan[t_base_ent_change_info]@0 ( stats=772,232,044, qualified=paimon_fs.paimon_oss_pro.t_base_ent_change_info, selected partitions num=unknown, operativeCols=[entity_id#1] )
PhysicalFileScan[t_base_ent_change_info]@0 ( stats=772,232,044, qualified=paimon_fs.paimon_oss_pro.t_base_ent_change_info, selected partitions num=unknown, operativeCols=[entity_id#1] )
rid#0 -> unknown(7.72232044E8)
entity_id#1 -> unknown(7.72232044E8)
change_item#2 -> unknown(7.72232044E8)
change_date#3 -> unknown(7.72232044E8)
before_content#4 -> unknown(7.72232044E8)
after_content#5 -> unknown(7.72232044E8)
change_type#6 -> unknown(7.72232044E8)
is_history#7 -> unknown(7.72232044E8)
cd_create_time#8 -> unknown(7.72232044E8)
cd_update_time#9 -> unknown(7.72232044E8)
cd_opt_type#10 -> unknown(7.72232044E8)