doris查询paimon外表有些表会报错

Viewed 7

调整be.conf的这个参数没有效果 JAVA_OPTS="-Xmx2048m -XX:+UseG1GC"
paimon版本是1.1的,parquet 是几M大小。
报错日志:
errCode = 2, detailMessage = (10.130.66.108)[INTERNAL_ERROR]failed to init reader, err: [JNI_ERROR]Failed to get JNIEnv: it is nullptr.

0# doris::JniUtil::GetJNIEnv(JNIEnv_**) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:0
1# doris::vectorized::JniConnector::open(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
2# doris::vectorized::PaimonJniReader::init_reader(std::unordered_map, std::allocator >, std::variant, doris::ColumnValueRange<(doris::PrimitiveType)4>, doris::ColumnValueRange<(doris::PrimitiveType)5>, doris::ColumnValueRange<(doris::PrimitiveType)6>, doris::ColumnValueRange<(doris::PrimitiveType)7>, doris::ColumnValueRange<(doris::PrimitiveType)8>, doris::ColumnValueRange<(doris::PrimitiveType)9>, doris::ColumnValueRange<(doris::PrimitiveType)36>, doris::ColumnValueRange<(doris::PrimitiveType)37>, doris::ColumnValueRange<(doris::PrimitiveType)15>, doris::ColumnValueRange<(doris::PrimitiveType)10>, doris::ColumnValueRange<(doris::PrimitiveType)23>, doris::ColumnValueRange<(doris::PrimitiveType)11>,
执行计划:Summary:

  • Profile ID: 57a8a650ea0c4e08-b227a0484b03d7c7
  • Task Type: QUERY
  • Start Time: 2025-12-04 10:45:08
  • End Time: 2025-12-04 10:45:11
  • Total: 3sec578ms
  • Task State: JNI_ERROR
  • User: root
  • Default Catalog: paimon_fs
  • Default Db: paimon_oss_pro
  • Sql Statement: SELECT rid, entity_id FROM t_base_ent_change_info WHERE entity_id = '477235540' LIMIT 1000
  • Distributed Plan: N/A
    Execution Summary:
  • Workload Group: normal
  • Parse SQL Time: 0ms
  • Plan Time: 409ms
    • Garbage Collect During Plan Time: 0ms
    • Nereids Lock Table Time: 1ms
    • Nereids Analysis Time: 1ms
    • Nereids Rewrite Time: 1ms
      • Nereids Fold Const By BE Time: 0ms
    • Nereids Collect Table Partition Time: 0ms
  • Nereids Pre Rewrite By Mv Time: N/A
    • Nereids Optimize Time: N/A
    • Nereids Translate Time: 405ms
      • Init Scan Node Time: 0ms
      • Finalize Scan Node Time: 404ms
        • Get Splits Time: 384ms
        • Get Partitions Time: N/A
        • Get Partition Files Time: N/A
      • Create Scan Range Time: 20ms
    • Nereids Distribute Time: 1ms
  • Get Meta Version Time: N/A
    • Get Partition Version Time: N/A
    • Get Partition Version Count (hasData): N/A
    • Get Partition Version Count: N/A
    • Get Table Version Time: N/A
    • Get Table Version Count: N/A
  • Schedule Time: 33ms
    • Fragment Assign Time: 1ms
    • Fragment Serialize Time: 2ms
    • Fragment RPC Phase1 Time: 21ms
    • Fragment RPC Phase2 Time: 9ms
    • Fragment Compressed Size: 1.84 MB
    • Fragment RPC Count: 6
  • Schedule Time Of BE: {"phase1":{"10.130.66.109: 8060":{"RPC Work Time":"9ms","RPC Latency From FE To BE":"2ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"9ms"},"10.130.66.115: 8060":{"RPC Work Time":"6ms","RPC Latency From FE To BE":"4ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"10ms"},"10.130.66.108: 8060":{"RPC Work Time":"13ms","RPC Latency From FE To BE":"9ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"-1ms"}},"phase2":{"10.130.66.109: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"0ms","RPC Work Queue Time":"1ms","RPC Latency From BE To FE":"8ms"},"10.130.66.115: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"2ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"7ms"},"10.130.66.108: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"5ms","RPC Work Queue Time":"4ms","RPC Latency From BE To FE":"0ms"}}}
  • Wait and Fetch Result Time: N/A
  • Fetch Result Time: 0ms
  • Write Result Time: 0ms
  • Doris Version: doris-4.0.1-rc02-791725594d
  • Is Nereids: Yes
  • Is Cached: No
  • Total Instances Num: 4
  • Instances Num Per BE: 10.130.66.108:8060:1,10.130.66.115:8060:1,10.130.66.109:8060:2
  • Parallel Fragment Exec Instance Num: 12
  • Trace ID: ebcfa037-251e-4b56-ab73-462d2c8098fc
  • Transaction Commit Time: N/A
  • System Message: This profile is not complete, since its collection does not finish in time. Maybe increase profile_waiting_time_for_spill_secs in fe.conf current val: 10
  • Executed By Frontend: N/A
  • Splits Assignment Weight: N/A

ChangedSessionVariables:
[
{
"VarName": "character_set_results",
"CurrentValue": "NULL",
"DefaultValue": "utf8mb4"
},
{
"VarName": "enable_profile",
"CurrentValue": "true",
"DefaultValue": "false"
},
{
"VarName": "sql_mode",
"CurrentValue": "ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES",
"DefaultValue": "ONLY_FULL_GROUP_BY"
},
{
"VarName": "session_context",
"CurrentValue": "trace_id:ebcfa037-251e-4b56-ab73-462d2c8098fc",
"DefaultValue": ""
},
{
"VarName": "lower_case_table_names",
"CurrentValue": "1",
"DefaultValue": "0"
}
]
MergedProfile:
Fragments:
Fragment 0:
Fragment 1:

DetailProfile(57a8a650ea0c4e08-b227a0484b03d7c7):
Fragments:
Fragment 0:
Fragment 1:
LoadChannels:

Appendix:

PhysicalPlan:
PhysicalResultSink[146] ( outputExprs=[rid#0, entity_id#1] )
+--PhysicalLimit[142]@4 ( limit=1000, offset=0, phase=GLOBAL, stats=1,000 )
+--PhysicalDistribute[138]@3 ( stats=1,000, distributionSpec=DistributionSpecGather )
+--PhysicalLimit[134]@3 ( limit=1000, offset=0, phase=LOCAL, stats=1,000 )
+--PhysicalProject[130]@2 ( stats=386,116,022, projects=[rid#0, entity_id#1] )
+--PhysicalFilter[126]@1 ( stats=386,116,022, predicates=(entity_id#1 = '477235540') )
+--PhysicalFileScan[t_base_ent_change_info]@0 ( stats=772,232,044, qualified=paimon_fs.paimon_oss_pro.t_base_ent_change_info, selected partitions num=unknown, operativeCols=[entity_id#1] )
PhysicalFileScan[t_base_ent_change_info]@0 ( stats=772,232,044, qualified=paimon_fs.paimon_oss_pro.t_base_ent_change_info, selected partitions num=unknown, operativeCols=[entity_id#1] )
rid#0 -> unknown(7.72232044E8)
entity_id#1 -> unknown(7.72232044E8)
change_item#2 -> unknown(7.72232044E8)
change_date#3 -> unknown(7.72232044E8)
before_content#4 -> unknown(7.72232044E8)
after_content#5 -> unknown(7.72232044E8)
change_type#6 -> unknown(7.72232044E8)
is_history#7 -> unknown(7.72232044E8)
cd_create_time#8 -> unknown(7.72232044E8)
cd_update_time#9 -> unknown(7.72232044E8)
cd_opt_type#10 -> unknown(7.72232044E8)

0 Answers