doris: 3.0.2
hive: 3.1.0.3.1.5.0-152
描述:执行多条件查询hive表报错,且所有be宕机,如果只是简单的select *则可以正常执行。数据量约为3亿多条,字段有50多个,下文建表简化了没有查询的字段。
hivecatalog:
CREATE CATALOG hive_1
PROPERTIES (
"type" = "hms",
"ipc.client.fallback-to-simple-auth-allowed" = "true",
"hive.metastore.uris" = "thrift://data2:9083"
);
建表语句:
create table if not exists bd.record_di (
RECORD_ID
string ,
PERSON_ID
string ,
CARD_PHYSICAL_ID
string
)
PARTITIONED BY (STAT_DAY INT,
ORDER_TYPE
INT
) ROW FORMAT delimited FIELDS TERMINATED BY '\t' STORED AS parquet;
SQL语句:SELECT * FROM hive_1.bd.record_di WHERE stat_day = 20250219 AND PERSON_ID = '2222' AND RECORD_ID = '11111' AND CARD_PHYSICAL_ID = '2222' limit 100
SQL查询报错:
SQL 错误 [1105] [HY000]: RpcException, msg: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
日志:
be.out:
fe.warning
be.out:
INFO: java_cmd /usr/java/jdk-17.0.1//bin/java
INFO: jdk_version 17
StdoutLogger 2025-03-13 13:39:13,780 Start time: 2025年 03月 13日 星期四 13:39:13 CST
INFO: java_cmd /usr/java/jdk-17.0.1//bin/java
INFO: jdk_version 17
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250313 13:39:13.946334 171041 config.cpp:1694] set config enable_file_cache true [OK]
I20250313 13:39:13.950488 171041 config.cpp:1694] set config enable_file_cache true [OK]
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
start BE in cloud mode, cloud_unique_id: 1:760636558:LuPQZIhO, meta_service_endpoint: 172.25.21.104:5000,172.25.21.2:5000,172.25.21.3:5000
*** Query id: 4e0a0bbb57d4dae-85668fb072cc5541 ***
*** is nereids: 1 ***
*** tablet id: 0 ***
*** Aborted at 1741844572 (unix time) try "date -d @1741844572" if you are using GNU date ***
*** Current BE git commitID: c21b9f5bce ***
*** SIGSEGV address not mapped to object (@0x6300000063) received by PID 171041 (TID 173644 OR 0x7f7d07ae4700) from PID 99; stack trace: ***
INFO: java_cmd /usr/java/jdk-17.0.1//bin/java
INFO: jdk_version 17
StdoutLogger 2025-03-13 13:43:36,217 Start time: 2025年 03月 13日 星期四 13:43:36 CST
INFO: java_cmd /usr/java/jdk-17.0.1//bin/java
INFO: jdk_version 17
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250313 13:43:36.396243 175132 config.cpp:1694] set config enable_file_cache true [OK]
I20250313 13:43:36.397869 175132 config.cpp:1694] set config enable_file_cache true [OK]
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/doris/doris-3.0.2/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
start BE in cloud mode, cloud_unique_id: 1:760636558:LuPQZIhO, meta_service_endpoint: 172.25.21.104:5000,172.25.21.2:5000,172.25.21.3:5000