基本情况:kafka和doris在不同的k8s集群中,kafka通过loadBalancer暴露服务,通信正常。在doris里面创建了ROUTINE LOAD消费kafka中的数据,但是通过SHOW ROUTINE LOAD 中ReasonOfStateChanged报detailMessage = Failed to get all partitions of kafka 这个错误创建语句如下:
CREATE TABLE test_routineload_tbl(
user_id BIGINT NOT NULL COMMENT "user id",
name VARCHAR(20) COMMENT "name",
age INT COMMENT "age"
)
DUPLICATE KEY(user_id)
DISTRIBUTED BY HASH(user_id) BUCKETS 10;
//创建ROUTINE LOAD
CREATE ROUTINE LOAD example_routine_load_json ON test_routineload_tbl
COLUMNS(user_id,name,age)
PROPERTIES(
"format"="json",
"jsonpaths"="["$.user_id","$.name","$.age"]"
)
FROM KAFKA(
"kafka_broker_list" = "XXX.XXX.XXX.XXX:9092",
"kafka_topic" = "XXX_TOPIC",
"property.security.protocol"="SASL_PLAINTEXT",
"property.sasl.mechanism"="PLAIN",
"property.sasl.username"="user",
"property.sasl.password"="PASSWORD",
"property.kafka_default_offsets" = "OFFSET_BEGINNING"
);
报错信息:
ErrorReason{code=errCode = 4, msg='errCode = 2, detailMessage = Failed to get all partitions of kafka topic: XXXX error: errCode = 2, detailMessage = Failed to get info may be Kafka properties set in job is error or no partition in this topic that should check Kafka'}
请各位大佬帮忙看看,多谢