kafka-doris,ROUTINE LOAD导入方式遇到问题

Viewed 35

没指定消费者组group_id
企业微信截图_1761618729550.png
企业微信截图_17616187568106.png
企业微信截图_17616187744741.png
重新创建,指定消费者组
(补充:修改,添加消费者组报错,此外第一次创建的消费者组group_id,kafka查询does not exist,重新创建指定后可以查询到)

2025-10-28 10:17:28:[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = txn 3045512 could not be COMMITTED while task bda7da1b20794620-92302d7a1daea029 has been aborted.

企业微信截图_17616192755057.png
企业微信截图_17616194969909.png
企业微信截图_17616195185564.png
因为txn_id一直显示-1,于是暂停kafka_test_job2,Other_Message

failed to get latest partition offset. {}errCode = 2, detailMessage = Failed to get latest offsets of kafka topic: test. error: errCode = 2, detailMessage = Failed to get info

仍然是-1。但目前测试情况,似乎要先指定消费者组,第一次同步会正常进行,但之后的任务就不行

2 Answers

得看下BE的日志中的详细错误,拿着你的job_id 在be.INFO 中搜下

1、内存小的问题
2、kafka只部署在一台服务器上,doris三台服务器,doris日志报错

WARN (Routine load task scheduler|46) [KafkaUtil.getInfoRequest():241] failed to get info request to TNetworkAddress(hostname:10.15.8.72, port:8060) err Waited 60 seconds (plus 76023 nanoseconds delay) for io.grpc.stub.ClientCalls$GrpcFuture@4b0526fb[status=PENDING, info=