doris 使用flink导入, 报 stream load error: HTTP/1.1 307 Temporary Redirect

Viewed 17

doris版本 2.1.8.3, flink connector版本 1.16-1.6.2 报错信息:
2025-05-26 15:49:32,702 INFO org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Split fetcher 0 exited.
2025-05-26 15:49:32,704 WARN org.apache.flink.runtime.taskmanager.Task [] - Source: source_kafka[1] -> Calc[2] -> sink_doris[3]: Writer -> sink_doris[3]: Committer (9/20)#0 (1d442c3eaccd7677751d0497c75c6d84_cbc357ccb763df2852fee8c4fc7d55f2_8_0) switched from RUNNING
to FAILED with failure cause: java.lang.Exception: Could not perform checkpoint 117 for operator Source: source_kafka[1] -> Calc[2] -> sink_doris[3]: Writer -> sink_doris[3]: Committer (9/20)#0.
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1166)
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$triggerCheckpointAsync$12(StreamTask.java:1113)
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90)
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMail(MailboxProcessor.java:398)
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsWhenDefaultActionUnavailable(MailboxProcessor.java:367)
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:352)
at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:229)
at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:831)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:780)
at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.doris.flink.exception.DorisRuntimeException: org.apache.doris.flink.exception.StreamLoadException: stream load error: HTTP/1.1 307 Temporary Redirect
at org.apache.doris.flink.sink.writer.DorisStreamLoad.stopLoad(DorisStreamLoad.java:285)
at org.apache.doris.flink.sink.writer.DorisWriter.prepareCommit(DorisWriter.java:250)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.emitCommittables(SinkWriterOperator.java:198)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.prepareSnapshotPreBarrier(SinkWriterOperator.java:168)
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.prepareSnapshotPreBarrier(RegularOperatorChain.java:89)
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:334)
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$13(StreamTask.java:1281)
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1269)
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1154)
... 14 more
Caused by: org.apache.doris.flink.exception.StreamLoadException: stream load error: HTTP/1.1 307 Temporary Redirect
at org.apache.doris.flink.sink.writer.DorisStreamLoad.handlePreCommitResponse(DorisStreamLoad.java:266)
at org.apache.doris.flink.sink.writer.DorisStreamLoad.stopLoad(DorisStreamLoad.java:283)
... 23 more

2025-05-26 15:49:32,705 INFO org.apache.flink.runtime.taskmanager.Task [] - Freeing task resources for Source: source_kafka[1] -> Calc[2] -> sink_doris[3]: Writer -> sink_doris[3]: Committer (9/20)#0 (1d442c3eaccd7677751d0497c75c6d84_cbc357ccb763df2852fee8c4fc7d55f2_8_0).
2025-05-26 15:49:32,707 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FAILED to JobManager for task Source: source_kafka[1] -> Calc[2] -> sink_doris[3]: Writer -> sink_doris[3]: Committer (9/20)#0 1d442c3eaccd7677751d0497c75c6d84_cbc357ccb763df2852fee8c4fc7d55f2_8_0.
2025-05-26 15:49:48,128 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1, taskHeapMemory=384.000mb (402653174 bytes), taskOffHeapMemory=0 bytes, managedMemory=512.000mb (536870920 bytes), networkMemory=128.000mb (134217730 bytes)}, allocationId: 4e4d4b4497587af98ded36436855b3c2, jobId: 3ed2d36d0f5bf0296af4a2e7c7a8089e).
2025-05-26 15:49:48,133 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 3ed2d36d0f5bf0296af4a2e7c7a8089e from job leader monitoring.
2025-05-26 15:49:48,134 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 3ed2d36d0f5bf0296af4a2e7c7a8089e.

1 Answers