异步物化视图刷新失败,提示“errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 90250840: not enough streams 1/2”

Viewed 53

定义了100+个异步物化视图,每天晚上定时刷新,最近经常会出现多个物化视图刷新失败,通过查看刷新任务信息,结果的ErrorMsg字段显示:

errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 90250840: not enough streams 1/2

执行手工刷新物化视图命令后,可以正常刷新成功。

请问针对视图刷新失败的错误大佬有什么解决方案???

2 Answers

可以发一下详细的报错吗?fe.log里面看下对应的信息

2025-07-31 01:01:05,944 WARN (mtmv-task-execute-1-thread-6|64894) [AbstractInsertExecutor.execImpl():157] insert [label_f315820072f643a6_82cb55dd3cfb5bcf] with query id f315820072f643a6-82cb55dd3cfb5bcf failed, (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2
2025-07-31 01:01:05,944 WARN (mtmv-task-execute-1-thread-6|64894) [OlapInsertExecutor.onFail():229] insert [label_f315820072f643a6_82cb55dd3cfb5bcf] with query id f315820072f643a6-82cb55dd3cfb5bcf failed
org.apache.doris.common.DdlException: errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2
at org.apache.doris.common.ErrorReport.reportDdlException(ErrorReport.java:68) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.execImpl(AbstractInsertExecutor.java:158) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.executeSingleInsert(AbstractInsertExecutor.java:194) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.runInternal(InsertIntoTableCommand.java:320) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.run(InsertIntoTableCommand.java:124) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.runInsertCommand(InsertOverwriteTableCommand.java:279) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.insertIntoPartitions(InsertOverwriteTableCommand.java:345) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.run(InsertOverwriteTableCommand.java:215) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.extensions.mtmv.MTMVTask.exec(MTMVTask.java:252) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.extensions.mtmv.MTMVTask.run(MTMVTask.java:218) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.task.AbstractTask.runTask(AbstractTask.java:167) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.extensions.mtmv.MTMVTask.runTask(MTMVTask.java:334) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.executor.TaskProcessor.runTask(TaskProcessor.java:82) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.job.executor.TaskProcessor.lambda$addTask$0(TaskProcessor.java:48) ~[doris-fe.jar:1.2-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_251]
2025-07-31 01:01:05,971 INFO (mtmv-task-execute-1-thread-6|64894) [DatabaseTransactionMgr.abortTransaction():1644] abort transaction: TransactionState. transaction id: 35143841, label: label_f315820072f643a6_82cb55dd3cfb5bcf, db id: 800767, table id list: 61170987, callback id: -1, coordinator: FE: 10.74.108.78, transaction status: ABORTED, error replicas num: 0, replica ids: , prepare time: 1753894801784, commit time: -1, finish time: 1753894865944, reason: errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2 successfully
2025-07-31 01:01:05,972 WARN (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteTableCommand.runInsertCommand():282] InsertInto state error:errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2
2025-07-31 01:01:05,972 WARN (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteTableCommand.run():230] insert into overwrite failed with task(or group) id 95915423
2025-07-31 01:01:05,972 INFO (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteManager.taskFail():213] insert overwrite task [95915423] failed
2025-07-31 01:01:05,972 WARN (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteTableCommand.runInsertCommand():282] InsertInto state error:errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2
2025-07-31 01:01:05,972 WARN (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteTableCommand.run():230] insert into overwrite failed with task(or group) id 95915423
2025-07-31 01:01:05,972 INFO (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteManager.taskFail():213] insert overwrite task [95915423] failed
2025-07-31 01:01:05,972 INFO (mtmv-task-execute-1-thread-6|64894) [OlapTable.updateVisibleVersionAndTime():2996] updateVisibleVersionAndTime, tableName: dim_org_mapping, visibleVersion, 84, visibleVersionTime: 1753894865972
2025-07-31 01:01:06,001 INFO (mtmv-task-execute-1-thread-6|64894) [InsertOverwriteManager.removeTask():259] remove insert overwrite task: InsertOverwriteTask{cancel=false, dbId=800767, tableId=61170987, tempPartitionNames=[iot_temp_dim_org_mapping]}
... 7 more
2025-07-31 01:01:06,143 INFO (mtmv-task-execute-1-thread-6|64894) [MTMVService.refreshComplete():145] refreshComplete: dim_org_mapping
2025-07-31 01:01:06,143 INFO (mtmv-task-execute-1-thread-6|64894) [MTMVService.alterMTMV():112] alterMTMV, mtmvName: dim_org_mapping, AlterMTMV: AlterMTMV{mvName=org.apache.doris.nereids.trees.plans.commands.info.TableNameInfo@33072f63, refreshInfo=null, status=null, needRebuildJob=false, mvProperties=null, task=MTMVTask{dbId=800767, mtmvId=61170987, taskContext=MTMVTaskContext{triggerMode=SYSTEM, partitions=null, isComplete=false}, needRefreshPartitions=[dim_org_mapping], completedPartitions=[], refreshMode=COMPLETE} AbstractTask{jobId=61171019, taskId=24071226552490470, status=FAILED, createTimeMs=1753894801118, startTimeMs=1753894801118, finishTimeMs=null, taskType=SCHEDULED, errMsg='errCode = 2, detailMessage = (10.56.88.77)[CANCELLED]failed to open DeltaWriter 95915524: not enough streams 1/2'}, relation=org.apache.doris.mtmv.MTMVRelation@10091942}