使用 JOB 定时执行 INSERT INTO SELECT 报错 Execute timeout

Viewed 9

Doris 版本:2.1.10。在从数据目录中导入数据到Doris时单独执行 INSERT INTO SELECT 语句能够执行,但结合 JOB 定时增量执行 INSERT INTO SELECT 时报错:

2025-08-14 10:19:44,154 WARN (insert-task-execute-1-thread-3|472) [OlapInsertExecutor.onFail():229] insert [32676127816251662_32739728703354080] with query id fb1d6f0c20064f76-a03fed09a47ffb4d failed
org.apache.doris.common.DdlException: errCode = 2, detailMessage = Execute timeout
	at org.apache.doris.common.ErrorReport.reportDdlException(ErrorReport.java:68) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.common.ErrorReport.reportDdlException(ErrorReport.java:63) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.execImpl(AbstractInsertExecutor.java:152) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.executeSingleInsert(AbstractInsertExecutor.java:194) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.runInternal(InsertIntoTableCommand.java:318) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.runWithUpdateInfo(InsertIntoTableCommand.java:127) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.job.extensions.insert.InsertTask.run(InsertTask.java:203) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.job.task.AbstractTask.runTask(AbstractTask.java:167) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.job.executor.TaskProcessor.runTask(TaskProcessor.java:82) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.job.executor.TaskProcessor.lambda$addTask$0(TaskProcessor.java:48) ~[doris-fe.jar:1.2-SNAPSHOT]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_191]

试了使用 JOB 定时执行其他数据量较小的表不会报错,判定时数据量的问题,于是按照文档修改:
1)FE 配置参数 insert_load_default_timeout_second=28800。
2)环境变量 insert_timeout=28800。

修改后仍然报错,有没有大佬遇到类似问题

JOB 定义:

CREATE JOB LOAD_ODS_GDWS_SIGN_PERSON_EVERY_10_MINUTE
ON SCHEDULE EVERY 10 MINUTE
DO
INSERT INTO gdws_monitor.ODS_GDWS_SIGN_PERSON 
(ID,AREA_ID,NAME,SEX_CODE,SEX_NAME,BIRTHDAY,ID_NO,PHONE,RESIDENT_TYPE,NATION_CODE,NATION_NAME,ABOBLOOD_CODE,ABOBLOOD_NAME,RHBLOOD_CODE,RHBLOOD_NAME,CULTURE_CODE,CULTURE_NAME,OCCUPATION_CODE,OCCUPATION_NAME,MARRY_CODE,MARRY_NAME,INS_TYPE,AREAPROVINCE_CODE,AREACITY_CODE,AREACOUNTRY_CODE,AREATOWN_CODE,AREAVILLAGE_CODE,AREA_HOUSENO,AREA_FULLADDRESS,STATE,FLAG,CREATE_CODE,CREATE_NAME,CREATE_ORGANIZATION_CODE,CREATE_ORGANIZATION_NAME,CREATE_TIME,UPDATE_CODE,UPDATE_NAME,UPDATE_ORGANIZATION_CODE,UPDATE_ORGANIZATION_NAME,UPDATE_TIME,SIGN_STATE,SIGN_DOCTOR_CODE,SIGN_DOCTOR_NAME,SIGN_ORGANIZATION_CODE,SIGN_ORGANIZATION_NAME,SIGN_TIME,`NO`,WORK_UNIT,CONTACT_NAME,CONTACT_PHONE,EXPOSURE_HISTOR,FATHER_DISEASE,MOTHER_DISEASE,BROTHERS_DISEASE,CHILDREN_DISEASE,HEREDITARY_HISTORY,HEREDITARY_NAME,DEFORMITY_SITUATION,EXHAUST_FACILIT,FUEL_TYPE,DRINKING_WATER,TOILET,POULTRY_ENCLOSU,ABNORMAL_REASON,VERSION_ID,VERSION_NUM,ALLERGY_HISTORY_CODE,PAST_HISTORY_CODE,OPERATION,TRAUMA,BLOOD_TRANSFUSION,REGISTER_ADDRESS,REGISTER_HOUSENO,ARCHIVING_DOCTOR_CODE,ARCHIVING_DOCTOR_NAME,ARCHIVING_DATE,HUJI_TYPE,IMPROPER_TIME,JT_NO,FAMILY_RELATIONS_CODE,FAMILY_RELATIONS_NAME,ZU_CODE,CHECK_DATE,PROPERTIES,DATA_SOURCES,JT_ID,UNSIGNED_REASON,TEAM_CODE,AREAVILLAGE_CODE_OLD,RESPONSIBILITY_DOCTOR_NAME,RESPONSIBILITY_DOCTOR_PHONE,FATHER_DISEASE_OTHER,MOTHER_DISEASE_OTHER,BROTHERS_DISEASE_OTHER,CHILDREN_DISEASE_OTHER,DEFORMITY_SITUATION_OTHER,QUALIFIED,FACE_URL,COORDINATES,VERIFICATION_PERSON,VERIFICATION_PERSON_NAME,VERIFICATION_TIME,VERIFICATION_REMARK,VERIFICATION,AUDIT_NAME,AUDIT_TIME,AUDIT_REASON,AUDIT_CODE,SHIFT_STATE,GUARDER_ID_NO,IS_SON_PREGNANT,IS_EXAMINE,EXAMINE_REMARK,STANDARD,STANDARD_UPDATE_TIME,IS_USED,OTHER_ID_TYPE,OTHER_ID_NO,MANUAL_NO,STATUS_REMARKS,FIRST_SIGN_ORG_CODE,FIRST_SIGN_ORG_NAME,FIRST_NO,FIRST_ARCHIVING_DOCTOR_CODE,FIRST_ARCHIVING_DOCTOR_NAME,FIRST_ARCHIVING_DATE,SORTING_TYPE,MIGRATE_MSG,PREGNANT_RISK_LEVEL,MALIGNANCY,ENDEMIC_DISEASE,OCCUPATIONAL_DISEASE,CONGENITAL_MALFORMATION,LEGAL_INFECT_DISEASE,LEGAL_INFECT_DISEASE_OTHER,WEIGHT_STATUS,NATIVE_PLACE,BIRTH_PLACE,SIGN_ORGANIZATION_PHONE,IS_SIGN,SIGN_DOCTOR_PHONE,EMERGENCY_NAME_ONE,EMERGENCY_RELATION_ONE,EMERGENCY_PHONE_ONE,EMERGENCY_NAME_TWO,EMERGENCY_RELATION_TWO,EMERGENCY_PHONE_TWO,INS_TYPE_OTHER,FOOT_ALLERGY_HISTORY,ALLERGY_HISTORY_OTHER,ALLERGY_HISTORY_TYPE_CODE,DRUG_ALLERGY_HISTORY_OTHER,DISEASE,VACCINATION,MALIGNANCY_F,ENDEMIC_DISEASE_F,OCCUPATIONAL_DISEASE_F,CONGENITAL_MALFORMATION_F,MALIGNANCY_M,ENDEMIC_DISEASE_M,OCCUPATIONAL_DISEASE_M,CONGENITAL_MALFORMATION_M,MALIGNANCY_B,ENDEMIC_DISEASE_B,OCCUPATIONAL_DISEASE_B,CONGENITAL_MALFORMATION_B,MALIGNANCY_C,ENDEMIC_DISEASE_C,OCCUPATIONAL_DISEASE_C,CONGENITAL_MALFORMATION_C,ETL_TIME)
SELECT 
ID,AREA_ID,NAME,SEX_CODE,SEX_NAME,BIRTHDAY,ID_NO,PHONE,RESIDENT_TYPE,NATION_CODE,NATION_NAME,ABOBLOOD_CODE,ABOBLOOD_NAME,RHBLOOD_CODE,RHBLOOD_NAME,CULTURE_CODE,CULTURE_NAME,OCCUPATION_CODE,OCCUPATION_NAME,MARRY_CODE,MARRY_NAME,INS_TYPE,AREAPROVINCE_CODE,AREACITY_CODE,AREACOUNTRY_CODE,AREATOWN_CODE,AREAVILLAGE_CODE,AREA_HOUSENO,AREA_FULLADDRESS,STATE,FLAG,CREATE_CODE,CREATE_NAME,CREATE_ORGANIZATION_CODE,CREATE_ORGANIZATION_NAME,CREATE_TIME,UPDATE_CODE,UPDATE_NAME,UPDATE_ORGANIZATION_CODE,UPDATE_ORGANIZATION_NAME,UPDATE_TIME,SIGN_STATE,SIGN_DOCTOR_CODE,SIGN_DOCTOR_NAME,SIGN_ORGANIZATION_CODE,SIGN_ORGANIZATION_NAME,SIGN_TIME,`NO`,WORK_UNIT,CONTACT_NAME,CONTACT_PHONE,EXPOSURE_HISTOR,FATHER_DISEASE,MOTHER_DISEASE,BROTHERS_DISEASE,CHILDREN_DISEASE,HEREDITARY_HISTORY,HEREDITARY_NAME,DEFORMITY_SITUATION,EXHAUST_FACILIT,FUEL_TYPE,DRINKING_WATER,TOILET,POULTRY_ENCLOSU,ABNORMAL_REASON,VERSION_ID,VERSION_NUM,ALLERGY_HISTORY_CODE,PAST_HISTORY_CODE,OPERATION,TRAUMA,BLOOD_TRANSFUSION,REGISTER_ADDRESS,REGISTER_HOUSENO,ARCHIVING_DOCTOR_CODE,ARCHIVING_DOCTOR_NAME,ARCHIVING_DATE,HUJI_TYPE,IMPROPER_TIME,JT_NO,FAMILY_RELATIONS_CODE,FAMILY_RELATIONS_NAME,ZU_CODE,CHECK_DATE,PROPERTIES,DATA_SOURCES,JT_ID,UNSIGNED_REASON,TEAM_CODE,AREAVILLAGE_CODE_OLD,RESPONSIBILITY_DOCTOR_NAME,RESPONSIBILITY_DOCTOR_PHONE,FATHER_DISEASE_OTHER,MOTHER_DISEASE_OTHER,BROTHERS_DISEASE_OTHER,CHILDREN_DISEASE_OTHER,DEFORMITY_SITUATION_OTHER,QUALIFIED,FACE_URL,COORDINATES,VERIFICATION_PERSON,VERIFICATION_PERSON_NAME,VERIFICATION_TIME,VERIFICATION_REMARK,VERIFICATION,AUDIT_NAME,AUDIT_TIME,AUDIT_REASON,AUDIT_CODE,SHIFT_STATE,GUARDER_ID_NO,IS_SON_PREGNANT,IS_EXAMINE,EXAMINE_REMARK,STANDARD,STANDARD_UPDATE_TIME,IS_USED,OTHER_ID_TYPE,OTHER_ID_NO,MANUAL_NO,STATUS_REMARKS,FIRST_SIGN_ORG_CODE,FIRST_SIGN_ORG_NAME,FIRST_NO,FIRST_ARCHIVING_DOCTOR_CODE,FIRST_ARCHIVING_DOCTOR_NAME,FIRST_ARCHIVING_DATE,SORTING_TYPE,MIGRATE_MSG,PREGNANT_RISK_LEVEL,MALIGNANCY,ENDEMIC_DISEASE,OCCUPATIONAL_DISEASE,CONGENITAL_MALFORMATION,LEGAL_INFECT_DISEASE,LEGAL_INFECT_DISEASE_OTHER,WEIGHT_STATUS,NATIVE_PLACE,BIRTH_PLACE,SIGN_ORGANIZATION_PHONE,IS_SIGN,SIGN_DOCTOR_PHONE,EMERGENCY_NAME_ONE,EMERGENCY_RELATION_ONE,EMERGENCY_PHONE_ONE,EMERGENCY_NAME_TWO,EMERGENCY_RELATION_TWO,EMERGENCY_PHONE_TWO,INS_TYPE_OTHER,FOOT_ALLERGY_HISTORY,ALLERGY_HISTORY_OTHER,ALLERGY_HISTORY_TYPE_CODE,DRUG_ALLERGY_HISTORY_OTHER,DISEASE,VACCINATION,MALIGNANCY_F,ENDEMIC_DISEASE_F,OCCUPATIONAL_DISEASE_F,CONGENITAL_MALFORMATION_F,MALIGNANCY_M,ENDEMIC_DISEASE_M,OCCUPATIONAL_DISEASE_M,CONGENITAL_MALFORMATION_M,MALIGNANCY_B,ENDEMIC_DISEASE_B,OCCUPATIONAL_DISEASE_B,CONGENITAL_MALFORMATION_B,MALIGNANCY_C,ENDEMIC_DISEASE_C,OCCUPATIONAL_DISEASE_C,CONGENITAL_MALFORMATION_C,CAST(NOW() AS VARCHAR)
FROM JYDB_245_CATALOG.GDWS.GDWS_SIGN_PERSON
where UPDATE_TIME >= (select MAX(ETL_TIME) from ODS_GDWS_SIGN_PERSON);
0 Answers