flink cdc on yarn报错

Viewed 7
2.1

有谁遇到过这个问题： 我想用flink 欧尼yarn调度，从mysql同步数据到doris，执行命令./bin/flink-cdc.sh -t yarn-application example/mysql2doris_gravity_10.yaml 报错。 使用flink单机standlone模式能执行成功。环境信息：doris2.1.10, flink 1.20.2； flink cdc 3.4； hadoop:3.3.3

2025-10-21 18:48:20,144 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2025-10-21 18:48:20,151 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnApplicationClusterEntryPoint (Version: 1.20.2, Scala: 2.12, Rev:1641cb9, Date:2025-06-12T21:40:37+02:00)
2025-10-21 18:48:20,151 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: yarn
2025-10-21 18:48:20,386 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2025-10-21 18:48:20,501 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: root
2025-10-21 18:48:20,501 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.333-b02
2025-10-21 18:48:20,502 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64
2025-10-21 18:48:20,502 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 429 MiBytes
2025-10-21 18:48:20,508 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/jdk1.8.0_333
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 3.3.3
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx469762048
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms469762048
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.base/sun.net.util=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED
2025-10-21 18:48:20,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.lang=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.net=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.io=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.nio=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/sun.nio.ch=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.lang.reflect=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.text=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.time=ALL-UNNAMED
2025-10-21 18:48:20,512 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util=ALL-UNNAMED
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:+IgnoreUnrecognizedVMOptions
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/data/nm/userlogs/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/jobmanager.log
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:log4j.properties
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:log4j.properties
2025-10-21 18:48:20,513 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
2025-10-21 18:48:20,514 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=469762048b
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b
2025-10-21 18:48:20,515 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: :flink-cdc-dist-3.4.0.jar:lib/flink-cdc-dist-3.4.0.jar:lib/flink-cdc-pipeline-connector-doris-3.4.0.jar:lib/flink-cdc-pipeline-connector-kafka-3.4.0.jar:lib/flink-cdc-pipeline-connector-mysql-3.4.0.jar:lib/flink-cep-1.20.2.jar:lib/flink-connector-files-1.20.2.jar:lib/flink-csv-1.20.2.jar:lib/flink-json-1.20.2.jar:lib/flink-scala_2.12-1.20.2.jar:lib/flink-table-api-java-uber-1.20.2.jar:lib/flink-table-planner-loader-1.20.2.jar:lib/flink-table-runtime-1.20.2.jar:lib/log4j-1.2-api-2.24.3.jar:lib/log4j-api-2.24.3.jar:lib/log4j-core-2.24.3.jar:lib/log4j-slf4j-impl-2.24.3.jar:lib/mysql-connector-java-8.0.27.jar:flink-dist-1.20.2.jar:config.yaml::/opt/datasophon/hadoop-3.3.3/etc/hadoop:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/snappy-java-1.1.8.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/nimbus-jose-jwt-9.8.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/hadoop-annotations-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-net-3.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/accessors-smart-2.4.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/curator-framework-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/netty-3.10.6.Final.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-databind-2.13.2.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-servlet-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/dnsjava-2.1.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-xml-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-compress-1.21.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-webapp-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-security-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/paranamer-2.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-server-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/stax2-api-4.2.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/gson-2.8.9.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/reload4j-1.2.18.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jersey-json-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/avro-1.7.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/hadoop-shaded-guava-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-http-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-annotations-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/asm-5.0.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-core-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/json-smart-2.4.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/curator-recipes-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-io-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-lang3-3.12.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/hadoop-auth-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-text-1.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/woodstox-core-5.3.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jettison-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/zookeeper-jute-3.5.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jul-to-slf4j-1.7.36.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-io-2.8.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/curator-client-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-util-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/zookeeper-3.5.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jetty-util-ajax-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/re2j-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-codec-1.15.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/hadoop-registry-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/hadoop-common-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/hadoop-kms-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/hadoop-nfs-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/common/hadoop-common-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/snappy-java-1.1.8.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/nimbus-jose-jwt-9.8.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/hadoop-annotations-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-net-3.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/accessors-smart-2.4.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/curator-framework-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/netty-all-4.1.68.Final.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-databind-2.13.2.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-servlet-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-xml-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-compress-1.21.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-webapp-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-security-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-server-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/stax2-api-4.2.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/gson-2.8.9.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/reload4j-1.2.18.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/hadoop-shaded-guava-1.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-http-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-annotations-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/httpcore-4.4.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-core-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/json-smart-2.4.7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/curator-recipes-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-io-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-lang3-3.12.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/hadoop-auth-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jakarta.activation-api-1.2.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-text-1.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/woodstox-core-5.3.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/zookeeper-jute-3.5.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-io-2.8.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/curator-client-4.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-util-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/zookeeper-3.5.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-codec-1.15.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/httpclient-4.5.13.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-client-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-client-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/lib/*:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.3-tests.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jetty-plus-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jackson-jaxrs-base-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jetty-jndi-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/snakeyaml-1.26.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jetty-annotations-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax.websocket-client-api-1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/fst-2.50.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/websocket-servlet-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jakarta.xml.bind-api-2.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/bcpkix-jdk15on-1.60.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/objenesis-2.6.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/asm-tree-9.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/asm-analysis-9.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.13.2.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax-websocket-client-impl-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax.ws.rs-api-2.1.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/websocket-common-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/websocket-api-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jetty-client-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jersey-client-1.19.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/websocket-server-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/bcprov-jdk15on-1.60.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/asm-commons-9.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jna-5.2.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/websocket-client-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/guice-4.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/javax-websocket-server-impl-9.4.43.v20210629.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/jline-3.9.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-router-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-api-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-client-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-applications-mawo-core-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-common-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-registry-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-services-core-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-common-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-services-api-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.3.jar:/opt/datasophon/hadoop-3.3.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.3.jar

2 Answers

剩下的日志：

2025-10-21 18:48:20,516 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2025-10-21 18:48:20,518 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
2025-10-21 18:48:20,524 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - YARN daemon is running as: root Yarn client user obtainer: root
2025-10-21 18:48:20,536 INFO org.apache.flink.configuration.GlobalConfiguration [] - Using standard YAML parser to load flink configuration file from /data/nm/usercache/root/appcache/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/config.yaml.
2025-10-21 18:48:20,636 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.web.address, 0.0.0.0
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.web.port, 8082
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1760960206029_0031
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.archive.fs.fs.refresh-interval, 10000
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, doris-57
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.resolve.order, parent-first
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.savepoints.dir, hdfs://192.168.111.53:8020/flink-savepoints
2025-10-21 18:48:20,637 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: io.tmp.dirs, /tmp
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, ['{"source":{"type":"mysql","hostname":"192.168.111.122","port":3306,"username":"bi_user","password":"geex@2021","tables":"gravity_product.BIZ_APP_COMMON","server-id":"5400-5404","server-time-zone":"UTC+8"},"sink":{"type":"doris","fenodes":"192.168.111.51:18030","benodes":"192.168.111.56:18040","username":"root","password":"TEST123456!@#","table.create.properties.light_schema_change":true,"table.create.properties.replication_num":3},"pipeline":{"name":"MySQ2dorisPipelineBIZ_APP_COMMON","parallelism":1}}']
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.all, --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.archive.fs.dir, hdfs:///completed-jobs/
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.type, hashmap
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.flink.cdc.cli.CliExecutor
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, hdfs:///completed-jobs/
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1024m
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.mode, EXACTLY_ONCE
2025-10-21 18:48:20,638 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.tolerable-failed-checkpoints, 0
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.unaligned, false
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.resolve-order, child-first
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.incremental, false
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.cancel.enable, true
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-application
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1024m
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.ship-files, []
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2025-10-21 18:48:20,639 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.interval, 3min
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.timeout, 10min
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.state-recovery.claim-mode, NO_CLAIM
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.externalized-checkpoint-retention, DELETE_ON_CANCELLATION
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, ['file:/opt/datasophon/flink-cdc-3.4.0/lib/flink-cdc-dist-3.4.0.jar']
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.submit.enable, true
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, 0.0.0.0
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.min-pause, 0
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.state-recovery.ignore-unclaimed-state, false
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.max-concurrent-checkpoints, 1
2025-10-21 18:48:20,640 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/datasophon/flink-1.20.2/conf/log4j.properties
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.dir, hdfs://192.168.111.53:8020/flink-checkpoints
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.off-heap.size, 134217728b
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.min, 201326592b
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-metaspace.size, 268435456b
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.heap.size, 469762048b
2025-10-21 18:48:20,641 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.max, 201326592b
2025-10-21 18:48:20,677 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port'
2025-10-21 18:48:20,695 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Overriding Flink's temporary file directories with those specified in the Flink config: /tmp
2025-10-21 18:48:20,845 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnApplicationClusterEntryPoint.
2025-10-21 18:48:20,863 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
2025-10-21 18:48:20,896 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-influx
2025-10-21 18:48:20,901 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: external-resource-gpu
2025-10-21 18:48:20,901 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-statsd
2025-10-21 18:48:20,902 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-jmx
2025-10-21 18:48:20,902 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-datadog
2025-10-21 18:48:20,902 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-graphite
2025-10-21 18:48:20,902 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-prometheus
2025-10-21 18:48:20,902 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-slf4j
2025-10-21 18:48:20,925 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
2025-10-21 18:48:20,974 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to root (auth:SIMPLE)
2025-10-21 18:48:20,975 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Kerberos security is disabled.
2025-10-21 18:48:20,982 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-1770998075398090643.conf.
2025-10-21 18:48:20,993 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
2025-10-21 18:48:21,005 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working directory: WorkingDirectory(/tmp/jm_c8c1a2767a83a5c3f89745a1b5443946).
2025-10-21 18:48:21,379 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Trying to start actor system, external address doris-52:0, bind address 0.0.0.0:0.
2025-10-21 18:48:22,360 INFO org.apache.pekko.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2025-10-21 18:48:22,406 INFO org.apache.pekko.remote.RemoteActorRefProvider [] - Pekko Cluster not in use - enabling unsafe features anyway because pekko.remote.use-unsafe-remote-features-outside-cluster has been enabled.
2025-10-21 18:48:22,406 INFO org.apache.pekko.remote.Remoting [] - Starting remoting
2025-10-21 18:48:22,851 INFO org.apache.pekko.remote.Remoting [] - Remoting started; listening on addresses :[pekko.tcp://flink@doris-52:46764]
2025-10-21 18:48:23,046 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Actor system started at pekko.tcp://flink@doris-52:46764
2025-10-21 18:48:23,072 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Loading delegation token providers
2025-10-21 18:48:23,076 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token provider hadoopfs loaded and initialized
2025-10-21 18:48:23,079 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token provider hbase loaded and initialized
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-influx
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: external-resource-gpu
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-statsd
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-jmx
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-datadog
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-graphite
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-prometheus
2025-10-21 18:48:23,080 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-slf4j
2025-10-21 18:48:23,081 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token providers loaded successfully
2025-10-21 18:48:23,082 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Loading delegation token receivers
2025-10-21 18:48:23,084 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hadoopfs loaded and initialized
2025-10-21 18:48:23,085 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hbase loaded and initialized
2025-10-21 18:48:23,085 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-influx
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: external-resource-gpu
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-statsd
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-jmx
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-datadog
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-graphite
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-prometheus
2025-10-21 18:48:23,086 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-slf4j
2025-10-21 18:48:23,086 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receivers loaded successfully
2025-10-21 18:48:23,086 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Checking provider and receiver instances consistency
2025-10-21 18:48:23,086 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Provider and receiver instances are consistent
2025-10-21 18:48:23,086 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Obtaining delegation tokens
2025-10-21 18:48:23,090 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation tokens obtained successfully
2025-10-21 18:48:23,090 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No tokens obtained so skipping notifications
2025-10-21 18:48:23,106 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.port'
2025-10-21 18:48:23,120 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/jm_c8c1a2767a83a5c3f89745a1b5443946/blobStorage
2025-10-21 18:48:23,124 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:36500 - max concurrent requests: 50 - max backlog: 1000
2025-10-21 18:48:23,151 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
2025-10-21 18:48:23,151 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No trace reporter configured, no metrics will be exposed/reported.
2025-10-21 18:48:23,157 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Trying to start actor system, external address doris-52:0, bind address 0.0.0.0:0.
2025-10-21 18:48:23,179 INFO org.apache.pekko.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2025-10-21 18:48:23,184 INFO org.apache.pekko.remote.RemoteActorRefProvider [] - Pekko Cluster not in use - enabling unsafe features anyway because pekko.remote.use-unsafe-remote-features-outside-cluster has been enabled.
2025-10-21 18:48:23,184 INFO org.apache.pekko.remote.Remoting [] - Starting remoting
2025-10-21 18:48:23,205 INFO org.apache.pekko.remote.Remoting [] - Remoting started; listening on addresses :[pekko.tcp://flink-metrics@doris-52:36810]
2025-10-21 18:48:23,222 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Actor system started at pekko.tcp://flink-metrics@doris-52:36810
2025-10-21 18:48:23,244 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
2025-10-21 18:48:23,386 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port'
2025-10-21 18:48:23,390 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-5d4867b1-603d-4a72-80b4-ebfd52a80de5/flink-web-upload does not exist.
2025-10-21 18:48:23,391 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-5d4867b1-603d-4a72-80b4-ebfd52a80de5/flink-web-upload for file uploads.
2025-10-21 18:48:23,395 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint.
2025-10-21 18:48:23,725 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir'
2025-10-21 18:48:23,777 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /data/nm/userlogs/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/jobmanager.log
2025-10-21 18:48:23,777 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /data/nm/userlogs/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/jobmanager.out
2025-10-21 18:48:23,816 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at 192.168.111.52:36965
2025-10-21 18:48:23,818 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://192.168.111.52:36965 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2025-10-21 18:48:23,820 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://192.168.111.52:36965.
2025-10-21 18:48:23,844 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (102.400mb (107374184 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
2025-10-21 18:48:23,846 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction network memory (57.600mb (60397978 bytes)) is less than its min value 64.000mb (67108864 bytes), min value will be used instead
2025-10-21 18:48:23,860 WARN org.apache.flink.yarn.entrypoint.YarnResourceManagerFactory [] - Configured size for 'taskmanager.memory.process.size' is ignored. Total memory size for TaskManagers are dynamically decided in fine-grained resource management.
2025-10-21 18:48:23,872 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
2025-10-21 18:48:23,880 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
2025-10-21 18:48:23,882 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Starting resource manager service.
2025-10-21 18:48:23,885 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is granted leadership with session id 00000000-0000-0000-0000-000000000000.
2025-10-21 18:48:23,887 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs that are not finished, yet.
2025-10-21 18:48:23,888 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
2025-10-21 18:48:23,931 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_0 .
2025-10-21 18:48:23,939 INFO org.apache.flink.configuration.GlobalConfiguration [] - Using standard YAML parser to load flink configuration file from /data/nm/usercache/root/appcache/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/config.yaml.
2025-10-21 18:48:23,955 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.web.address, 0.0.0.0
2025-10-21 18:48:23,955 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.web.port, 8082
2025-10-21 18:48:23,955 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
2025-10-21 18:48:23,955 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1760960206029_0031
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.archive.fs.fs.refresh-interval, 10000
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, doris-57
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.resolve.order, parent-first
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.savepoints.dir, hdfs://192.168.111.53:8020/flink-savepoints
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: io.tmp.dirs, /tmp
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, ['{"source":{"type":"mysql","hostname":"192.168.111.122","port":3306,"username":"bi_user","password":"geex@2021","tables":"gravity_product.BIZ_APP_COMMON","server-id":"5400-5404","server-time-zone":"UTC+8"},"sink":{"type":"doris","fenodes":"192.168.111.51:18030","benodes":"192.168.111.56:18040","username":"root","password":"TEST123456!@#","table.create.properties.light_schema_change":true,"table.create.properties.replication_num":3},"pipeline":{"name":"MySQ2dorisPipelineBIZ_APP_COMMON","parallelism":1}}']
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.all, --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: historyserver.archive.fs.dir, hdfs:///completed-jobs/
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.type, hashmap
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.flink.cdc.cli.CliExecutor
2025-10-21 18:48:23,956 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.archive.fs.dir, hdfs:///completed-jobs/
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1024m
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.mode, EXACTLY_ONCE
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.tolerable-failed-checkpoints, 0
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.unaligned, false
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.resolve-order, child-first
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.incremental, false
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.cancel.enable, true
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-application
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1024m
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.ship-files, []
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.interval, 3min
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.timeout, 10min
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.state-recovery.claim-mode, NO_CLAIM
2025-10-21 18:48:23,957 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.externalized-checkpoint-retention, DELETE_ON_CANCELLATION
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, ['file:/opt/datasophon/flink-cdc-3.4.0/lib/flink-cdc-dist-3.4.0.jar']
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: web.submit.enable, true
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, 0.0.0.0
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.min-pause, 0
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.state-recovery.ignore-unclaimed-state, false
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.max-concurrent-checkpoints, 1
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/datasophon/flink-1.20.2/conf/log4j.properties
2025-10-21 18:48:23,958 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.dir, hdfs://192.168.111.53:8020/flink-checkpoints
2025-10-21 18:48:24,015 INFO org.apache.flink.client.ClientUtils [] - Starting program (detached: true)
2025-10-21 18:48:24,024 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at pekko://flink/user/rpc/resourcemanager_1 .
2025-10-21 18:48:24,041 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager.
2025-10-21 18:48:24,049 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Starting the slot manager.
2025-10-21 18:48:24,050 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Starting tokens update task
2025-10-21 18:48:24,050 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No tokens obtained so skipping notifications
2025-10-21 18:48:24,050 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
2025-10-21 18:48:24,247 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'execution.checkpointing.unaligned' instead of proper key 'execution.checkpointing.unaligned.enabled'
2025-10-21 18:48:24,249 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir'
2025-10-21 18:48:24,280 INFO org.apache.flink.cdc.composer.flink.FlinkEnvironmentUtils [] - pipeline.jars is file:/data/nm/usercache/root/appcache/application_1760960206029_0031/container_e12_1760960206029_0031_01_000001/flink-cdc-dist-3.4.0.jar,file:/data/nm/usercache/root/appcache/application_1760960206029_0031/filecache/13/flink-cdc-pipeline-connector-mysql-3.4.0.jar
2025-10-21 18:48:24,289 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - Print mysql connector configuration:
2025-10-21 18:48:24,289 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - hostname = 192.168.111.122
2025-10-21 18:48:24,289 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - password = ******
2025-10-21 18:48:24,289 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - tables = gravity_product.BIZ_APP_COMMON
2025-10-21 18:48:24,289 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - port = 3306
2025-10-21 18:48:24,290 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - server-time-zone = UTC+8
2025-10-21 18:48:24,290 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - username = bi_user
2025-10-21 18:48:24,290 INFO org.apache.flink.cdc.connectors.mysql.utils.OptionUtils [] - server-id = 5400-5404
2025-10-21 18:48:24,420 WARN io.debezium.connector.mysql.MySqlConnection [] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead
2025-10-21 18:48:24,543 INFO org.apache.flink.cdc.connectors.mysql.utils.MySqlSchemaUtils [] - Read list of available databases
2025-10-21 18:48:24,799 INFO org.apache.flink.yarn.YarnResourceManagerDriver [] - Recovered 0 containers from previous attempts ([]).
2025-10-21 18:48:24,800 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Recovered 0 workers from previous attempt.
2025-10-21 18:48:24,848 INFO org.apache.hadoop.conf.Configuration [] - resource-types.xml not found
2025-10-21 18:48:24,848 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils [] - Unable to find 'resource-types.xml'.
2025-10-21 18:48:24,870 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
2025-10-21 18:48:24,877 INFO org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl [] - Upper bound of the thread pool size is 500
2025-10-21 18:48:25,036 INFO org.apache.flink.cdc.connectors.mysql.utils.MySqlSchemaUtils [] - list of available databases are: [gravity_product]
2025-10-21 18:48:25,036 INFO org.apache.flink.cdc.connectors.mysql.utils.MySqlSchemaUtils [] - Read list of available tables in gravity_product

linjie1

org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
... 4 more
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321)
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
... 4 more
Caused by: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:182)
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex$Factory.createExecutionJobVertex(ExecutionJobVertex.java:672)
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobVertices(DefaultExecutionGraph.java:881)
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobGraph(DefaultExecutionGraph.java:854)
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:225)
at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173)
at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382)
at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:225)
at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:142)
at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162)
at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121)
at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406)
at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:383)
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128)
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100)
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
... 5 more
Caused by: java.lang.ClassCastException: cannot assign instance of org.apache.doris.flink.cfg.DorisOptions to field org.apache.doris.flink.sink.schema.SchemaChangeManager.dorisOptions of type org.apache.doris.flink.cfg.DorisOptions in instance of org.apache.flink.cdc.connectors.doris.sink.DorisSchemaChangeManager
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2302)
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1432)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2460)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:508)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:466)
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:488)
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:472)
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:467)
at org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67)
at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.create(OperatorCoordinatorHolder.java:496)
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.createOperatorCoordinatorHolder(ExecutionJobVertex.java:294)
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:173)
... 20 more
2025-10-21 18:48:28,036 WARN org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly:
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_333]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka98a81efe-79e1-4e99-b1fa-d90aaac4d7a5.jar:1.20.2]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:61) [flink-rpc-akka98a81efe-79e1-4e99-b1fa-d90aaac4d7a5.jar:1.20.2]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_333]
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067) [?:1.8.0_333]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703) [?:1.8.0_333]
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172) [?:1.8.0_333]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'MySQ2dorisPipelineBIZ_APP_COMMON'.
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.20.2.jar:1.20.2]
... 12 more
Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'MySQ2dorisPipelineBIZ_APP_COMMON'.
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2487) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:192) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2453) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.cdc.composer.flink.FlinkPipelineExecution.execute(FlinkPipelineExecution.java:43) ~[flink-cdc-dist-3.4.0.jar:3.4.0]
at org.apache.flink.cdc.cli.CliExecutor.main(CliExecutor.java:118) ~[flink-cdc-dist-3.4.0.jar:3.4.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_333]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:356) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.20.2.jar:1.20.2]
... 12 more
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:75) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:457) ~[?:1.8.0_333]
... 4 more
Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:182) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex$Factory.createExecutionJobVertex(ExecutionJobVertex.java:672) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobVertices(DefaultExecutionGraph.java:881) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobGraph(DefaultExecutionGraph.java:854) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:142) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:383) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.lang.ClassCastException: cannot assign instance of org.apache.doris.flink.cfg.DorisOptions to field org.apache.doris.flink.sink.schema.SchemaChangeManager.dorisOptions of type org.apache.doris.flink.cfg.DorisOptions in instance of org.apache.flink.cdc.connectors.doris.sink.DorisSchemaChangeManager
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2302) ~[?:1.8.0_333]
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1432) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2460) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:508) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:466) ~[?:1.8.0_333]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:488) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:472) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:467) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.create(OperatorCoordinatorHolder.java:496) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.createOperatorCoordinatorHolder(ExecutionJobVertex.java:294) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex$Factory.createExecutionJobVertex(ExecutionJobVertex.java:672) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobVertices(DefaultExecutionGraph.java:881) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobGraph(DefaultExecutionGraph.java:854) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:142) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:383) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
2025-10-21 18:48:28,049 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint.
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_333]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_333]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_333]
at org.apache.flink.runtime.concurrent.pekko.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:172) ~[?:?]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.concurrent.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.pekko.dispatch.TaskInvocation.run(AbstractDispatcher.scala:59) [flink-rpc-akka98a81efe-79e1-4e99-b1fa-d90aaac4d7a5.jar:1.20.2]
at org.apache.pekko.dispatch.ForkJoinExecutorConfigurator$PekkoForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:61) [flink-rpc-akka98a81efe-79e1-4e99-b1fa-d90aaac4d7a5.jar:1.20.2]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_333]
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067) [?:1.8.0_333]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703) [?:1.8.0_333]
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172) [?:1.8.0_333]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Failed to execute job 'MySQ2dorisPipelineBIZ_APP_COMMON'.
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:373) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.20.2.jar:1.20.2]
... 12 more
Caused by: org.apache.flink.util.FlinkException: Failed to execute job 'MySQ2dorisPipelineBIZ_APP_COMMON'.
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2487) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:192) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2453) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.cdc.composer.flink.FlinkPipelineExecution.execute(FlinkPipelineExecution.java:43) ~[flink-cdc-dist-3.4.0.jar:3.4.0]
at org.apache.flink.cdc.cli.CliExecutor.main(CliExecutor.java:118) ~[flink-cdc-dist-3.4.0.jar:3.4.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_333]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_333]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_333]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_333]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:356) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:223) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:113) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.20.2.jar:1.20.2]
... 12 more
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:75) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:457) ~[?:1.8.0_333]
... 4 more
Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_333]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.lang.RuntimeException: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator Source: Flink CDC Event Source: mysql -> SchemaOperator -> PrePartition
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:182) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex$Factory.createExecutionJobVertex(ExecutionJobVertex.java:672) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobVertices(DefaultExecutionGraph.java:881) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobGraph(DefaultExecutionGraph.java:854) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:142) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:383) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
Caused by: java.lang.ClassCastException: cannot assign instance of org.apache.doris.flink.cfg.DorisOptions to field org.apache.doris.flink.sink.schema.SchemaChangeManager.dorisOptions of type org.apache.doris.flink.cfg.DorisOptions in instance of org.apache.flink.cdc.connectors.doris.sink.DorisSchemaChangeManager
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2302) ~[?:1.8.0_333]
at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1432) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2460) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2454) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2378) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2236) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1692) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:508) ~[?:1.8.0_333]
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:466) ~[?:1.8.0_333]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:488) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:472) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:467) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.create(OperatorCoordinatorHolder.java:496) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.createOperatorCoordinatorHolder(ExecutionJobVertex.java:294) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.(ExecutionJobVertex.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.ExecutionJobVertex$Factory.createExecutionJobVertex(ExecutionJobVertex.java:672) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobVertices(DefaultExecutionGraph.java:881) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.attachJobGraph(DefaultExecutionGraph.java:854) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.SchedulerBase.(SchedulerBase.java:225) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultScheduler.(DefaultScheduler.java:142) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.JobMaster.(JobMaster.java:383) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100) ~[flink-dist-1.20.2.jar:1.20.2]
at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_333]
at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) ~[flink-dist-1.20.2.jar:1.20.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_333]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_333]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_333]
2025-10-21 18:48:28,056 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:36500
2025-10-21 18:48:28,057 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting YarnApplicationClusterEntryPoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2025-10-21 18:48:28,063 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint.
2025-10-21 18:48:28,108 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing cache directory /tmp/flink-web-5d4867b1-603d-4a72-80b4-ebfd52a80de5/flink-web-ui
2025-10-21 18:48:28,109 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://192.168.111.52:36965 lost leadership
2025-10-21 18:48:28,109 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut down complete.
2025-10-21 18:48:28,109 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components.
2025-10-21 18:48:28,111 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Stopping SessionDispatcherLeaderProcess.
2025-10-21 18:48:28,112 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Stopping resource manager service.
2025-10-21 18:48:28,113 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is not running. Ignore revoking leadership.
2025-10-21 18:48:28,116 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping dispatcher pekko.tcp://flink@doris-52:46764/user/rpc/dispatcher_0.
2025-10-21 18:48:28,117 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping all currently running jobs of dispatcher pekko.tcp://flink@doris-52:46764/user/rpc/dispatcher_0.
2025-10-21 18:48:28,131 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Stopping credential renewal
2025-10-21 18:48:28,133 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Stopped credential renewal
2025-10-21 18:48:28,133 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Closing the slot manager.
2025-10-21 18:48:28,133 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Suspending the slot manager.
2025-10-21 18:48:29,045 INFO org.apache.flink.runtime.history.FsJobArchivist [] - Job 4c21d042bf789c8de35b1fa085363b41 has been archived at hdfs:/completed-jobs/4c21d042bf789c8de35b1fa085363b41.
2025-10-21 18:48:29,125 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopped dispatcher pekko.tcp://flink@doris-52:46764/user/rpc/dispatcher_0.
2025-10-21 18:48:29,134 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Stopping Pekko RPC service.
2025-10-21 18:48:29,139 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Stopping Pekko RPC service.
2025-10-21 18:48:29,179 WARN org.apache.pekko.actor.CoordinatedShutdown [] - Could not addJvmShutdownHook, due to: Shutdown in progress
2025-10-21 18:48:29,179 WARN org.apache.pekko.actor.CoordinatedShutdown [] - Could not addJvmShutdownHook, due to: Shutdown in progress
2025-10-21 18:48:29,180 INFO org.apache.pekko.actor.CoordinatedShutdown [] - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
2025-10-21 18:48:29,180 INFO org.apache.pekko.actor.CoordinatedShutdown [] - Running CoordinatedShutdown with reason [ActorSystemTerminateReason]
2025-10-21 18:48:29,203 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2025-10-21 18:48:29,203 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2025-10-21 18:48:29,205 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2025-10-21 18:48:29,205 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2025-10-21 18:48:29,264 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2025-10-21 18:48:29,269 INFO org.apache.pekko.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2025-10-21 18:48:29,289 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Stopped Pekko RPC service.
2025-10-21 18:48:29,305 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Stopped Pekko RPC service.
2025-10-21 18:48:29,305 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Terminating cluster entrypoint process YarnApplicationClusterEntryPoint with exit code 1445.

linjie1
Related Questions
flink cdc on yarn报错
2 answers
创建ROUTINE LOAD Kafka任务报错Failed to get real offsets of kafka topic
doris2.1.11 配置ranger2.4权限不生效
服务器ip变化后fe启动失败
unique 表类型, 不分区的情况下, 如果给数据设置ttl
1 answers
什么时候doris出一个物化视图编排的管理工具
1 answers