我创建的catalog是iceberg glue rest catalog,使用的aws ak和sk是有s3tables full权限的,为什么查询的时候会偶尔报S3 400的错误呢,下面是我的异常信息:
Caused by: software.amazon.awssdk.services.s3.model.S3Exception: Bad Request (Service: S3, Status Code: 400, Request ID: NAVHXRB0G6KM1DEQ, Extended Request ID: fcTYIZwzgbDBh+mQGz9/0LbChQ1oHTYYPNVsaeNEmBKq5JYkRk4hx8VqttE/Y9bHDxe0OPP95RUAJDmplxafTS4i65lxq+iKccs726qNvss=)
at software.amazon.awssdk.services.s3.model.S3Exception$BuilderImpl.build(S3Exception.java:104)
at software.amazon.awssdk.services.s3.model.S3Exception$BuilderImpl.build(S3Exception.java:58)
at software.amazon.awssdk.services.s3.internal.handlers.ExceptionTranslationInterceptor.modifyException(ExceptionTranslationInterceptor.java:88)
at software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.modifyException(ExecutionInterceptorChain.java:181)
at software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.runModifyException(ExceptionReportingUtils.java:54)
at software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.reportFailureToInterceptors(ExceptionReportingUtils.java:38)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:39)
at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26)
at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:210)
at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103)
at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173)
at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80)
at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182)
at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74)
at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45)
at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53)
at software.amazon.awssdk.services.s3.DefaultS3Client.headObject(DefaultS3Client.java:7029)
at org.apache.iceberg.aws.s3.BaseS3File.getObjectMetadata(BaseS3File.java:96)
at org.apache.iceberg.aws.s3.S3InputFile.getLength(S3InputFile.java:112)
at org.apache.iceberg.avro.AvroIterable.newFileReader(AvroIterable.java:102)
at org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:77)
at org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:37)
at org.apache.iceberg.relocated.com.google.common.collect.Iterables.addAll(Iterables.java:332)
at org.apache.iceberg.relocated.com.google.common.collect.Lists.newLinkedList(Lists.java:261)
at org.apache.iceberg.ManifestLists.read(ManifestLists.java:42)
at org.apache.iceberg.BaseSnapshot.cacheManifests(BaseSnapshot.java:176)
at org.apache.iceberg.BaseSnapshot.dataManifests(BaseSnapshot.java:202)
at org.apache.doris.datasource.iceberg.source.IcebergScanNode.lambda$isBatchMode$6(IcebergScanNode.java:474)
at org.apache.doris.common.security.authentication.ExecutionAuthenticator.execute(ExecutionAuthenticator.java:44)
at org.apache.doris.datasource.iceberg.source.IcebergScanNode.isBatchMode(IcebergScanNode.java:471)
... 22 more
2026-01-08 07:10:00,191 WARN (mysql-nio-pool-75|1277) [StmtExecutor.execute():546] Analyze failed. stmt[1115, 9d8ec04bd7204619-82e5b25696ceaede]