使用doris查询paimon 执行show databases 直接报错

Viewed 50

使用doris 查询 paimon表数据,catalog创建好后,执行show databases; 直接报错

[HY000][1105] errCode = 2, detailMessage = Failed to init catalog: paimon_s3_catalog, error: UnsupportedSchemeException: Could not find a file io implementation for scheme 's3' in the classpath. Hadoop FileSystem also cannot access this path 's3://flink-application-dev/paimon'.

1 Answers

CREATE CATALOG paimon_s3_catalog PROPERTIES (
"type" = "paimon",
"warehouse" = "s3://flink-application-dev/paimon",
"s3.endpoint" = "https://xxx",
"s3.access_key" = "xxx",
"s3.secret_key" = "xxx",
"s3.path.style.access" = "true",
"paimon.s3.access.key" = "xxx",
"paimon.s3.secret.key" = "xxx",
"paimon.s3.endpoint" = "https://xxx"
);
doris 版本是4.0.3
flink 版本是1.20.3
paimon 版本是1.4
s3 底层是ceph
我已经解决了这个问题了 修改下配置就可以了,完整配置如下
CREATE CATALOG paimon_s3_catalog PROPERTIES (
"type" = "paimon",
"warehouse" = "s3://flink-application-dev/paimon",
"s3.endpoint" = "https://abc.com",
"s3.access_key" = "xxx",
"s3.secret_key" = "xxx",
"paimon.s3.endpoint" = "https://s3-dev-pool.cnzbai.com",
"paimon.s3.access-key" = "xxx",
"paimon.s3.secret-key" = "xxx",
"paimon.s3.path.style.access" = "true"
);