使用doris查询paimon 执行show databases 直接报错 doris版本是3.1.3和4.1.3都试过,都不行 s3存储使用的rustfs

Viewed 24

详细命令为:
CREATE CATALOG IF NOT EXISTS datalake_vol-03a435b942ab_data_dev_workspace_2071421428902936576 PROPERTIES (
'type' = 'paimon',
'warehouse' = 's3://vol-03a435b942ab/data/dev/workspace/2071421428902936576/',
's3.endpoint' = 'xxxxxxx',
's3.access-key' = 'xxxxxx',
's3.secret-key' = 'xxxxxx',
"s3.region" = "us-east-1",
's3.path.style.access' = 'true',
's3.use_path_style' = 'true',
'paimon.s3.endpoint' = 'xxxxxx',
'paimon.s3.access-key' = 'xxxxxx',
'paimon.s3.secret-key' = 'xxxxxx',
"paimon.s3.region" = "xxx",
'paimon.s3.use_path_style' = 'true',
'paimon.s3.path.style.access' = 'true'
);

REFRESH CATALOG datalake_vol-03a435b942ab_data_dev_workspace_2071421428902936576;

SHOW DATABASES FROM datalake_vol-03a435b942ab_data_dev_workspace_2071421428902936576;

相关报错:
查询:SHOW DATABASES FROM datalake_vol-03a435b942ab_data_dev_workspace_2071421428902936576

错误代码: 1105
errCode = 2, detailMessage = Failed to init catalog: datalake_vol-03a435b942ab_data_dev_workspace_2071421428902936576, error: UnsupportedSchemeException: Could not find a file io implementation for scheme 's3' in the classpath. Hadoop FileSystem also cannot access this path 's3://vol-03a435b942ab/data/dev/workspace/2071421428902936576'.

还是说不支持rustfs,要支持doris官方列出来的这部分存储服务才行??
26efa74a95e602f50647135e9ee299ae.png

1 Answers

用这个试试,如果还是有问题,请把完整的 fe.log 发送给我

CREATE CATALOG IF NOT EXISTS datalake_vol_03a435b942ab_data_dev_workspace_2071421428902936576 PROPERTIES (
  'type' = 'paimon',
  'warehouse' = 's3://vol-03a435b942ab/data/dev/workspace/2071421428902936576/',
  'fs.s3.support' = 'true',
  's3.endpoint' = 'http(s)://<rustfs-endpoint>',
  's3.region' = 'us-east-1',
  's3.access_key' = '<ak>',
  's3.secret_key' = '<sk>',
  'use_path_style' = 'true'
);