Apache Doris 中文技术论坛
Questions Tags Users Badges

Trino有通过引入外部插件来支持数据血缘,Doris目前有这个方面的考虑吗?

Asked Oct 12, 2024 Modified Jan 1, 0001
Viewed 103
1.2

油管视频
https://www.youtube.com/watch?v=A7hj1M7IYj8
PR
https://github.com/trinodb/trino/issues/21599
主要是用这个玩意儿
https://github.com/MarquezProject/marquez

edited Jan 1, 0001
tlzmkm17
asked Oct 12, 2024
1 Answers

目前可以参考
1、datahub:
https://datahubproject.io/docs/next/features/
2、apache atlas:
https://atlas.apache.org/api/v2/index.html
3、基于ali的druid二开,例如data-lineage-doris项目:
使用ali的druid去解析sql。由于sql本身有记录在fe的审计日志里,只需通过类似flume采集日志推送到kafka,后端设计一个服务专门去解析这些sql生成血缘关系即可:
https://github.com/eyesmoons/data-lineage-doris

后续我们将做规划和研发

edited Jan 1, 1970
徐振超@SelectDB7821
answered Oct 14, 2024
Related Questions
Doris 2.1.11 通过创建jdbc catalog 访问 doris 1.2.8的bitmap类型字段报错
1 answers
Doris 1.2.8 查询嵌套视图数据时,报错IllegalArgumentException
1 answers
fe启动失败:java.lang.NullPointerException: null at org.apache.doris.datasource.InternalCatalog.unprotectAddReplica(InternalCatalog.java:983)
2 answers
BE无法正常启动
1 answers
doris 1.2.7 FE 无法启动ERROR (replayer|79) [CatalogRecycleBin.replayErasePartition():517]
1 answers
doris1.1.4 元数据损坏修复
1 answers

Terms of service Privacy policy

Powered by Answer - the open-source software that powers Q&A communities.
Made with love © 2025 Apache Doris 中文技术论坛.