Apache Doris 中文技术论坛
Questions Tags Users Badges

【已解决】spark connector报spark type is DATETIMEV2, but arrow type iS TIMESTAMPMICRO

Asked Apr 24, 2024 Modified Apr 26, 2024
Viewed 437
2.1

doris版本:2.1.1
spark connector版本:spark-doris-connector-3.2_2.12:1.3.0
问题描述:doris从2.0.x升级到2.1.x后,datetime类型读取失败
3de30b5579682c5d572f6ee738c08ac.png

edited Apr 26, 2024
North Lin35
asked Apr 24, 2024
1 Answers

2.1.2 内核arrow类型转换发生改变,目前最新的flink,spark connector都已经兼容,可以使用最新的connector

对应 PR:https://github.com/apache/doris-spark-connector/pull/193

edited Apr 26, 2024
vinlee303
answered Apr 24, 2024
Related Questions
大佬们求助,授予角色可以创建catalog的权限报错
1 answers
不同doris集群如何同步数据?
1 answers
关于catalog_paimon环境下如何启用paimonNativeReadSplits?
bitmap类型设置默认值后,数据导入报错can not cast from origin type bitmap to target type=varchar(65533)
1 answers
doris2.1.8,相同的sql,不同账期但数据量差异,大小表join,有时候会自动join reorder导致OOM
1 answers
Doris BE 集群1-2个节点过一段时间后内存持续升高,出现OOM,定位是冷数据垃圾回收功能影响
1 answers

Terms of service Privacy policy

Powered by Answer - the open-source software that powers Q&A communities.
Made with love © 2025 Apache Doris 中文技术论坛.