Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] #656

Open
tttggg163 opened this issue Mar 27, 2024 · 1 comment
Open

[BUG] #656

tttggg163 opened this issue Mar 27, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@tttggg163
Copy link

ETL 数据同步,源和目标都是 clickhouse, 当 数据结构中有 Array 等字段就报错:
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-12], Description:[不支持的数据库类型. 请注意查看 DataX 已经支持的数据库类型以及数据库版本.]. - 您的配置文件中的列配置信息有误. 因为DataX 不支持数据库读取这种字段类型. 字段名:[cym], 字段名称:[2003], 字段Java类型:[java.sql.Array]. 请尝试使用数据库函数将其转换datax支持的类型 或者不同步该字段 .

已知 datax 不支持 Array[String] 类型,只支持 String, 是否可以就不支持的类型进行 toString(字段) 转换,以规避这个问题?
clickhouse 常规避情况都是大宽表,人工添加数据库函数的成本太高,建议在 datax-web 生成json 脚本时自动加上数所组转字符串函数。

@tttggg163 tttggg163 added the bug Something isn't working label Mar 27, 2024
@qujiabin
Copy link

qujiabin commented Mar 27, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants