Skip to content
This repository has been archived by the owner on Sep 26, 2023. It is now read-only.

Truncate string values exceeding column's limits #42

Closed
chuwy opened this issue Jan 23, 2018 · 2 comments
Closed

Truncate string values exceeding column's limits #42

chuwy opened this issue Jan 23, 2018 · 2 comments
Assignees
Milestone

Comments

@chuwy
Copy link
Contributor

chuwy commented Jan 23, 2018

RDB Loader truncates columns for both atomic and shredded types: https://github.com/snowplow/snowplow-rdb-loader/blob/master/src/main/scala/com/snowplowanalytics/snowplow/rdbloader/loaders/RedshiftLoadStatements.scala#L140

Snowflake loader instead fails after hitting longer column.

@userkci
Copy link

userkci commented May 23, 2018

We've run into this issue and a workaround/alternative solution provided by Snowflake is to redefine the column type without the precision specified - VARCHAR versus VARCHAR(XXX). This can even be applied to an already existing table, as Snowflake permits widening character types with ALTER TABLE .. ALTER COLUMN.

@chuwy
Copy link
Contributor Author

chuwy commented Feb 25, 2019

snowplow/iglu-central#778 should be used.

@chuwy chuwy added this to the Version 0.5.0 milestone Feb 25, 2019
@rzats rzats modified the milestones: Version 0.5.0, Version 0.4.2 Mar 1, 2019
@rzats rzats closed this as completed in a313f47 Apr 3, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants