Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RDB Shredder: truncate string values exceeding column's limits #143

Closed
chuwy opened this issue Apr 17, 2019 · 0 comments
Closed

RDB Shredder: truncate string values exceeding column's limits #143

chuwy opened this issue Apr 17, 2019 · 0 comments
Assignees
@chuwy
Milestone
Release 31

Comments

@chuwy
Copy link
Contributor

chuwy commented Apr 17, 2019

Identical to snowplow-incubator/snowplow-snowflake-loader#42

Since we've migrated from SCE to Scala Analytics SDK in RDB Shredder 0.15.0 we need to use the same approach the Snowflake Loader takes, namely fetch atomic schema and truncate all fields on by one.
@chuwy chuwy added this to the Release 31 milestone Apr 17, 2019
@chuwy chuwy self-assigned this Apr 17, 2019
@chuwy chuwy changed the title Truncate string values exceeding column's limits RDB Shredder: Truncate string values exceeding column's limits Apr 17, 2019
@chuwy chuwy changed the title RDB Shredder: Truncate string values exceeding column's limits RDB Shredder: truncate string values exceeding column's limits Apr 17, 2019
chuwy added a commit that referenced this issue Apr 17, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
0beb11f 
…143)
chuwy added a commit that referenced this issue Apr 17, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
0613b4e 
…143)
chuwy added a commit that referenced this issue Apr 17, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
3c26b10 
…143)
chuwy added a commit that referenced this issue Apr 17, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
df7ac8f 
…143)
chuwy added a commit that referenced this issue Apr 18, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
ade7629 
…143)
chuwy added a commit that referenced this issue Apr 19, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
4dc27fd 
…143)
chuwy added a commit that referenced this issue Apr 21, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
18bbfd9 
…143)
chuwy added a commit that referenced this issue Jun 25, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
e4fecdd 
…143)
chuwy added a commit that referenced this issue Jul 18, 2019
@chuwy
RDB Shredder: truncate string values exceeding column's limits (close #…
7cc72dc 
…143)
@chuwy chuwy closed this as completed in 38ae3bf Aug 16, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@chuwy chuwy

Labels
None yet
Projects
None yet
Milestone
Release 31
Development

No branches or pull requests
1 participant
@chuwy