You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
SAT perform schema validation of records against the catalog schema with the jsonschema library.
According to jsonschema a float value with a zero fractional part is a valid integer :
This relaxed definition is problematic because database destinations are more strict in terms of typing.
This situation prevents us from identifying schema inconsistencies in SAT when a field is declared as integers but the actual record values in our test account are 1.0, 2.0, 3.0 etc. It led this PR that introduced a schema inconsistency to be merged with successful acceptance tests.
How
A. Implement a custom check in the verify_records_schema function to make sure that a field defined as integer is an integer in python term's...
B. Find a way to force this validation with jsonschema
The text was updated successfully, but these errors were encountered:
What
SAT perform schema validation of records against the catalog schema with the
jsonschema
library.According to
jsonschema
a float value with a zero fractional part is a validinteger
:This relaxed definition is problematic because database destinations are more strict in terms of typing.
This situation prevents us from identifying schema inconsistencies in SAT when a field is declared as
integers
but the actual record values in our test account are1.0, 2.0, 3.0
etc. It led this PR that introduced a schema inconsistency to be merged with successful acceptance tests.How
A. Implement a custom check in the verify_records_schema function to make sure that a field defined as integer is an integer in python term's...
B. Find a way to force this validation with
jsonschema
The text was updated successfully, but these errors were encountered: