Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

JDBC Sources can discover ints and longs + handle them in normalization #14362

Merged
merged 49 commits into from
Jul 26, 2022
Merged

JDBC Sources can discover ints and longs + handle them in normalization #14362

merged 49 commits into from
Jul 26, 2022

Commits on Jul 22, 2022

  1. generate airbyte_type:integer

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    ae93edd View commit details
    Browse the repository at this point in the history

  2. normalization accepts airbyte_type: integer

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    f1f0e34 View commit details
    Browse the repository at this point in the history

  3. handles ints+longs

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    987ca81 View commit details
    Browse the repository at this point in the history

  4. update avro for consistency

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    54dc4ab View commit details
    Browse the repository at this point in the history

  5. delete long type for now, treat all ints as longs

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    cde8116 View commit details
    Browse the repository at this point in the history

  6. update avro type mappings 

    {type:number, airbyte_type:integer} -> long
{type:number, airbyte_type:big_integer} -> string (i.e. "unbounded integer")
    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    d0781a3 View commit details
    Browse the repository at this point in the history

  7. fix test

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    0fe3927 View commit details
    Browse the repository at this point in the history

  8. remove long handling

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    25f0624 View commit details
    Browse the repository at this point in the history

  9. Revert "remove long handling" 

    This reverts commit 33ade8d.
    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    3fb4bbc View commit details
    Browse the repository at this point in the history

  10. Revert "update avro type mappings" 

    This reverts commit 5b0349b.
    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    a5e1c0c View commit details
    Browse the repository at this point in the history

  11. Revert "delete long type for now, treat all ints as longs" 

    This reverts commit 018efd4.
    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    5dbc721 View commit details
    Browse the repository at this point in the history

  12. Revert "update avro for consistency" 

    This reverts commit bcf47c6.
    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    3279f5b View commit details
    Browse the repository at this point in the history

  13. newline@eof

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    b18a0dd View commit details
    Browse the repository at this point in the history

  14. update test

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    5259c86 View commit details
    Browse the repository at this point in the history

  15. slightly better local tests

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    fd8b780 View commit details
    Browse the repository at this point in the history

  16. fix test

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    ec048b6 View commit details
    Browse the repository at this point in the history

  17. missed a few cases

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    d3b2e20 View commit details
    Browse the repository at this point in the history

  18. postgres tests use correct hostnames

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    8f79a0f View commit details
    Browse the repository at this point in the history

  19. fix normalization

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    903c6da View commit details
    Browse the repository at this point in the history

  20. fix int macro

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    af2566e View commit details
    Browse the repository at this point in the history

  21. add test case

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    0cb6177 View commit details
    Browse the repository at this point in the history

  22. normalization test output

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    76d9b15 View commit details
    Browse the repository at this point in the history

  23. handle int/long correctly

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    cc9d2bb View commit details
    Browse the repository at this point in the history

  24. fix types for other DBs

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    f14e633 View commit details
    Browse the repository at this point in the history

  25. uint32 -> bigint; tests

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    c3ae74c View commit details
    Browse the repository at this point in the history

  26. add type value assertions

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    6248d81 View commit details
    Browse the repository at this point in the history

  27. more test updates

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    5f9a6d8 View commit details
    Browse the repository at this point in the history

  28. regenerate output

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    6f59197 View commit details
    Browse the repository at this point in the history

  29. reconcile big_integer to match docs

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    105aec6 View commit details
    Browse the repository at this point in the history

  30. update comment

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    3e3a7d2 View commit details
    Browse the repository at this point in the history

  31. fix type

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    1d01d82 View commit details
    Browse the repository at this point in the history

  32. fix mysql constructor call

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    ca367ca View commit details
    Browse the repository at this point in the history

  33. bigint only has 38 digits

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    b370502 View commit details
    Browse the repository at this point in the history

  34. fix s3 ints, fix DAT test case

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    80efe72 View commit details
    Browse the repository at this point in the history

  35. big_integer should be string

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    a66f047 View commit details
    Browse the repository at this point in the history

  36. reduce to 28 digit big_ints

    @edgao
    edgao committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    4b5d7b8 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2022

  1. Merge branch 'master' into edgao/int_type

    @edgao
    edgao authored Jul 23, 2022
    Configuration menu
    Copy the full SHA
    93d6f1b View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2022

  1. fix test setup, mysql

    @edgao
    edgao committed Jul 24, 2022
    Configuration menu
    Copy the full SHA
    599bb18 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. kill big_integer tests

    @edgao
    edgao committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    0f0c931 View commit details
    Browse the repository at this point in the history

  2. regenerate output

    @edgao
    edgao committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    95ae5ca View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into edgao/int_type

    @edgao
    edgao committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    20922fa View commit details
    Browse the repository at this point in the history

  4. version bumps

    @edgao
    edgao committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    e30d787 View commit details
    Browse the repository at this point in the history

  5. auto-bump connector version [ci skip]

    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    d365363 View commit details
    Browse the repository at this point in the history

  6. auto-bump connector version [ci skip]

    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    2b445aa View commit details
    Browse the repository at this point in the history

  7. Merge branch 'edgao/int_type' of https://github.com/airbytehq/airbyte … 

    …into edgao/int_type
    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    efaebcc View commit details
    Browse the repository at this point in the history

  8. auto-bump connector version [ci skip]

    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    4c371f0 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'edgao/int_type' of https://github.com/airbytehq/airbyte … 

    …into edgao/int_type
    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    6df941d View commit details
    Browse the repository at this point in the history

  10. auto-bump connector version [ci skip]

    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    28fcbe4 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'edgao/int_type' of https://github.com/airbytehq/airbyte … 

    …into edgao/int_type
    @octavia-squidington-iii
    octavia-squidington-iii committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    cf7dcef View commit details
    Browse the repository at this point in the history