Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-12297][SQL] Hive compatibility for Parquet Timestamps #16781

Closed
wants to merge 52 commits into from
Closed

[SPARK-12297][SQL] Hive compatibility for Parquet Timestamps #16781

wants to merge 52 commits into from

Commits on Feb 2, 2017

  1. very basic test for adjusting read parquet data

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    53d0744 View commit details
    Browse the repository at this point in the history

  2. wip

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    69a3c8c View commit details
    Browse the repository at this point in the history

  3. working version for non-vectorized read -- lots of garbage too

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    51e24f2 View commit details
    Browse the repository at this point in the history

  4. working for vectorized reads -- not sure about all code paths

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    7e61841 View commit details
    Browse the repository at this point in the history

  5. more tests for write path

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    9fbde13 View commit details
    Browse the repository at this point in the history

  6. expand tests; fix some metastore interaction; cleanup a lot of garbage

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    bac9eb0 View commit details
    Browse the repository at this point in the history

  7. more cleanup

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    1b05978 View commit details
    Browse the repository at this point in the history

  8. handle bad timezones; include unit test

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    b622d27 View commit details
    Browse the repository at this point in the history

  9. write support; lots more unit tests

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    0604403 View commit details
    Browse the repository at this point in the history

  10. add tests for alter table

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    f45516d View commit details
    Browse the repository at this point in the history

  11. utc or gmt; cleanup

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    d4511a6 View commit details
    Browse the repository at this point in the history

  12. more cleanup

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    223ce2c View commit details
    Browse the repository at this point in the history

  13. fix compatibility

    @squito
    squito committed Feb 2, 2017
    Configuration menu
    Copy the full SHA
    5b49ae0 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    9ef60a4 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    0b6883c View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2017

  1. wip

    @squito
    squito committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    69b8142 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2017

  1. fix

    @squito
    squito committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    7ca2c86 View commit details
    Browse the repository at this point in the history

  2. fixes; passes tests now

    @squito
    squito committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    6f982d3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    1ad2f83 View commit details
    Browse the repository at this point in the history

  4. fix merge

    @squito
    squito committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    2c8a228 View commit details
    Browse the repository at this point in the history

  5. fix

    @squito
    squito committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    f0b89fd View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 13, 2017
    Configuration menu
    Copy the full SHA
    db0216f View commit details
    Browse the repository at this point in the history

  2. refactor the test

    @squito
    squito committed Mar 13, 2017
    Configuration menu
    Copy the full SHA
    46fab8d View commit details
    Browse the repository at this point in the history

  3. cleanup

    @squito
    squito committed Mar 13, 2017
    Configuration menu
    Copy the full SHA
    c242fb8 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2017

  1. reset timezone property after tests; make tests more granular

    @squito
    squito committed Mar 14, 2017
    Configuration menu
    Copy the full SHA
    c87a573 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 14, 2017
    Configuration menu
    Copy the full SHA
    db7e514 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2017

  1. separate tests for reading & writing

    @squito
    squito committed Mar 15, 2017
    Configuration menu
    Copy the full SHA
    f4dca27 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 15, 2017
    Configuration menu
    Copy the full SHA
    2891582 View commit details
    Browse the repository at this point in the history

  3. fix merge

    @squito
    squito committed Mar 15, 2017
    Configuration menu
    Copy the full SHA
    d951443 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 16, 2017
    Configuration menu
    Copy the full SHA
    38e19cd View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 23, 2017
    Configuration menu
    Copy the full SHA
    1e3b768 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @squito
    squito committed Mar 23, 2017
    Configuration menu
    Copy the full SHA
    39f506c View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Mar 24, 2017
    Configuration menu
    Copy the full SHA
    f33bc91 View commit details
    Browse the repository at this point in the history

  2. remove config for setting table time zone automatically

    @squito
    squito committed Mar 24, 2017
    Configuration menu
    Copy the full SHA
    17565e8 View commit details
    Browse the repository at this point in the history

  3. fixup

    @squito
    squito committed Mar 24, 2017
    Configuration menu
    Copy the full SHA
    a96806f View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2017

  1. predicate pushdown tests

    @squito
    squito committed Apr 5, 2017
    Configuration menu
    Copy the full SHA
    7582b2c View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2017

  1. minor cleanup

    @squito
    squito committed Apr 6, 2017
    Configuration menu
    Copy the full SHA
    5817064 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Apr 10, 2017
    Configuration menu
    Copy the full SHA
    773704a View commit details
    Browse the repository at this point in the history

  2. fix merge

    @squito
    squito committed Apr 10, 2017
    Configuration menu
    Copy the full SHA
    be134be View commit details
    Browse the repository at this point in the history

  3. swap conversion logic

    @squito
    squito committed Apr 10, 2017
    Configuration menu
    Copy the full SHA
    d15b660 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2017

  1. update tests a bunch; tests session timezones, and tests are easier t… 

    …o reason about now
    @squito
    squito committed Apr 11, 2017
    Configuration menu
    Copy the full SHA
    283b1c7 View commit details
    Browse the repository at this point in the history

  2. session timezones

    @squito
    squito committed Apr 11, 2017
    Configuration menu
    Copy the full SHA
    6ccaa92 View commit details
    Browse the repository at this point in the history

  3. cleanup

    @squito
    squito committed Apr 11, 2017
    Configuration menu
    Copy the full SHA
    71c7e60 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into SPARK-12297

    @squito
    squito committed Apr 11, 2017
    Configuration menu
    Copy the full SHA
    75e8579 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2017

  1. partial review feedback

    @squito
    squito committed Apr 19, 2017
    Configuration menu
    Copy the full SHA
    e4e88a5 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2017

  1. better param names and docs

    @squito
    squito committed Apr 20, 2017
    Configuration menu
    Copy the full SHA
    44a8bbb View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2017

  1. review feedback

    @squito
    squito committed Apr 25, 2017
    Configuration menu
    Copy the full SHA
    e31657a View commit details
    Browse the repository at this point in the history

Commits on May 2, 2017

  1. Merge branch 'master' into SPARK-12297

    @squito
    squito committed May 2, 2017
    Configuration menu
    Copy the full SHA
    d4ff9fd View commit details
    Browse the repository at this point in the history

  2. add check for partitioned tables

    @squito
    squito committed May 2, 2017
    Configuration menu
    Copy the full SHA
    acc72ea View commit details
    Browse the repository at this point in the history

  3. fix typo

    @squito
    squito committed May 2, 2017
    Configuration menu
    Copy the full SHA
    b9c03e9 View commit details
    Browse the repository at this point in the history

  4. review feedback

    @squito
    squito committed May 2, 2017
    Configuration menu
    Copy the full SHA
    fc17a2e View commit details
    Browse the repository at this point in the history

Commits on May 3, 2017

  1. review feedback

    @squito
    squito committed May 3, 2017
    Configuration menu
    Copy the full SHA
    2537437 View commit details
    Browse the repository at this point in the history