Skip to content

Releases: awslabs/aws-athena-query-federation

Release v2023.18.1 of Athena Query Federation

03 May 18:08
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
891182733 28294338 aws-athena-federation-sdk-2023.18.1-withdep.jar
3259058121 633602 aws-athena-federation-sdk-2023.18.1.jar

Athena Federation Connector Lambda jars

CheckSum File
1289099269 42451291 athena-aws-cmdb-2023.18.1.jar
2932678151 46462687 athena-cloudera-hive-2023.18.1.jar
1021079053 42259163 athena-cloudera-impala-2023.18.1.jar
1911951404 37162482 athena-cloudwatch-2023.18.1.jar
2088111097 31050526 athena-cloudwatch-metrics-2023.18.1.jar
249684480 32717271 athena-datalakegen2-2023.18.1.jar
316277651 37996021 athena-db2-2023.18.1.jar
3361730298 32872176 athena-docdb-2023.18.1.jar
2565813415 32646512 athena-dynamodb-2023.18.1.jar
108435683 57714092 athena-elasticsearch-2023.18.1.jar
3209046396 92248977 athena-gcs-2023.18.1.jar
2466050806 76818901 athena-google-bigquery-2023.18.1.jar
2988867416 93553241 athena-hbase-2023.18.1.jar
2357555302 46463201 athena-hortonworks-hive-2023.18.1.jar
3258943047 44143044 athena-kafka-2023.18.1.jar
2455064608 50905970 athena-msk-2023.18.1.jar
1209696122 35502148 athena-mysql-2023.18.1.jar
3676385385 55075875 athena-neptune-2023.18.1.jar
3638120251 38171548 athena-oracle-2023.18.1.jar
543602779 32417327 athena-postgresql-2023.18.1.jar
2034809379 35643098 athena-redis-2023.18.1.jar
3773260484 33428266 athena-redshift-2023.18.1.jar
1952291644 33099927 athena-saphana-2023.18.1.jar
1307808253 64602545 athena-snowflake-2023.18.1.jar
3953448674 32721605 athena-sqlserver-2023.18.1.jar
3175962678 34931600 athena-synapse-2023.18.1.jar
1090587291 31325508 athena-teradata-2023.18.1.jar
3590870538 31628737 athena-timestream-2023.18.1.jar
3974706684 31165334 athena-tpcds-2023.18.1.jar
3690632561 30492735 athena-udfs-2023.18.1.jar
2660307944 32395625 athena-vertica-2023.18.1.jar

Athena Federation Connector Lambda zips

CheckSum File
3417011914 85955220 athena-gcs.zip
1770185226 81324705 athena-saphana.zip

What's Changed

  • support querying tables across databases for cloudera-hive (#1243)
  • add data stream support for elasticsearch
  • adding equals, toString, and hashCode to GetDataSourceCapabilitiesRequest
  • [JDBC Fix] IN predicate with variable expression formed malformed SQL
  • build(deps): bump ngdbc from 2.16.11 to 2.16.14 (#1238)
  • build(deps): bump google-cloud-bigquery from 2.24.5 to 2.25.0 (#1237)
  • build(deps): bump netty.version from 4.1.91.Final to 4.1.92.Final (#1236)
  • build(deps): bump junit-bom from 5.9.2 to 5.9.3 (#1235)
  • build(deps): bump google-cloud-resourcemanager from 1.17.0 to 1.18.0 (#1234)
  • build(deps): bump google-cloud-storage from 2.22.0 to 2.22.1 (#1233)
  • build(deps): bump jacoco-maven-plugin from 0.8.8 to 0.8.10 (#1232)
  • build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#1231)
  • build(deps): bump aws-sdk.version from 1.12.454 to 1.12.459 (#1230)
  • build(deps): bump aws-cdk.version from 1.199.0 to 1.200.0 (#1229)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.17.1..v2023.18.1

Release v2023.17.1 of Athena Query Federation

28 Apr 20:07
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
1347508576 28204059 aws-athena-federation-sdk-2023.17.1-withdep.jar
612794459 632953 aws-athena-federation-sdk-2023.17.1.jar

Athena Federation Connector Lambda jars

CheckSum File
2523859470 42354958 athena-aws-cmdb-2023.17.1.jar
1081009721 46372407 athena-cloudera-hive-2023.17.1.jar
3289367499 42168922 athena-cloudera-impala-2023.17.1.jar
4194990004 37072216 athena-cloudwatch-2023.17.1.jar
3746831661 30960250 athena-cloudwatch-metrics-2023.17.1.jar
1409805175 32627030 athena-datalakegen2-2023.17.1.jar
1445443224 37905779 athena-db2-2023.17.1.jar
4008388562 32781898 athena-docdb-2023.17.1.jar
3880963363 32556234 athena-dynamodb-2023.17.1.jar
542406834 57622449 athena-elasticsearch-2023.17.1.jar
1304162774 92158560 athena-gcs-2023.17.1.jar
2507045251 76536391 athena-google-bigquery-2023.17.1.jar
1293450867 93463015 athena-hbase-2023.17.1.jar
2456525496 46372957 athena-hortonworks-hive-2023.17.1.jar
3233168544 44052763 athena-kafka-2023.17.1.jar
3208987169 50815689 athena-msk-2023.17.1.jar
2738725878 35411907 athena-mysql-2023.17.1.jar
3172962310 54985595 athena-neptune-2023.17.1.jar
911523890 38081307 athena-oracle-2023.17.1.jar
1474493344 32327085 athena-postgresql-2023.17.1.jar
1813767336 35552819 athena-redis-2023.17.1.jar
2930012371 33338024 athena-redshift-2023.17.1.jar
2909145328 33009686 athena-saphana-2023.17.1.jar
1775614847 64512304 athena-snowflake-2023.17.1.jar
1951901067 32631363 athena-sqlserver-2023.17.1.jar
286207120 34841359 athena-synapse-2023.17.1.jar
1333293987 31235268 athena-teradata-2023.17.1.jar
2191864685 31538456 athena-timestream-2023.17.1.jar
1302806756 31075055 athena-tpcds-2023.17.1.jar
3923748428 30402456 athena-udfs-2023.17.1.jar
1357193872 32305346 athena-vertica-2023.17.1.jar

Athena Federation Connector Lambda zips

CheckSum File
3944086861 85879769 athena-gcs.zip
2443890447 81099258 athena-saphana.zip

What's Changed

  • [Bug Fix] [athena-cloudwatch] Stop lowercasing all schemas and tables, fix data integrity issue
  • athena-timestream: Add pagination for doListTables
  • Add PaginatedRequestIterator
  • [Timestream] Add case-insensitive lookup to allow queries against cased dbs/tables to succeed
  • build(deps): bump aws-cdk.version from 1.198.1 to 1.199.0 (#1219)
  • build(deps): bump fasterxml.jackson.version from 2.14.2 to 2.15.0 (#1221)
  • build(deps): bump vertica-jdbc from 12.0.3-0 to 12.0.4-0 (#1225)
  • build(deps): bump mysql-connector-j from 8.0.32 to 8.0.33 (#1224)
  • build(deps): bump snowflake-jdbc from 3.13.29 to 3.13.30 (#1223)
  • build(deps): bump maven-checkstyle-plugin from 3.2.1 to 3.2.2 (#1222)
  • build(deps): bump lettuce-core from 6.2.3.RELEASE to 6.2.4.RELEASE (#1220)
  • build(deps): bump aws-sdk.version from 1.12.450 to 1.12.454 (#1218)
  • Update cut_release.yml (#1217)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.16.2..v2023.17.1

Release v2023.16.2 of Athena Query Federation

19 Apr 16:31
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
774421089 28095323 aws-athena-federation-sdk-2023.16.2-withdep.jar
1407983997 631548 aws-athena-federation-sdk-2023.16.2.jar

Athena Federation Connector Lambda jars

CheckSum File
189731503 42246222 athena-aws-cmdb-2023.16.2.jar
364297972 46263671 athena-cloudera-hive-2023.16.2.jar
4090968800 42060185 athena-cloudera-impala-2023.16.2.jar
1218694276 36976933 athena-cloudwatch-2023.16.2.jar
4182206810 30851513 athena-cloudwatch-metrics-2023.16.2.jar
929912942 32518294 athena-datalakegen2-2023.16.2.jar
2893322158 37797043 athena-db2-2023.16.2.jar
2614192738 32673161 athena-docdb-2023.16.2.jar
310525440 32447497 athena-dynamodb-2023.16.2.jar
3456732252 57513716 athena-elasticsearch-2023.16.2.jar
3552026413 92049823 athena-gcs-2023.16.2.jar
1386494255 76427655 athena-google-bigquery-2023.16.2.jar
227268333 93354860 athena-hbase-2023.16.2.jar
1207377530 46264221 athena-hortonworks-hive-2023.16.2.jar
1287185985 43943674 athena-kafka-2023.16.2.jar
2792742500 50706595 athena-msk-2023.16.2.jar
2417662932 35302432 athena-mysql-2023.16.2.jar
404986945 54876858 athena-neptune-2023.16.2.jar
1678361833 37972571 athena-oracle-2023.16.2.jar
4019388370 32218349 athena-postgresql-2023.16.2.jar
3484660406 35433670 athena-redis-2023.16.2.jar
4245139591 33229288 athena-redshift-2023.16.2.jar
380990994 32901095 athena-saphana-2023.16.2.jar
3955655256 64411673 athena-snowflake-2023.16.2.jar
2722421933 32522627 athena-sqlserver-2023.16.2.jar
2725779463 34732623 athena-synapse-2023.16.2.jar
189912743 31126531 athena-teradata-2023.16.2.jar
3320115182 31427588 athena-timestream-2023.16.2.jar
3502614897 30966318 athena-tpcds-2023.16.2.jar
886541438 30293720 athena-udfs-2023.16.2.jar
415576451 32178276 athena-vertica-2023.16.2.jar

Athena Federation Connector Lambda zips

CheckSum File
1549641596 85786007 athena-gcs.zip
1782627894 80817953 athena-saphana.zip

What's Changed

  • Drop SerDe version to 2 for connectors until Athena Engine V2 receives resolution fix
  • build(deps): bump ImpalaJDBC42 from 2.6.29.1035 to 2.6.30.1036 (#1215)
  • build(deps): bump msal4j from 1.13.7 to 1.13.8 (#1214)
  • build(deps): bump grpc-google-cloud-bigquerystorage-v1 from 2.34.2 to 2.35.0 (#1211)
  • build(deps): bump google-cloud-bigquery from 2.24.4 to 2.24.5 (#1208)
  • build(deps): bump google-cloud-resourcemanager from 1.16.0 to 1.17.0 (#1207)
  • build(deps): bump redshift-jdbc42 from 2.1.0.13 to 2.1.0.14 (#1206)
  • build(deps): bump jetty.version from 11.0.14 to 11.0.15 (#1205)
  • build(deps): bump hbase.version from 2.5.3-hadoop3 to 2.5.4-hadoop3 (#1204)
  • build(deps): bump google-cloud-storage from 2.21.0 to 2.22.0 (#1203)
  • build(deps): bump aws-sdk.version from 1.12.445 to 1.12.450

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.16.1..v2023.16.2

Release v2023.16.1 of Athena Query Federation

17 Apr 20:23
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
3870742584 28095118 aws-athena-federation-sdk-2023.16.1-withdep.jar
452649490 631547 aws-athena-federation-sdk-2023.16.1.jar

Athena Federation Connector Lambda jars

CheckSum File
3876905364 42245639 athena-aws-cmdb-2023.16.1.jar
4153054376 46263464 athena-cloudera-hive-2023.16.1.jar
1115656896 42057059 athena-cloudera-impala-2023.16.1.jar
3018073767 36976728 athena-cloudwatch-2023.16.1.jar
3475544197 30851308 athena-cloudwatch-metrics-2023.16.1.jar
3129732164 32518088 athena-datalakegen2-2023.16.1.jar
388066706 37796837 athena-db2-2023.16.1.jar
397687536 32672956 athena-docdb-2023.16.1.jar
2673061825 32447292 athena-dynamodb-2023.16.1.jar
3857145612 57513507 athena-elasticsearch-2023.16.1.jar
1612058836 96721222 athena-gcs-2023.16.1.jar
702692374 76423294 athena-google-bigquery-2023.16.1.jar
4019116186 93347479 athena-hbase-2023.16.1.jar
2208145556 46264013 athena-hortonworks-hive-2023.16.1.jar
173981796 43943467 athena-kafka-2023.16.1.jar
323950310 50706388 athena-msk-2023.16.1.jar
2179415089 35302227 athena-mysql-2023.16.1.jar
3693881957 54876654 athena-neptune-2023.16.1.jar
670408913 37972365 athena-oracle-2023.16.1.jar
2970675342 32218143 athena-postgresql-2023.16.1.jar
3086774122 35433465 athena-redis-2023.16.1.jar
3720788846 33226709 athena-redshift-2023.16.1.jar
1152995034 32900888 athena-saphana-2023.16.1.jar
1056449198 64411467 athena-snowflake-2023.16.1.jar
1011683411 32522421 athena-sqlserver-2023.16.1.jar
2802775143 34609228 athena-synapse-2023.16.1.jar
1426746849 31126326 athena-teradata-2023.16.1.jar
275492356 31427380 athena-timestream-2023.16.1.jar
3625116623 30966113 athena-tpcds-2023.16.1.jar
1152223290 30293514 athena-udfs-2023.16.1.jar
2720287683 32178070 athena-vertica-2023.16.1.jar

Athena Federation Connector Lambda zips

CheckSum File
2812975538 89950687 athena-gcs.zip
3598162866 80838460 athena-saphana.zip

What's Changed

  • Merge pull request #1212 from awslabs/master-ddb-ignore-no-kms-table
  • return empty schema in ddb kms encrypted table when lambda role doesn't have access to KMS
  • Merge pull request #1213 from awslabs/mysql-test-typo
  • [athena-mysql Fix] Add testing for both order by directiosn in MySql test
  • build(deps): bump protobuf-java from 3.22.2 to 3.22.3
  • PR Review Updates
  • Make sdk changes leaner
  • Update Athena-Example and Documentation for Predicate Pushdown Changes
  • Update SerDe to V4 and add backwards compatibilty support
  • JDBC Aggregation Support, DynamoDB Limit Support, Order By Support, Parser Bug Fix
  • Bump POM, fix checkstyle and bugs
  • GetDataSourceCapabilities Impl, LIMIT support JDBC, Complex Expression Parser for JDBC
  • Initial SDK Changes for Predicate Pushdown
  • feat(athena-redshift): Support spill buckets using KMS CMK keys, passing role arn for lambda

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.15.1..v2023.16.1

Release v2023.15.1 of Athena Query Federation

12 Apr 19:33
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
143044011 28019960 aws-athena-federation-sdk-2023.15.1-withdep.jar
3268165024 557485 aws-athena-federation-sdk-2023.15.1.jar

Athena Federation Connector Lambda jars

CheckSum File
3380286845 42170481 athena-aws-cmdb-2023.15.1.jar
3093052493 46179379 athena-cloudera-hive-2023.15.1.jar
426208953 41972976 athena-cloudera-impala-2023.15.1.jar
857368483 36901570 athena-cloudwatch-2023.15.1.jar
1148856696 30776150 athena-cloudwatch-metrics-2023.15.1.jar
1741786200 32434004 athena-datalakegen2-2023.15.1.jar
1996051552 37712754 athena-db2-2023.15.1.jar
3560962519 32597798 athena-docdb-2023.15.1.jar
2210551248 32371679 athena-dynamodb-2023.15.1.jar
808569119 57438344 athena-elasticsearch-2023.15.1.jar
2123528429 96646062 athena-gcs-2023.15.1.jar
2742342924 76339213 athena-google-bigquery-2023.15.1.jar
4231364584 93272321 athena-hbase-2023.15.1.jar
2406395843 46179929 athena-hortonworks-hive-2023.15.1.jar
2215782615 43868309 athena-kafka-2023.15.1.jar
1341806596 50631230 athena-msk-2023.15.1.jar
352350104 35216139 athena-mysql-2023.15.1.jar
1150988845 54801494 athena-neptune-2023.15.1.jar
2521515065 37888282 athena-oracle-2023.15.1.jar
118316999 32132061 athena-postgresql-2023.15.1.jar
1163336208 35358307 athena-redis-2023.15.1.jar
2086209832 33139054 athena-redshift-2023.15.1.jar
660180290 32816806 athena-saphana-2023.15.1.jar
850047180 64327384 athena-snowflake-2023.15.1.jar
411570709 32438336 athena-sqlserver-2023.15.1.jar
3704636922 34525145 athena-synapse-2023.15.1.jar
2756724771 31042243 athena-teradata-2023.15.1.jar
3748898417 31352222 athena-timestream-2023.15.1.jar
4197380824 30890955 athena-tpcds-2023.15.1.jar
2825978998 30218356 athena-udfs-2023.15.1.jar
211662514 32102912 athena-vertica-2023.15.1.jar

Athena Federation Connector Lambda zips

CheckSum File
2059150309 89890649 athena-gcs.zip
1320015196 80710770 athena-saphana.zip

What's Changed

  • [fix]athena-google-bigquery: return athena catalog name instead of project name from gbq. (#1200)
  • DateTimeFormatterUtilTest: verify round trip packing unpacking
  • build(deps): bump api-ldap-model from 2.1.2 to 2.1.3
  • build(deps): bump jsii-runtime from 1.79.0 to 1.80.0
  • build(deps): bump ojdbc8 from 21.9.0.0 to 23.2.0.0
  • build(deps): bump netty.version from 4.1.90.Final to 4.1.91.Final
  • build(deps): bump google-cloud-storage from 2.20.2 to 2.21.0
  • build(deps): bump aws-sdk.version from 1.12.440 to 1.12.445
  • build(deps): bump mongo-java-driver from 3.12.12 to 3.12.13
  • build(deps): bump xml2js (#1197)
  • workflows/cut_release: fix release version auto increment

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.14.1..v2023.15.1

Release v2023.14.1 of Athena Query Federation

06 Apr 19:47
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
3563656006 27997315 aws-athena-federation-sdk-2023.14.1-withdep.jar
301595864 557484 aws-athena-federation-sdk-2023.14.1.jar

Athena Federation Connector Lambda jars

CheckSum File
1019824191 42147613 athena-aws-cmdb-2023.14.1.jar
2267665919 46156737 athena-cloudera-hive-2023.14.1.jar
1234534622 41950331 athena-cloudera-impala-2023.14.1.jar
768806824 36878923 athena-cloudwatch-2023.14.1.jar
2626937562 30753502 athena-cloudwatch-metrics-2023.14.1.jar
2200882004 32411359 athena-datalakegen2-2023.14.1.jar
844961568 37690111 athena-db2-2023.14.1.jar
1439136062 32575123 athena-docdb-2023.14.1.jar
2437886066 32349032 athena-dynamodb-2023.14.1.jar
3829401462 57415697 athena-elasticsearch-2023.14.1.jar
1169918071 96279333 athena-gcs-2023.14.1.jar
1300489848 76316750 athena-google-bigquery-2023.14.1.jar
1124573134 93249674 athena-hbase-2023.14.1.jar
1002962800 46157286 athena-hortonworks-hive-2023.14.1.jar
4067167925 43845665 athena-kafka-2023.14.1.jar
1071145095 50608586 athena-msk-2023.14.1.jar
1046851615 35193495 athena-mysql-2023.14.1.jar
1645828526 54778850 athena-neptune-2023.14.1.jar
3544258288 36117620 athena-oracle-2023.14.1.jar
1244557429 32109416 athena-postgresql-2023.14.1.jar
718757645 35335663 athena-redis-2023.14.1.jar
218200707 33116409 athena-redshift-2023.14.1.jar
3652219759 32794160 athena-saphana-2023.14.1.jar
3406623695 64304740 athena-snowflake-2023.14.1.jar
1948127488 32415693 athena-sqlserver-2023.14.1.jar
1158559163 34502501 athena-synapse-2023.14.1.jar
3078596866 31019599 athena-teradata-2023.14.1.jar
202626413 31329577 athena-timestream-2023.14.1.jar
2073325703 30868312 athena-tpcds-2023.14.1.jar
875563117 30195716 athena-udfs-2023.14.1.jar
700336835 32080268 athena-vertica-2023.14.1.jar

Athena Federation Connector Lambda zips

CheckSum File
3146084142 89576013 athena-gcs.zip
3041665879 80639840 athena-saphana.zip

What's Changed

  • publish_to_maven_central: use -am flag
  • publish_to_maven_central: add athena-federation-integ-test
  • Added Money type support for Postgres
  • Remove *-dsv2
  • Update publish_to_maven_central.yml
  • Compatibility changes for certain Spark distributions
  • Merge pull request #1179 from awslabs/cross-account-ddb
  • [SDK + DDB] Add Cross-Account DynamoDB Table Access + Generic Cross-Account Credentials Provider
  • build(deps): bump grpc-google-cloud-bigquerystorage-v1
  • build(deps): bump msal4j from 1.13.6 to 1.13.7
  • build(deps): bump commons-configuration2 from 2.8.0 to 2.9.0
  • build(deps): bump google-cloud-bigquery from 2.21.0 to 2.24.4
  • build(deps): bump aws-cdk.version from 1.198.0 to 1.198.1
  • build(deps): bump aws-sdk.version from 1.12.435 to 1.12.440
  • build(deps): bump google-cloud-resourcemanager from 1.15.0 to 1.16.0
  • Update workflows/codeql-analysis again
  • workflows/codeql-analysis: custom java build step
  • workflows/cut_release: filter out athena-jdbc

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.13.1..v2023.14.1

Release v2023.13.1 of Athena Query Federation

31 Mar 22:27
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

Athena Federation SDK jars

CheckSum File
106247132 27843525 aws-athena-federation-sdk-2023.13.1-withdep.jar
1683627323 555754 aws-athena-federation-sdk-2023.13.1.jar

Athena Federation Connector Lambda jars

CheckSum File
2647384524 41965608 athena-aws-cmdb-2023.13.1.jar
1524122275 46002766 athena-cloudera-hive-2023.13.1.jar
3448108009 41796360 athena-cloudera-impala-2023.13.1.jar
2747324484 36725127 athena-cloudwatch-2023.13.1.jar
1938734417 30599709 athena-cloudwatch-metrics-2023.13.1.jar
3224821913 32257388 athena-datalakegen2-2023.13.1.jar
2653964697 37536141 athena-db2-2023.13.1.jar
1059426856 32421330 athena-docdb-2023.13.1.jar
3352525496 32194936 athena-dynamodb-2023.13.1.jar
3573705929 57261901 athena-elasticsearch-2023.13.1.jar
1167431189 96125539 athena-gcs-2023.13.1.jar
69544486 75695226 athena-google-bigquery-2023.13.1.jar
1935794288 93089387 athena-hbase-2023.13.1.jar
3923329631 46003314 athena-hortonworks-hive-2023.13.1.jar
312397252 43843091 athena-kafka-2023.13.1.jar
270383804 50606012 athena-msk-2023.13.1.jar
140119810 35039526 athena-mysql-2023.13.1.jar
1809837648 54612818 athena-neptune-2023.13.1.jar
2316746942 35963650 athena-oracle-2023.13.1.jar
3802162267 31955448 athena-postgresql-2023.13.1.jar
950037823 35181869 athena-redis-2023.13.1.jar
1563559772 32962436 athena-redshift-2023.13.1.jar
3609424473 32640191 athena-saphana-2023.13.1.jar
2898419139 64150767 athena-snowflake-2023.13.1.jar
2488717553 32261723 athena-sqlserver-2023.13.1.jar
3703871049 34348529 athena-synapse-2023.13.1.jar
2297934003 30865628 athena-teradata-2023.13.1.jar
2305222628 31175779 athena-timestream-2023.13.1.jar
1535457638 30714517 athena-tpcds-2023.13.1.jar
967577577 30041922 athena-udfs-2023.13.1.jar
3471837433 31926474 athena-vertica-2023.13.1.jar

Athena Federation Connector Lambda zips

CheckSum File
4117460929 89437756 athena-gcs.zip
2528793740 80227285 athena-saphana.zip

What's Changed

  • bump redshift to preferred driver version
  • workflows: use aws-athena-query-federation group
  • workflows/cut_release: temporary changes
  • Update workflow/cut_release to include the zips as well
  • Workflows updates (#1161)
  • workflows/cut_release: Use ubuntu-latest instead of self-hosted (#1160)
  • Add github workflow to cut a release (#1159)
  • Fix typo in Kafka (#1158)
  • Add athena-federation-sdk-dsv2 and adapted connectors
  • Add AthenaFederationIpcOption for backwards compatibility with Arrow 2.0.0
  • Fixed accessing domain endpoints that are in a VPC when using auto_discover_endpoint.
  • athena-gcs: Update GcsUtilsTest for coerce (#1145)
  • build(deps): bump msal4j from 1.13.5 to 1.13.6 (#1150)
  • build(deps): bump aws-cdk.version from 1.197.0 to 1.198.0 (#1147)
  • build(deps): bump jsii-runtime from 1.78.1 to 1.79.0 (#1151)
  • build(deps): bump google-cloud-storage from 2.20.1 to 2.20.2 (#1155)
  • build(deps): bump jqwik from 1.7.2 to 1.7.3 (#1154)
  • build(deps): bump ngdbc from 2.16.10 to 2.16.11 (#1153)
  • build(deps): bump hadoop-common from 3.3.4 to 3.3.5 (#1149)
  • build(deps): bump aws-sdk.version from 1.12.431 to 1.12.435 (#1146)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.12.1..v2023.13.1

Release v2023.12.1 of Athena Query Federation

24 Mar 16:43
a836f95
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum File
1845195280 554586 aws-athena-federation-sdk-2023.12.1.jar
2565088674 27841074 aws-athena-federation-sdk-2023.12.1-withdep.jar

What's Changed

  • athena-gcs: Fix StorageMetadata::getCompatibleFieldType (#1142)
  • Update maven_push.yml
  • updated getInt() to getLong() to fetch record count (#1143)
  • Update maven_push.yml
  • Add support for TIMESTAMPMICROTZ
  • Add support unpacked timestamps with timezones
  • Add ArrowSchemaUtils.remapArrowTypesWithinField
  • build(deps): bump ngdbc from 2.15.12 to 2.16.10 (#1131)
  • build(deps): bump google-cloud-resourcemanager from 1.14.0 to 1.15.0 (#1129)
  • build(deps): bump postgresql from 42.5.4 to 42.6.0 (#1128)
  • build(deps): bump surefire.failsafe.version from 3.0.0-M9 to 3.0.0 (#1127)
  • build(deps): bump aws-sdk.version from 1.12.425 to 1.12.431 (#1140)
  • build(deps): bump slf4j-log4j.version from 2.0.6 to 2.0.7 (#1130)
  • build(deps-dev): bump equalsverifier from 3.14 to 3.14.1 (#1132)
  • build(deps): bump netty.version from 4.1.89.Final to 4.1.90.Final (#1133)
  • build(deps): bump jsii-runtime from 1.77.0 to 1.78.1 (#1134)
  • build(deps): bump snowflake-jdbc from 3.13.28 to 3.13.29 (#1136)
  • build(deps): bump aws-sdk.version from 1.12.425 to 1.12.430 (#1126)
  • build(deps): bump aws-cdk.version from 1.196.0 to 1.197.0 (#1125)
  • build(deps): bump jettison from 1.5.3 to 1.5.4 (#1137)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.11.1..v2023.12.1

Release v2023.11.1 of Athena Query Federation

17 Mar 20:19
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum File
1722592411 551184 aws-athena-federation-sdk-2023.11.1.jar
1859491083 27835357 aws-athena-federation-sdk-2023.11.1-withdep.jar

What's Changed

  • GCS connector fix partition column value issue (#1120)
  • athena-dynamodb: Improve ddb sort key pushdown handling (#1122)
  • Don't depend on Google Guava toImmutableList (#1119)
  • domain.predicate.Constraints: Fix close() method signature (#1116)
  • Some of the SortedRangeSet static utility functions public (#1118)
  • Enhance BlockAllocatorImpl to take in a shared RootAllocator (#1117)
  • codeql-analysis.yml: skip duplicate actions (#1114)
  • build(deps): bump protobuf-java from 3.22.0 to 3.22.2 (#1111)
  • build(deps): bump jsii-runtime from 1.76.0 to 1.77.0 (#1113)
  • build(deps): bump google-cloud-storage from 2.19.0 to 2.20.1 (#1109)
  • build(deps): bump aws-sdk.version from 1.12.420 to 1.12.425 (#1108)
  • build(deps): bump aws-cdk.version from 1.195.0 to 1.196.0 (#1107)
  • .github/workflows/maven_push.yml: target java 8 to ensure source compatibility (#1106)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.10.1..v2023.11.1

Release v2023.10.1 of Athena Query Federation

10 Mar 23:28
197f491
Compare
Choose a tag to compare

This version includes improvements and bugfixes in some connectors. See here for changes since the last release.

Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:

  1. Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".

  2. Look for entries published by the "Amazon Athena Federation" author.

You can assert the validity of the binary distribution by comparing against the below cksums.

CheckSum File
3004269374 551040 aws-athena-federation-sdk-2023.10.1.jar
405396809 27834365 aws-athena-federation-sdk-2023.10.1-withdep.jar

What's Changed

  • .github/workflows/maven_push.yml enhancements (#1103)
  • Merge pull request #1102 from awslabs/msk-pagination-get-splits
  • Apply same diff to kafka
  • Add pagination for MSK doGetSplits
  • GCS connector fix for uploaded partition folder issue (#1099)
  • Make source compatible with Java 8 (#1100)
  • build(deps): bump google-cloud-resourcemanager from 1.13.0 to 1.14.0 (#1095)
  • build(deps): bump jetty.version from 11.0.13 to 11.0.14 (#1094)
  • build(deps): bump maven-compiler-plugin from 3.10.1 to 3.11.0 (#1093)
  • build(deps-dev): bump equalsverifier from 3.13.2 to 3.14 (#1098)
  • build(deps): bump aws-sdk.version from 1.12.415 to 1.12.420 (#1092)
  • build(deps): bump aws-cdk.version from 1.194.0 to 1.195.0 (#1091)
  • Get rid of environment variable mocking
  • Refactor code to not use System.getenv directly
  • build(deps-dev): bump log4j2Version from 2.19.0 to 2.20.0
  • build(deps): bump spotbugs-annotations from RELEASE to 4.7.3
  • build(deps): bump snakeyaml from 1.33 to 2.0
  • build(deps): bump msal4j from 1.13.4 to 1.13.5
  • build(deps): bump google-cloud-storage from 2.18.0 to 2.19.0
  • build(deps): bump maven-assembly-plugin from 3.4.2 to 3.5.0
  • build(deps): bump snowflake-jdbc from 3.13.27 to 3.13.28
  • build(deps): bump ngdbc from 2.15.10 to 2.15.12
  • build(deps): bump aws-cdk.version from 1.193.0 to 1.194.0
  • build(deps): bump aws-sdk.version from 1.12.410 to 1.12.415
  • build(deps): bump jsii-runtime from 1.75.0 to 1.76.0 (#1076)

Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.8.3..v2023.10.1