Skip to content

2019-05-15 (GCS 1.9.17, BQ 0.13.17)
Compare
Choose a tag to compare
@medb medb released this 16 May 00:49
· 9 commits to branch-1.9.x since this release
v1.9.17
6fb7795

Changelog

Cloud Storage connector:

  1. Add a property to parallelize GCS requests in getFileStatus and listStatus methods to reduce latency:

    fs.gs.status.parallel.enable (default: false)

    Setting this property to true will cause GCS connector to send more GCS requests which will decrease latency but also increase cost of getFileStatus and listStatus method calls.

BigQuery connector:

  1. POM updates for GCS connector 1.9.17.

  2. Support nested record type in field schema in BigQuery connector.

  3. Add a property to specify BigQuery tables partitioning definition:

    mapred.bq.output.table.partitioning
Assets 2
Loading