2018-09-20 (GCS 1.6.10, BQ 0.10.11)
Changelog
Cloud Storage connector:
-
Add an option to specify max bytes rewritten per rewrite request when
fs.gs.copy.with.rewrite.enable
is set totrue
:fs.gs.rewrite.max.bytes.per.call (default: 536870912)
Even though GCS does not require this parameter for rewrite requests, rewrite requests are flaky without it.
BigQuery connector:
- POM updates for GCS connector 1.6.10.