Skip to content

v0.6.0

Compare
Choose a tag to compare
@jeremybeard jeremybeard released this 12 Oct 20:08
· 60 commits to master since this release

Envelope 0.6.0

Highlights

  • Envelope now depends entirely on upstream Apache projects
  • New validation framework to eagerly identify invalid configuration files
  • Migration to standalone delegation token management to remove the dependency on unstable Spark APIs
  • New example showing how Cloudera Navigator logs can be ingested into Kudu and Solr
  • Native Kafka offset management for Kudu inputs, enabled by default
  • Kafka input can now read from a list of topics
  • Translator implementation for protobuf
  • Driver memory can now be set in the application configuration
  • New in-list deriver to filter a dataset where a column value matches a list of values
  • New select deriver to include or exclude a list of columns from a dataset
  • New distinct deriver
  • Support for sliding windows in streaming pipelines

Breaking Changes

  • Repartition and coalesce configurations must now be specified at the step level rather than at input or deriver levels
  • By default, Kafka offset management is turned on and uses Kafka to store the offsets. This means that group.id is now required by default
  • KafkaInput topic configuration is now topics and requires a list of topics
  • Application executors is now executor.instances