Skip to content

Learn how to develop and test stateful streaming and batch data pipelines

License

Notifications You must be signed in to change notification settings

mkuthan/stream-processing

Repository files navigation

Learn How To Develop And Test Stateful Streaming Data Pipelines

CI codecov

Shared modules:

  • stream-processing-shared - shared utilities for developing stateful streaming data pipelines
  • stream-processing-infrastructure - infrastructure layer with IOs for BigQuery, Pubsub and Cloud Storage
  • stream-processing-test - shared utilities for testing stateful streaming data pipelines

Use cases:

  • toll-application, toll-domain, toll-infrastructure - sample application for toll data processing, see blog post
  • word-count - fixed window example, see blog post
  • session-window - session window example, see blog post