Skip to content

Rapid Snowflake Deployment
Compare
Choose a tag to compare
@AdamDewberry AdamDewberry released this 18 Nov 12:21
· 36 commits to master since this release
v0.1.1
1919df5
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

This initial release uses terraform to rapidly deploy Snowflake resources for data ingestion from AWS S3.

It uses terraform workspaces to separate environments and simplify parameter declarations.

The tooling can create the following resources and their dependencies:

AWS S3 state bucket & DynamoDB lock table
AWS S3 data lake
AWS IAM roles for PUT & GET on S3 files (necessary for imports to Snowflake using Snowpipes and exports to S3 using External Stages)
Snowpipes
External Stages
Storage Integrations

Additions from v0.1.0 is the removal of a circular dependency during initial set up of the DynamoDB lock table.

Assets 2
Loading