This repo does a test drive of using snowflake as a source in ray. This has been done after I struggled to make -- anyscale snowflake connector work. I have written a test driver as well which shows how to do a basic transform on this dataset.
You just need a valid snowflake account to test this out. I tested this code on a trial snowflake account and hence could get this to work with ACCOUNTADMIN creds.
make all: create python 3.10 venv and install the deps.cp .env.example .env: setup the credentials environment.- Open the
.envfile and setup the 3 creds.
Once you have filled up the creds correctly, you can run the script and see things happen. The test script performs a write to a DB as well. You can tinker the script to put in the correct db name.