Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Control Plane API call to put your own custom enrichments in Snowplow Mini #66

Closed
yalisassoon opened this issue Sep 7, 2016 · 7 comments
Assignees
Milestone

Comments

@yalisassoon
Copy link
Member

This is really useful e.g. to test Javascript enrichments before putting them live on production clients.

Note that it is currently possible to do this manually by sshing into the box, adding the enrichments json, editing an init.d file and then rebooting.

@miike
Copy link
Contributor

miike commented Nov 15, 2016

For reference if anybody would like to test enrichments in Snowplow Mini.

  1. SSH into the Snowplow mini machine
    ssh -i private-key.pem ubuntu@IP
  2. Create a directory to store enrichments
    mkdir snowplow/configs/enrichments
  3. Copy or create a new file containing the enrichment. The enrichment should follow the format here. If the enrichment relies on additional schemas these should be uploaded to the Iglu server using the API.
    vim snowplow/configs/enrichments/example.json
  4. Add the --enrichments folder to the init.d file for stream enrich.
    sudo vim /etc/init.d/snowplow_stream_enrich_0.7.0
  5. Add --enrichments file:/home/ubuntu/snowplow/configs/enrichments to the end of the string in the cmd= string.
  6. Save the file
  7. Restart the stream service
    sudo service snowplow_stream_enrich_0.7.0 restart

When the machine reboots events that now go through the stream enricher should use the enrichments specified in the enrichments folder.

@jbeemster
Copy link
Member

Thanks @miike ! Rather than sudo reboot thought we can sudo service snowplow_stream_enrich_0.7.0 restart also just to reset that service.

@miike
Copy link
Contributor

miike commented Nov 15, 2016

Yes, that's a much more graceful way of handling it. I've updated my comment above to reflect that.

@jbeemster
Copy link
Member

I will add these steps to the Wiki until such time as this ticket is cleared!

@jbeemster
Copy link
Member

@alexanderdean
Copy link
Member

Pushing back...

@alexanderdean alexanderdean removed this from the Version 0.3.0 milestone Apr 12, 2017
@alexanderdean alexanderdean added this to the Version 0.4.0 milestone Jul 7, 2017
@alexanderdean
Copy link
Member

I think you can rename this ticket to become one of the Control Plane API tickets

@aldemirenes aldemirenes changed the title Make it possible to run your own custom enrichments in Snowplow Mini Add Control Plane API call to write domain name to Caddyfile for automatic TLS Jul 12, 2017
@aldemirenes aldemirenes changed the title Add Control Plane API call to write domain name to Caddyfile for automatic TLS Add Control Plane API call to put your own custom enrichments in Snowplow Mini Jul 12, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants