Skip to content

Webreaper/SensorTagDataCollector

Repository files navigation

SensorTagDataCollector

ElasticSearch Ingester for Wireless Sensor Tag Data.

What does it do?

Wireless Sensor Tags (http://wirelesstag.net) are small sensors which measure humidity, temperature and ambient light level, and transmit this back to a hub to be stored in the cloud. This app uses the WirelessTag API (http://wirelesstag.net/apidoc.html) to query that data, transform it, and ingest it into an ElasticSearch instance for creating dashboards, plotting trends, etc.

As an added bonus, the process can also query the historic temperature of a Hive Home heating system Thermostat, and ingest that data into the ES index too. If you have a Weather Underground (WUnderground) API key, you can also specfy this in the settings, along with a country and city, and the app will pull in complete weather data history for that location and ingest it into ElasticSearch.

Alt text

Features

  • Year-based index generation (e.g., sensordata-2017) with top-level alias creation (e.g., sensordata)
  • High-watermark checking for each device UUID so only new data is ingested on each run
  • Automatic detection of new tags when registered with your account
  • Collection of temp (C), humidity (%RH), ambient light level (lux) and battery-level (volt) collection
  • Optional configuration to send an email if no data received for n minutes, or battery level for any device is too low
  • Optional collection of HiveHome temperature and battery data
  • Optional collection of Weather Underground weather (temp/humidity/rainfall/wind/etc) data

Settings Storage

The service reads the various settings (ES info, WirelessTag username/password) from a json file. It then queries the service, gathering up the data before writing it to the ES cluster/index specified in the settings file. Data is written to month-based indexes, and then an alias created to cover all indexes.

Running the service

The service is a .Net/C# application, developed with Visual Studio fo Mac. It can be run on any architecture - for example, I run it using Mono, on a linux-based Synology NAS. Example command-line:

mono SensorTagDataCollector.exe

Disclaimer

I accept no liability for any data loss or corruption caused by the use of this application. Your use of this app is entirely at your own risk - please ensure that you have adequate backups before you use this software.

Software (C) Copyright 2017-2018 Mark Otway

About

ElasticSearch ingester for Wireless Sensor Tags

Resources

License

Stars

Watchers

Forks

Packages

No packages published