-
Notifications
You must be signed in to change notification settings - Fork 0
Spidering Format
thill-odi edited this page Jun 12, 2020
·
6 revisions
The first step in normalising the data is to harvest the data. And the first step for harvesting the data is spidering down from a top-level data catalogue through to the data endpoints themselves.
For an example of how this works, starting from a Top-Level Directory JSON object, spidering should traverse as follows:
- https://opendata.leisurecloud.live/api/datacatalog
- https://openactivedatacatalog.legendonlineservices.co.uk/api/DataCatalog
- https://openactive.io/data-catalogs/singular.jsonld
- http://data.better.org.uk/
- http://data.bookwhen.com/
- http://data.britishorienteering.org.uk/
- http://data.britishtriathlon.org/
- http://data.emduk.org/
- http://data.gomammoth.co.uk/
- http://data.goodgym.org/
- http://data.letsride.co.uk/
- http://data.makesweat.com/
- http://data.opensessions.io/
- http://data.pingengland.co.uk/
- http://data.tabletennis365.com/
- https://api.activenewham.org.uk/OpenActive/
- https://blackburnwithdarwen-openactive.legendonlineservices.co.uk/OpenActive
- https://booking.1life.co.uk/OpenActive/
- https://data.englandnetball.co.uk/
- https://data.everyoneactive.com/OpenActive/
- https://data.runtogether.co.uk/
- https://gll-openactive.legendonlineservices.co.uk/OpenActive
- https://goteamup.com/api/openactive/v1/
- https://halo-openactive.legendonlineservices.co.uk/OpenActive
- https://hsvonline.herts.ac.uk/OpenActive/
- https://jubileehall-openactive.legendonlineservices.co.uk/OpenActive
- https://lancaster-openactive.legendonlineservices.co.uk/OpenActive
- https://lawntennisassociation.github.io/
- https://leisurecentre-openactive.legendonlineservices.co.uk/OpenActive
- https://lifeleisure-openactive.legendonlineservices.co.uk/OpenActive
- https://lincsinspire-openactive.legendonlineservices.co.uk/OpenActive
- https://mws.ledleisure.co.uk/OpenActive/
- https://onlinebooking.1610.org.uk/OpenActive/
- https://openactive.upshot.org.uk/
- https://opendata.exercise-anywhere.com/
- https://opendata.fusion-lifestyle.com/OpenActive/
- https://opendata.fusion-lifestyle.com/OpenActiveTNG/
- https://ourparks.org.uk/openactive
- https://playwaze.com/OpenData/OpenActive
- https://sales360.gladstonesoftware.co.uk/OpenActive/
- https://serco-openactive.legendonlineservices.co.uk/OpenActive
- https://sportstarta.github.io/
- https://tameside-openactive.legendonlineservices.co.uk/OpenActive
- https://tst.myeveryoneactive.com/OpenActive/
- https://uatbook.myeveryoneactive.com/OpenActive/
- https://webbookings.blackpool.gov.uk/OpenActive/
- https://www.participant.co.uk/participant/openactive/
- https://www.sportsuite.co.uk/odapikey/datasite/
- https://ymcaspg.leisurecloud.net/OpenActive/
- http://api.cotech.no/api/v1/oa/1325/courses
- http://api.cotech.no/api/v1/oa/1325/events
- http://api.cotech.no/api/v1/oa/1325/scheduled-sessions
- http://api.cotech.no/api/v1/oa/1325/sessions
- https://blackburnwithdarwen-openactive.legendonlineservices.co.uk/api/facility-uses
- https://blackburnwithdarwen-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://blackburnwithdarwen-openactive.legendonlineservices.co.uk/api/sessions
- https://gll-openactive.legendonlineservices.co.uk/api/facility-uses
- https://gll-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://gll-openactive.legendonlineservices.co.uk/api/sessions
- https://goteamup.com/api/openactive/v1/events
- https://goteamup.com/api/openactive/v1/scheduledsessions
- https://goteamup.com/api/openactive/v1/sessionseries
- https://halo-openactive.legendonlineservices.co.uk/api/facility-uses
- https://halo-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://halo-openactive.legendonlineservices.co.uk/api/sessions
- https://jubileehall-openactive.legendonlineservices.co.uk/api/facility-uses
- https://jubileehall-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://jubileehall-openactive.legendonlineservices.co.uk/api/sessions
- https://lancaster-openactive.legendonlineservices.co.uk/api/facility-uses
- https://lancaster-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://lancaster-openactive.legendonlineservices.co.uk/api/sessions
- https://leisurecentre-openactive.legendonlineservices.co.uk/api/facility-uses
- https://leisurecentre-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://leisurecentre-openactive.legendonlineservices.co.uk/api/sessions
- https://lifeleisure-openactive.legendonlineservices.co.uk/api/facility-uses
- https://lifeleisure-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://lifeleisure-openactive.legendonlineservices.co.uk/api/sessions
- https://lincsinspire-openactive.legendonlineservices.co.uk/api/facility-uses
- https://lincsinspire-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://lincsinspire-openactive.legendonlineservices.co.uk/api/sessions
- https://opendata.exercise-anywhere.com/api/rpde/events
- https://opendata.exercise-anywhere.com/api/rpde/scheduled-sessions
- https://opendata.exercise-anywhere.com/api/rpde/session-series
- https://opendata.leisurecloud.live/api/feeds/1610-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/1610-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/1610-live-session-series
- https://opendata.leisurecloud.live/api/feeds/1610-live-slots
- https://opendata.leisurecloud.live/api/feeds/1Life-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/1Life-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/1Life-live-session-series
- https://opendata.leisurecloud.live/api/feeds/1Life-live-slots
- https://opendata.leisurecloud.live/api/feeds/ActiveNewham-live-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/ActiveNewham-live-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/ActiveNewham-live-live-session-series
- https://opendata.leisurecloud.live/api/feeds/ActiveNewham-live-live-slots
- https://opendata.leisurecloud.live/api/feeds/Blackpool-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/Blackpool-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/Blackpool-live-session-series
- https://opendata.leisurecloud.live/api/feeds/Blackpool-live-slots
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveSLM-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveSLM-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveSLM-live-session-series
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveSLM-live-slots
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveUAT-uat-facility-uses
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveUAT-uat-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveUAT-uat-session-series
- https://opendata.leisurecloud.live/api/feeds/EveryoneActiveUAT-uat-slots
- https://opendata.leisurecloud.live/api/feeds/GladstoneSales-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/GladstoneSales-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/GladstoneSales-live-session-series
- https://opendata.leisurecloud.live/api/feeds/GladstoneSales-live-slots
- https://opendata.leisurecloud.live/api/feeds/HSV-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/HSV-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/HSV-live-session-series
- https://opendata.leisurecloud.live/api/feeds/HSV-live-slots
- https://opendata.leisurecloud.live/api/feeds/LED-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/LED-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/LED-live-session-series
- https://opendata.leisurecloud.live/api/feeds/LED-live-slots
- https://opendata.leisurecloud.live/api/feeds/YMCASTPaulsGroup-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/YMCASTPaulsGroup-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/YMCASTPaulsGroup-live-session-series
- https://opendata.leisurecloud.live/api/feeds/YMCASTPaulsGroup-live-slots
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-live-facility-uses
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-live-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-live-session-series
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-live-slots
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-training-facility-uses
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-training-scheduled-sessions
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-training-session-series
- https://opendata.leisurecloud.live/api/feeds/fusion-lifestyle-fl-training-slots
- https://ourparks.org.uk/api/events
- https://playwaze.com/OpenData/Events
- https://playwaze.com/OpenData/OnDemand
- https://playwaze.com/OpenData/ScheduledSessions
- https://playwaze.com/OpenData/SessionSeries
- https://serco-openactive.legendonlineservices.co.uk/api/facility-uses
- https://serco-openactive.legendonlineservices.co.uk/api/facility-uses/events
- https://serco-openactive.legendonlineservices.co.uk/api/sessions
- https://www.sportsuite.co.uk/api/cs-api/openactive
- http://api.letsride.co.uk/public/v1/rides
- http://www.devapi.lewishamparklife.co.uk/api/games/get_active_single_game
- https://api.britishtriathlon.org/openactive/v1/events
- https://api.clubspark.uk/odi/public/courses
- https://api.englandnetball.co.uk/api/openactive/sessions
- https://api.runtogether.co.uk/odi/public/courses
- https://app.upshot.org.uk/api/v0/openactive/v1.0/
- https://bookwhen.com/api/openactive/event_types
- https://makesweat.com/service/openactive.php
- https://opensessions.io/api/rpde/session-series
- https://reports.gomammoth.co.uk/api/OpenData/Leagues?afterTimestamp=0
- https://www.better.org.uk/odi/sessions.json
- https://www.britishorienteering.org.uk/fullfixturesjson.php
- https://www.classfinder.org.uk/api/public/classes
- https://www.goodgym.org/api/happenings