10 October 2022
Go.Data is a software for outbreak response and contact tracing developed by WHO in collaboration with partners in the Global Outbreak Alert and Response Network (GOARN). Go.Data focusses on case and contact data including laboratory data, hospitalization and other variables collected through investigation forms. It generates contact follow-up lists and allows visualisation of chains of transmission.
The godataR package was built to allow the Go.Data user
community to more easily retrieve or
send data from or to a particular instance of Go.Data via its API,
especially when dealing with large volumes of data. You can now quickly
retrieve a database colleciton in an un-nested format for further
cleaning and analysis with one line of R code.
For example, the functions get_cases() or get_locations() provides a
painless way to retrieve case data or hierarchical locations by
bypassing all of the normal API syntax and authenticating with Go.Data
user login credentials from objects already stored in the R environment.
Users can also now retrieve cases, contacts or laboratory records that
fall within a specific date range, using get_cases_epiwindow(),
get_contacts_epiwindow() or get_labresults_epiwindow() respectively.
get_lab_fields() is another new function that will help users retrieve
a table of all the laboratory fields (including those in the lab
questionnaire) and their reference values (where relevant), for their
active outbreak. This may be useful for automating reporting on lab
results across different instances of Go.Data, particularly if the exact
structure and column names within the database are not known. Future
versions may include a similar approach for case data.
Future iterations will focus on POSTing to the Go.Data API for bulk creation or modification of case, contact and lab records.
This package is hosted on the WHO Github Repository here: https://github.com/WorldHealthOrganization/godataR. Install the package within your R console by executing the code below.
# Install package
devtools::install_github("WorldHealthOrganization/godataR")You must have valid Go.Data user credentials with appropriate roles/permissions to successfully receive an access token to make any API calls. You can set your parameters at the outset of your R session, to call them more easily when fetching your collections. You can also specify ad-hoc if you are working across various outbreaks.
### Set Go.Data login credentials:
# Load libraries:
library(getPass)
library(godataR)
# Your Go.Data URL
url <- "https://MyGoDataServer.com/"
# Your email address to log in to Go.Data
username <- getPass::getPass(msg = "Enter your Go.Data username (email address):")
# Your password to log in to Go.Data
password <- getPass::getPass(msg = "Enter your Go.Data password:")
# Get ID for active outbreak:
outbreak_id <- godataR::get_active_outbreak(url = url,
username = username,
password = password)# Get case data:
cases <- get_cases(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get contacts data:
contacts <- get_contacts(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get contacts of contacts:
contacts_of_contacts <- get_contacts_of_contacts(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get lab results:
lab_results <- get_labresults(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get relationships:
relationships <- get_relationships(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get follow-ups:
followups <- get_followups(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get events:
events <- get_events(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)
# Get clusters:
clusters <- get_clusters(url = url,
username = username,
password = password,
outbreak_id = outbreak_id)The below section demonstrates some new functions that allow users to retrieve data from Go.Data that falls within a specific date range:
#########################
# New godataR functions:
# Set a date range from a vector of dates:
mydates <- c("2022-04-19", "2022-05-10", "2022-03-07", "2022-09-25")
# Use the godataR helper function get_date_range() to set the date range:
daterange <- get_date_range(dates = mydates)
# Use the godataR helper function mongify_date() to convert dates to mongodb:
mongo_formatted_dates <- mongify_date(dates = mydates, dateformat = "undefined")
# Get case data within a specific date range:
cases <- get_cases_epiwindow(url = url,
username = username,
password = password,
outbreak = "active",
cols2return = "identifiers",
datequery = "date range",
daterangeformat = "ymd",
epiwindow = 30,
mindate = daterange$mindate,
maxdate = daterange$maxdate)
# Get contacts within a specific date range:
contacts <- get_contacts_epiwindow(url = url,
username = username,
password = password,
outbreak = "active",
cols2return = "identifiers",
datequery = "date range",
daterangeformat = "ymd",
epiwindow = 30,
mindate = daterange$mindate,
maxdate = daterange$maxdate)
# Get lab results within a specific date range:
labres <- get_labresults_epiwindow(url = url,
username = username,
password = password,
outbreak = "active",
cols2return = "identifiers",
datequery = "date range",
epiwindow = 30,
daterangeformat = "ymd",
mindate = daterange$mindate,
maxdate = daterange$maxdate,
sampledates = seqdata$specdate)
# Get all lab variables (including lab questionnaire) for the active outbreak:
labfields <- get_lab_fields(url = url,
username = username,
password = password)Note that some require extra parameters, like language tokens (specify “english_us” for English, otherwise find your token_id in the URL when the language token is selected in the web-app).
# Get users:
users <- get_users(url = url,
username = username,
password = password)
# Get teams:
teams <- get_teams(url = url,
username = username,
password = password)
# Get locations:
locations <- get_locations(url = url,
username = username,
password = password)
# Get reference data:
reference_data <- get_reference_data(url = url,
username = username,
password = password)
# Get language tokens:
language_tokens <- get_language_tokens(url = url,
username = username,
password = password,
language = "english_us")There were significant changes to most API endpoints at the release of V38.1, in order to increase performance during export and in-app visualization. There are two methods for downloading the data to accomodate version history:
method = "export"will only work on Go.Data versions 2.38.1 or newer. This method relies on theGET outbreak/{id}/cases/exportAPI endpoint. An export request is submitted to the server, and then when the export is ready, it will be downloaded. Due to better performance and more options,method = "export"will be the default if you are using Go.Data version 2.38.1 or newer.method = "batches"will work on all versions of Go.Data. This method relies on the API endpoints such asGET outbreak/{id}/casesorGET outbreak/{id}/contactsAPI endpoint. Records are then retrieved in batches based onbatch_sizeand appended together into a final dataset.method = "batches"will be the default and only available method for Go.Data version 2.38.0 or older.
We recommend always upgrading to the latest Go.Data version to benefit from ongoing performance enhancements, when handling large amounts of data.
Go.Data is running on LoopBack.
You can access the self-documenting description of all available API
methods in using Loopback Explorer by adding /explorer to the end of
any Go.Data URL.
You can find more information on the Go.Data API here.
Bug reports and feature requests should be posted on github under issues. All other questions and feedback, feel free to email us at [email protected].
Contributions are welcome via pull requests.