Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

List of already existing python and argo libraries / snippets #3

Closed
gmaze opened this issue Mar 18, 2020 · 21 comments
Closed

List of already existing python and argo libraries / snippets #3

gmaze opened this issue Mar 18, 2020 · 21 comments
Labels
documentation Improvements or additions to documentation help wanted stale No activity over the last 90 days

Comments

@gmaze
Copy link
Member

gmaze commented Mar 18, 2020

Please list url of the libraries you know, its focus/scope and main features.

We don't want to reinvent or redesigned things.

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/gmaze/pyargo

Focus on profile history variables

Allows to easily read the history of measurements

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/euroargodev/argopy-osnet

Focus on rapidly loading in-memory measurements from a local copy of the GDAC ftp.

Allows to retrieve in-memory a list of numpy arrays with curated pressure, temperature and salinity measurements

Allows to retrieve a flat collection of measurements or a collection of profiles interpolated on standard depth levels

@gmaze gmaze added the documentation Improvements or additions to documentation label Mar 18, 2020
@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/pvthinker/argopy

Focus on computing climatological statistics from a local copy of the GDAC ftp

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/jbusecke/xargofloat

Tools to work with argo float data in xarray

Provide a prototype for an interpolation function for argo floats

⚠️ This package is deprecated in favor of argopy. Please see documentation on interpolating argo floats

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/castelao/CoTeDe

Focus on data QC

Provide a python implementation of real-time Argo QC tests
(see doc for more)[https://cotede.readthedocs.io/en/latest/qctests.html#argo-incomplete]

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/IQuOD/AutoQC

Focus on data QC

(list of QC tests)[https://github.com/IQuOD/AutoQC/tree/0e66ce33de7b584c8616bd6a782b8a19814af87c/tests]

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/quai20/DataViz

Provide notebooks to remind all kind of data analytics or visualisation stuff for Argo index files

@gmaze
Copy link
Member Author

gmaze commented Mar 18, 2020

https://github.com/biofloat/biofloat

This one has not been updated since several years ...

@philippemiron
Copy link

philippemiron commented Apr 4, 2020

Deep and surface trajectories of Argo floats, there are different databases but something like YoMaHa would be great!

http://apdrc.soest.hawaii.edu/projects/yomaha/

@tylertucker202
Copy link
Contributor

Convert Argo profiles into python documents, and store them on a MongoDB database. This is how Argovis stores its profiles.

https://github.com/tylertucker202/argo-database

@adamml
Copy link
Member

adamml commented Apr 4, 2020

A suggestion - once there are a few more resources here, why not make this into an Awesome List.

We've done one for Erddap resources, so would be happy to help with set up etc.

@quai20
Copy link
Member

quai20 commented Apr 4, 2020

A suggestion - once there are a few more resources here, why not make this into an Awesome List.

We've done one for Erddap resources, so would be happy to help with set up etc.

Didn't know about Awesome List, thank you this will be useful to me. You can add Ifremer erddap deployment in the Erddap resources.

@gmaze
Copy link
Member Author

gmaze commented Apr 6, 2020

Deep and surface trajectories of Argo floats, there are different databases but something like YoMaHa would be great!

http://apdrc.soest.hawaii.edu/projects/yomaha/

Hi @philippemiron , thanks for the suggestion, ANDRO is a must have along YoMaHa.
Digging into trajectory data would be great in argopy, we have some demands about that, but still a lot to do before moving on to this (consolidating access to T/S/P and then to BGC profile variables),
if you want to help in any ways that would get you there much faster !

@philippemiron
Copy link

Deep and surface trajectories of Argo floats, there are different databases but something like YoMaHa would be great!
http://apdrc.soest.hawaii.edu/projects/yomaha/

Hi @philippemiron , thanks for the suggestion, ANDRO is a must have along YoMaHa.
Digging into trajectory data would be great in argopy, we have some demands about that, but still a lot to do before moving on to this (consolidating access to T/S/P and then to BGC profile variables),
if you want to help in any ways that would get you there much faster !

I'm interested, I will take a look this week how to include trajectory data sets in argopy.

@gmaze
Copy link
Member Author

gmaze commented Apr 6, 2020

Convert Argo profiles into python documents, and store them on a MongoDB database. This is how Argovis stores its profiles.

https://github.com/tylertucker202/argo-database

Hi @tylertucker202 !
Do you suggest that argopy could have a local data store based on MongoDB ?
This would mean that users getting a sync of the GDAC ftp would need to furthermore manage a local database server ?

@tylertucker202
Copy link
Contributor

Convert Argo profiles into python documents, and store them on a MongoDB database. This is how Argovis stores its profiles.
https://github.com/tylertucker202/argo-database

Hi @tylertucker202 !
Do you suggest that argopy could have a local data store based on MongoDB ?
This would mean that users getting a sync of the GDAC ftp would need to furthermore manage a local database server ?

The Issue asked that we list existing python and argo libraries, I'm only providing what is requested and nothing more. If a few brave souls are interested, there are instructions on how to build a dockerized instance of Argovis here

@jbusecke
Copy link

https://github.com/jbusecke/xargofloat

It seems like the functionality of xargofloat is already available in [def linear_interpolation_remap]. Id be happy to retire xargofloat and point to this repo. Is there a tutorial for interpolation of xarray data, that I could link to?

@gmaze
Copy link
Member Author

gmaze commented Sep 24, 2020

Hi @jbusecke
Yes, our interpolator implemented by @quai20 is directly adapted from your use of xarrayutils in xargofloat.
The doc for its usage in argopy is here: https://argopy.readthedocs.io/en/latest/data_manipulation.html#Interpolation-to-standard-levels
The ds.argo.interp_std_levels covers what xargofloat does and if it doesn't the linear_interpolation_remap is accessible in argopy.utilities to users
so it's up to you decide if you want to retire xargofloat, if you do, we would be please to have you onboard argopy !

@jbusecke
Copy link

I just added a note in the readme. The functionality was defunct anyways. If I work on argo in the future Ill head over here. Thanks for the effort.

Could you maybe edit the post above with a note that the package is defunct/functionality available here?

@gmaze
Copy link
Member Author

gmaze commented Nov 30, 2020

bgcArgoDMQC

I just came across: https://github.com/ArgoCanada/bgcArgoDMQC from @cgrdn and @synapticarbors

The general description is:
A python library of functions for quality controlling dissolved oxygen data. Heavily based on the SOCCOM BGC Argo QC methods program in matlab, uses either NCEP or World Ocean Atlas data to calculate oxygen gains (Johnson et al. 2015).

@github-actions
Copy link

github-actions bot commented Sep 1, 2021

Stale issue message

@github-actions github-actions bot added the stale No activity over the last 90 days label Sep 1, 2021
@github-actions github-actions bot closed this as completed Sep 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation help wanted stale No activity over the last 90 days
Projects
None yet
Development

No branches or pull requests

6 participants