Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCMD keyword metadata items for datasets based on multiple platforms and instruments #389

Open
korvinos opened this issue Oct 23, 2018 · 10 comments
Assignees

Comments

@korvinos
Copy link
Member

description: https://podaac.jpl.nasa.gov/dataset/UKMO-L4HRfnd-GLOB-OSTIA
data: https://podaac-opendap.jpl.nasa.gov/opendap/allData/ghrsst/data/L4/GLOB/UKMO/OSTIA/

@korvinos korvinos self-assigned this Oct 23, 2018
@korvinos
Copy link
Member Author

korvinos commented Oct 23, 2018

@mortenwh & @akorosov Could you tell me please, how should I describe a platform/instrument metadata in case of combined product? Shall I list all instruments? Or is there a specification for this type of products?

metadata from the file:
source_data: AMSRE,ATS_NR_2P,AVHRR18_G,AVHRR17_NAR,AVHRR18_NAR,OSISAF_ICE,SEVIRI,TMI

@mortenwh
Copy link
Contributor

mortenwh commented Oct 23, 2018

The best solution is perhaps to add it as list, as you suggest. This should work fine for Nansat, but I am not sure how we should solve it for Geo-SPaaS. Currently, I think there is only one source per dataset in the Geo-SPaaS catalog. There is a related issue in Django-Geo-SPaaS which should be solved as well: nansencenter/django-geo-spaas#1

@korvinos
Copy link
Member Author

@mortenwh As far as I can see, we usually specify platform/instrument separately but not a source. So in the case of different sources, there will be a set of platforms and a set of instruments are not connected with each other. Therefore, since it is not going to work with GS anyway, I think that I will have to skip this metadata.

@korvinos
Copy link
Member Author

korvinos commented Oct 23, 2018

I have just looked through a mapper_opendap_globcurrent_thredds.py and found that i can define platform and instrument through a generic name for now:

        mm = pti.get_gcmd_instrument('Passive Remote Sensing')
        ee = pti.get_gcmd_platform('Earth Observation Satellites')

UPD: I cannot do that since the dataset is not only from remote sensing observations

korvinos added a commit that referenced this issue Oct 23, 2018
korvinos added a commit that referenced this issue Oct 23, 2018
@mortenwh
Copy link
Contributor

source is the table name in geospaas... Anyway, platform and instrument come in pairs and it may be complicated to have more than one pair in the metadata without major changes. So more generic names are probably good.

@mortenwh
Copy link
Contributor

I will introduce a hack for OSTIA data in the nansat mapper mapper_opendap_ostia: mapper_opendap_ostia sets platform to Aqua and instrument to AMSR-E.

The issue with multiple sources will then be followed up in nansencenter/django-geo-spaas#1

mortenwh added a commit that referenced this issue Oct 24, 2018
mortenwh added a commit that referenced this issue Oct 24, 2018
@mortenwh mortenwh reopened this Jan 31, 2019
@mortenwh
Copy link
Contributor

I suggest to solve this by setting platforms and instruments in a list of lists:

pi = [
    [pti.get_gcmd_platform('noaa-18'), pti.get_gcmd_instrument('avhrr-3')],
    [pti.get_gcmd_platform('noaa-19'), pti.get_gcmd_instrument('avhrr')]
]
self.dataset.SetMetadataItem('platform/instrument', json.dumps(pi))

Django-Geo-SPaaS could be modified to accept both separate metadata fields (i.e., platform and instrument) and combined fields (i.e., platform/instrument). As such, we don't need to change mappers for datasets from single instruments.

@mortenwh mortenwh changed the title GHRSST/OSTIA mapper OpenDAP GCMD keyword metadata items for datasets based on multiple platforms and instruments Jan 31, 2019
@mortenwh
Copy link
Contributor

mortenwh commented Feb 1, 2019

  • Update opendap_ostia mapper

  • Update globcurrent mapper

  • Update other mappers (?). I suggest that we do this gradually with emerging needs...

@mortenwh
Copy link
Contributor

mortenwh commented Feb 6, 2019

Note: Not all globcurrent products provide the source platforms and instruments. In that case a warning is issued, advising the user to create a github issue.

mortenwh added a commit that referenced this issue Feb 6, 2019
…that not all globcurrent products provides the source data, and the (hardcoded) list in the mapper may be incomplete.. This means that we will not be able to provide source metadata for all products.
akorosov pushed a commit that referenced this issue Feb 6, 2019
…that not all globcurrent products provides the source data, and the (hardcoded) list in the mapper may be incomplete.. This means that we will not be able to provide source metadata for all products.
@mortenwh
Copy link
Contributor

@akorosov - this is merged and can be closed, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants