Deploy AWS services and scheduler tasks to AWS environment

[jordanpadams]

💡 Description

Staging

• Registry
  • schema updates?
  • reindex?
• Registry API @tloubrieu-jpl
  • Smoke tests @miguelp1986
• Monitoring
  • Smoke tests @sjoshi-jpl @jimmie

Production

• Registry
• Registry API (terraform) @sjoshi-jpl @jimmie
  • Smoke tests @miguelp1986
• Monitoring
  • Smoke tests @sjoshi-jpl @jimmie

NGAP

• Nucleus (terraform) @sjoshi-jpl @ramesh-maddegoda
  • Smoke tests @viviant100 @ramesh-maddegoda (and document smoke test)
• Monitoring
  • Smoke tests @sjoshi-jpl @jimmie

[sjoshi-jpl]

@tloubrieu-jpl I've updated the steps to deploy registry-api based on the learnings last week.

https://wiki.jpl.nasa.gov/display/PDSEN/Deploy+Registry+API

[tloubrieu-jpl]

The workflow work with a workaround for OIDC authentication.

[tloubrieu-jpl]

@miguelp1986 @viviant100 I believe we are only mssing the smoke test to be run on the new deployment before we can close this ticket. Could you look at that ? Thanks

[sjoshi-jpl]

@tloubrieu-jpl the new updated terraform workflow is completed - NASA-PDS/nucleus@main...terraform-deploy

Should I go ahead and create a PR?

[nutjob4life]

Smoke test: in progress. PRs all closed. End of sprint is 2023-07-20!

[nutjob4life]

Merged!

[jordanpadams]

@miguelp1986 @sjoshi-jpl @ramesh-maddegoda are we good with baseline deployment per B13.1? This does not include any of the new work being done with regard to monitoring and CD, as that is tracked separately.

[miguelp1986]

@jordanpadams I've smoke tested Production. Could you please share the endpoint for Registry API on staging? I can't seem to find it.

[viviant100]

https://pds.nasa.gov/api/search-en-gamma/1/swagger-ui/index.html

[jordanpadams]

Thanks @viviant100 . Do we know if there is a reason that is not at https://pds-gamma.jpl.nasa.gov/api/search/1/swagger-ui/index.html ? Everything else we do on gamma is represented this way except the Registry API? Maybe @tloubrieu-jpl can help us here

[ramesh-maddegoda]

@miguelp1986 @sjoshi-jpl @ramesh-maddegoda are we good with baseline deployment per B13.1? This does not include any of the new work being done with regard to monitoring and CD, as that is tracked separately.

@jordanpadams , do you mean the baseline deployment of Nucleus? If so, we are good with the baseline deployment of Nucleus, as long as the Airflow environment does not have issues on AWS (such as the recent MWAA issues on NGAP).

[jordanpadams]

Calling this task completed for this build, but we will most likely need to improve this over time, especially Nucleus smoke tests.