Skip to content

Climate Data Analytic Service provider built on scala, Spark, Akka, Haddop, and python tools such as UVCDAT, etc. Designed to be deployed with the nasa-nccs-cds/CDWPS framework.

License

Notifications You must be signed in to change notification settings

nasa-nccs-cds/CDAS2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CDS2 Project

Climate Data Analytic Service provider built on scala, Spark, Akka, Haddop, and python tools such as UVCDAT, etc.

Prerequisite: Install the Java/Scala develpment tools:

1) Java SE Platform (JDK) 1.7:   http://www.oracle.com/technetwork/indexes/downloads/index.html
2) Scala:                        http://www.scala-lang.org/download/install.html
3) Scala Build Tool (sbt):       http://www.scala-sbt.org/0.13/docs/Setup.html

Install and run CDS2:

1) Checkout the CDS2 sources:

    >> cd <prefix>
    >> git clone https://github.com/nasa-nccs-cds/CDAS2.git 

2) Build the application (for a clean build one can execute "sbt clean" before "sbt package"):

    >> cd CDAS2
    >> sbt package

 3) Run unit tests:

    >> sbt test

 4) Source the setup file to configure the runtime environment:

    >> source <prefix>/CDAS2/bin/setup_runtime.sh

 6) Startup the CDAS server:
 
    >> cd CDAS2
    >> ./bin/startup_cdas_local.sh

 7) Access demos:

    Designed to be deployed with the CDWPS framework (https://github.com/nasa-nccs-cds/CDWPS)

Python/NetCDF support through Conda::

1) Install Anaconda: https://github.com/UV-CDAT/uvcdat/wiki/Install-using-Anaconda

2) Create cdas2 conda environment:
    
    >> conda create -n cdas -c conda-forge -c uvcdat uvcdat nco pyzmq psutil lxml
    
3) Initialize shell enviromnment for cdas:

    >> source <prefix>/CDAS2/bin/setup_runtime.sh
    >> source activate cdas
    
4) Build CDAS python pacakges:

    >> cd CDAS
    >> python setup.py

Code development:

1) Install IntelliJ IDEA CE from https://www.jetbrains.com/idea/download/ with Scala plugin enabled.

2) Start IDEA and import the CDAS2 Project from Version Control (github) using the address https://github.com/nasa-nccs-cds/CDAS2.git.

Acknowledgements:

CDAS uses the YourKit profiler (https://www.yourkit.com/java/profiler/), by YourKit, LLC, which supports 
open source projects with innovative and intelligent tools for profiling Java and .Net applications.

About

Climate Data Analytic Service provider built on scala, Spark, Akka, Haddop, and python tools such as UVCDAT, etc. Designed to be deployed with the nasa-nccs-cds/CDWPS framework.

Resources

License

Stars

Watchers

Forks

Packages

No packages published