Skip to content

Latest commit

 

History

History
70 lines (38 loc) · 2.18 KB

README.md

File metadata and controls

70 lines (38 loc) · 2.18 KB
Raw

CDS2 Project

Climate Data Analytic Service provider built on scala, Spark, Akka, Haddop, and python tools such as UVCDAT, etc.

Prerequisite: Install the Java/Scala develpment tools:

1) Java SE Platform (JDK) 1.7:   http://www.oracle.com/technetwork/indexes/downloads/index.html
2) Scala:                        http://www.scala-lang.org/download/install.html
3) Scala Build Tool (sbt):       http://www.scala-sbt.org/0.13/docs/Setup.html

Install and run CDS2:

1) Checkout the CDS2 sources:

    >> cd <prefix>
    >> git clone https://github.com/nasa-nccs-cds/CDAS2.git 

2) Build the application (for a clean build one can execute "sbt clean" before "sbt package"):

    >> cd CDAS2
    >> sbt package

 3) Run unit tests:

    >> sbt test

 4) Source the setup file to configure the runtime environment:

    >> source <prefix>/CDAS2/bin/setup_runtime.sh

 6) Startup the CDAS server:
 
    >> cd CDAS2
    >> ./bin/startup_cdas_local.sh

 7) Access demos:

    Designed to be deployed with the CDWPS framework (https://github.com/nasa-nccs-cds/CDWPS)

Python/NetCDF support through Conda::

1) Install Anaconda: https://github.com/UV-CDAT/uvcdat/wiki/Install-using-Anaconda

2) Create cdas2 conda environment:
    
    >> conda create -n cdas -c conda-forge -c uvcdat uvcdat nco pyzmq psutil lxml
    
3) Initialize shell enviromnment for cdas:

    >> source <prefix>/CDAS2/bin/setup_runtime.sh
    >> source activate cdas
    
4) Build CDAS python pacakges:

    >> cd CDAS
    >> python setup.py

Code development:

1) Install IntelliJ IDEA CE from https://www.jetbrains.com/idea/download/ with Scala plugin enabled.

2) Start IDEA and import the CDAS2 Project from Version Control (github) using the address https://github.com/nasa-nccs-cds/CDAS2.git.

Acknowledgements:

CDAS uses the YourKit profiler (https://www.yourkit.com/java/profiler/), by YourKit, LLC, which supports 
open source projects with innovative and intelligent tools for profiling Java and .Net applications.