Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MiRS reader #1511

Merged
merged 33 commits into from
Mar 9, 2021
Merged

Add MiRS reader #1511

merged 33 commits into from
Mar 9, 2021

Commits on Jan 22, 2021

  1. Configuration menu
    Copy the full SHA
    1bd35fb View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2021

  1. Remove unused lines

    joleenf committed Jan 27, 2021
    Configuration menu
    Copy the full SHA
    0b102c4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b5613fd View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2021

  1. Change name of mirs_l2_nc to mirs

    This is done because the reader name in polar2grid is mirs, and that
    has been used for a while, so it should not change for users
    joleenf committed Feb 3, 2021
    Configuration menu
    Copy the full SHA
    2c7b733 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    59c32b3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    95852a9 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2021

  1. Configuration menu
    Copy the full SHA
    a0386b6 View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2021

  1. Remove code that is not used

    Remove variables that are never used
    There seems to be no reason to handle coords again in __getitem__,
    let xarray handle these.
    joleenf committed Feb 17, 2021
    Configuration menu
    Copy the full SHA
    7064d39 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    29576d9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    188f609 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2021

  1. Configuration menu
    Copy the full SHA
    9c6b0d1 View commit details
    Browse the repository at this point in the history
  2. Changes requested for retrieve of coeffs and application

    1.)  Do not need the file registry before running pooch retrieve command
    2.)  Simplify/make easier to read code that does the pooch retrieve
         and call when needed, not at the beginning of the code. The filenames
         do not need to be in the metadata for the scene.
    3.)  Use dask.where rather than roundabout numpy logic.  This eliminates
         all squeeze calls.
    4.)  removes bt_data array slice where it is not needed but does use the
         bt_data attributes for the xarray of the corrected brightness temperatures
    joleenf committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    5168e6f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    aea1e9e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    935b518 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2021

  1. Move limb_correct_bt

    limb_correct_bt does not need to be in the class.  Move
    code out of class methods and restructure the call to the
    limb_correction to facilitate this move.
    joleenf committed Feb 20, 2021
    Configuration menu
    Copy the full SHA
    45ce5f3 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2021

  1. Configuration menu
    Copy the full SHA
    7fa7143 View commit details
    Browse the repository at this point in the history
  2. Update map_blocks call without assigning to a numpy array

    Assigning a map_blocks call to a numpy array 96 times
    causes dask to compute before it is necessary.  Also, I could be wrong,
    by it does not seem necessary to loop over map_blocks.  It makes more
    sense to loop over the fov in the function that map_blocks calls.
    joleenf committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    346926c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f526e99 View commit details
    Browse the repository at this point in the history
  4. Remove else return statement

    joleenf committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    40c0542 View commit details
    Browse the repository at this point in the history
  5. Merge upstream commits

    Merge branch 'master' of https://github.com/pytroll/satpy into mirs
    joleenf committed Feb 21, 2021
    Configuration menu
    Copy the full SHA
    874dd7f View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2021

  1. BUG FIX: function that map_blocks calls should receive and return num…

    …py arrays
    
    also, don't hard code the block size for the arrays, use the block size of the input daskArray.
    joleenf committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    0e871d4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ac4bccc View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2021

  1. Configuration menu
    Copy the full SHA
    f710028 View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2021

  1. Remove dask calls in function that map_blocks calls and reorder code

    1.)  Remove extra check for self.nc.coords and just check within new_coords
         method
    2.)  Change all dask calls in apply_limb_correction method to
         np calls.
    joleenf committed Feb 25, 2021
    Configuration menu
    Copy the full SHA
    0cb3280 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2021

  1. Remove xarray coord assignment for corrected bt_data

    This feature of xarray is not working well with dask
    pydata/xarray#3068
    joleenf committed Feb 26, 2021
    Configuration menu
    Copy the full SHA
    3e5bb3e View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2021

  1. Remove assignment of coordinates through xarray coord attributes

    1.)  Removes the new_coords method which added lat/lon coords
         through xarray.Dataset.assign_coords method.
    2.)  Removes coordinate assignment when bt_corrected xarray.DataArrays
         are constructed.
    3.)  Restructures available_datasets:  Hope, it is easier to understand
         and ensures that lat/lon coordinates have standard_names even
         if file metdata without it takes precedence after the yaml.
    joleenf committed Feb 27, 2021
    Configuration menu
    Copy the full SHA
    2c6fdad View commit details
    Browse the repository at this point in the history
  2. Add Scanline/FOV dims to RR

       otherwise they are dim_0 and dim_1 and they are not recognized by
       the reader.  Scanline/FOV are converted to y,x in reader
    joleenf committed Feb 27, 2021
    Configuration menu
    Copy the full SHA
    7f68d6c View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2021

  1. Configuration menu
    Copy the full SHA
    186f53d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0de4ad2 View commit details
    Browse the repository at this point in the history
  3. Remove information that is not being processed

    The necessary metadata to get metop files read into satpy
    is getting added in the reader.  The information provided to
    the yaml would be nice to supplement information in the file, but
    I can't think of a reason why it should override information, except
    for descriptions, which can be handled elsewhere.  Since trying to
    juggle yaml/file metadata would be a little more involved in the code,
    I feel it is best to keep the model of the gaasp reader which assumes
    the necessary metadata is in the file and add missing metadata within the
    reader.
    joleenf committed Mar 3, 2021
    Configuration menu
    Copy the full SHA
    0b334af View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    290fcdc View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2021

  1. Add mocking for download of data and reading of coefficients

    - add the mocks
    - create fake coefficient data in test
    - updates how the coefficients are read in mirs by splitting our the
      reading of the file and the actual parsing.
    - Checks the end of coefficient file for n_chn and n_fov thus removing
      the need for globals
    - Remove the global N_FOV in the loop which calculates the coefficients
      on the data.  Use dataset size for loop endpoint, if the dataset
      for some reason does not have 96 fov, this loop would fail with a
      fixed endpoint.
    joleenf committed Mar 5, 2021
    Configuration menu
    Copy the full SHA
    fad34f7 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2021

  1. Configuration menu
    Copy the full SHA
    e2bdd8b View commit details
    Browse the repository at this point in the history