Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Big rewrite of swath/cell handlers, adding accessors #74

Open
wants to merge 135 commits into
base: master
Choose a base branch
from
Open

Big rewrite of swath/cell handlers, adding accessors #74

wants to merge 135 commits into from

Conversation

claytharrison
Copy link
Collaborator

I edit a better description in here later, there are a lot of changes.

Clay Harrison and others added 30 commits May 11, 2024 15:05
@sebhahn
Add MultiFileHandler cell file readers
15ce19c
@sebhahn
Fix sneaky syntax error
d6f0859
@sebhahn
Add util for getting various gpi-sets from grid
abe356b
@sebhahn
Rename cell read method to extract
73381e7
@sebhahn
Reformat test data generator and add swaths
7d8df97
@sebhahn
Add ChronFiles-based swath reader + tests
c16a68d
@sebhahn
add pyresample to dependencies
26618ae
@sebhahn
add numba
5e4f1ed
Remove numba
87dfb08
add extra options to get_grid_gpis
646464f
add grid cache and ASCAT products to product_info
1deaa1f
Add spatial functionality to swath_collection
185b450
adapt aggregators to use new swath_collection
96c0ba8
ignore profiling
e1e5fac
Start adding spatial funcs to cell_collection
26fddba
Start on swath/cell xarray accessors
aedfdf2
Fix orthomulti tests
342eca9
Fix swath tests
342c1a5
Resolve conflict with master
5d4c583
Allow passing kwargs to _fmt functions
c273db3
Decapitalize np.Inf -> np.inf
a5981b6
Option for "sat" on extract
7cd2561
Parallelize swath merge/extract
109a005
Add stacking SwathGridFiles to cell files
ee823b6
Some more tests
6dfbd26
Passing tests
ac98681
Fix encoding error
733ee85
Cleanup
b062d88
Add reprocess method to CellGridFiles
b02cfce
Use reprocess method for conv. dir to contig.
95ac7b6
Clay Harrison and others added 30 commits November 15, 2024 16:21
Adding docstrings and type hints
666f0a9
Fix logic in ragged array -> ragged array
82710d5
Can't do None or [] trick with ndarray
5556372
Add skeleton to OrthoMultiArray
d6de185
Formatting
51106b1
Add sel_geom to PGG accessor
abfca92
Fix cell_collection imports
6e1946b
Get rid of old classes
9e736e4
Pass swath preprocessor to iter_read_nbytes
46d4a5b
Rename SwathGridFiles extract to read
938faf1
Use new accessors in RaggedArrayCell
00ebae3
Pass kwargs to RaggedArrayCell._merge
e3cf94f
Try rmvng encoding step from RaggedArrayCell.write
dd3ca65
Pass through preprocessor in CellGridFiles
ac8b947
Switch to new grid registry
9997ab6
Use with clause for datasets when checking itrsxn
24e72b1
Pass preprocessor thru Swath/GridFiles
b5ac8f8
Don't pass Swath to SwathGridFiles anymore
a009a24
Pass on global attrs needed by cf_geom on merge
58e552a
Cleanup swath_collection
fe24ba1
Add CF metadata to generate_test_data
4562756
update preprocessors on Cell/Swath product classes
2029b8d
Delete sf_pattern for ERS cell
f7fe3c1
Fix formatting bug for cell names
65ccba9
Update old tests for cell/swath collections
53be735
Add xarray_accessors tests
e073e67
Only convert location_id to int32 if necessary
d8631b9
Change swath spatial filtering strategy
c70e142 
It seems faster to filter swaths by just selecting desired grid
points from each file rather than checking intersection with the bbox
for each one and then reading again. Check with Pavan though, maybe
he has a faster implementation
Load swath files on read?
815c01c
@claytharrison
Merge branch 'TUW-GEO:master' into xarr_refactor_refined
70061c8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@claytharrison @sebhahn