Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor 'ahi_hsd' reader and make overview/overview_raw consistent with ABI #1909

Merged
merged 2 commits into from
Dec 3, 2021

Conversation

djhoese
Copy link
Member

@djhoese djhoese commented Dec 1, 2021

This is a mini-PR on the path toward improving the performance of the ahi_hsd/abi_l1b true_color generation as discussed in #1902. This is mostly just cleanup with a small modification to the space masking code to pass the chunk size of the data that the mask will be used on. This is just to avoid future issues where fancy chunking may not match with the PYTROLL_CHUNK_SIZE.

I also updated the overview composite to add an overview_raw so they match what the ABI composites do. I also made the composites based on channel name instead of wavelength.

About pre-commit: bandit complained about the use of PIPE in the utils module, but I'm not sure there is an easy way around that. Mypy also complained about an import in _compat.py but I couldn't seem to make it happy (the import only exists in Python 3.8+ and it must be running in Python 3.7). I turned off hooks so I could do the last commit.

  • Tests added
  • Fully documented

@djhoese djhoese added component:readers component:compositors cleanup Code cleanup but otherwise no change in functionality labels Dec 1, 2021
@djhoese djhoese self-assigned this Dec 1, 2021
@codecov
Copy link

codecov bot commented Dec 1, 2021

Codecov Report

Merging #1909 (487781f) into main (1227328) will increase coverage by 0.01%.
The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #1909      +/-   ##
==========================================
+ Coverage   93.39%   93.40%   +0.01%     
==========================================
  Files         273      275       +2     
  Lines       40622    40728     +106     
==========================================
+ Hits        37940    38044     +104     
- Misses       2682     2684       +2     
Flag Coverage Δ
behaviourtests 4.82% <0.00%> (-0.02%) ⬇️
unittests 93.97% <100.00%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
satpy/readers/ahi_hsd.py 97.25% <100.00%> (-0.05%) ⬇️
satpy/readers/utils.py 91.79% <100.00%> (ø)
satpy/readers/seadas_l2.py 97.82% <0.00%> (ø)
satpy/tests/reader_tests/test_seadas_l2.py 98.43% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1227328...487781f. Read the comment docs.

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.0006%) to 93.905% when pulling 487781f on djhoese:refactor-ahi-hsd into 85656a8 on pytroll:main.

Copy link
Member

@sfinkens sfinkens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, LGTM!

Copy link
Member

@mraspaud mraspaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mraspaud mraspaud merged commit 0a09f79 into pytroll:main Dec 3, 2021
@djhoese djhoese deleted the refactor-ahi-hsd branch December 3, 2021 17:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cleanup Code cleanup but otherwise no change in functionality component:compositors component:readers
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants