-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
daily processing pipeline #405
base: master
Are you sure you want to change the base?
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #405 +/- ##
==========================================
- Coverage 75.84% 71.21% -4.64%
==========================================
Files 68 75 +7
Lines 7257 7795 +538
==========================================
+ Hits 5504 5551 +47
- Misses 1753 2244 +491 ☔ View full report in Codecov by Sentry. 🚨 Try these New Features:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks ok to me.
I'm concerned about out use of context mangers and multiple threads - I don't think they are natively thread aware. Might not be an issue for this PR but brought to my attention based on our conversation the other day and this PR
Also I see the tests are failing? |
0e7c7cf
to
50d6a00
Compare
Co-authored-by: Shane Maloney <maloneys@tcd.ie>
create a second processing pipeline to handle not TM packets triggered processing steps
this pipeline runs on a cron bases (once a day?) and performs product creations (fits files)
first included processing is HK-L+ to ANC-ASPECT files