Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[scheduler] Even more resilient perl beanstalkd annotation worker #545

Merged
Show file tree
Hide file tree
Changes from 48 commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
7dd9246
fuck this
akotlar Apr 5, 2024
f0473a6
merged master
akotlar Apr 25, 2024
eb14c1f
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Apr 25, 2024
c63153a
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Apr 29, 2024
0a848ce
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar May 1, 2024
21dd594
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar May 3, 2024
98635c3
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar May 12, 2024
37233aa
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar May 17, 2024
4c93b9b
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar May 20, 2024
5457eb8
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 3, 2024
ee9422a
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 7, 2024
c92dd1e
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 10, 2024
0f70f86
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 14, 2024
70fa314
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 24, 2024
459ef7e
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jun 27, 2024
45973e0
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jul 6, 2024
39eb8d5
Merge branch 'master' of https://github.com/bystrogenomics/bystro
akotlar Jul 8, 2024
3d7f4ea
add client-side timeouts for beanstalkd operations
akotlar Jul 8, 2024
57feca7
add periodic job touching
akotlar Jul 9, 2024
4a194eb
perltidy
akotlar Jul 9, 2024
d340e4c
organize outputs
akotlar Jul 9, 2024
5395595
clean up error reporting in handleJobFailure
akotlar Jul 9, 2024
387ad6d
cleanup
akotlar Jul 9, 2024
0f1d9f4
sleep between iterations of loop in bystro-server.pl
akotlar Jul 9, 2024
0d94122
wip, adding better error messages and wrapping stats, touch commands …
akotlar Jul 10, 2024
4a424ad
fix issues, and remove reliance on job->connect, which is no longer n…
akotlar Jul 10, 2024
e0c5344
refactor bystro-server.pl to be more easily testable
akotlar Jul 11, 2024
8724d3b
add test for bystro-server.pl
akotlar Jul 11, 2024
806c7d4
uprev bystro veresion
akotlar Jul 11, 2024
56ff2eb
remove unnecessary debug message
akotlar Jul 11, 2024
9891381
remove unnecessary spaces
akotlar Jul 11, 2024
44d4dc3
output all debug messages to stderr
akotlar Jul 11, 2024
0608e04
remove json::xs
akotlar Jul 11, 2024
9c94ab4
fix perl test
akotlar Jul 11, 2024
dc039e8
remove unused coercions in Interface.pm
akotlar Jul 11, 2024
5eedd4b
switch to python annotation worker
akotlar Jul 12, 2024
8b602de
add lock file to Bystro annotator, to ensure multiple instances of By…
akotlar Jul 13, 2024
41c1560
better file locks
akotlar Jul 14, 2024
475ba2d
Error if the annotation already completed
akotlar Jul 14, 2024
05d7dba
simplify error handling and make the double-submission explanation mo…
akotlar Jul 14, 2024
eb85904
more clarity on error
akotlar Jul 14, 2024
2612c43
sleep between touches to reduce CPU usage
akotlar Jul 14, 2024
c973cf1
more clear error message
akotlar Jul 14, 2024
66e0180
simplify error message
akotlar Jul 14, 2024
337980e
cleanup
akotlar Jul 14, 2024
0ec06bf
fix mypy errors
akotlar Jul 14, 2024
6ce4856
format, and get rid of unused NotFoundError
akotlar Jul 14, 2024
4073226
remove unused WrappedHandlerFn
akotlar Jul 14, 2024
4b4c636
perltidy
akotlar Jul 14, 2024
3c777eb
more verbose logging for beanstalkd workers
akotlar Jul 15, 2024
b47fc66
log to stderr after files have been moved to the final directory
akotlar Jul 15, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
381 changes: 0 additions & 381 deletions perl/bin/bystro-server.pl

This file was deleted.

Loading
Loading