Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Infra consolidation metabug #3008

Closed
7 of 8 tasks
jonathanmetzman opened this issue Apr 21, 2023 · 2 comments
Closed
7 of 8 tasks

Infra consolidation metabug #3008

jonathanmetzman opened this issue Apr 21, 2023 · 2 comments
Labels
autoclosed stale

Comments

@jonathanmetzman
Copy link
Collaborator

jonathanmetzman commented Apr 21, 2023 •
edited
Loading

Tasks

  • Fuzz
  • Symbolize
  • Minimize
  • Progression
  • Regression
  • Corpus Pruning
  • Analyze
  • Variant
@jonathanmetzman jonathanmetzman mentioned this issue Apr 25, 2023
Merged
This was referenced Apr 26, 2023
Merged
Merged
jonathanmetzman added a commit that referenced this issue Apr 26, 2023
@jonathanmetzman
Remove MLRNN (#2955)
3ad38f4 
It's no longer used and adds a fair amount of complexity. It was too hard to support
Related: #3008
jonathanmetzman added a commit that referenced this issue Apr 27, 2023
@jonathanmetzman
Delete corpus tagging
57eedba 
It's not really used and complicates the rearchitecture.
Related: #3008
jonathanmetzman added a commit that referenced this issue Apr 27, 2023
@jonathanmetzman
Delete dictionary analysis (#3010)
498e153 
It's not clear it delivers value, it does deliver complexity and would
be too hard to support under the new architecture.
Related: #3008
jonathanmetzman added a commit that referenced this issue May 2, 2023
@jonathanmetzman
Delete corpus tagging (#3014)
9877ff3 
It's not really used and complicates the rearchitecture. 
Related: #3008
I do think it would be interesting to use though.
@jonathanmetzman jonathanmetzman mentioned this issue May 7, 2023
Merged
jonathanmetzman added a commit that referenced this issue May 7, 2023
@jonathanmetzman
[rearchitecture] Add tooling for dealing with signed URLs.
05a808f 
Add functionality for creating signed upload and download URLs and using
them, both for the filesystem and GCS storage implementations.
Add tests.
For now this is a non-functional change.

Related: #3008
This was referenced May 7, 2023
Merged
Merged
jonathanmetzman added a commit that referenced this issue May 8, 2023
@jonathanmetzman
[rearchitecture] Fix run_bot/butler
6de97fb 
Print stacktraces properly.
Propogate errors so that butler command
fails when run_bot and other commans fails.
Related: #3008
This was referenced May 8, 2023
Merged
Merged
jonathanmetzman added a commit that referenced this issue May 8, 2023
@jonathanmetzman
[rearchitecture] Fix run_bot/butler (#3033)
cffd9cd 
Print stacktraces properly.
Propogate errors so that butler command
fails when run_bot and other commands fails.
Related: #3008
jonathanmetzman added a commit that referenced this issue May 8, 2023
@jonathanmetzman
[rearchitecture] Add tooling for dealing with signed URLs. (#3031)
a19533d 
Add functionality for creating signed upload and download URLs and using
them, both for the filesystem and GCS storage implementations. Add
tests.
For now this is a non-functional change.

Related: #3008
This was referenced May 10, 2023
Merged
Merged
Merged
jonathanmetzman added a commit that referenced this issue May 11, 2023
@jonathanmetzman
[consolidation] Add tooling for executing utasks in-memory.
c9683f4 
This will be a good middle ground to test on before, using GCS.
And it will be more performant than using GCS.
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue May 11, 2023
Merged
jonathanmetzman added a commit that referenced this issue May 11, 2023
@jonathanmetzman
[consolidation] Add tooling for executing utasks in-memory. (#3050)
2d6d58b 
This will be a good middle ground to test on before, using GCS. And it
will be more performant than using GCS.
Related: #3008
jonathanmetzman added a commit that referenced this issue May 11, 2023
@jonathanmetzman
[consolidation] Add logging
62c03e1 
Add more logging: #3008
@jonathanmetzman jonathanmetzman mentioned this issue May 11, 2023
Merged
jonathanmetzman added a commit that referenced this issue May 11, 2023
@jonathanmetzman
[consolidation] Add logging (#3055)
b22a08a 
Add more logging: #3008
@jonathanmetzman jonathanmetzman mentioned this issue May 11, 2023
Merged
jonathanmetzman added a commit that referenced this issue May 11, 2023
@jonathanmetzman
Make analyze_task untrusted (#3052)
2d76a81 
While this doesn't complete this work, it makes analyze_task use the
untrusted_task API and it will make analyze_task
execute using the in-memory untrusted task executor.
Related: #3008
jonathanmetzman added a commit that referenced this issue May 12, 2023
@jonathanmetzman
[consolidation] Fix issue signing URLs on GCE.
730156a 
Sign URLs with a key.
Related: #3008
Fixes: #3057
jonathanmetzman added a commit that referenced this issue Jul 14, 2023
@jonathanmetzman
[zipcorpora] Zip zipcorpora on the fly and in-memory
84dfd1f 
Do this so that we don't waste disk space or run out of memory when
uplaoding corpora.

Related: #3217
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Jul 14, 2023
Merged
jonathanmetzman added a commit that referenced this issue Jul 17, 2023
@jonathanmetzman
[zipcorpora] Zip zipcorpora lazily and in-memory (#3221)
92d1ce0 
Do this so that we don't waste disk space or run out of memory when
uploading corpora.

Related: #3217
Related: #3008
jonathanmetzman added a commit that referenced this issue Jul 17, 2023
@jonathanmetzman
[rearchitecture] Add functions for determining machine specs.
a9ba639 
This will be used by tworkers to launch batch tasks that execute utask_main.
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Jul 17, 2023
Merged
jonathanmetzman added a commit that referenced this issue Jul 18, 2023
@jonathanmetzman
[rearchitecture] Add functions for determining machine specs. (#3236)
0bf00b3 
This will be used by tworkers to launch batch tasks that execute
utask_main. Related: #3008
jonathanmetzman added a commit that referenced this issue Jul 21, 2023
@jonathanmetzman
[rearchicture] Let uworker set error messages.
2c2d590 
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Sep 11, 2023
Merged
jonathanmetzman added a commit that referenced this issue Nov 16, 2023
@jonathanmetzman
[rearchitecture][analyze] Run uworker_main on cloud batch.
d153df9 
Make uworker_main of analyze_task execute on cloud batch.
The next step is to drop the privileges of the service account we use.

Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Nov 16, 2023
Merged
jonathanmetzman added a commit that referenced this issue Nov 16, 2023
@jonathanmetzman
[rearchitecture][analyze] Run uworker_main on cloud batch. (#3518)
24da2b9 
Make uworker_main of analyze_task execute on cloud batch. The next step
is to drop the privileges of the service account we use.

Related: #3008
jonathanmetzman added a commit that referenced this issue Nov 20, 2023
@jonathanmetzman
[rearchitecture] Execute variant task on batch.py
f77a9e3 
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Nov 20, 2023
Merged
jonathanmetzman added a commit that referenced this issue Nov 20, 2023
@jonathanmetzman
[rearchitecture] Execute variant task on batch.py (#3523)
78448b0 
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Nov 20, 2023
Closed
@jonathanmetzman jonathanmetzman mentioned this issue Mar 19, 2024
Merged
jonathanmetzman added a commit that referenced this issue Mar 19, 2024
@jonathanmetzman
Move privileged operation in minimize to preprocess.
a61e713 
Move argument retreival to preprocess.
Related: #3008
Fixes: #3888
@jonathanmetzman jonathanmetzman mentioned this issue Mar 19, 2024
Merged
jonathanmetzman added a commit that referenced this issue Mar 19, 2024
@jonathanmetzman
Move privileged operation in minimize to preprocess. (#3896)
25bf084 
Move argument retreival to preprocess.
Related: #3008
Fixes: #3888
@jonathanmetzman jonathanmetzman mentioned this issue Aug 21, 2024
Merged
jonathanmetzman added a commit that referenced this issue Aug 23, 2024
@jonathanmetzman
[rearch][fuzz_task] Get data bundle directory in safe way. (#4202)
970c2ce 
Related #3008
@jonathanmetzman jonathanmetzman mentioned this issue Sep 19, 2024
Merged
jonathanmetzman added a commit that referenced this issue Oct 11, 2024
@jonathanmetzman
[rearchitecture][fuzz_task] Move corpus signing to preprocess.
71e0b18 
Related: #3008
@jonathanmetzman jonathanmetzman mentioned this issue Oct 11, 2024
Merged
jonathanmetzman added a commit that referenced this issue Oct 14, 2024
@jonathanmetzman
[rearchitecture][fuzz_task] Move corpus signing to preprocess. (#4316)
86777f0 
Related: #3008
@github-actions GitHub Actions
Copy link

This issue has not had any activity for 60 days and will be automatically closed in two weeks

@github-actions github-actions bot added the stale label Jan 31, 2025
@github-actions GitHub Actions
Copy link

Automatically closing stale issue

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
autoclosed stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jonathanmetzman