-
Notifications
You must be signed in to change notification settings - Fork 525
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support macOS natively #477
Conversation
918e483
to
364966e
Compare
98ad98f
to
70b8418
Compare
70b8418
to
e4fcad8
Compare
4be68c1
to
22d1968
Compare
@@ -31,27 +50,13 @@ def get_pools(self): | |||
PrioritizedTaskPool(dummy_pool_func, name="B", max_batch_size=1), | |||
) | |||
|
|||
# Simulate requests coming from ConnectionHandlers | |||
proc = mp.context.ForkProcess(target=_submit_tasks, args=(pools, results_valid)) | |||
proc.start() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moving that before Runtime.start()
since (a) that's how real server works and (b) so we don't fork after creating active threads (this provably improves test stability)
- { model: 'bigscience/bloom-560m', os: 'ubuntu', python-version: '3.8' } | ||
- { model: 'bigscience/bloom-560m', os: 'ubuntu', python-version: '3.11' } | ||
- { model: 'Maykeye/TinyLLama-v0', os: 'ubuntu', python-version: '3.8' } | ||
- { model: 'Maykeye/TinyLLama-v0', os: 'ubuntu', python-version: '3.11' } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- would be nice to add adapters for llama tests since they are the new main
- if no time, please create an issue
ce2a348
to
f47e922
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
f47e922
to
b79c357
Compare
aaa9a17
to
44a8b58
Compare
568a1c4
to
8889cab
Compare
8889cab
to
7bdf6e8
Compare
This PR makes both clients and servers work on macOS. Specifically, it:
p2pd
binary (both x86-64 and ARM64 are supported)