Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add llamatune checks with quantized values #814

Merged

Conversation

bpkroth
Copy link
Contributor

@bpkroth bpkroth commented Jul 23, 2024

Follow on to #812

Closes #813

motus and others added 17 commits July 17, 2024 16:55
These changes are mainly to add flexibility to the auth service in
supporting azure authenticating via:

- A personal identity via az CLI for the local dev environment. This
will still run into expiring issues, but is probably fine for local dev.
- A personal or managed identity in an azure hosted environment. The
flexibility to use the managed identity allows us to avoid the expiring
issue without needing a separate SP, key-vault and cert setup, aligning
with new security recommendations.

---------

Co-authored-by: Eu Jing Chua <eujingchua@microsoft.com>
Co-authored-by: Sergiy Matusevych <sergiym@microsoft.com>
Mypy got updated to v 1.11 recently
We need these mypy fixes to make other PRs pass the CI tests
Closes microsoft#785 

Also, add more unit tests to make sure the optimizer handles string
inputs correctly.

---------

Co-authored-by: Brian Kroth <bpkroth@users.noreply.github.com>
@bpkroth bpkroth marked this pull request as ready for review July 31, 2024 15:21
@bpkroth bpkroth requested a review from a team as a code owner July 31, 2024 15:21
@bpkroth
Copy link
Contributor Author

bpkroth commented Jul 31, 2024

@motus I guess this will have to wait until #803 gets done.

@bpkroth
Copy link
Contributor Author

bpkroth commented Aug 8, 2024

@motus do you want to take over this one while you're working on #835 ?

Copy link
Member

@motus motus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code looks good. Let's make CI pass and merge it in. I don't care in which order this PR goes in, before or after the quantization update.

@motus
Copy link
Member

motus commented Aug 19, 2024

@motus do you want to take over this one while you're working on #835 ?

sure! let me fix it now

* move monkey_patch_quantization and its unit tests to mlos_core

* SMAC suggests slightly different config now
@motus motus merged commit 9183ae6 into microsoft:main Aug 19, 2024
12 of 13 checks passed
@bpkroth
Copy link
Contributor Author

bpkroth commented Aug 20, 2024

@motus concerned this isn't working quite right yet since the result output isn't quantized as expected (e.g., the test values that were reverted in the PR you made against mine in bpkroth#59).

Let's start another PR to make sure that is working as expected and we get the quantization in the the meta field as we discussed.

@bpkroth bpkroth deleted the add-llamatune-checks-with-quantized-values branch August 20, 2024 20:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add quantized tunable + llamatune tests
3 participants