Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support convert and quantize from hf models #167

Merged
merged 17 commits into from
Oct 23, 2024
Merged

support convert and quantize from hf models #167

merged 17 commits into from
Oct 23, 2024

Conversation

zhycheng614
Copy link
Collaborator

No description provided.

@zhycheng614
implemented basic quantization api
a8e88c4
@zhycheng614
WIP - added basic convert from hf to gguf logic, and the the convert …
0c638bd 
…- quantize pipeline
@zhycheng614
added directory checking logic, and added main function for covnert
016e801
@zhycheng614
WIP - made quantization parameters more robust
4ebf704
@zhycheng614
WIP - add arguments for convert
6515f7c
@zhycheng614
WIP - Implemented basic clis for nexa convert
4646dac
@zhycheng614
support download and convert huggingface repos
6e8f0f1
@zhycheng614
refactored some code to constants
05dfebc
@zhycheng614
changed import self package (nexa gguf) code place
51d0ec7
@zhycheng614
added doc string for convert inner function
066a782
@zhycheng614
format function arguments
048542e
@zhycheng614
Merge branch 'main' of https://github.com/NexaAI/nexa-sdk into perry/…
4f65eef 
…convert-and-quantize
@zhycheng614
implemented suggest run after convert logic
5085393
@zhycheng614
adjusted cli argument positions
3d692ce
@zhycheng614
updated cli readme
ab6c916
@zhycheng614
set convert to optional dependency
f1deaf7
@zhycheng614 zhycheng614 requested a review from zhiyuan8 October 22, 2024 19:42
@zhycheng614 zhycheng614 marked this pull request as ready for review October 22, 2024 19:42
zhiyuan8
zhiyuan8 requested changes Oct 22, 2024
View reviewed changes
CLI.md Show resolved Hide resolved
nexa/constants.py Show resolved Hide resolved
nexa/gguf/converter/nexa_convert.py Show resolved Hide resolved
nexa/gguf/converter/nexa_convert.py Show resolved Hide resolved
nexa/gguf/converter/nexa_convert.py Show resolved Hide resolved
pyproject.toml Show resolved Hide resolved
@zhiyuan8 zhiyuan8 merged commit 12b1bb4 into main Oct 23, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zhiyuan8 zhiyuan8 zhiyuan8 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zhycheng614 @zhiyuan8