Made convert.py work with LLaMA 3 files distributed by meta

[0xMana-git]

The fix is overall pretty hacky and not very clean, but it does work and doesn't have any pre vocab issues afaik
Improvements such as not using another script can be made, and detection for llama 3 is basically nonexistent, but I guess if someone just wants to get stuff working then this could be applicable

Simple math question test can be seen here(cpu inference, i messed up the cuda build):

[teleprint-me]

It should be noted that the convert.py script is in the process of being deprecated and will be moved to examples.

[0xMana-git]

It should be noted that the convert.py script is in the process of being deprecated and will be moved to examples.

😭

[mofosyne]

Hmmm... as long as it doesn't break the legacy convert script let's get this merged in quickly before we do the refactor

[compilade]

Hmmm... as long as it doesn't break the legacy convert script let's get this merged in quickly before we do the refactor

That's not a reason to avoid doing a proper review. This looks useful, but there are some parts of it I'd like to review in more detail.

Regarding the order of the merges, I think #7430 should be merged first, because it will be much easier to test this with the new file names and locations. (because things will break, especially since convert.py here assumes convert_llama_weights_to_hf.py is in the same directory)

[teleprint-me]

@Manaball123 Do not lose hope. Programming isn't easy, but that's what makes it fun 😉.

@compilade If this is merged, get this merged this first. This should be merged before PR #7430. I'm going to be awhile. I did crack the vocab though. 🥲

My only issue with this PR is that the vocab wasn't properly handled. Other than that, I think it's a good start. It just needs some guidance.

[0xMana-git]

You could probably merge convert_llama_weights_to_hf.py into the same file as-is, I didn't do it because it would make convert.py more cluttered than it already is lol
Regarding the vocab issue, can you elaborate on what it is? I could probably write a fix if it's nothing major.

[mofosyne]

Heads up that #7430 has merged, so will need to refactor this pr

[0xMana-git]

uh oh i think i messed something up :(

[compilade]

uh oh i think i messed something up :(

To fix this, check your git reflog and git reset to a previous commit (but read about --soft, --mixed, --hard, and --keep first (git reset --help)), then git push --force-with-lease this branch back to that commit.

[0xMana-git]

Sorry for the inconvenience, made new pr here
😭