You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I haven't looked into the architecture yet, but I'm hoping it is similar to GPT, which we already know how to handle OK thanks to the Falcon experience. I see it also uses Alibi which we should have support for, but we haven't tested extensively, so there might be issues there.
The text was updated successfully, but these errors were encountered:
This is a new 1.6B code model: https://huggingface.co/smallcloudai/Refact-1_6B-fim
We should look into adding support into
llama.cpp
similar as to how we did for Falcon and Baichuan:I haven't looked into the architecture yet, but I'm hoping it is similar to GPT, which we already know how to handle OK thanks to the Falcon experience. I see it also uses Alibi which we should have support for, but we haven't tested extensively, so there might be issues there.
The text was updated successfully, but these errors were encountered: