Curious, is BLOOM an intended target supported model?

[linuxmagic-mp]

Just curious, most of the supported models are variations of Llama, and I was curious if Bloom would be a target supported model. And if not, curious as to why

[BetaDoggo]

llama.cpp will only support llama models, but the ggml library can be used with several different architectures. There's a fork for bloom models called bloomz.cpp.

[linuxmagic-mp]

Thanks for that.. Will look at that one, but of course.. sometimes it is a pet peeve that we can't all work together ;) Be nice if this was unified, and my fault for putting that comment in the llama.cpp discussion :0 But this is one of the more interesting developments I have been researching.. Also really well put together including documentation.