MOEish ideas

[Swight1423]

CustomModelFormat Draft 4.txt
this format was an old idea before I had a full grasp on everything AI(which is still the case but a little better now) and definitely could not be used as is but some concepts may be interesting. The idea was sort of a what model am I going to be today model utilizing compressed deltas from a base model, where you can use two tokens to allow the user or appropriately trained model to select different recipes to give different mixes of the included deltas. a modernized version might make use of references to mergekit yaml files for the recipes. there may also be simpler ways of reaching similar goals. this could also serve as a try in memory before you commit to using storage space option for messing with merge recipes. I could also see keeping the deltas separate as an option so you could just download the ones you want rather than a curated selection.