Cortex.cpp: Model Compatibility Prediction

[dan-homebrew]

Goal

• Cortex.cpp can predict model compatibility or performance, based on user's detected (or selected) hardware
• e.g. Incompatible if model size > available memory
• e.g. Slow on your machine if model size will consume significant memory

Open Questions

• We need to decide if we use selected hardware instead of detected (e.g. if user chooses CPU-only, predictions should use that)