Model Updates

[pkelaita]

Added

• New supported models gemma-2-9b, llama-3.2-1b, and llama-3.2-3b via Groq.

Changed

• In order to be more consistent with l2m2's naming scheme, the following model ids have been updated:
  • llama3-8b → llama-3-8b
  • llama3-70b → llama-3-70b
  • llama3.1-8b → llama-3.1-8b
  • llama3.1-70b → llama-3.1-70b
  • llama3.1-405b → llama-3.1-405b
• This is a breaking change!!! Calls using the old model_ids (llama3-8b, etc.) will fail.

Removed

• Provider octoai has been removed as they have been acquired and are shutting down their cloud platform. This is a breaking change!!! Calls using the octoai provider will fail.
  • All previous OctoAI supported models (mixtral-8x22b, mixtral-8x7b, mistral-7b, llama-3-70b, llama-3.1-8b, llama-3.1-70b, and llama-3.1-405b) are still available via Mistral, Groq, and/or Replicate.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Files with missing lines	Coverage Δ
l2m2/__init__.py	100.00% <100.00%> (ø)
l2m2/client/base_llm_client.py	100.00% <ø> (ø)
l2m2/memory/chat_memory.py	100.00% <ø> (ø)
l2m2/model_info.py	100.00% <ø> (ø)