Skip to content
@METR

METR

Model Evaluation and Threat Research
README.md

Model Evaluation and Threat Research (METR)

METR is a research nonprofit that works on assessing whether cutting-edge AI systems could pose catastrophic risks to society.

We build the science of accurately assessing risks, so that humanity is informed before developing transformative AI systems.

Read more about our work here.

Our Software

Popular repositories Loading

  1. task-standard task-standard Public

    METR Task Standard

    TypeScript 136 32

  2. public-tasks public-tasks Public

    TeX 82 3

  3. vivaria vivaria Public

    Vivaria is METR's tool for running evaluations and conducting agent elicitation research.

    TypeScript 74 24

  4. ai-rd-tasks ai-rd-tasks Public

    Python 53 6

  5. task-template task-template Public template

    TypeScript 9 5

  6. autonomy-evals-guide autonomy-evals-guide Public

    SCSS 3 4

Repositories

Showing 10 of 21 repositories
  • eval-analysis-public Public

    Public repository containing METR's DVC pipeline for eval data analysis

    METR/eval-analysis-public’s past year of commit activity
    Python 0 0 0 0 Updated Jan 22, 2025
  • task-protected-scoring Public
    METR/task-protected-scoring’s past year of commit activity
    Python 0 1 3 2 Updated Jan 21, 2025
  • vivaria Public

    Vivaria is METR's tool for running evaluations and conducting agent elicitation research.

    METR/vivaria’s past year of commit activity
    TypeScript 74 MIT 24 231 (3 issues need help) 16 Updated Jan 21, 2025
  • task-artifacts Public
    METR/task-artifacts’s past year of commit activity
    Python 0 0 0 0 Updated Jan 21, 2025
  • SWE-bench-fork Public Forked from swe-bench/SWE-bench

    [ICLR 2024] SWE-bench: Can Language Models Resolve Real-world Github Issues?

    METR/SWE-bench-fork’s past year of commit activity
    Python 0 MIT 403 0 1 Updated Jan 15, 2025
  • inspect_k8s_sandbox Public Forked from UKGovernmentBEIS/inspect_k8s_sandbox

    A Kubernetes sandbox environment for use with inspect_ai

    METR/inspect_k8s_sandbox’s past year of commit activity
    Python 0 MIT 3 0 0 Updated Jan 14, 2025
  • llm-foundry Public Forked from mosaicml/llm-foundry

    LLM training code for Databricks foundation models

    METR/llm-foundry’s past year of commit activity
    Python 0 Apache-2.0 544 0 0 Updated Jan 13, 2025
  • viv-task-dev Public
    METR/viv-task-dev’s past year of commit activity
    Shell 0 1 7 0 Updated Jan 10, 2025
  • public-tasks Public
    METR/public-tasks’s past year of commit activity
    TeX 82 3 0 2 Updated Jan 9, 2025
  • ai-rd-tasks Public
    METR/ai-rd-tasks’s past year of commit activity
    Python 53 6 2 2 Updated Jan 9, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…