This repo is currently deprecated. For the updated benchmark view the main repo at https://github.com/Significant-Gravitas/AutoGPT in the benchmark
folder.
Built for the purpose of benchmarking the performance of agents regardless of how they work.
Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.
Save time and money while doing it through smart dependencies. The best part? It's all automated.
![Screenshot 2023-07-25 at 10 35 01 AM](https://private-user-images.githubusercontent.com/9652976/255984902-98963e0b-18b9-4b17-9a6a-4d3e4418af70.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ4MDA3NjEsIm5iZiI6MTcyNDgwMDQ2MSwicGF0aCI6Ii85NjUyOTc2LzI1NTk4NDkwMi05ODk2M2UwYi0xOGI5LTRiMTctOWE2YS00ZDNlNDQxOGFmNzAucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjdUMjMxNDIxWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NTFhMjE2MzJkNTc0YTZiNWZlZTJiNGRjYzgxZGNlNjQ1MjUyYzA3MWU4ZTA2YjZjODdhZjhiOTQ5ZWUxNzdhYSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.BPMZ6bXRMi2mxrPIiltBsFAnAlfilVgcZcgqDjeWL28)
![Screenshot 2023-07-25 at 10 42 15 AM](https://private-user-images.githubusercontent.com/9652976/255986293-39be464c-c842-4437-b28a-07d878542a83.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ4MDA3NjEsIm5iZiI6MTcyNDgwMDQ2MSwicGF0aCI6Ii85NjUyOTc2LzI1NTk4NjI5My0zOWJlNDY0Yy1jODQyLTQ0MzctYjI4YS0wN2Q4Nzg1NDJhODMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjdUMjMxNDIxWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NjYyMDUwZjEwNjcwZGEwNTBkYjgyNTVmYzRiMGVjM2Y2Zjk3NWU4MzMyNWUyODU3OWU5MDgwMjVmNmQ5OGEwYiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.0S12n0bZjeX9o5iNzkopS0rNt1hi-V0KaU9hlPS7PVw)
Click here to see the results and the raw data!!
More agents coming soon !