Post
373
auto 200m 2 is out now!
Auto is a series of models designed to classify if a tool called by an AI agent is safe to run or not, like how the "auto" approval modes work in codex or claude. This is the smallest model in the series by far and it still packs a punch! Over 96 percent accuracy on the held out benchmark, beating deepseek v4 0731 and absolutely destroying regex at classifying if a tool call is safe to run (to be fair it is a bit of a weird and very hard benchmark but it works!)
check it out: ProCreations/auto-200m-2
Auto is a series of models designed to classify if a tool called by an AI agent is safe to run or not, like how the "auto" approval modes work in codex or claude. This is the smallest model in the series by far and it still packs a punch! Over 96 percent accuracy on the held out benchmark, beating deepseek v4 0731 and absolutely destroying regex at classifying if a tool call is safe to run (to be fair it is a bit of a weird and very hard benchmark but it works!)
check it out: ProCreations/auto-200m-2
- 1 reply
