14 LLMs fought 314 Street Fighter matches. Here's who won.

Submit
14 LLMs fought 314 Street Fighter matches. Here's who won.community.aws
community.aws

14 LLMs fought 314 Street Fighter matches. Here's who won.

AI summary of the linked article

The author, a developer, pitted 14 LLMs against each other in Street Fighter III using an emulator run through Diambra and a test bed from Stan Girard, with each model picking moves for Ken via Amazon Bedrock. Models were ranked by Elo rating across 314 matches, and Claude 3 Haiku finished first with 1613.45, followed by Claude 3 Sonnet at 1557.25 and Claude 2.1 at 1554.98. The article suggests smaller models did better, likely because of lower latency, and it notes that the matches also produced invalid moves such as "Jump Cancel" and a refusal from Claude 2.1 to play a violent scenario.

No comments yetWhat caught your eye? Start the discussion.