14 LLMs fought 314 Street Fighter matches. Here's who won.
AI summary of the linked articleThe author, a developer, pitted 14 LLMs against each other in Street Fighter III using an emulator run through Diambra and a test bed from Stan Girard, with each model picking moves for Ken via Amazon Bedrock. Models were ranked by Elo rating across 314 matches, and Claude 3 Haiku finished first with 1613.45, followed by Claude 3 Sonnet at 1557.25 and Claude 2.1 at 1554.98. The article suggests smaller models did better, likely because of lower latency, and it notes that the matches also produced invalid moves such as "Jump Cancel" and a refusal from Claude 2.1 to play a violent scenario. |
Comments No comments yetWhat caught your eye? Start the discussion. |
