Token Generation Simulator: token generation speeds for different devices/models

This page is an interactive simulator for comparing LLM token generation speeds across devices, models and quantization levels, with a benchmark table of Apple Silicon, NVIDIA GPU, and Llama2, Llama3 model results. The tables list tokens per second for processing and generation, such as the Apple M2 Ultra with 76 GPU cores reaching 1401.85 tokens/s on Llama2_7B_F16 processing and 41.02 tokens/s on generation. The page states that the simulator uses pre-defined text rather than real model computations, and that its elapsed times are measured with the browser's performance API and may differ from expected times.