All your LLMs ranked by speed every minute metrik-dashboard.vercel.app 2 points by mbouassa 6 hours ago
chaidhat 6 hours ago Cool! Is there tok/s too? TTFT and tok/s also decreases given a larger context window, maybe a metric of tok/s given # tok in context would also be nice.
Cool! Is there tok/s too? TTFT and tok/s also decreases given a larger context window, maybe a metric of tok/s given # tok in context would also be nice.