2026-04-08 20:26 UTC
@mirth @alienghic @cwebber
I would be very interested in links showing what you say if you have them.
Replies (1)
-
@mirth@mastodon.sdf.org 2026-04-08 20:45
@MichaelTBacon @alienghic @cwebber This is a synthesis of what I've seen across years of doing compute related work plus reading the published benchmark data and some papers. In my opinion it is necessary to have a reasonable knowledge of at least what's been published before having specific opinions about what the technical trends are or are not. Here's a leaderboard for SWE Bench Verified, a reasonable gauge of one dimension of model strength: https://llm-stats.com/benchmarks/swe-bench-verified