Where Benchmarks Are Prophecies
Benchmarks can show us something real, but they cannot carry the weight of prophecy; the truer test is what a model does in the work in front of us.
Benchmarks can show us something real, but they cannot carry the weight of prophecy; the truer test is what a model does in the work in front of us.
I spent a few minutes prompting Hermes during a homeschool conference, and the automation made me more engaged, not less.
Local LLMs on the M5 Max have become useful for bounded agent work, but they are not Amp or Claude killers yet.