Just like algae blooms in the ocean and pollen in the spring, there’s been an explosion in the past year or two of new software, related tools and lingo from the IT and mainstream/consumer side. Some ...

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...

OpenAI wants to retire the leading AI coding benchmark—and the reasons reveal a deeper problem with how the whole industry measures itself.

Imagine trying to design a key for a lock that is constantly changing its shape. That is the exact challenge we face in ...

Every engineering leader watching the agentic coding wave is eventually going to face the same question: if AI can generate production-quality code faster than any team, what does governance look like ...

The Boston startup uses AI to translate and verify legacy software for defense contractors, arguing modernization can’t come at the cost of new bugs.