Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Abstract: Artificial Neural Networks (ANNs) are a widely used and powerful tool for modeling and predicting various processes across society, industry, and nature. In recent decades, ANNs have found ...