Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Tyler has worked on, lived with and tested all types of smart home and security technology for over a dozen years, explaining the latest features, privacy tricks, and top recommendations. With degrees ...