Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Here is a custom GPT that I quickly made to help answer questions about how to use and integrate Builder.io by simply providing the URL to the Builder docs. This project crawled the docs and generated ...
There's a lot you can automate.