Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

There's been a seismic shift in science, with scientists developing new AI tools and applying AI to just about any question that can be asked. Researchers are now putting actual seismic waves to work, ...

A team of UCSF researchers successfully tested several mainstream AI agents for the ability to analyze big data on women's ...

Scientists at Rice University and the University of Houston have created a powerful new material by guiding bacteria to grow cellulose in aligned patterns, resulting in sheets with the strength of ...

Large language models (LLMs) can suggest hypotheses, write code and draft papers, and AI agents are automating parts of the research process. Although this can accelerate science, it also makes it ...

With the exception of infectious diseases, examination of the environmental causes of illness has been piecemeal. Gary Miller, a toxicologist at Columbia University who also addressed the meeting, ...

Many of the latest large language models (LLMs) are designed to remember details from past conversations or store user profiles, enabling these models to personalize responses. But researchers from ...

NASA gears up for a historic lunar flyby, AI gives stroke patients hope, and researchers discover the oldest known cave art What’s on the road to the launch of NASA’s Artemis II, how scientists are ...