Towards a Science of AI Agent Reliability

Sayash Kapoor and Arvind Narayanan are among the coauthors of a paper proposing a new holistic mode of evaluating AI agents.

Kapoor and Narayanan describe the work on AI as Normal Technology, suggesting that developers measure reliability as separate from accuracy in order to make up for lags in the former domain.