Agent experience (AX) testing for AI agents

In late 2024, Anthropic introduced Computer Use, allowing a large language model (LLM) to independently operate graphical user interfaces.  A flood of similar “AI agents” has followed, offering a new way for human users to passively get work done.  But interfaces designed for humans can prove impenetrable for agents.  In this workshop, you’ll learn how to conduct a new kind of usability test–one for AI agents, rather than human users.

Target audience

  • Researchers, designers, and PMs who want to understand how to design and test interfaces to be optimized for AI agents

  • Researchers (and people who do research) looking to expand their research toolkit with new AI-specific research methods

What you’ll learn

  • Define AI agents

  • Introduce “Agent Experience” and why it matters

  • Conduct a usability test with an AI agent - “Agent Experience (AX) testing”

    • Identify major agent experience issues with a public website

    • Practice reporting findings and recommending how to improve interface designs

Attendee feedback

“We may need to design for AI agents in the future… [It was valuable] understanding the limitations.”

– Workshop participant

 

Interested in hosting this workshop for your team?

 
Llewyn Paine