What do you wish you knew about AI-moderated interviews?

If you could get an inside look at how AI-moderated interviews work under the hood, what would you want to know?

A lot of AI research companies today are pushing “AI moderation,” where an LLM questions your participants directly.  The promise is exciting: the depth of interviews, at the scale of surveys.

But how well does AI moderation actually work?

It’s difficult to find unbiased answers. I did a review of the AI moderation training available for UX practitioners, and what I found was disappointing:

  • 🛠️ Most of it (unsurprisingly) came from the tool companies themselves.

  • 🦜 And the rest came from AI consultants parroting those same companies’ marketing claims.

There actually are academic and empirical studies that challenge these claims, but you have to do a lot more digging to find them.

So, I’ve decided to offer new training on AI moderation.

This will follow up on my previous behind-the-scenes workshops on AI synthesis and AI agents, with the specific goals of:

  • 🔎 Showing how AI moderation tools actually work at the level of models and prompts; and

  • 📊 Sharing the latest (unsponsored) empirical findings on their strengths and weaknesses for UXR.

If this sounds like something you’d be interested in, I’d love to hear from you!

AI, Methods & toolsLlewyn Paine