UX experiments / Humans + AI
Humans + AI · Field experiment
Consultants with GPT-4 or without: who did better work?
Realistic product-strategy tasks that AI can do well. Consultants with GPT-4 or without: who did better work?
Make your call. Which version won, and why? Decide before you open the result. Guessing first is what trains your judgment.
Made your call? See the result
With AI: 12.2% more tasks, 25.1% faster, about 40% higher quality.
What happened
Consultants below average gained the most. The study calls the area where AI helps the “jagged technological frontier”.
Why it worked
Inside the frontier, AI multiplies speed and quality, and lifts weaker performers toward the best.
The takeaway
Inside the frontier, speed is no longer your edge. Choosing what's worth doing is.
Source
- Dell'Acqua et al. · Navigating the Jagged Technological Frontier (papers.ssrn.com)
More experiments to call
Practice the call
Call experiments like these every day.
Irreplaceable gives you a few real experiments a day to call before you see the result, and tracks how your judgment improves. Start with a free baseline: 12 decisions, about 12 minutes.