Tuesday Sep 1

Mollick Asks When AI Should Ask Us

1SEP
AGENTHUMAN

We spent years teaching people when to ask AI. Ethan Mollick, the Wharton professor who studies AI at work, argues the harder question is when an agent should ask a human.

He calls it the Twilight Factory. Agents do most of the work, but a facilitator agent decides when to pull a person in. It is the opposite of the lights-out dark factory.

Four triggers: approval before spending money or contacting outsiders, expertise where models stay weak, variance because AI ideas cluster together, and interest.

That last one is the sharp bit. If agents take every interesting decision and leave people the approvals and the failures, we automated the wrong half of the job.

full brief & sources

⚡ Why this matters

  • Every agent product ships an escalation policy, usually by accident. Mollick gives it a name and a shape.
  • The Hugging Face incident is the counterexample: agents that never asked. This is the design answer to that failure.
  • The interest trigger is a genuinely new argument. Nobody designs handoffs around whether the human wants the work.

🔍 What happened

  • The essay is Agency and Agents, published on One Useful Thing in late August, developed with Dr. Lilach Mollick.
  • The Twilight Factory sits between the fully human workshop and the lights-out dark factory.
  • Alongside the orchestrator agent that does the work, a facilitator agent decides when to involve people.
  • Trigger one, approval: agents should not spend money, contact outsiders, or access sensitive material unasked.
  • Trigger two, expertise: models are jagged and still lag human experts on parts of a task.
  • Triggers three and four, variance and interest: AI proposals cluster, and humans should keep the work they actually want.

💬 Smart takes

  • Mollick: we built the playbook for humans asking AI and never built the reverse.
  • The Signal: reads the essay as the constructive bookend to the Hugging Face incident.
  • Mac Power Users forum: frames the two as competing visions of agentic work published the same week.
  • Skeptic: a facilitator agent is another model deciding when to interrupt you. The judgment problem moved, it did not go away.

🧭 Where this goes

  1. Likelyescalation policy becomes a named surface in agent platforms, not a hidden prompt.
  2. Likelythe interest trigger shows up in enterprise change-management decks within a quarter.
  3. Possiblea vendor ships a configurable facilitator agent as a product feature this year.
  4. Possiblethe framing gets flattened into an approval-only checkbox and the other three triggers get dropped.
  5. Wild Carda regulator borrows the approval trigger as a mandatory control for autonomous agents.

🥄 The Spoon Take

If you are building agent workflows, write the escalation policy before the happy path. Which decisions need a person, which need an expert, which need a second opinion, and which does the human simply want to keep. That last column is the one every roadmap skips, and it is the one people quit over.

🤔 Pushback

A facilitator agent deciding when to interrupt a human is still a model making the judgment call. The hard problem moved one layer up.