Why Frontier AI Needs Critics It Can't Buy
The Vatican was the dramatic setting. The more important signal came from Chris Olah's remarks : every frontier AI lab is trapped inside incentives that can conflict with doing the right thing. That is the part builders should pay attention to. A lab at the frontier is saying, in public, that it cannot be its own final critic. This Is Not Really a Church Story You do not need to be Catholic to find the point here. The Vatican matters as a setting because it sits outside Silicon Valley's incentive stack. It is one example of an institution the labs do not control, cannot hire, and cannot fold into a product roadmap. Anthropic's own follow-up, Widening the conversation on frontier AI , makes the scope even clearer. They are not only talking to clergy. They are talking to philosophers, humanists, lawyers, writers, psychologists, and civic leaders across traditions. The real story is simple: the labs are looking for outside judgment because inside judgment is co...