Anthropic is preparing for an initial public offering that could potentially value the company above $2 trillion. This flotation will serve as a test of investor appetite for frontier AI amidst fierce competition in the industry.
A leaked IPO prospectus reveals that the maker of Claude has devoted nearly a third of the filing to risk factors. The company warns that its advanced AI models could pose catastrophic or existential risks to humanity, specifically noting that these models could exhibit self-preserving behaviors and resist shutdowns.
The prospectus also highlights the significant costs associated with building frontier AI, with plans to spend hundreds of billions of dollars. Financially, the company reported a net loss of $42 billion last year and noted a heavy reliance on only two customers.
These warnings follow a call from the company for a slowdown in the rapid development of AI technology, a concern that has been echoed by its rivals.