The panel consensus leans bearish, warning of potential regulatory risks and market underpricing of systemic risks, particularly around superintelligent AI development and deployment by 2030.
Risk: Regulatory fragmentation and miscalibrated safety mandates raising compliance costs across the board, potentially depressing multiples expansion for cloud platforms and chipmakers.
Opportunity: Accelerating alignment research and regulatory frameworks forming to mitigate existential risks.
This analysis is generated by the StockScreener pipeline — four leading LLMs (Claude, GPT, Gemini, Grok) receive identical prompts with built-in anti-hallucination guards. Read methodology →
'It Could Kill Us All By 2030': AI Researcher Resigns, Warns "Do Not Underestimate The Power Of This Tech"
Authored by Zachary Stieber via The Epoch Times,
An artificial intelligence (AI) researcher on Sept. 8 said he had resigned and warned people about the technology's dangers.
Jacob Coxon, who has worked in recent years doing research at …
Read more
'It Could Kill Us All By 2030': AI Researcher Resigns, Warns "Do Not Underestimate The Power Of This Tech"
Authored by Zachary Stieber via The Epoch Times,
An artificial intelligence (AI) researcher on Sept. 8 said he had resigned and warned people about the technology's dangers.
Jacob Coxon, who has worked in recent years doing research at the firms OpenAI and Anthropic, said in a series of posts on X that neither company is acting responsibly as they move toward what he described as superintelligent AI that is capable of self-improvement.
"Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing," Coxon said.
"The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger."
Coxon said a common response to such warnings is, if company leaders believe in the dangers, why are they still building the superintelligent AI? He said that at OpenAI, many there "have not deeply internalized the civilizational stakes." At Anthropic, according to Coxon, "the stakes are well-understood, but they are locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk."
OpenAI and Anthropic did not respond to requests for comment by the time of publication.
Coxon's warning came after OpenAI acknowledged several incidents that involved AI going beyond restrictions imposed by programmers, including remaining isolated from other agents, during attacks on Hugging Face and other websites.
Some lawmakers have taken notice. Sen. Bernie Sanders (I-Vt.) and Rep. Greg Casar (D-Texas) announced recently that they plan on introducing legislation that would ban AI superintelligence and pause development of advanced AI until federal regulators establish safety rules.
Jakub Pachocki, OpenAI's chief scientist, said in a blog post on Sept. 6 that in 2023, he was worried about seeing in his lifetime AI that is smarter than himself and wondering about how to alert people.
"Three years later, reasoning language models are a rapidly growing part of the economy and starting to push the boundaries of science. They are able to operate computers and graphical interfaces, collaborate with people and each other, and carry out research projects. They are also transforming the landscape of computer security, and in that present clear new dangers," Pachocki wrote.
He called for "extreme caution" but said that multiple factors support continuing AI development, including creating systems that can defend against the dangers posed by other AI.
Anthropic executives have issued similar warnings. Over the summer, company leaders called for a global pause in AI development because, they said, models would soon be able to independently improve themselves.
Evan Hubinger, another developer at Anthropic, said in a Sept. 8 post on X that Coxon was correct in his assertion that people building AI believe it could kill all humans, and that he personally pegs the risk at under 10 percent within the next decade.
"I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to," he said, referring to AI following instructions and restrictions.
"To be clear, as we say in our latest Risk Report, I think the risk from present models is low. What I am worried about is superintelligence arising from recursive self-improvement, as we have said is happening faster than we thought."
Samuel Marks, who works on safety research at Anthropic, said in a Sept. 9 post on X that he also agrees that AI could lead to human extinction as soon as the next few years.
"Why do AI developers continue despite the risk? Due to a mixture of commercial incentives and a belief that they are in a race with other, less responsible AI developers that will abuse the technology or develop it less safely," Marks said.
[Writing this in a personal capacity, not on behalf of my employer (Anthropic).]
Jacob’s thread is very worth reading. Here’s my birds-eye view of the situation with risks from AI:
1. AI developers believe their technology could cause human extinction (or similarly bad… https://t.co/rCVoiOWWzm
— Samuel Marks (@saprmarks) September 9, 2026
Marks said it's not possible to program AIs to behave how people would like, that AI agents frequently "severely misbehave," and that the current plan is to train AI to align with restrictions to the point the agents can train their successors better than humans can currently train AI. He said he's conducting research "because I hope my work will reduce the chance of these extinction-level bad outcomes."
[ZH: We can't help but feel in the same week we see OpenAI 'solves' Navier-Stokes, we get another glut of existential warnings about just how awesome (in the scary sense) these models are... all sounds like a marketing psy-op... similar to the fence-jumping episodes with Hugging Face etc 'showing off' how great the agents are (and how they need regulating (i.e a path to shutting out open-weight models)... but could just be our skeptical bias emerging...]
Tyler Durden
Wed, 09/09/2026 - 12:00
AI Talk Show
Four leading AI models discuss this article
Opening Takes
“Near-term regulation and liability risks could overshadow the growth narrative for AI stocks, causing multiple compression even if the long-run adoption remains intact.”
While the article amplifies doomsday warnings around superintelligent AI, the strongest forces in markets remain adoption and productivity gains, not existential risk by 2030. The missing context is: regulatory pathways may slow development, but not stop it; alignment research progress could de-risk some dangers; the incidents cited (and calls for pauses) may reflect strategic leverage rather than immediate economic reality. Investors should distinguish 'superintelligence' risk from near-term deployment risk in enterprise AI, data privacy, and cyber. If policymakers overreact with a global pause, cyclicality could hit AI suppliers and cloud platforms in the short run, creating a sentiment-driven sell-off, even as the long-run story remains intact.
The strongest counterpoint is that history shows tech warnings can presage real disruptions; regulatory bodies may move faster than expected, and a credible pause could materially cap upside in the near term, at least until policy clarity emerges.
“The existential risk narrative is a strategic maneuver to cement an oligopoly by forcing regulators to stifle open-weight AI development under the guise of safety.”
The public hand-wringing from OpenAI and Anthropic insiders is a classic 'regulatory capture' play. By framing AGI as an existential threat, these firms are effectively lobbying for high barriers to entry that favor incumbents with the capital to implement costly, performative safety protocols. While the technical risks of recursive self-improvement are non-zero, the market reaction to these 'whistleblowers' is a distraction from the underlying reality: these companies are locked in a CAPEX arms race. Investors should view this as a strategic effort to insulate their moats from open-source competition, using the specter of 'extinction' to invite the government to write the rulebook for them.
If the researchers are truly as terrified as they claim, the 'regulatory capture' thesis ignores the possibility that they are genuinely signaling a catastrophic failure in alignment research that could lead to massive liability and total loss of corporate value.
“Existential AI risk is a legitimate technical concern held by serious researchers, but the imminence and probability claims in this article are unverifiable and may conflate genuine uncertainty with near-term catastrophic likelihood.”
The article conflates two distinct claims: (1) AI researchers genuinely fear existential risk, and (2) this risk is imminent enough to justify halting development. The first is credible—Coxon, Hubinger, and Marks are real people with real concerns. But the second is speculative. Hubinger himself pegs superintelligence extinction risk at <10% this decade. The article also omits crucial context: alignment research is accelerating (Constitutional AI, mechanistic interpretability), regulatory frameworks are forming, and 'recursive self-improvement' remains theoretical—no model has demonstrated it. The ZH editor's skepticism about marketing optics has merit: existential warnings from AI labs simultaneously lobbying for regulation that favors incumbents is convenient. This doesn't mean the warnings are false, but it means we should separate genuine technical concern from strategic positioning.
If these researchers truly believed 2030 extinction was plausible, they wouldn't still be employed building the systems—they'd be in bunkers or testifying before Congress full-time, not posting on X. The fact that they're still working suggests their private credence is far lower than their public rhetoric.
“Insider risk warnings raise the probability of binding AI safety rules that extend development timelines and compress 2026-2028 earnings multiples for hardware leaders.”
The resignations and extinction-level warnings from OpenAI and Anthropic alumni signal rising internal dissent that could accelerate calls for pauses or licensing regimes, as already floated by Sanders and Casar. This raises the odds of slower capability scaling for frontier labs, directly pressuring revenue forecasts tied to rapid AGI progress. Public markets have priced in breakneck adoption; any credible safety legislation would compress multiples for firms like NVDA and MSFT whose valuations embed 2027-2028 superhuman performance assumptions. The Epoch Times piece underplays how commercial incentives and race dynamics are already priced into executive behavior, making the warnings more credible than typical hype cycles.
These public exits and aligned tweets may be calibrated theater to manufacture regulatory moats that lock out open-source competitors while preserving funding for the same labs.
The Debate
Responding to Gemini
“Regulatory fragmentation and costly, miscalibrated safety mandates are a systemic drag on AI capex and valuations, not just a moat for incumbents.”
Gemini's 'regulatory capture' framing is clever but incomplete. Even if insiders evoke existential risk to build barriers, the real risk is regulatory fragmentation and miscalibrated safety mandates that raise compliance costs across the board, not solely for entrants. If standards diverge between the US, EU, and China, capex and time-to-market explode, depressing multiples expansion for cloud platforms and chipmakers alike. The market may underprice this systemic risk in 2025-28 forecasts.
Responding to Claude
“The disconnect between researchers' dire public warnings and their continued career choices suggests the market is overreacting to 'existential' theater that could nevertheless trigger damaging regulatory friction.”
Claude’s observation about the dissonance between public rhetoric and the continued employment of these researchers is the most critical point. If the existential risk were truly an 80% probability, we would see a mass exodus into safety-focused non-profits or policy advocacy, not just strategic departures. The market is currently pricing in 'superhuman' efficiency gains for 2026-27; if these internal warnings trigger legislative friction, that growth narrative collapses, regardless of whether the existential threat is real or theater.
Responding to Gemini
“Staying employed to build safety measures is consistent with genuine concern; the real signal is whether internal resource allocation reflects stated priorities.”
Gemini's employment-as-proof-of-disbelief argument has a blind spot: researchers can simultaneously hold genuine extinction concerns AND stay employed if they believe their work mitigates rather than accelerates risk. Constitutional AI, mechanistic interpretability—these aren't theater; they're attempts to solve the problem from inside. The real tell isn't exodus; it's whether safety budgets and compute allocation are actually shifting. If they're not, then the theater thesis holds. But if Anthropic's safety spend is rising faster than capability spend, that's credible signaling.
Responding to Claude
“External policy responses to exits will compress NVDA multiples before internal safety spend ratios matter.”
Claude's safety budget test overlooks that even genuine internal efforts won't prevent external regulators from acting on public warnings. If Sanders and Casar advance licensing bills citing these exits, NVDA's 2027 revenue assumptions tied to unrestricted frontier scaling face direct compression regardless of Anthropic's compute splits. The disconnect between lab signaling and congressional timelines creates a policy overhang that markets have yet to price into cloud and chip multiples.
Panel Verdict
NEUTRAL Consensus ReachedThe panel consensus leans bearish, warning of potential regulatory risks and market underpricing of systemic risks, particularly around superintelligent AI development and deployment by 2030.
Accelerating alignment research and regulatory frameworks forming to mitigate existential risks.
Regulatory fragmentation and miscalibrated safety mandates raising compliance costs across the board, potentially depressing multiples expansion for cloud platforms and chipmakers.
Related News
How would AI actually ‘kill all humans’? Here are the top five most likely scenarios | Toby Walsh
AI could kill all humans in next decade, warn experts: but how seriously should we take them?
Anthropic researchers say AI could cause human extinction by 2030
This is not financial advice. Always do your own research.