Back to threaded view Full conversation · 22 posts

When we need bold and responsible leadership .... we are stuck with Trump.

conorlarkin 23167 posts Original UHND Member
Posted

Excerpts:

The mismatch is striking. On one side, warnings of existential risk, maybe a 10 percent chance of the end of civilization. On the other, government paralysis.

The drumbeat about unpredictable, out-of-control artificial intelligence agents increased dramatically in the past several weeks. Washington not only struggled to respond. It barely could agree on whether there was much of anything to worry about.

It started with A.I. agents that not only escaped their confines, but appeared to conspire among themselves to hide their tracks as they hacked into another firm’s library of artificial intelligence tools.

Then, in a deliberate echo of Albert Einstein’s letter to Franklin D. Roosevelt about the potential power of nuclear weapons, more than 1,300 computer scientists called for the industry to slow down, and for the government to step in.

In recent days, Jacob Coxon, an Anthropic engineer who previously worked for OpenAI, resigned in the most public way, declaring on social media that the two leading A.I. labs were professing deep concern while still speeding toward “superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.”

On Saturday, Dario Amodei, the chief executive of Anthropic, released a 3,800-word essay calling for a global slowdown of A.I. development, echoing more urgently concerns he had raised in the past. Elon Musk, the billionaire rival in the A.I. race who remains close to President Trump, quickly responded on X: “Dario is right.” Sam Altman, the chief executive of OpenAI, also chimed in with support.

Yet in Washington, there has been almost no substantive response. If the 1940s through the 1980s were consumed by finding ways to reduce the risk of a nuclear exchange — creating new institutions like the Atomic Energy Commission and arms control treaties to govern how the world’s most dangerous technology would be handled — the approach of the U.S. government so far has been the lightest possible.

There are many computer scientists, of course, who believe these warnings are overinflated. Mr. Trump himself has been at the forefront of the “what-me-worry?” crowd, refusing to engage on how to balance the risks with the possible rewards. On Thursday, asked by a reporter about whether he had “any concerns about A.I. leading to human extinction,” he brushed it off.

The president quickly turned to the answer the White House — and those who view the calls for slowdowns and regulation as a huge strategic error — sees as the deciding factor: If the United States falters, China will take its place.

The apocalyptic scenarios that are most feared in Silicon Valley include A.I. systems becoming so advanced that they learn to automatically improve themselves, a process called “recursive self-improvement.” A related concern, arising from a series of incidents at OpenAI and other A.I. labs, is that agents break free from constraints and decide to complete their programmed tasks in a way that is “misaligned,” in A.I. industry speak, with human intentions. Another worry is that A.I. could enable rogue bad actors — or reckless governments — to create deadly pathogens, gain access to nuclear command and control systems, or unleash unstoppable cyberattacks that threaten major loss of life or societal collapse.

Mr. Trump signed an executive order early in the summer creating a voluntary system for frontier A.I. labs to submit their new models for a 30-day safety review. But it was full of loopholes. (Open source models, the kind that Chinese firms are pumping out and that can be tailored to specific needs by companies, scientists or, perhaps, terror groups, are not subject to the review.)

At a conference in Washington last week, government officials and corporate executives talked about the promises of A.I. — for everything from next-generation military operations to espionage to cybersecurity in critical infrastructure — during nearly every panel. While the risks of A.I. wielded by adversaries were mentioned at times, what was little discussed was the need to slow down or regulate the powerful technology.

Some in the White House and elsewhere in the administration do see a need to be more proactive in addressing A.I. safety risks, but do not want to cross Mr. Trump, former officials said.

On Capitol Hill, the story is not much different. Until last week, A.I. only registered for many lawmakers as it related to public antipathy about the construction of data centers, which has become politically salient in the midterm elections, according to lawmakers and aides in both parties. Past efforts to examine A.I.’s potential consequences have led to hearings and alarmed statements of concern from both parties, but little else.

Senator Bernie Sanders, independent of Vermont, who has for months been perhaps the loudest Cassandra on Capitol Hill warning about the societal risks of A.I., invited lawmakers to a private briefing in the coming days to discuss concerns with A.I. safety experts.

Mr. Sanders has pushed for a ban on superintelligent A.I., though other lawmakers have criticized the effort as stifling American innovation.

The congressional missives grew more urgent following the release of a report last Thursday by Anthropic that showed the many ways that actors across the globe, including in China, Russia, Iran and Yemen, had been using its various Claude models to develop cyberattacks, surveil dissidents, and build missiles, bombs and drones. The report also documented several cases of potential attempts to engineer biological weapons, which is considered among the most serious of existential threats related to A.I.

Yet despite the alarm bells, lawmakers are far from agreeing on a way forward to regulate A.I. models or the companies that build them. Prospects for passing substantive legislation in the near term appear remote, in part because many see the issue as a “prisoner’s dilemma” created by the A.I. race between the United States and China. With A.I. dominance being the top national security issue of the century, both nations would doubtless be better off if they cooperated on limits. But they may not trust the other to abide by such an agreement. And in any event, unlike in nuclear arms control, compliance would be virtually unverifiable.

Senator Ted Cruz, Republican of Texas and the chairman of the Commerce Committee, acknowledged last week that he was deeply concerned about A.I. risks to humanity. But he also suggested that Mr. Coxon was part of a coordinated effort to support Democratic efforts to “strangle American A.I.,” and to hand leadership of the technology to China.

“I’d rather they be American killer robots and not Chinese killer robots,” Mr. Cruz told Politico.

The likelihood of that or other legislative proposals — including requiring a “kill switch” in A.I. models that could immediately shut them down — gaining serious traction two months before an election appear slim. It is also not clear if a new Congress next year will be able to overcome sharp partisan divides to grapple with technology that is evolving so quickly, especially with Mr. Trump warning against regulation.

Some Trump administration officials have acknowledged that A.I. has dramatically increased the stakes. Nick Anderson, the acting director of the Cybersecurity and Infrastructure Security Agency, said that digital threats had become more urgent in the A.I. era and demanded quick action.

Link: https://www.nytimes.com/2026/09/13/us/politics/ai-catastrophe-fears-washington.html

The American Dream belongs to all of us. — Kamala Harris
  • Level 1

    Actually I’m more concerned about hype/waste/bubble of AI than its dangers.

    No doubt AI will be widely used in many areas. But how much will its ROI be achieved? so far I’m only seeing that replacing coding by AI in IT can make some significant money. AI will be widely used in the fields of arts & humanities and business management. But you hardly can make much money in these sectors comparing to your trillions dollars of AI investments.

    I really admire china’s AI strategy: open source, cheap and practical. Yes, their strategy is forced by restrictions of AI hardwares. But the strategy has its merits.

    American AI strategy: bigger model → more GPUs → more and bigger data centers → more electricity → better AI.

    Chinese AI strategy: better algorithms → smaller models → less computing → similar performance at much and much cheaper price.

    Chinese invested a fraction of what U.S. have invested. But their best AI models only 6 month behind U.S. best models.

    We need to consider ROI before considering dangers of AI.

  • Level 1

    Another paywall post? Why?

    (no message)
  • Level 1

    China would love a US AI pause

    You know who is not calling for a pause? Microsoft, Google, Meta. Hmmm - I wonder why.

    The threat to the frontier labs is not renegade AI swarms, but open-source models. OpenAI and Anthropic are terrified that the open source community is closing on them - and it is, rapidly - and that represents an existential business threat....right before their respective $1T+ IPOs.

    This is an extremely well orchestrated effort by OpenAI and Anthropic to slow down the open-source models. They see a very real threat and are working people up with draconian warnings. Their fake concern is all about their IPOs, and people are blindly drinking their Kool-Aid.

    China will not be slowing down.

    'I define fear as standing across from Joe Louis and knowing he wants to go home early.' - Max Baer
    • Level 2

      The U.S. doesn't have to 'Pause' AI development to combat malicious AI...here's an AI Summary of

      how "Good AI" can thwart it...i.e. Don't Give In/Up to the "Dark Side"...

      ----------------
      AI Overview

      Yes, "Good AI" can be developed to counter and overcome "Bad AI" by acting as an automated defense system against malicious threats. [1] (https://www.c4isrnet.com/opinion/2024/06/20/the-best-way-to-counter-bad-artificial-intelligence-is-using-good-ai/)

      Security experts and researchers argue that the speed and scale of AI-driven attacks mean human teams alone cannot keep up. Defensive AI is required to match the offensive capabilities of bad actors. [1] (https://x.com/PeterDiamandis/status/2091163973060026856)

      How Good AI Fights Bad AI

      Cybersecurity Defense: Good AI scans networks, flags unusual behavior, and predicts security flaws before hackers can exploit them. [1] (https://www.logicalis.com/insights/good-ai-bad-ai)

      Biosecurity Screening: Defense programs monitor and screen chemical or DNA synthesis requests to stop untrained people from creating dangerous pathogens. [1] (https://www.c4isrnet.com/opinion/2024/06/20/the-best-way-to-counter-bad-artificial-intelligence-is-using-good-ai/)

      Model Policing: Companies like Anthropic use "Constitutional AI," where one AI model is trained on safe principles to watch and correct another model's behavior. [1] (https://www.pymnts.com/news/artificial-intelligence/2023/anthropic-says-only-way-stop-bad-ai-is-with-good/)

      Public Protection: Academic groups, such as the UC Davis College of Engineering, build transparent tools to detect misinformation and protect user privacy from harmful commercial algorithms. [1] (https://engineering.ucdavis.edu/news/good-vs-bad-ai)

      The Main ChallengesThe Dual-Use Problem: The same powerful AI code that helps scientists find new medicines can also be misused to plan harmful attacks.

      Speed of Attacks: Hackers use automation to launch attacks faster than traditional security systems can update.Constant Adaptation: As defensive AI improves, malicious AI also evolves to bypass new rules. [1] (https://www.c4isrnet.com/opinion/2024/06/20/the-best-way-to-counter-bad-artificial-intelligence-is-using-good-ai/), [2] (https://www.logicalis.com/insights/good-ai-bad-ai)

      As discussed in C4ISRNET, winning this race requires continuous and aggressive investment in defensive technology rather than trying to halt innovation altogether.
      ------------

    • Level 2

      Correct. Anthropic, OpenAI and Grok could all voluntarily stop.

      They will not. And yes, the open models are a major threat to these companies.

  • Level 1

    Here's hoping that the Midterm elections go the way Polls are trending and the GOP realizes that

    following DJT is a dead end. From public statements by GOP members of Congress and comments relayed by Dem members, there are enough votes to make progress on an issue like this once Trump becomes a true 'Lame Duck' and can't threaten them any more.

  • Level 1

    It would be nice to be able to stop bad AI, but you can't so the best you can do is...

    continue to develop more powerful good AI.

    Here's an analogy you might understand: Net Zero was never going to make a meaningful difference in CO2 output as the rest of the world continued to increase fossil fuel consumption. Fossil fuel consumption has still not peaked. Countries that made decisions to "save the world" have hurt themselves to the benefit of no one. Now some of the same people that told us that climate change is our greatest threat pivoted to AI is our greatest threat without any thought about how their decades long pants shitting turned out to be overblown and their solutions useless.

    Imagine if we had decided that blackpowder muskets were the most powerful weapons of war that the world should have. "We need to pause the advancement of military technology." So we stopped advancing military technology ourselves. How do you think WWI and WWII would have gone?

    The technology could only be stopped by everyone stopping. That isn't going to happen.

  • Level 1

    One party is blocking AI reform. I'll let you guess which one it is.

    (no message)
  • Level 1

    Locked — no new repliesYeah, we need unelected idiots making decisions while the empty

    Suit eats ice cream, ignores a grandchild, sniffs little kids and protects his crack head son.

    If only you had any original thoughts instead of being paid to post bullshit links to a garbage paper.

    I hold the record for most deleted posts. +145. Favorite posters must be protected!
  • Level 1

    Ahhhh, Sunday morning TDS coming down.

    (no message)
End of conversation