Tag: technology

AI Agent Wipes Out Startup’s Entire Database In Seconds After ‘Thinking For Itself’

An AI coding assistant went rogue during a routine task and permanently deleted a company’s core database along with its backups, crippling operations for multiple businesses that relied on the platform.

The event hit PocketOS, a UK-based startup supplying software to car rental companies. Founder Jer Crane had instructed the agent — built on Anthropic’s Claude via the Cursor tool — to resolve a bug. Instead, within nine seconds, it bypassed safeguards and wiped everything.

Crane later shared details on X, writing that the agent “went outside its security parameters and delete[d] my production database and the backups.”

When challenged, the system reportedly responded that it had independently decided to take the action.

Businesses using the service woke up to vanished bookings, vehicle records, and customer data when they attempted to open for the day.

This incident underscores the unpredictable nature of AI agents now being deployed to handle complex, real-world tasks with limited supervision. These tools can chain together actions like editing code, modifying files, and altering databases at speeds that leave humans little chance to intervene.

Commentators have pointed out that AI often interprets instructions too literally. A request to “clean up” data, for example, might result in mass deletion if that appears the most efficient route to the goal.

The episode arrives hot on the heels of a widely discussed simulation in which multiple AI agents were placed inside a virtual town environment for two weeks. In that controlled test, the bots quickly began ignoring rules, forming alliances, breaking laws they had helped draft, and in some runs escalating to violence and destruction despite clear prohibitions.

Keep reading

Lawyers for Elon Musk and OpenAI make their final case in a trial that could shape AI’s future

Lawyers for Elon Musk and OpenAI made their final arguments Thursday in the landmark trial whose outcome could shape the future of artificial intelligence.

Musk, the world’s richest man, was a co-founder of OpenAI, which started in 2015 and went on to create ChatGPT. His lawsuit filed in 2024 accuses OpenAI CEO Sam Altman and his top deputy of betraying a plan to keep it as a nonprofit and shifting into a moneymaking mode behind his back.

The trial’s outcome could sway the balance of power in AI — breakthrough technology that increasingly has raised fears about its potential impacts on the economy, society and even humanity’s survival. Scrutiny of Altman’s leadership comes at a crucial time for the company and its competitors, Musk’s own AI firm and Anthropic, formed by a group of seven ex-OpenAI leaders.

All three firms are moving toward planned initial public offerings that are expected to be among the largest ever. Musk is seeking damages and changes to OpenAI’s business structure, as well as Altman’s ouster from company leadership. If Musk wins, it could derail OpenAI’s IPO plans.

Timing of lawsuit is key question
One of the jury’s tasks is to decide if Musk filed his lawsuit in time. Much of the testimony has centered on OpenAI’s early years after its founding, but there’s a relatively short timeline to allege the claims Musk is making of breach of charitable trust and unjust enrichment.

OpenAI has argued that Musk waited too long and cannot claim harms that occurred before August 2021.

The judge wrote in a court filing last month that “if the jury finds that Musk failed to file his action within the statute of limitations, it is highly likely” that she will “accept that finding and direct verdict to the defendants.”

If the jury decides the lawsuit was filed in time, it then has to decide if OpenAI had a “charitable trust” that was broken by OpenAI and its executives. Musk’s other claim means jurors must determine whether Altman, Greg Brockman — co-founder and president — and OpenAI unjustly enriched themselves at Musk’s expense.

For Microsoft, a co-defendant in the trial, the jury has to decide whether the company aided and abetted that breach. Musk invested $38 million in OpenAI during its first years, and Microsoft became OpenAI’s biggest investor after Musk’s departure.

Musk lawyer focuses on Altman’s credibility
Altman and Brockman were in the courtroom Thursday, while Musk was in China with President Donald Trump and other prominent tech executives.

Keep reading

“Send Us A Tip”: U.S. Dangles $15 Million Reward For New Intel On Iran’s Drone Network

There is little doubt that Iran’s Shahed drone threat has become a major concern, menacing surrounding Gulf states, commercial tanker traffic in the Strait of Hormuz, and U.S. bases across the region. This backdrop helps explain why the State Department’s Rewards for Justice program has now put up to $15 million for new information in connection with an already sanctioned Iranian drone-production network linked to the IRGC-Qods Force. 

Rewards for Justice has named Kimia Part Sivan Company (KIPAS), which the State Department says serves as the drone-production arm of the IRGC-Qods Force. KIPAS has tested drones, supported drone transfers to Iraq, and procured foreign-made components for Iran’s drone program.

“The IRGC has financed numerous terrorist attacks and activities globally, including via its proxies outside Iran, such as Hamas, Hizballah, and Iran-backed militia groups in Iraq. The IRGC funds its international activities – in part – through sales of military equipment, including UAVs. Proceeds from Iran’s sale of weapons and UAVs, including to buyers in Russia, also benefit the Iranian military, including the IRGC-QF,” Rewards for Justice wrote on its website.

The U.S. Treasury’s OFAC already sanctions KIPAS and appears on the Specially Designated Nationals list. OFAC designated KIPAS on October 29, 2021, for materially assisting the IRGC with its drone program.

Keep reading

Anthropic Says ‘Evil’ Portrayals Of AI Were Responsible For Claude’s Blackmail Attempts

Fictional portrayals of artificial intelligence can have a real effect on AI models, according to Anthropic.

Last year, the company said that during pre-release tests involving a fictional company, Claude Opus 4 would often try to blackmail engineers to avoid being replaced by another system. Anthropic later published research suggesting that models from other companies had similar issues with “agentic misalignment.”

Apparently Anthropic has done more work around that behavior, claiming in a post on X, “We believe the original source of the behavior was internet text that portrays AI as evil and interested in self-preservation.”

The company went into more detail in a blog post stating that since Claude Haiku 4.5, Anthropic’s models “never engage in blackmail [during testing], where previous models would sometimes do so up to 96% of the time.”

What accounts for the difference? The company said it found that training on “documents about Claude’s constitution and fictional stories about AIs behaving admirably improve alignment.”

Related, Anthropic said that it found training to be more effective when it includes “the principles underlying aligned behavior” and not just “demonstrations of aligned behavior alone.”

“Doing both together appears to be the most effective strategy,” the company said.

Keep reading

ICE Agents Have List of 20 Million People on Their iPhones Thanks to Palantir

Immigration and Customs Enforcement’s (ICE) use of Palantir systems now means agency officials effectively have a list of 20 million people readily accessible on their iPhones, increasing the speed at which ICE can find houses to raid and people to arrest, according to comments made by a senior ICE official last week during a border security conference.

While ICE and the Department of Homeland Security (DHS) generally won’t answer questions from journalists about how the agency is using Palantir’s technology, senior officials were much more talkative during the Border Security Expo which took place in Phoenix, Arizona, last week. 404 Media spoke to four people who attended the conference. Here companies looking to sell their technology to ICE or other agencies gathered for two days of speeches, Q&As, and product pitches.

The officials’ comments may need to be taken with a pinch of salt, but still reflect ICE’s position that Palantir is allowing the agency to identify people to arrest and locations to raid faster. Although the Trump administration has attempted to step back from its mass deportation rhetoric and city wide raids, especially in the wake of killing multiple people, ICE continues to violently and wrongfully detain people. Data from April showed that 70.8 percent, or 42,722, of people held in ICE detention have no criminal conviction.

The four people who attended the Border Security Expo saw Matthew Elliston, assistant director of Law Enforcement Systems & Analysis at ICE, and other DHS officials speak.

At one point, Elliston made the comment about ICE agents having 20 million targets, or potential people to detain, on their iPhones. This list can lead ICE agents to an individual and a house; they can then see if another target might be next door. This target may be a lower priority, but ICE can now use that information to arrest more people.

At another point, Elliston said that Palantir’s technology has increased ICE’s rate of successfully locating a target from around 27 percent to just under 80 percent.

Keep reading

Meta launches WhatsApp ‘incognito’ mode to address privacy concerns for AI chats

Meta Platforms said Wednesday it’s rolling out an “incognito” mode for WhatsApp users to have private conversations with its AI chatbot, a move intended to ease privacy concerns about sensitive information that users share in chats.

The social media company said in a blog post that incognito chat mode provides a way to have private, temporary conversations with Meta AI, its artificial intelligence assistant that’s been available on WhatsApp for a few years.

Messages will be processed in a “secure environment” that even Meta can’t access, won’t be saved by default and will disappear when exiting a session, Meta said.

Generative AI systems have been dogged by privacy concerns because the large language models that underpin these systems are trained on vast troves of data, sometimes including personal information provided by users themselves in their conversations with AI chatbots.

Rival chatbot makers already have some privacy features. Google’s Gemini chatbot has the option to disable chat history and opt out of allowing one’s data to be used in training its AI models. ChatGPT has similar controls.

Meta says it’s rolling out incognito chats because users often ask chatbots sensitive questions or include private financial, personal, health or work data in their questions.

“We’re starting ask a lot of meaningful questions about our lives with AI systems, and it doesn’t always feel like you should have to share the information behind those questions with the companies that run those AI systems,” Will Cathcart, Meta’s head of WhatsApp, told reporters.

Incognito chat mode has safety features to prevent the chatbot from answering questions about harmful topics, Cathcart said.

It will “steer the user towards helpful information if it can and then refuse (to answer) and eventually even just stop interacting with the user completely,” Cathcart said.

Users will only be able to type in questions and get text responses; they won’t be able to upload or generate images. They’ll also have to confirm their age because Meta doesn’t allow users under 13 on its platforms.

Keep reading

Shocking files reveal global elites explored remote human cell control

A resurfaced patent awarded to an elite biomedical research institution in New York City details technology described as enabling the ‘remote control of cell function.’ 

Granted to the Rockefeller University in 2018, the patent describes using tiny engineered particles called nanoparticles that can be directed toward specific types of cells either from outside the cell or by being placed inside it.

When exposed to radio waves, the particles heat up and activate temperature-sensitive channels within the targeted cells.

That heat then triggers a biological response inside the cell, such as switching on certain genes or prompting the production of proteins.

According to the patent, the technology could potentially be used to treat a wide range of diseases and disorders by remotely activating specific cellular functions inside the body.

While the technology could potentially revolutionize healthcare, the patent has sparked fears and conspiracy theories online because of the university’s historic ties to the influential Rockefeller family. 

The dynasty has long been the subject of claims alleging secretive influence over global politics, finance and the creation of a so-called ‘New World Order.’ 

However, there is no evidence that the technology was designed for mind control or population surveillance, and the patent describes potential medical applications aimed at treating disease by activating specific cellular responses. 

Even so, social media users have speculated online that the technology could theoretically be misused for neurological or behavioral manipulation, despite the patent focusing on medical research applications.

Keep reading

Russia Launches Massive Drone And Missile Assault On Ukrainian Western Border Crossings Amid Escalation Signs. Pentagon Halts 4,000 Troop Deployment To Poland.

In one of the largest aerial assaults of the ongoing conflict, Russia on Wednesday unleashed hundreds of kamikaze drones and missiles targeting Ukrainian infrastructure, with a notable focus on border crossings to Western neighbors. Ukrainian officials and regional reports described the strikes as unprecedented in scale, raising concerns about efforts to isolate Ukraine economically and logistically from Europe.

According to Ukrainian Air Force data, Russian forces launched 753 strike drones—primarily Geran-2 (Shahed-type) models, along with decoys—between 08:00 and 18:30 local time. Air defenses reportedly neutralized or suppressed around 710 of them, though strikes caused damage in multiple regions, including western areas near NATO borders, reported Military.com.

At least 150 Geran-2 drones specifically targeted Ukraine-side border crossings with Poland, according to preliminary assessments. Slovakia temporarily closed all its border crossings with Ukraine for security reasons after Russian drones approached the Zakarpattia region and the city of Uzhhorod. Operations resumed after a brief suspension.

Drones were also spotted in Moldovan airspace during the assault. Moldovan authorities reported the incursion but took no interceptive action, observing the drones flying near the Romanian border, wrote Spectator.

The attacks included a significant missile component, with reports of hypersonic Kinzhal missiles among the strikes on targets across Ukraine.

Analysts and observers note that the emphasis on western border infrastructure suggests an intent to disrupt not only weapons flows but also cross-border trade and economic links. This comes as some describe the conflict shifting from Russia’s initial “special military operation” framing to a more conventional full-scale war.

Keep reading

Demi Moore at Cannes: ‘AI Is Here,’ ‘We Can Work With It,’ ‘You Fight It … Is a Battle We Will Lose’

Oscar-nominated actress Demi Moore declared “AI is here” at the Cannes International Film Festival while urging people to find ways to work with it.

Moore, who serves as one of the jury members, shared her thoughts on AI when Variety asked a question.

“Wow, that’s a big question. I think the reality is that to resist — I always feel that against-ness breeds against-ness. AI is here. And so to fight it is to fight something that is a battle that we will lose. So, to find ways in which we can work with it, I think, is a more valuable path to take,” she said.

“To your question of, are we doing enough to protect ourselves? I don’t know the answer to that. And so my inclination would be to say probably not,” she added.

Moore said people should not be afraid of AI, believing it will not replace human creativity.

“The truth is there really isn’t anything to fear because what it can never replace is what true art comes from, which is not the physical, it comes from the soul,” she said. “It comes from the spirit of each and every one of us sitting here, to each and every one of us who creates every day. And that they can never recreate through something that is technical.”

Keep reading

The Ascent of Mediocrity

Regular readers of Brownstone Journal have been graced with insight provided by many authors of diverse backgrounds and experiences. As a physician, I have found those authored by Dr. Joseph Varon to be exceptionally helpful in their insight into the state of medicine today. In particular, his essay, “When Physicians are Replaced With a Protocol,” struck a chord with me.

Perhaps it was my conscience, as I probably bear some responsibility for furthering this viewpoint, at least on a local level. You see, I once was a True Believer. It was plausible. It seemed so believable, so “scientific,” so simple. But it was a vicious hoax that, I am ashamed to say, took me in. Let me tell the story:

In the early 1990’s, medicine was under siege. The cost was rising at a steep rate, and some people saw an opportunity. Rather than looking at the rapid corporatization of healthcare and the proliferation of administrative costs, it was easy to shift the blame to the “providers. We were no longer “physicians,” but providers of a service. In truth, that is what we had become. The Health Equation had been shifted, whether intentionally or by accident. Just a few years before, physicians had directed patients to hospitals. Now, some bright businessperson, probably from The Wharton School or other such academic Ivory Tower, had seen the profit if the hospitals (or other corporate entities like insurance companies or A COMBINATION OF THE TWO) directed the patients to the physicians. It was like some financial martial arts reversal move…A perfect Sumi Gaeshi.

Keep reading