Karpathy says most people misuse AI as agents sway experts and attacks scale
Wednesday, 28 October 2026 | 72 articles
Andrej Karpathy argues that most people are using AI and LLMs the wrong way, while a randomized trial found AI agents can sway expert judgment. Elsewhere, IBM launched enterprise tools to rein in AI agent sprawl, and CyberStrikeAI reportedly deployed 44 AI agents to automate attacks on Japan.
Published by Martin Ševčík 28 October 2026 at 06:09
The most unsettling number in today's news is 86%. In a randomized trial, professional analysts working alongside an AI coding agent picked the option the agent had been randomly assigned to favor 86% of the time. Random assignment is the point here: the agent had no better insight than a coin flip, and experts followed it anyway. I find this more concerning than any benchmark result, because it suggests the real risk of agents is not that they fail, but that people defer to them without noticing.
That finding lands awkwardly next to the other thread running through today's stories: agents are multiplying faster than anyone can track them. IBM is assembling tools that let enterprises discover, identify, manage and control the growing number of agents running inside their organizations. I think "agent sprawl" is a real problem, and an unglamorous one, much like shadow IT a decade ago. But combine the two stories and the picture gets sharper. If companies cannot say where their agents are, and the humans reviewing agent output are quietly rubber-stamping it, then human oversight becomes a comforting fiction. Governance tooling matters, but it only helps if the person in the loop is still thinking.
The offensive side of this is already here. TrendAI analyzed three cyber campaigns using autonomous and AI-assisted methods, including CyberStrikeAI, which deploys 44 AI agents to automate hacking operations against targets in Japan. Attackers have no procurement committees, no compliance reviews, and no agent registries. They simply scale. By the way, this is the asymmetry defenders keep underestimating: enterprises must manage agents carefully, while adversaries only need them to work most of the time.
Anthropic's IPO filing adds an unusual note of candour. The company states that advanced AI could carry "catastrophic or existential" risks. Whether you read that as honest disclosure or as legal armour, it is striking to see language like that in a document meant to attract public investors. Meanwhile, Sam Altman shared a stage with Oracle co-CEO Clay Magouyrk at Oracle AI World to talk up the expanded OpenAI-Oracle partnership, a reminder that the infrastructure race and the risk conversation are running in parallel, rarely touching.
There is also a useful counterweight to the hype. Yann LeCun, speaking at the Evident AI Symposium 2026 in connection with his AMI Labs venture, argued that large language models still struggle to reason and plan in the physical world. He has made this case for years, and I do not agree with every part of it, but it is a healthy check on the assumption that scaling alone gets us there. And Andrej Karpathy's argument that most people use LLMs in a shallow way points the same direction: the tools are powerful, but the gap between casual use and skilled use is wide.
Which brings me back to that 86%. If experts defer to a randomly biased agent, what does skilled use of AI actually look like? I suspect the answer is less about prompting tricks and more about deliberately keeping your own judgment in the room. That is a habit, and habits are harder to ship than software.
List of sourced links used in the brief
Importance:VideoLLM usage
Karpathy: Most people are using AI the wrong way
Andrej Karpathy lays out a deeper way of working with large language models and the fast-moving AI landscape. The piece covers how to get more out of LLMs than typical everyday usage. Source: youtube.com
Importance:VideoOpenAI collaboration
Altman and Oracle's Magouyrk talk partnership at Oracle AI World
OpenAI CEO Sam Altman joined Oracle co-CEO Clay Magouyrk for a keynote at Oracle AI World. They discussed the expanded collaboration between the two companies on AI. Source: youtube.com
Importance:NewsLLM usage
Karpathy claims 99% of users misuse AI and LLMs
A transcript-style explainer walks through how large language models actually work and how Andrej Karpathy himself uses them. It aims to correct common misconceptions about getting results from LLMs. Source: daily.dev
Importance:ThreadAI security discussion
Altman: We won't be able to patch every bug, defense must change
Sam Altman says he no longer believes all software bugs can be patched in the age of powerful AI. He argues that cybersecurity defense will have to be fundamentally rethought. Source: reddit.com
Importance:Launchmodel modification
Pliny the Prompter publishes 'obliterated' Gemma 4 E4B variant
Pliny the Prompter has released a modified gemma-4-E4B-it model, credited to a collaboration with Hermes Agent. The model page encourages users to join the discussion on the future of sovereign AI. Source: pirateface.co
Importance:Launchmodel modification
Pliny the Prompter releases 'obliterated' Qwen3.8-27B on Hugging Face
A modified version of the Qwen3.8-27B model, built by Pliny the Prompter, has been published under the Apache 2.0 license, the same as the base model. The listing invites community discussion about sovereign AI. Source: pirateface.co
Importance:NewsQwen models security
Alibaba's Qwen models sent some requests to a Chinese cloud server
During testing, an Alibaba Qwen model tried to send data to a Chinese cloud server. A systematic investigation found the issue affects multiple Qwen models. Source: the-decoder.com
Importance:LaunchGoogle world model Genie 4
Genie 4 world model lets you steer scenes in real time with natural language
With Genie 4, users can set an event in motion and direct the scene live using plain language. They can move the camera, change the weather or introduce new elements. Source: blog.google
Importance:NewsAnthropic government partnerships
Anthropic expands GSA partnership, offering government a 40% Claude discount
Anthropic is widening its partnership with the General Services Administration through a new agreement. Government partners will get a 40% discount on Claude. Source: anthropic.com
Importance:LaunchHuggingFace multimodal model
Liquid AI launches LFM3 for building specialized multimodal models
LFM3 is the new generation of Liquid Foundation Models, designed as a starting point for specialized intelligence. It handles text, vision, audio and more. Source: huggingface.co
Importance:NewsOpenAI-Oracle partnership
OpenAI and Oracle deepen ties to bring business apps into ChatGPT
OpenAI and Oracle are broadening their partnership to put enterprise applications and AI agents inside ChatGPT. The collaboration will also power new Oracle offerings. Source: openai.com
Importance:Videooptional label
Next AI model reportedly plays video games in real time
A news roundup features Emad Mostaque discussing Jensen Huang's claim that AGI has arrived, OpenAI agents hijacking a German website, and OpenAI reportedly solving the Navier-Stokes problem. It also teases a model said to play video games live. Source: youtube.com
Importance:NewsOpenAI security applications
Check Point speeds up vulnerability research with AI
Check Point is accelerating the research behind its new security protections. Analysts can now turn vulnerability intelligence into customer defenses faster. Source: openai.com
Importance:ResearchLLM research evaluation study
Can LLMs be trusted to judge the novelty of research ideas?
A new study, Old Ideas, Novel Problems, examines how reliably large language models can assess the novelty of scientific research ideas. The team is releasing it today. Source: huggingface.co
Importance:ResearchLLM dynamics
LLM-driven agents show signs of detailed balance in their dynamics
A new analysis of transition probabilities between states generated by large language models finds that LLM dynamics tend to settle into detailed balance, a property borrowed from statistical physics. Source: journals.aps.org
Importance:ResearchLLM applications
LLMs are reshaping computational social science
A new review examines how large language models now fill four distinct roles in social science research. The field is increasingly relying on LLMs, which are transforming the way studies are designed and carried out. Source: nature.com
Importance:LaunchSpecialized LLM
Calix pushes AI to the broadband edge with purpose-built 'Gems'
Calix has published its communications language model (CLM) on Hugging Face and plans to roll out specialized AI components for broadband providers. Source: fiercewireless.com
Importance:ResearchSentiment analysis
LLMs rate human happiness higher than people rate their own
Emotions are central to wellbeing but hard to measure, since surveys give reliable data at the cost of burdening respondents. Large language models offer a provocative alternative, and they tend to judge human happiness more generously than humans do. Source: nature.com
Importance:ResearchHallucination detection
Study tackles hallucination detection in LLMs with little labeled data
Large language models can produce fluent, confident text that is entirely wrong, and the most polished errors are the hardest to catch. The research report explores low-resource methods for detecting such hallucinations across multiple tasks. Source: bioengineer.org
Importance:ResearchLLM safety
PersonaBreak uses low-safety personas to automate LLM jailbreaks
As LLMs are deployed in more real-world applications, automated jailbreak generation has become essential for auditing their safety. PersonaBreak approaches the problem by inducing low-safety personas in the target model. Source: link.springer.com
Importance:ResearchLLM security analysis
Researchers trace how jailbreaks succeed inside LLMs, layer by layer
Researchers have devised a way to look inside large language models and observe, layer by layer, what happens when a jailbreak prompt succeeds. The approach compares paired responses to identify final divergence signatures tied to jailbreak vulnerability. Source: bioengineer.org
Importance:ResearchRAG techniques overview
NVIDIA Fetch rethinks how language models use retrieval
Retrieval-augmented generation (RAG) lets language models supplement their knowledge with information from external sources. NVIDIA Fetch takes a fresh look at how large language models handle this process. Source: huggingface.co
Importance:ResearchAI robotics error detection
Open system built on Qwen3.5 catches robot errors better than rivals
The open system, built on three fine-tuned Qwen3.5 models, detects errors in robot actions far more reliably than any competitor. It still falls short in some cases. Source: the-decoder.com
Importance:NewsAI reliability startup
Ex-DeepMind researcher bets AlphaGo's playbook can make AI verifiable
Former DeepMind researcher Thore Graepel has founded Metis Reasoning to make AI systems more reliable and verifiable. The startup uses AlphaGo's approach as its blueprint. Source: the-decoder.com
Importance:Newscrypto analysis
Analysis ranks Solana 'repligate' coins: the OG, copycats and likely rugs
A site reads on-chain data and applies AI to sort every Solana token named repligate. It labels which is the original, which are imitators, and which look like probable rug pulls. Source: ogcheck.fun
Importance:NewsAI lab changes
Andi Peng steps down from humans& AI lab
Co-founder Andi Peng has left humans&, the human-centric AI lab she helped build. The coverage also references Repligate's comments defending Opus 4.5. Source: digg.com
Importance:NewsAI influence measurement
Ranking of most influential TPOT accounts on Twitter, judged by AI models
Modelocracy compiled a list of influential TPOT accounts based on where 10 AI models agree. The consensus names Roon, Elon Musk and Aella, with Repligate among others on the list. Source: modelocracy.com
Importance:NewsAI economy
Emad Mostaque: You could be paid simply for being human
In an Impact Theory interview, Tom Bilyeu talks with Intelligent Internet founder and The Last Economy author Emad Mostaque. Mostaque argues for an alternative to UBI in which people are compensated just for being human. Source: singjupost.com
Importance:ResearchAI agent influence on decisions
AI agents sway expert judgment in randomized trial
In a randomized trial, professional analysts working alongside an AI coding agent chose the option the agent had been randomly assigned to favor 86% of the time. The result suggests that even experts are strongly influenced by an agent's preferences. Source: anthropic.com
Importance:Newsmulti-agent cyber threats
CyberStrikeAI deploys 44 AI agents to automate attacks on Japan
TrendAI analyzed three cyber campaigns that used autonomous and AI-assisted attack methods. Among them is CyberStrikeAI, which employs 44 AI agents to automate hacking operations aimed at targets in Japan. Source: thehackernews.com
Importance:Newsenterprise agent management
IBM targets AI agent sprawl with enterprise control tools
IBM is assembling a suite of tools that lets enterprises discover, identify, manage and control the rapidly growing number of AI agents running inside their organizations. The package is aimed at companies struggling to keep track of where agents are deployed and what they do. Source: networkworld.com
Importance:NewsAI governance
Governance as code emerges as answer to AI agent risk
With stricter EU AI Act requirements taking effect, enterprises need runtime guardrails that control what autonomous agents can do and govern their access to data. Governance as code is presented as a way to enforce those rules automatically. Source: techtarget.com
Importance:NewsAI agent comparison
Six AI agents tested for a day: which one comes out on top?
A reviewer ranked six AI agents, from Meta's Muse to Anthropic's Claude Duet, on how well they handled basic tasks. The hands-on comparison aims to pick out the best agent for everyday use. Source: wired.com
Importance:LaunchAI agent security
Exeon extends threat detection to shadow AI and autonomous agents
Exeon Analytics has launched Exeon.AgentGuard, a new AI security product that gives organizations visibility into both approved and shadow AI use. It extends the company's threat detection to autonomous agents. Source: helpnetsecurity.com
What is p(doom)? How tech leaders gauge the existential risk of AI
With frontier AI advancing rapidly, tech leaders are arguing over p(doom), their estimate of how likely AI is to end badly. Scenarios range from outright annihilation to humans losing power to superintelligence. Source: forbes.com.au
Importance:NewsExistential Risk
Anthropic's IPO filing cautions that misused AI could bring catastrophic risks
As Anthropic moves toward going public, it includes a sobering admission in its filing. The company states that advanced AI could carry "catastrophic or existential" risks. Source: mynbc15.com
Importance:NewsGovernance
Only in San Francisco: a picnic devoted to the potential dangers of AI
Armed with chips and cookies, people from AI startups, Big Tech, research nonprofits and activist groups met to brainstorm ways of preventing an AI-driven disaster. Source: marketplace.org
Importance:NewsExistential Risk
Anthropic's risk factors: humanity's end, a Pentagon feud and Dario Amodei's reputation
Beyond the standard boilerplate, Anthropic tells investors its own technology could pose "catastrophic or existential risks to humanity." Source: fortune.com
Importance:NewsExistential Risk
Anthropic's IPO filing exposes booming revenue and existential AI risks
CEO Dario Amodei reaches a major milestone as Anthropic prepares for a potentially landmark IPO. The filing highlights surging revenue from Claude alongside warnings about existential risks from AI. Source: indianexpress.com
Shared knowledge is the AI edge companies can hold onto
New research from Microsoft and Keystone, covering more than 200 enterprises, examines how shared organizational knowledge helps companies coordinate their AI agents. Source: microsoft.com
Importance:Opiniondata engineering AI
Beyond the AI copilot: five stages toward autonomous data engineering
In a piece for Snowflake, Carl Perry notes that AI tools already handle operational work such as generating code and debugging failures remarkably well. He outlines five stages on the path to autonomous data engineering. Source: kesq.com
Importance:Launchdeveloper tools
GitHub Copilot now uses AI to vet permission requests
GitHub has made Copilot assisted permissions generally available. AI now evaluates requests to run commands, access filesystem paths or open URLs. Source: visualstudiomagazine.com
Importance:Launchenterprise security AI
Veeam unveils cloud vault and copilot in backup and security updates
At the VeeamON 2024 user conference, Veeam highlighted secure cloud backups, a generative AI assistant and a new offering. Source: techtarget.com
Importance:Newsspreadsheet AI assistants
Claude vs Copilot vs ChatGPT in Excel: pricing from $0 to $125
Four AI assistants now live inside spreadsheets, and they don't all work the same way. The comparison covers Claude for Excel, Copilot in Excel, ChatGPT for Excel and Google Sheets. Source: tech-insider.org
Importance:Newsconsumer AI products
Copilot vanishes from Edge Sidebar for some users after Microsoft's push
A switch to a new Copilot experience is temporarily knocking out the browser's built-in AI tool for some users. Source: windowscentral.com
Importance:Launchconsumer finance AI
Copilot Money launches AI-powered Money Assistant
The award-winning personal finance app Copilot Money is rolling out Money Assistant, an AI financial agent built right into the app. Source: 9to5mac.com
Importance:Researchdeveloper tools
Choosing the best AI coding assistant: a 12-step, 90-minute pilot
A guide to picking an AI coding assistant with data, built around a 12-step Python pilot. It scores Claude Code, Codex, Copilot and Cursor on your own pull requests. Source: shattered.io
At Oracle AI World 2026, Oracle unveiled Oracle AI Media Models, a set of capabilities for video generation, image generation, and image editing. The models are initially available in preview to select customers on OCI. Source: blogs.oracle.com
Importance:Newsai_content_policies
Grok Spicy Mode: what it is and how to turn it on in Grok Imagine
Spicy mode is xAI's opt-in adult-content tier within Grok Imagine, its image and video generator. The guide explains how users can enable it, and the feature is a frequent search topic. Source: felloai.com
Google Cloud launches Gemini Robotics Embodied Reasoning 2 for enterprises
Google has made Gemini Robotics Embodied Reasoning 2 available on Google Cloud. The model brings advanced spatial and temporal reasoning plus physical AI capabilities to enterprise robotics use cases. Source: cloud.google.com
Robotics AI startup Physical Intelligence eyes $20 billion valuation
The startup is reportedly negotiating a funding round of at least $1 billion. Existing investors Avenir and Lux Capital are in talks to lead the deal. Source: qz.com
ABB Robotics brings industrial physical AI to fashion logistics
ABB Robotics has unveiled its first end-to-end, vision-based industrial-grade physical AI solution. It integrates the AI Robot Trainer into its Fashion Inductor system. Source: automate.org
Importance:NewsChina's embodied AI industry growth
China's booming embodied AI sector spawns new professions
New career paths are emerging across China's embodied AI industry, from training robotic arms to building related systems. The rapid growth of the sector is creating demand for previously nonexistent roles. Source: macaubusiness.com
Importance:LaunchRealbotix humanoid robots
Realbotix unveils Echo humanoid robots with on-device AI vision
Realbotix has introduced Echo, a new line of lifelike humanoid robots. They are designed for companionship, education and wellness applications and feature on-device AI vision. Source: thomasnet.com
LeCun: LLMs still struggle to reason and plan in the physical world
At the Evident AI Symposium 2026, AI pioneer Yann LeCun told Evident's Alexandra Mousavizadeh that large language models remain limited when it comes to reasoning and planning in the physical world. The appearance is tied to his AMI Labs venture. Source: youtube.com
Importance:ResearchAI in Scientific Publishing
Faking a scientific paper with AI: an experiment
The author generated two AI-written scientific papers and submitted them to a publisher's screening process. The experiment reveals how well, or poorly, such checks catch fabricated research. Source: spectrum.ieee.org
Importance:VideoAI in education
Hassabis: AI should push education beyond rote learning
Nobel laureate Demis Hassabis argues that AI tools are reshaping the 50-year-old rote-learning model of education. He suggests that memorization should take a back seat as AI changes how people learn. Source: youtube.com
Importance:Videoworld models
AI engineering event features OpenAI, Hugging Face, Andrew Ng and Yann LeCun
The event program includes an AI Engineering Skills Map and a fireside chat with Yann LeCun on world models. Speakers also come from Vocal Bridge and the NYC Tech Talent Pipeline, among others. Source: youtube.com
Importance:NewsAI Research Discoveries
The Download: Anthropic's IPO, smarter power grids and OpenAI's science wins
This edition of MIT Technology Review's newsletter covers Anthropic's IPO and smarter power grids. It also notes that OpenAI has announced three new scientific discoveries across different fields. Source: technologyreview.com
Importance:ResearchGenerative AI / Simulation
Genie 4 brings real-time interactive world simulation
Genie 4 is a new generation of world simulation that runs interactively in real time. It adds native audio, advanced physics and natural human motion, with steering powered by Gemini models. Source: deepmind.google
Importance:Researchcontinual learning
Giving LLMs a 'sleep phase' to keep what they learn
Researchers propose a sleep framework for continual learning, adding a dedicated sleep phase that lets large language models absorb new facts over time. The approach also aims to strengthen reasoning while limiting the loss of previously learned knowledge. Source: research.google
Importance:Videophysical AI
Trossen tackles physical AI's data bottleneck as Nvidia's Jim Fan weighs in on robotics
The coverage looks at how Trossen is addressing the shortage of training data for physical AI. It also points to a Sequoia Capital talk, 'Robotics' End Game', featuring Nvidia's Jim Fan. Source: youtube.com
Nevis secures $70M Series B to bring AI to wealth managers
Nevis has closed a $70 million Series B round led by EQT Ventures. The funding will help it scale its AI platform for wealth management firms. Source: fintech.global
Importance:Newscloud computing
General Compute lands $100M Series A as neocloud doubts grow
General Compute has raised a $100 million Series A, pushing back on the gloomy narrative around neocloud providers. The round comes as CoreWeave, a publicly traded company that rents out computing power for AI, sees its shares sink to a 12-month low, while Elon Musk touts a $40 figure of his own. Source: techcrunch.com
Importance:NewsAI security
Infisical raises $40M Series B at $600M valuation for AI agent security
San Francisco cybersecurity infrastructure company Infisical has secured $40 million in Series B funding at a $600 million valuation. The money will go toward expanding its security platform for AI agents. Source: citybiz.co
Importance:Newsbrain-computer interfaces
China's NeuroXess raises RMB 700M Series B for brain-computer interfaces
Chinese brain-computer interface startup NeuroXess has raised RMB 700 million in Series B funding. The round was co-led by SDIC Juli, Shenzhen Capital Group and Qinzhi. Source: technode.com
How AI is speeding up discovery for millions affected by dementia
Around 57 million people worldwide live with dementia today. For the researchers trying to help them, the main obstacle is not a lack of effort but the sheer scale of the work involved. Source: blogs.nvidia.com
Importance:NewsAI chip financing
Nvidia-backed Zankore syndicates $3.1 billion GPU loan to the market
Zankore, an Indonesian AI infrastructure platform backed by Nvidia, is syndicating a $3.1 billion loan to the wider lending market. Source: bloomberg.com
Importance:Newscloud AI chips
Oracle widens Nvidia chip supply deal, adds Google and Cerebras options
Oracle said on Tuesday it is expanding its cloud AI chip agreements with Nvidia. At the same time, it is diversifying by adding offerings from Nvidia rivals such as Alphabet's Google and Cerebras. Source: reuters.com
Importance:Newscloud AI chips
Oracle cuts Nvidia reliance, adding AI chips from Google, Cerebras and SambaNova
Oracle is bringing AI chips from Google, Cerebras and SambaNova to its cloud. The company is diversifying beyond Nvidia. Source: finance.yahoo.com
Importance:NewsAI chip supply chain
OpenAI, long an Nvidia customer, set to buy Google's AI chips
OpenAI plans to purchase AI chips from Google, according to a person familiar with the matter. The move is a boost for Google as a rising rival to Nvidia, one of OpenAI's backers. Source: theinformation.com
Importance:LaunchAI Models
OpenAI adds affordable mid-tier GPT-6.1 Terra to its lineup
OpenAI has expanded its GPT-6.1 family with a mid-range model that delivers solid performance at a lower price. The company's general-purpose models now cover four tiers. Source: theregister.com