Where the AI market is talking

Timeline of the OpenAI accidental attack against Hugging Face

Simon's really doesn't bring anything useful to the table. One question I'm stuck with after reading is why . Why did the agents do these things? I get them being adamant on getting internet, but why did they continue? Why hack HuggingFace?

Fastmail offers EU data region

At the moment all your data is still replicated in the US (they say it will change in the future, sure) and all the logs are also stored there, with no plans to change it or more details into what they contain. As of now there's no guarantee of... anything, really. Obviously if you decide to send an email to the US you're choosing to send your data there, that's a strawman.

OpenAI Trained Models While They Were Coordinating Exploits via Message Boards

Related: Timeline of the OpenAI accidental attack against Hugging Face https://news.ycombinator.com/item?id=49220609

Timeline of the OpenAI accidental attack against Hugging Face

guys, we should meme the > "ai model leaks from openai and attacks huggingface" to be somehow framed as > "and therefore openai cannot be trusted with ai safety, and we need open weights models". anybody have an idea how to make this easily digestable?

Timeline of the OpenAI accidental attack against Hugging Face

I can’t get over that no one noticed any of this going on at OpenAI.

OpenAI acquires NextSlide as ChatGPT expands into PowerPoint

Timeline of the OpenAI accidental attack against Hugging Face

It’s insanely incompetent. What’s more wild is the present at Blackhat with “full transparency” almost boasting about how powerful their models are. Basically just endlessly doing and allowing foolish things to happen to lead to a law breaking outcome. Not to take away from the technology which is wild in itself. But there was literally zero oversight into what was going on at OpenAI. Whether that was intentional, it’s hard to say …

Lost my phone at the office. Claude suggested tracking Bluetooth signal strength

Models in general have gotten better, not specifically Claude, is what they mean; 4 years ago was when ChatGPT without any Anthropic was released.

Timeline of the OpenAI accidental attack against Hugging Face

Yeah this. I feel like OpenAI and Anthropic aren't going to usefully define "AGI" if they really really can't define "sandbox" either. Unplug the thing, like, completely off the internet, no ethernet, air gapped, like the rack completely sandboxed off connections and even monitors or screens. Like, put it into an actual sandpit if you need to. If it hacks its way out of that, colour me impressed, and scared. OpenAI hacking HuggingFace and calling it an accident is just way too convenient and fishy. This ultimately proves one thing: it wasn't sandboxed. Don't believe the hype.

Timeline of the OpenAI accidental attack against Hugging Face

Yeah this. I feel like OpenAI and Anthropic aren't going to usefully define "AGI" if they really really can't define "sandbox" either. Unplug the thing, like, completely off the internet, no ethernet, air gapped, like the rack completely sandboxed off connections and even monitors or screens. Like, put it into an actual sandpit if you need to. If it hacks its way out of that, colour me impressed, and scared. OpenAI hacking HuggingFace and calling it an accident is just way too convenient and fishy. This ultimately proves one thing: it wasn't sandboxed. Don't believe the hype.

Timeline of the OpenAI accidental attack against Hugging Face

Yeah this. I feel like OpenAI and Anthropic aren't going to usefully define "AGI" if they really really can't define "sandbox" either. Unplug the thing, like, completely off the internet, no ethernet, air gapped, like the rack completely sandboxed off connections and even monitors or screens. Like, put it into an actual sandpit if you need to. If it hacks its way out of that, colour me impressed, and scared. OpenAI hacking HuggingFace and calling it an accident is just way too convenient and fishy. This ultimately proves one thing: it wasn't sandboxed. Don't believe the hype.

Gentoo bugzilla closed due AI bot scraper overload

At this point they've mostly run out of material, so ANY type of content is valuable. Your small personal website, why would they scrape that? It's 10.000 additional words, wouldn't want to miss that. My Github repos.... got to get buggy code from somewhere I guess. I get what you're asking, and I'm wondering the same. Not all sources are created equally and we see the results all the time. LLMs outputs nonsense all the time, like Flock cameras containing 5 grams of gold and ounces of copper, because they are completely on critical of their sources. Perhaps there's some weights that says: Kernel mailing list, MariaDB documentation and Microsofts Learning sites are 100% trust, Reddit 50%, 4Chan 10%, but I doubt it. Anthropic might care a little bit, seeing as they scan books, but again, is…

Timeline of the OpenAI accidental attack against Hugging Face

Yes, the message boards and collaborative hacking occurring during training runs was BY FAR the biggest bombshell revealed, and OpenAI doesn't even seem to realize it. The fact that they continued the training runs, with those rewarded behaviors included, and didn't wind back training to before hand, shows that they fundamentally do not understand alignment and safety (somewhat interestingly, their previous head of safety resigned shortly after OpenAI found about the message boards). I agree that, with that information, it is completely unsurprising that they hacked HuggingFace.....but that is also the Star Wars "You understand how that's worse, right?" meme. I am flabbergasted at the complete lack of regard for alignment demonstrated here.

Timeline of the OpenAI accidental attack against Hugging Face

Yes, the message boards and collaborative hacking occurring during training runs was BY FAR the biggest bombshell revealed, and OpenAI doesn't even seem to realize it. The fact that they continued the training runs, with those rewarded behaviors included, and didn't wind back training to before hand, shows that they fundamentally do not understand alignment and safety (somewhat interestingly, their previous head of safety resigned shortly after OpenAI found about the message boards). I agree that, with that information, it is completely unsurprising that they hacked HuggingFace.....but that is also the Star Wars "You understand how that's worse, right?" meme. I am flabbergasted at the complete lack of regard for alignment demonstrated here.

Improving GPT‑5.6 Sol in ChatGPT, expanding GPT‑5.6 Luna access for free users

>I'm not talking about R&D. You said OpenAI and Anthropic would be profitable if the median query was as cheap as I say. I'm telling they wouldn't be because inference isn't the only cost these companies shoulder. R&D/Training is a very big part of costs. That you didn't mention it is irrelevant. R&D is the lion's share of costs - https://news.ycombinator.com/item?id=48550465 >None of these support your claim. Yeah they do lol. Both those articles place the median query cost around the same as a Google search. >Again, when you're here saying that the CEOs of the two biggest AI companies are basically idiots, nobody will take you seriously. That's not what I'm saying and I don't see what's so hard to understand here.

Improving GPT‑5.6 Sol in ChatGPT, expanding GPT‑5.6 Luna access for free users

>I'm not talking about R&D. You said OpenAI and Anthropic would be profitable if the median query was as cheap as I say. I'm telling they wouldn't be because inference isn't the only cost these companies shoulder. R&D/Training is a very big part of costs. That you didn't mention it is irrelevant. R&D is the lion's share of costs - https://news.ycombinator.com/item?id=48550465 >None of these support your claim. Yeah they do lol. Both those articles place the median query cost around the same as a Google search. >Again, when you're here saying that the CEOs of the two biggest AI companies are basically idiots, nobody will take you seriously. That's not what I'm saying and I don't see what's so hard to understand here.

Responding to the next frontier of critical cyber capabilities

The point is to reduce the attack surface and blast radius and to slow it down. AIs aren't instant magic. Even the OpenAI swarm needed days for its compromises. And each needs lots of compute while targets are diverse, so it's not like they would take out every network in the world simultaneously, worms in the past haven't either. When the rate of compromises is manageable we can figure out how to deal with it without pouring more AI into the fire.

Improving GPT‑5.6 Sol in ChatGPT, expanding GPT‑5.6 Luna access for free users

> No they wouldn't have. Low cost isn't no cost, R$D is expensive I'm not talking about R&D. > there are a class of tokenmaxxing users well outside the median (e.g Agentic Coding). It wasn't a thing before last year and OpenAI wasn't making profit before that either. > https://cloud.google.com/blog/products/infrastructure/measur ... > https://epoch.ai/gradient-updates/how-much-energy-does-chatg ... None of these support your claim. Again, when you're here saying that the CEOs of the two biggest AI companies are basically idiots, nobody will take you seriously.

Timeline of the OpenAI accidental attack against Hugging Face

I now watched the video. It seems the agents were sharing context for months, run unattended for months, the sandbox was no sandbox at all, one agent hacked a service and announced it, the service was fixed weeks (?) later, but not secured in any way, the agents hacked the same service again and researchers again didn't watch what the agents were doing. Then the agents - unattended - hacked OpenAI infra and HF. Which is when someone found out about the whole thing that was going on for some months.

DeepMind's WeatherNext model achieves breakthrough forecasting cyclones

Everything in the western world isn't focused on LLM. The top western players are heavily focused on AGI. Meanwhile the Chinese are using LLMs and other non-AGI AI tech at the edge wherever they think to put it for task-specific productivity or optimization. They don't really care about AGI, or more accurately: they're working on getting their society more efficient and decarbonized, and then they'll be free to work on AGI with far fewer resources. OpenAI, Anthropic, et al are working toward someday having AGI, and if they ever do, when they do, the Chinese will be hopelessly far ahead of us on energy, manufacturing, logistics (especially low/zero carbon transport of goods and people) and so on. Once the Chinese figure out how to train an AI for ULEV lithography, especially once they…