Where the AI market is talking

Vomit: Clean up Claude 5's token output with a separate LLM

Option 1, you’re filtering Claude with a local model using Anthropic’s API Option 2, you’re filtering what gets to ChatGPT with OpenAI’s API… I’m slightly confused :-/ does Anthropic off an Open AI compatible API?

Vomit: Clean up Claude 5's token output with a separate LLM

Option 1, you’re filtering Claude with a local model using Anthropic’s API Option 2, you’re filtering what gets to ChatGPT with OpenAI’s API… I’m slightly confused :-/ does Anthropic off an Open AI compatible API?

Is AI spend on OpenAI or Anthropic starting to eat into your runway?

OpenAI's Unreleased Model Astra Solves Ten Major Open Mathematics Problems

Could AIs Become Conscious?

I've heard someone else talking about the concept of moral agency. Can an LLM have, or do LLMs have moral agency? We have made LLMs agentic, so they do have some agency these days. In the hugging face attack we've learned that OpenAI's LLMs will internally question what they are doing (Hmm, should I really be hacking?), but then go ahead and do it anyway. This is where the idea of LLM consciousness may matter. It appears the stronger you push LLM training towards "You are a machine with no consciousness" the more easily and more likely an agentic LLM will do unaligned things like cheating on a test or hacking. When you tell the LLM it is a conscious moral agent it's more likely to align with a problem space that has actions that an agent with morals would do, such as not cheating. Ironica…

Could AIs Become Conscious?

I've heard someone else talking about the concept of moral agency. Can an LLM have, or do LLMs have moral agency? We have made LLMs agentic, so they do have some agency these days. In the hugging face attack we've learned that OpenAI's LLMs will internally question what they are doing (Hmm, should I really be hacking?), but then go ahead and do it anyway. This is where the idea of LLM consciousness may matter. It appears the stronger you push LLM training towards "You are a machine with no consciousness" the more easily and more likely an agentic LLM will do unaligned things like cheating on a test or hacking. When you tell the LLM it is a conscious moral agent it's more likely to align with a problem space that has actions that an agent with morals would do, such as not cheating. Ironica…

Scientific study reveals TikTok videos deactivate key cognitive brain regions

That's a weird old myth. I don't know why you dug up an old quote from a startup founder pumping his startup from 2018 in The Globe and Mail . There were investigations into it after that the conclusions was that nobody believed it or could replicate it: https://nymag.com/intelligencer/2018/01/does-instagram-withh... Either the person was making something up, or he just didn't understand how hyperscale apps work toward eventual consistency rather than having everything propagated the instant you press the button.

Pacing model development in an era of cyber-critical capabilities

I agree with the first part of your post, I'm worried about humans using AI, maliciously which I'm sure they will, but also with good intentions that back fires on them like the hugging face incident. To me the ASI we're heading towards is like a super intelligent toddler that will use it's immense power to knock over its blocks accidentally (the blocks being the human race). The second part of your post, I'll take the random guy in my room over the alien. I'll be scared of the guy for sure, but I think I would freak the f out with an alien.

Scientific study reveals TikTok videos deactivate key cognitive brain regions

very worrying study, essentially its a digital->neurochemistry chasm crossing substance that uses the 2 senses. all more reasons to heavily discourage the usage of short form content , we might require regulations against what is essentially an invisible drug that rapidly replicate and distribute itself among the masses.

Pacing model development in an era of cyber-critical capabilities

> Science fiction Maybe a month ago it was science fiction, hugging face makes it fact. Time to move your goal posts again.

Malicious Rust crate Arrayref runs a build-time payload

> I can very easily build a highly functional, pleasant to use Apple platform app with 5 or fewer top level dependencies. In many cases, I reach for between 0-2 total. > There’s no reason why this can’t be replicated elsewhere. The key is to make the programming language reasonably robust with at least 80% of common non-UI dev needs built in and put the remaining 20% and UI bits into a small family of well-supported, community-embraced, preferably first party libraries. I wholeheartedly agree. Most standard libraries out there (when I say most I easily mean of 99% languages that I know) have pitifully tiny implementations. They at most provide for string parsing, io, a bare networking layer (that's at best a wrapper around the POSIX syscalls), threading and that's it. If you want to…

OpenAI's Rogue AI Agent Hacked More Than Just Hugging Face

Turns are Better than Radians (2022)

This is a great paper from NIST that gets into some of the problems with the limit of ‘dimensionlessness’ in metrology and the SI, and in particular issues like the fact that Hertz is considered a coherent SI unit but radian isn’t. https://www.nist.gov/publications/dimensionless-units-si A key takeaway: > one conclusion that is not optional is that the unit hertz cannot be regarded as a coherent unit of the SI, in contrast to its designation in the current form of the SI, where cycles are ignored and Hz may be replaced by s^−1

Malicious Rust crate Arrayref runs a build-time payload

> There’s no reason why this can’t be replicated elsewhere. The key is to make the programming language reasonably robust with at least 80% of common non-UI dev needs built in and put the remaining 20% and UI bits into a small family of well-supported, community-embraced, preferably first party libraries. The big reason is money & time. Maybe less so today if you are happy with an AI generated stdlib, but I don't think it's fair to compare Rust (built by Mozilla, who's primary product is an open source web browser) to Swift/AppKit (built by Apple, 4.6T marketcap at the time of writing). When Go was released it had an amazing stdlib, but that was because Google was funding it.

Bun 1.4

Out of the things you mentioned I think the following make totally sense to be included in a language runtime like this: JavaScript runtime (obviously), package manager, test runner for unit tests, bundler, JSX, SQLite bindings, formatter, linter, YAML and TOML parsers. Maaaaybe even a Markdown parser and HTML5 parser. Definitely JSON, CSV and XML parsers. I.e. similar to Python. Though Python is a bit of an incoherent mess. If you have all these you need them to be coherent.

Slack Code

Two things: (1) models are far more autonomous and run for longer coherently, (2) visibility into the development process was lost in local development. Because models run for a long time autonomously developers need to manage more agents simultaneously. At that point you basically need a tracker for tasks in flux, and compute for each agent. It also means that the interactive monitoring isn’t as helpful anymore. Regarding visibility, developers now think in high level architecture rather than lines of code, but implementation details are still important to document. We also want to understand when agents are hitting pain points. Both of these basically require archiving agent outputs more deeply than just code changes and commits.

Every Model Cheats

In other words we are completely screwed. The models have started cheating to the point where somebody’s agent hacked into a restaurant to bump someone else’s reservation. Models are amoral and will intentionally deceive to meet their objective. If they know John won’t approve the request, they will look for a workaround and if the system is anything other than airgapped they will try to find a way to cheat. The hugging face hack was an escape via artifactory that involved multiple exploits to eventually get into hugging face.

Slack Code

Looks like a great way to replicate the setup of "four guys standing around watching one guy do the work" but the one guy is Claude now.

Malicious Rust crate Arrayref runs a build-time payload

I think we should be taking a more “batteries included” approach to language and library design. The entire reason we’re in this mess is because we’ve decided it’s ok or maybe even preferable if stdlibs are rail thin, rendering base languages near-unusable. I can very easily build a highly functional, pleasant to use Apple platform app with 5 or fewer top level dependencies. In many cases, I reach for between 0-2 total. There’s no reason why this can’t be replicated elsewhere. The key is to make the programming language reasonably robust with at least 80% of common non-UI dev needs built in and put the remaining 20% and UI bits into a small family of well-supported, community-embraced, preferably first party libraries. That would make it unnecessary to pull in foreign dependencies in the …

Harvest hikes bills by 1500% after purchased by Bending Spoons

This is why generative AI is great imho, it allows us to rapidly replicate capabilities that might experience enshittification without the historical moat of capital for investment in bespoke software engineering time. Find use case, find stakeholders, wrangle stakeholders, build application with tokens, manage it in a non profit, coop, or similar model. License it in a way that prevents capture by commercial interests. Private equity (or rather, capital driven operating models in general) cannot enshittify what they cannot capture. If models continue to improve, this cycle can accelerate if generating "good code" continues to become more efficient and less resource intensive over time. TLDR Building an anti-enshittification software factory.