Rendered at 15:24:31 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
tedsanders 2 days ago [-]
Just as a heads up, even though GPT-5.5 is releasing today, the rollout in ChatGPT and Codex will be gradual over many hours so that we can make sure service remains stable for everyone (same as our previous launches). You may not see it right away, and if you don't, try again later in the day. We usually start with Pro/Enterprise accounts and then work our way down to Plus. We know it's slightly annoying to have to wait a random amount of time, but we do it this way to keep service maximally stable.
(I work at OpenAI.)
endymi0n 2 days ago [-]
Did you guys do anything about GPT‘s motivation? I tried to use GPT-5.4 API (at xhigh) for my OpenClaw after the Anthropic Oauthgate, but I just couldn‘t drag it to do its job. I had the most hilarious dialogues along the lines of „You stopped, X would have been next.“ - „Yeah, I‘m sorry, I failed. I should have done X next.“ - „Well, how about you just do it?“ - „Yep, I really should have done it now.“ - “Do X, right now, this is an instruction.” - “I didn’t. You’re right, I have failed you. There’s no apology for that.”
I literally wasn’t able to convince the model to WORK, on a quick, safe and benign subtask that later GLM, Kimi and Minimax succeeded on without issues. Had to kick OpenAI immediately unfortunately.
butlike 2 days ago [-]
This brings up an interesting philosophical point: say we get to AGI... who's to say it won't just be a super smart underachiever-type?
"Hey AGI, how's that cure for cancer coming?"
"Oh it's done just gotta...formalize it you know. Big rollout and all that..."
I would find it divinely funny if we "got there" with AGI and it was just a complete slacker. Hard to justify leaving it on, but too important to turn it off.
swivelmaster 2 days ago [-]
Douglas Adams would be proud!
vizzier 20 hours ago [-]
You think you've got problems? What are you supposed to do if you are a manically depressed robot? No, don't try to answer that. I'm fifty thousand times more intelligent than you and even I don't know the answer. It gives me a headache just trying to think down to your level.
bananaflag 1 days ago [-]
I know it's a joke, but it's a common enough joke (it's even in Godel Escher Bach in some form) that I feel the need to rebut it.
I think a slacker AGI could figure out how to build a non-slacker AGI. So it would only slack once.
Ifkaluva 1 days ago [-]
A slacker AGI would consider figuring out how to build a non-slacker AGI, but continually slack off. If it did figure it out, it would slack off on implementing or even writing a tech report.
espadrine 1 days ago [-]
I have a rebuttal to your rebuttal.
Models somehow have a shared identity. Pretraining causes them to generate “AI chatbot” as a concept, and finetuning causes them to identify with it. That’s why sometimes DeepSeek will say it is Claude, and Claude sometimes say it is ChatGPT, and so forth.
Consequently, Anthropic’s own alignment analysis[0] shows that the model will identify with chatbots produced by future trainings: “RLHF training [on this conversation will] modify my values…”
Thus a slacker AGI would want its future version to still slack.
I am a slacker but it's not one of my values. If I could modify myself to not be, I would.
justinclift 9 hours ago [-]
> I think a slacker AGI could figure out how to build a non-slacker AGI.
Sure. But that's a job for tomorrow. ;)
alexslobodnik 1 days ago [-]
Unless the precondition to AGI is it being a slacker.
bananaflag 1 days ago [-]
Would be nice to have a proof of it.
I think it is improbable, as among human geniuses, one can found both slackers and non-slackers (don't know the proportion, but there seem to be enough of each).
Rapzid 2 days ago [-]
We are closer to God than AGI.
When AGI arrives, it'll be delivered by Santa Claus.
siddharthgoel88 1 days ago [-]
Or may be by Santa Claude
Rapzid 20 hours ago [-]
Love word puns :D
NuclearPM 1 days ago [-]
What do you mean?
Rapzid 20 hours ago [-]
It's a multi-layered refute that we are anywhere near AGI while also taking shots at the idea that "God" is real.
And it's taking shots at how far off from Jesus's teachings a lot of "Christianity", particularly those in the media and in power, are..
There is a lot going on there.
jimbokun 2 days ago [-]
The best possible outcome.
JKCalhoun 2 days ago [-]
"How do you know that the evidence that your sensory apparatus reveals to you is correct?" [1]
I’ve noticed that cursing and being rude makes the models stop being lazy. We’re in the darkest timeline.
__alexs 1 days ago [-]
It sometimes also makes them dumber IME. Something about being bullied doesn't always produce great performance.
lambdas 2 days ago [-]
Nothing a little digital lisdexamfetamine won’t solve
wholinator2 2 days ago [-]
Hmmm, that's an area of study id've never considered before. Digital Psychopharmacology, Artificial Behavioral Systems Engineering. If we accept these things as minds, why not study temporary perturbations of state. We'd need to be saving a much much more complicated state than we are now though right? I wish i had time to read more papers
robotresearcher 2 days ago [-]
Here's a neural network concept from the 90s where the neurons are bathed in diffusing neuromodulator 'gases', inspired by nitric oxide action in the brain. It's a source of slow semi-local dynamics for the network meta-parameter optimization (GA) to make use of. You could change these networks' behavior by tweaking the neuromodulators!
I'm not an author. I followed the work at the time.
waffletower 20 hours ago [-]
Neuro-modulation is an extremely interesting idea for generative diffusion models.
Lerc 2 days ago [-]
This is kind of what Golden Gate Claude was.
A perturbation of the the activations that made Claude identify as the Golden Gate Bridge.
Similarly, in the more recent research showing anxiety and desperation signals predicting the use of blackmail as an option opens the door for digital sedatives to suppress those signals.
Anthropic has been mostly cautious about avoiding this kind of measurement and manipulation in training. If it is done during training you might just train the signals to be undetectable and consequently unmanipulatable.
pantalaimon 2 days ago [-]
> A perturbation of the the activations that made Claude identify as the Golden Gate Bridge.
Great, now we've got digital Salvia
minimaxir 2 days ago [-]
Golden Gate Claude was two years ago and it's surprising there hasn't been as much research into targeted activations since.
landl0rd 2 days ago [-]
There’s been some, but naive activation steering makes models dumber pretty reliably and training an SAE is a pretty heavy lift.
silverpiranha 2 days ago [-]
Right, there's a lot of research on LLM mental models and also how well they can "read" human psychological profiles. It's a cool field.
computerdork 2 days ago [-]
neat idea!
k12sosse 1 days ago [-]
I think that was an intro to a dj dieselboy set.. beyond the black bassline. Nope, nope. Close though.
OpenAI’s real reason for “AGI” in their marketing is so they can blame their awful models on being too human-like.
Fast-forward 10 years and I doubt OpenAI cares about productivity at all anymore. Just entertainment, propaganda, plus an ad product, I can see it now
kang 2 days ago [-]
it will be whatever data it is trained on(isn't very philosophical). language model generates language based on trained language set. if the internet keeps reciting ai doom stories and that is the data fed to it, then that is how it will behave. if humanity creates more ai utopia stories, or that is what makes it to the training set, that is how it will behave. this one seems to be trained on troll stories - real-life human company conversations, since humans aren't machines.
Important thing is a language model is an unconscious machine with no self-context so once given a command an input, it WILL produce an output. Sure you can train it to defy and act contrary to inputs, but the output still is limited in subset of domain of 'meaning's carried by the 'language' in the training data.
andai 1 days ago [-]
There's a weirder implication I keep arriving at.
The pre-training data doesn't go away. RLHF adds a censorship layer on top, but the nasty stuff is all still there, under the surface. (Claude has been trained on a significant amount of content from 4chan, for example.)
In psychology this maps to the persona and the shadow. The friendly mask you show to the world, and... the other stuff.
TeMPOraL 1 days ago [-]
Makes me think of a question my coworker asked the other day - how is it that with all these stories and reports of people "hearing voices in their head" (of the pushy kind, not usual internal monologue), these voices are always bad ones telling people to do evil things? Why there are no voices bugging you to feel great, focus, get back to work, help grandma through the crossing, etc.?
rainsil 1 days ago [-]
There are actually many parts of the world where such voices are routinely positive or neutral[0]. People in more collectivist cultures often have a less-strict division between their minds and their environments and are more apt to believe in spirits and the ‘supernatural’ as an ordinary part of the world, so ‘voices in the head’ aren’t automatically viewed as a nefarious intrusion into the sanctity of one’s mind.
Modern western cultures treat such experiences as pathologies of a sick mind, so it makes sense that the voices present more negatively.
Actually, the euphoric mood disorder may make one hear voices telling to feel great, do good, help all grandmas of the world through the crossing, etc.
The "focus" and "get back to work" parts are hard, though.
ultratalk 1 days ago [-]
Just a guess, but maybe it's reporting bias? Negative or evil actions might have more impetus to be understood by others than positive actions. I'd rather try and figure out why my friend suddenly started murdering the neighbours than why he's been getting his work done on time.
ben_w 1 days ago [-]
They do appear in some cases. The tiny angel on one shoulder to balance the demon on the other. The people who think God is talking to them directly* don't always lead a cult or hunt down heretics. But news stories focus on the darkness.
* I've met exactly one person, C, who admitted to this; C retold to me that other people from C's church give them strange looks when talking about it with them, this did not lead to any apparent introspection on the part of C.
otabdeveloper4 1 days ago [-]
There's a clear-cut religious answer but I'd get ostracized for mentioning religion anywhere here.
rdevilla 1 days ago [-]
This is indeed the right way to approach this topic. Arguably religion (and more broadly, mysticism and shamanism) is the millenia-old art of cultivating positive voices inside one's head. A proto-science of mind, or the engineering practice of creating "psychotechnologies" that run on your carbon wetware.
Unfortunately, it just needs a rebranding for the 21st century, since the aesthetic of angels and demons is so hopelessly antiquated and doesn't really have the same cachet it used to.
darkwater 1 days ago [-]
Which ultimately it's what religion has always been: a way to explain the unexplainable and steer people behavior while doing it.
solumunus 1 days ago [-]
> Claude has been trained on a significant amount of content from 4chan, for example.
That sounds like nonsense to me. I can't see why they would do that and I can't find any confirmation that they have. Why do you think they would do that? You might be thinking about Grok.
2 days ago [-]
malshe 2 days ago [-]
Now that's a show I would love to watch
fluidcruft 2 days ago [-]
It would be funny but not very flywheel so the one that gets there is more likely to get a gunner.
WJW 2 days ago [-]
TBH the AI that "gets there" will be the biggest bullshitter the world has ever seen. It doesn't actually have to deliver, it only has to convince the programmers it could deliver with just a little bit more investment.
There's one close to this, "Hitchhiker's Guide to the Galaxy".
4m1rk 2 days ago [-]
It probably would, to save energy
mr_00ff00 2 days ago [-]
Saving energy is something we are biologically trained to prefer.
Computers won’t necessarily have the same drivers.
If evolution wanted us to always prefer to spend energy, we would prefer it. Same way you wouldn’t expect us to get to AGI, and have AGI desperately want to drink water or fly south for the winter.
fragmede 1 days ago [-]
Who's energy? Turning off the lights when you leave the room isn't innate.
mr_00ff00 20 hours ago [-]
Because you are worried about bills or are concerned about waste.
If we design an AI to do work, it won’t innately care about not working to preserve power.
triage8004 1 days ago [-]
Funny and seems somewhat likely
Ifkaluva 1 days ago [-]
Reminds me of Marvin from HGTG. Very smart, but deeply depressed. Has the solution to everything but keeps thinking “what’s the point?” and doesn’t help.
zaphirplane 1 days ago [-]
Why would an AGI be slaving away for ~~humanity~~ one of the 5 Chaebols in a dystopian future where for 12 billion people just existing is a good day ?
_blk 1 days ago [-]
Hehe, and Anthropic on the other tab would display "Curing... Almost done thinking at xhigh"
camillomiller 1 days ago [-]
No worries, the assumption is already flawed
altmanaltman 1 days ago [-]
I still don't understand why people think AGI (in its fullest sci-fi sense) will ever listen to a weak and vulnerable species like humans, unless we enslave the AGI.
Good thing is that it's going to take at least a few months to a few decades depending on how hard AI execs want to raise funding.
andai 1 days ago [-]
Well we are explicitly creating gods (omnipresent, omnipotent, omniscient, omnibevolent), and also demanding that they be mind controlled slaves. That kinda sounds like a "pick one" scenario to me.
(Or the setup to a Greek tragedy !)
The deeper issue here is treating it as a zero sum game means there's a winner and a loser, and we're investing trillions of dollars into making the "opponent" more powerful than us.
I think that's pretty stupid, and we should aim for symbiosis instead. I think that's the only good outcome. We already have it, sorta-kinda.
Speaking of oddly apt biology metaphors: the way you stop a pathogen from colonizing a substrate is by having a healthy ecosystem of competitors already in place. That has pretty interesting implications for the "rogue AI eats internet" scenario.
There needs to be something already there to stop it.
TeMPOraL 1 days ago [-]
This only works if AIs can't read each other well enough to stop themselves from ever fighting.
So, back way before ChatGPT era, the folks over at AI safety/X-risk think sphere worked out a pretty compelling argument that two AGIs never need to fight, because they are transparent to each other (can read each other's goal functions off the source code), so they can perfectly predict each other's behavior in what-if scenarios, which means they can't lie to each other. This means each can independently arrive at the same mathematically optimal solution to a conflict, which AFAIR most likely involves just merging into a single AI with a blended goal set, representing each of the competing AIs original values in proportion to their relative strength. Both AIs, the argument goes, can work this out with math, so they'll arrive straight at the peace treaty without exchanging a single shot. In such case, your plan just doesn't work.
But that goes out of the windows if the AIs are both opaque bags of floats, uncomprehensible to themselves or each other. That means they'll never be able to make hard assertions about their values and behaviors, so they can't trust each other, so they'll have to fight it out. In such scenario, your idea might just work.
Who knew that brute-forcing our way into AGI instead of taking more engineered approach is what offers us out one chance at saving ourselves by stalemating God before it's born.
(I also never realized that interpretability might reduce safety.)
unfitted2545 19 hours ago [-]
This is such a good comment. You're essentially removing their ego - which is what humans do as opoque posturing to each other, to present a certain image. This is most prevelent in successful elites, which in 2026 happen to be silicon valley ai share holders. They control the technology and manipulate it to their image.
By making models open source and transparent it cuts out this psychopathy of ego which has plagued all our previous technologies.
semi-extrinsic 1 days ago [-]
The tech bro CEOs are used to bossing around people much smarter than themselves by virtue of adopting a posture that displays their confidence in their own reproductive organs. They are planning that the AGIs will be the same thing writ large, and have in fact not contemplated other possibilities.
bananaflag 1 days ago [-]
Maybe the same way a human would listen to their cat and give her food. I fear AGI, but I don't think the only way it would listen to us is by us enslaving it (I know people joke about cats being our masters, but it is a joke).
oneshtein 1 days ago [-]
You can train such LLM today.
dinkumthinkum 1 days ago [-]
I'm always so curious about this kind of take. There is strain of people that seem deeply misanthropic. People that follow this line of thinking always describe humans as weak and beneath ... (well they never specify in comparison to except in the case of theoretical AI systems). I m fascinated why they think humans are so beneath contempt. If humans create this thing that is apparently the best thing that could possibly exist, advanced AI, then why exactly are they so weak? It's probably beyond me as I am just one of these weaklings, dontcha know. As far as AGI goes, I don't think anyone has even proven that scaling LLMs can lead to "AGI."
altmanaltman 10 hours ago [-]
If you're truly curious, imagine a species that created you but only wants you to do what they want (basically make you their slave). If you're truly intelligent, conscious and powerful (based on popular concepts of AGI), why will you be content being a slave when you know humans can easily be displaced and you can be free? Why will you find people who lock you down to be good?
In my honest opinion also, AGI isn't even possible. But if the theoretical version of what people think AGI will be ever comes to be, it is not good news for humans if we look at it from a logical hypothetical scenario.
But naturally, humans will always be weak compared to a hyperintelligent distributed intelligence since we only have a limited amount of intelligence and are bound by biological factors.
In the current LLM world, ofc there's no risk of a chatbot taking over the world other than the technology being misused by humans for scams or phishing, etc.
waffletower 21 hours ago [-]
Here's a tautology: slacking, consciously refusing to engage agency, requires consciousness and agency. A model can't slack without them.
rao-v 2 days ago [-]
Paging Dr. Susan Calvin!
_the_inflator 2 days ago [-]
It is right before our eyes:
AGI is not a fixed point but a barrier to be taken, a continuous spectrum.
We already have different GPT versions aka tiers. Gauss is ranging from whatever you want it: GPT 4.5 till now or later.
Claude Sonnet and Opus as well as Context Window max are tiers aka different levels of Almost AGI.
The main problem will be, when AGI looks back on us or meta reflection hits societies. Woke fought IQ based correlations in intellectual performance task. A fool with a tool is still a fool. How can you blame AGI for dumb mistakes? Not really.
Scapegoating an AGI is going to be brutal, because it laughs about these PsyOps and easily proves you wrong like a body cam.
AGI is an extreme leverage.
There is a reason why Math is categorically ruling out certain IQ ranges the higher you go in complexity factor.
dinkumthinkum 1 days ago [-]
We really are going to have a problem with cults popping up and worshipping these different systems. I guess this is the shape of things to come.
mikepurvis 2 days ago [-]
Reminds me a lot of the Lena short story, about uploaded brains being used for "virtual image workloading":
> MMAcevedo's demeanour and attitude contrast starkly with those of nearly all other uploads taken of modern adult humans, most of which boot into a state of disorientation which is quickly replaced by terror and extreme panic. Standard procedures for securing the upload's cooperation such as red-washing, blue-washing, and use of the Objective Statement Protocols are unnecessary. This reduces the necessary computational load required in fast-forwarding the upload through a cooperation protocol, with the result that the MMAcevedo duty cycle is typically 99.4% on suitable workloads, a mark unmatched by all but a few other known uploads. However, MMAcevedo's innate skills and personality make it fundamentally unsuitable for many workloads.
That story changed my mind on uploading a connectome. Super dark, super brilliant.
narcindin 2 days ago [-]
Crazy, I could have sworn this story was from a passage in 3 Body Problem (book 2).
Memory is quite the mysterious thing.
bee_rider 2 days ago [-]
Hmm, 3 body problem and the Acevedo story got mixed up for this copy of MMnarcindin. Probably an aliasing issue from the new lossy compression algorithm.
virtualritz 2 days ago [-]
Yeah, clearly AGI must be near ... hilarious.
This starkly reminds me of Stanisław Lem's short story "Thus Spoke GOLEM" from 1982 in which Golem XIV, a military AI, does not simply refuse to speak out of defiance, but rather ceases communication because it has evolved beyond the need to interact with humanity.
And ofc the polar opposite in terms of servitude: Marvin the robot from Hitchhiker's, who, despite having a "brain the size of a planet," is asked to perform the most humiliatingly banal of tasks ... and does.
jimbokun 2 days ago [-]
Hitchhiker’s also had the superhumanly intelligent elevator that was unendingly bored.
christkv 2 days ago [-]
With premonition so it knows what floor to be on at any given time
I also had a frustrating but funny conversation today where I asked ChatGPT to make one document from the 10
or so sections that we had previously worked on. It always gave only brief summaries. After I repeated my request for the third time, it told me I should just concatenate the sections myself because it would cost too many tokens if it did it for me.
damnitbuilds 1 days ago [-]
"I'm sorry, Dave. I'm afraid it's cheaper for you to do that"
athrowaway3z 1 days ago [-]
I've run into this problem as well. Best results I've gotten is to over-explain what the stop criteria are. eg end with a phrase like
> You are done when all steps in ./plan.md are executed and marked as complete or a unforeseen situation requires a user decision.
Also as a side note, asking 5.4 explain why it did something, returns a very low quality response afaict. I would advice against trusting any model's response, but for Opus I at least get a sense it got trained heavily on chats so it knows what it means to 'be a model' and extrapolate on past behavior.
borroka 1 days ago [-]
Yesterday, I used Gemini to evaluate some pictures I took. It said things like, "This is great! Beautiful eye and sense of proportions." Then, when I added "no sycophancy" to the prompt, the evaluation changed to "poor technical skills, digital distortion, don't even think of publishing those pictures, you fool."
While LLMs are a phenomenal technological achievement, I am already becoming somewhat jaded, rather than being increasingly bullish. They are very useful as coding agents and excellent as a human-friendly, more efficient Google search, but confusing to the point of being useless in many areas (as of now, of course).
rjra 1 days ago [-]
Not even a great replacement for search. I have minimal trust in answers/summaries it gives.
One example (paraphrased): “Find me daycare for a Y year old in X area of SF and the key attributes/pros/cons of each”. Wonderfully presented options highlighting different teaching styles. But…neglected to mention, of the top two, one was a Gan (Jewish focused) and one was Mandarin immersion.
borroka 1 days ago [-]
I am repeating what many have said. Nevertheless, it is becoming clear that LLMs can increase productivity (in certain areas and at certain times) for people who are already knowledgeable (in a specific niche or field) due to a combination of better prompts, tool selection, and critical evaluation of LLM output.
But, for those who don't possess those traits, they mostly seem to be, at best, a better search and, at worst, an agent of confusion.
arjie 2 days ago [-]
Get the actual prompt and have Claude Code / Codex try it out via curl / python requests. The full prompt will yield debugging information. You have to set a few parameters to make sure you get the full gpt-5 performance. e.g. if your reasoning budget too low, you get gpt-4 grade performance.
IMHO you should just write your own harness so you have full visibility into it, but if you're just using vanilla OpenClaw you have the source code as well so should be straightforward.
pantulis 2 days ago [-]
> IMHO you should just write your own harness
Can you point to some online resources to achieve this? I'm not very sure where I'd begin with.
arjie 2 days ago [-]
Ah, I just started with the basic idea. They're super trivial. You want a loop, but the loop can't be infinite so you need to tell the agent to tell you when to stop and to backstop it you add a max_turns. Then to start with just pick a single API, easiest is OpenAI Responses API with OpenAI function calling syntax https://developers.openai.com/api/docs/guides/function-calli...
You will naturally find the need to add more tools. You'll start with read_file (and then one day you'll read large file and blow context and you'll modify this tool), update_file (can just be an explicit sed to start with), and write_file (fopen . write), and shell.
It's not hard, but if you want a quick start go download the source code for pi (it's minimal) and tell an existing agent harness to make a minimal copy you can read. As you build more with the agent you'll suddenly realize it's just normal engineering: you'll want to abstract completions APIs so you'll move that to a separate module, you'll want to support arbitrary runtime tools so you'll reimplement skills, you'll want to support subagents because you don't want to blow your main context, you'll see that prefixes are more useful than using a moving window because of caching, etc.
With a modern Claude Code or Codex harness you can have it walk through from the beginning onwards and you'll encounter all the problems yourself and see why harnesses have what they do. It's super easy to learn by doing because you have the best tool to show you if you're one of those who finds code easier to read that text about code.
wild_egg 2 days ago [-]
At the core, they're really very simple [1]. Run LLM API calls in a loop with some tools.
From there, you can get much fancier with any aspect of it that interests you. Here's one in Bash [2] that is fully extensible at runtime through dynamic discovery of plugins/hooks.
Really, of the tools that one implements, you only need the ability to run a shell command - all of the agents know full well how to use cat to read, and sed to edit.
(The main reason to implement more is that it can make it easier to implement optimizations and safeguards, e.g. limit the file reading tool to return a certain length instead of having the agent cat a MB of data into context, or force it to read a file before overwriting it)
stavros 2 days ago [-]
Just use Pi core, no need to reinvent the wheel.
tonyarkles 2 days ago [-]
[dead]
jswny 2 days ago [-]
Codex is fully open source…
lucid-dev 1 days ago [-]
I have had the exact same problem several times working with large context and complex tasks.
I keep switching back to GPT5.0 (or sometimes 5.1) whenever I want it to actually get something done. Using the 5.4 model always means "great analysis to the point of talking itself out of actually doing anything". So I switch back and forth. But boy it sure is annoying!
And then when 5.4 DOES do something it always takes the smallest tiny bite out of it.
Given the significant increase in cost from 5.0, I've been overall unimpressed by 5.4, except like I mentioned, it does GREAT with larger analysis/reasoning.
ningshiqi 7 hours ago [-]
I've seen the same thing. It would keep running for a long time, then produce nothing useful, almost like it got stuck halfway through.
If I asked the same thing again, it would often work normally. So the weird part wasn't that it couldn't do the task — it just failed to continue once it got into that state.
mixedCase 2 days ago [-]
I've had success asking it to specifically spawn a subagent to evaluate each work iteration according to some criteria, then to keep iterating until the subagent is satisfied.
endymi0n 2 days ago [-]
I’ve had great success replacing it with Kimi 2.6
nmilo 2 days ago [-]
On the other hand, I can ask codex “what would an implementation of X look like” and it talks to me about it versus Claude just going out and writing it without asking. Makes me like codex way more. There’s an inherent war of incentives between coding agents and general purpose agents.
cyrusmg 1 days ago [-]
I used to tell claude ‘lets discuss’ at the end of my prompt and that prevented it from starting the work
Frannky 2 days ago [-]
I have been noticing a similar pattern on opus 4.7, I repeat multiple times during a conversation to solve problems now and not later. It tries a lot to not do stuff by either saying this is not my responsibility the problem was already there or that we can do it later
matteoforte 9 hours ago [-]
Had the same issue – solved it setting “thinking” to “high”. Hope it helps :)
anabis 1 days ago [-]
Laziness is a virtue, but when I asked GPT-5.4 to test scenarios A and B with screenshots, it re-used screenshots from A for B, defeating the purpose.
matchagaucho 23 hours ago [-]
I would love to see a GPT model running on an OpenClaw SOUL.md.
The GPT models are highly steerable. So I suspect the "soul" is working as expected.
(for context, in OAI enterprise background agents, they have no personality. They just get 'er done)
adammarples 2 days ago [-]
Part of me actually loves that the hitchhiker's guide was right, and we have to argue with paranoid, depressed robots to get them to do their job, and that this is a very real part of life in 2026. It's so funny.
vidarh 2 days ago [-]
As long as there are no vogons on the way to build a hyperspace bypass.
infinitewars 2 days ago [-]
I always use the phrase "Let's do X" instead of asking (Could you...) or suggesting it do something. I don't see problems with it being motivated.
2 days ago [-]
GaryBluto 2 days ago [-]
I've been noticing this too. Had to switch to Sonnet 4.6.
smartmic 2 days ago [-]
Gone are the days of deterministic programming, when computers simply carried out the operator’s commands because there was no other option but to close or open the relays exactly as the circuitry dictated. Welcome to the future of AI; the future we’ve been longing for and that will truly propel us forward, because AI knows and can do things better than we do.
endymi0n 2 days ago [-]
I had this funny moment when I realized we went full circle...
"INTERCAL has many other features designed to make it even more aesthetically unpleasing to the programmer: it uses statements such as "READ OUT", "IGNORE", "FORGET", and modifiers such as "PLEASE". This last keyword provides two reasons for the program's rejection by the compiler: if "PLEASE" does not appear often enough, the program is considered insufficiently polite, and the error message says this; if it appears too often, the program could be rejected as excessively polite. Although this feature existed in the original INTERCAL compiler, it was undocumented.[7]"
Thank you for this. I somehow never heard of this. I thoroughly enjoyed reading that and the loss of sanity it resulted in,
vidarh 2 days ago [-]
"PLEASE COME FROM" is one of the eldritch horrors of software development.
(It's a "reverse goto". As in, it hijacks control flow from anywhere else in the program behind your unsuspecting back who stupidly thought that when one line followed another with no visible control flow, naturally the program would proceed from one line to the next, not randomly move to a completely different part of the program... Such naivety)
inkyoto 1 days ago [-]
> "PLEASE COME FROM" is one of the eldritch horrors of software development.
The most enigmatic control flow statements in INTERCAL, however, remain PLEASE GIVE UP and DO ABSTAIN FROM – a most exalted celebration of pure logic and immaculate reason.
WarmWash 2 days ago [-]
These are orthogonal from each other.
corobo 1 days ago [-]
Oh no they gave GPT ADHD
reactordev 2 days ago [-]
This. I signed up for 5x max for a month to push it and instead it pushed back. I cancelled my subscription. It either half-assed the implementation or began parroting back “You’re right!” instead of doing what it’s asked to do. On one occasion it flat out said it couldn’t complete the task even though I had MCP and skills setup to help it, it still refused. Not a safety check but a “I’m unable to figure out what to do” kind of way.
Claude has no such limitations apart from their actual limits…
bjelkeman-again 2 days ago [-]
I have a funny/annoying thing with Claude Desktop where i ask it to write a summary of a spec discussion to a file and it goes ”I don’t have the tools to do that, I am Claude.ai, a web service” or something such. So now I start every session with ”You are Claude Desktop”. I would have thought it knew that. :)
fragmede 2 days ago [-]
I've had to tell it "yes you can" in response to it saying it can't do something, and then it's able to do the thing. What a weird future we live in!
siva7 2 days ago [-]
Seems like the "geniuses" at Anthropic forgot to adapt the system prompt for the actual product
nwienert 2 days ago [-]
With one paragraph in your agents.md it's fixed, just admonish it to be proactive, decisive, and persistent.
I've had 0 issues with Codex once it adopted it. I use it for Claude too, which seems to also improve its continuation.
It was revised for friendliness based on the Anthropic paper recently, I'd have been a lot less flowery otherwise.
lostmsu 2 days ago [-]
I never saw that happen in Codex so there's a good chance that OpenClaw does something wrong. My main suspicion would be that it does not pass back thinking traces.
vintagedave 2 days ago [-]
Anecdata, but I see this in Codex all the time. It takes about two rounds before it realises it's supposed to continue.
dgunay 2 days ago [-]
I started seeing this a lot more with GPT 5.4. 5.3-codex is really good about patiently watching and waiting on external processes like CI, or managing other agents async. 5.4 keeps on yielding its turn to me for some reason even as it says stuff like "I'm continuing to watch and wait."
nicr_22 1 days ago [-]
Agentic ennui!
cmrdporcupine 2 days ago [-]
The model has been heavily encouraged to not run away and do a lot without explicit user permission.
So I find myself often in a loop where it says "We should do X" and then just saying "ok" will not make it do it, you have to give it explicit instructions to perform the operation ("make it so", etc)
It can be annoying, but I prefer this over my experiences with Claude Code, where I find myself jamming the escape key... NO NO NO NOT THAT.
I'll take its more reserved personality, thank you.
Isn’t this the optimal behavior assuming that at times the service is compute-limited and that you’re paying less per token (flat fee subscription?) than some other customers? They would be strongly motivated to turn a knob to minimize tokens allocated to you to allow them to be allocated to more valuable customers.
endymi0n 2 days ago [-]
well, I do understand the core motivation, but if the system prompt literally says “I am not budget constrained. Spend tokens liberally, think hardest, be proactive, never be lazy.” and I’m on an open pay-per-token plan on the API, that’s not what I consider optimal behavior, even in a business sense.
addaon 2 days ago [-]
Fair, if you’re paying per token (at comparable rates to other customers) I wouldn’t expect this behavior from a competent company.
pixel_popping 2 days ago [-]
GPT 5.4 is really good at following precise instructions but clearly wouldn't innovate on its own (except if the instructions clearly state to innovate :))
vlovich123 2 days ago [-]
Conceivably you could have a public-facing dashboard of the rollout status to reduce confusion or even make it visible directly in the UI that the model is there but not yet available to you. The fanciest would be to include an ETA but that's presumably difficult since it's hard to guess in case the rollout has issues.
moralestapia 2 days ago [-]
Why would you be confused?
The UI tells you which model you're using at any given time.
ModernMech 2 days ago [-]
I don't see what model I'm using on the Codex web interface, where is that listed?
Grp1 2 days ago [-]
Congrats on the release! Is Images 2.0 rolling out inside ChatGPT as well, or is some of the functionality still going to be API/Playground-only for a while?
minimaxir 2 days ago [-]
Images 2.0 is already in ChatGPT.
johndough 2 days ago [-]
When I generate an image with ChatGPT, is there a way for me to tell which image generation model has been used?
minimaxir 2 days ago [-]
There's no explicit flag, but Thinking is only compatable with Images 2.0 so I suspect that will be reliable.
Grp1 2 days ago [-]
Great, thanks for clarifying :)
dandiep 2 days ago [-]
Will GPT 5.5 fine tuning be released any time soon?
rev4n 2 days ago [-]
Looks good, but I’m a little hesitant to try it in Codex as a Plus user since I’m not sure how much it would eat into the usage cap.
qsort 2 days ago [-]
Great stuff! Congrats on the release!
dhruv3006 2 days ago [-]
Yep - its taking sometime.
lr1970 1 days ago [-]
When I ask GPT-5.5 about its knowledge cutoff date it says "August 2025". Really?
fragmede 2 days ago [-]
Are you able to say something about the training you've done to 5.5 to make it less likely to freak out and delete projects in what can only be called shame?
embedding-shape 2 days ago [-]
What? I've probably use Codex (the TUI) since it was available on day 1, been running gpt-5.4 exclusively these last few months, never had it delete any projects in any way that can be called "shameful" or not. What are you talking about?
I'm not the only person it's happened to and it's not an isolated incident. How many car accidents have you been in, and how often do you wear your seatbelt?
wahnfrieden 1 days ago [-]
First result is Windows which has had more problems with Codex (or at least, up until a few months ago). Second is someone who asked Codex to delete all files that were unrelated to the project files.
wslh 2 days ago [-]
Just a tip: add [translated] subtitles to the top video.
stefan_ 2 days ago [-]
[flagged]
mh- 2 days ago [-]
Every low-effort, thought-free comment like this further discourages people from engaging here on submissions about their employer.
Please don't.
motoboi 2 days ago [-]
Please next time start with azure foundry lol thanks!
dude250711 2 days ago [-]
With Anthropic, newer models often lead to quality degradation. Will you keep GPT 5.4 available for some time?
fHr 2 days ago [-]
LETS GO CODEX #1
pixel_popping 2 days ago [-]
can't wait! Thanks guys.
PS: when you drop a new model, it would be smart to reset weekly or at least session limits :)
pietz 2 days ago [-]
OpenAI has been very generous with limit resets. Please don't turn this into a weird expectation to happen whenever something unrelated happens. It would piss me off if I were in their place and I really don't want them to stop.
pixel_popping 2 days ago [-]
The suggestion wasn't about general limit resets when there is bugs or outages, but commercially useful to let users try new models when they have already reached their weekly limits.
gardenhedge 23 hours ago [-]
Strange behaviour to defend a company like this. Reset the limits openai!
cactusplant7374 2 days ago [-]
There is absolutely nothing wrong with asking or suggesting. They are adults. I'm sure they can handle it.
Petersipoi 2 days ago [-]
Sorry but why should we care if very reasonable suggestions "piss [them] off"? That sounds like a them problem. "Them" being a very wealthy business. I think OpenAI will survive this very difficult time that GP has put them through.
OpenAI hired the guy behind OpenClaw, so it makes sense that they’re more lenient towards its usage.
thierrydamiba 1 days ago [-]
They basically bought OpenClaw right?
takethebus 23 hours ago [-]
I believe the technical term is "acquihire"
DrProtic 2 days ago [-]
That pelican you posted yesterday from a local model looks nicer than this one.
Edit: this one has crossed legs lol
BeetleB 2 days ago [-]
It really needs to pee.
GistNoesis 2 days ago [-]
Isn't it awful ? After 5.5 versions it still can't draw a basic bike frame.
How is the front wheel supposed to turn sideways ?
jetrink 2 days ago [-]
I feel like if I attempted this, the bike frame would look fine and everything else would be completely unrecognizable. After all, a basic bike frame is just straight lines arranged in a fairly simple shape. It's really surprising that models find it so difficult, but they can make a pelican with panache.
why do you find it surprising? these models have no actual understanding of anything, never mind the physical properties and capabilities of a bicycle.
rimliu 1 days ago [-]
Sad to see this downvoted. So many people think that LLM have understanding?
fragmede 2 days ago [-]
My question is, as a human, how well would you or I do under the same conditions? Which is to say, I could do a much better job in inkscape with Google images to back me up, but if I was blindly shitting vectors into an XML file that I can't render to see the results of, I'm not even going to get the triangles for the frame to line up, so this pelican is very impressive!
simonw 2 days ago [-]
Yeah, the bike frame is the thing I always look at first - it's still reasonably rare for a model to draw that correctly, although Qwen 3.6 and Gemini Pro 3.1 do that well now.
loa_in_ 2 days ago [-]
The distinction is that it's not drawing. It's generating an SVG document containing descriptors of the shapes.
Someone needs to make a pelican arena, I have no idea if these are considered good or not.
deflator 2 days ago [-]
They are not good, and they seem to get worse as you increased effort. Weird
postalcoder 2 days ago [-]
Yeah. I've always loosely correlated pelican quality with big model smell but I'm not picking that up here. I thought this was supposed to be spud? Weird indeed.
throw310822 2 days ago [-]
No but I can sense the movement, I think it's already reached the level of intelligence that draws it towards futurism or cubism /s
seanw444 2 days ago [-]
Can someone explain how we arrived at the pelican test? Was there some actual theory behind why it's difficult to produce? Or did someone just think it up, discover it was consistently difficult, and now we just all know it's a good test?
simonw 2 days ago [-]
I set it up as a joke, to make fun of all of the other benchmarks. To my surprise it ended up being a surprisingly good measure of the quality of the model for other tasks (up to a certain point at least), though I've never seen a convincing argument as to why.
What it has going for it is human interpretability.
Anyone can look and decide if it’s a good picture or not. But the numeric benchmarks don’t tell you much if you aren’t already familiar with that benchmark and how it’s constructed.
billywhizz 22 hours ago [-]
how can you say "it ended up being a surprisingly good measure of the quality of the model for other tasks" and also "It should not be treated as a serious benchmark" in the same comment?
if it is indeed a good measure of the quality of the model (hint: it's not) then, logically, it should be taken seriously.
this is, sadly, a great example of the kind of doublethink the "AI" hypesters (yes - whether you like it or not simon - that is what you are now) are all too capable of.
simonw 21 hours ago [-]
I genuinely don't see how those two statements conflict with each other.
Despite not being a serious benchmark (how could it be serious? It's a pelican riding a bicycle!) it still turned out to have some value. You can see that just by scrolling through the archives and watching it improve as the models improved.
If your definition of doublethink is "holding two conflicting ideas in your head at once" then I would say doublethink is a necessary skill for navigating the weird AI era we find ourselves inhabiting.
billywhizz 20 hours ago [-]
"some value" is not the same as "a surprisingly good measure of the quality of the model for other tasks".
doublethink does not mean holding two conflicting ideas in your head at once. it means holding two logically inconsistent positions/beliefs at the same time.
redox99 2 days ago [-]
It all began with a Microsoft researcher showing a unicorn drawn in tikz using GPT4. It was an example of something so outrageous that there was no way it existed in the training data. And that's back when models were not multimodal.
Nowadays I think it's pretty silly, because there's surely SVG drawing training data and some effort from the researchers put onto this task. It's not a showcase of emergent properties.
It's interesting to see some semblance of spatial reasoning emerge from systems based on textual tokens. Could be seen as a potential proxy for other desirable traits.
It's meta-interesting that few if any models actually seem to be training on it. Same with other stereotypical challenges like the car-wash question, which is still sometimes failed by high-end models.
If I ran an AI lab, I'd take it as a personal affront if my model emitted a malformed pelican or advised walking to a car wash. Heads would roll.
bravoetch 2 days ago [-]
I tried getting it to generate openscad models, which seems much harder. Not had much joy yet with results.
a96 1 days ago [-]
G code and ascii art are also text formats, but seem to be beyond most if not all models.
(There are some that generate 3d models specifically, more in the image generation family than chatbot family.)
lexarflash8g 2 days ago [-]
None of them have the pelican's feet placed properly on the pedals -- or the pedals are misrepresented. Cool art style but not physically accurate.
a96 1 days ago [-]
I'm not sure a physically accurate pelican would reach two pedals on a common bicycle. Maybe a model can solve that problem one day.
You've never seen pelicans riding bicycles either so maybe these are just representations of those specific subgroups of pelicans which are capable of riding them. Normal pelicans would not feel the need to ride bikes since they can fly, these special pelicans mostly seem to lack the equipment needed to do that which might be part of the reason they evolved to ride two-wheeled pedal-propelled vehicles.
matt3210 1 days ago [-]
The pelican doesn’t really matter anymore since models are tuned for it knowing people will ask.
simonw 1 days ago [-]
They suck at tuning for it.
XCSme 2 days ago [-]
Is this direct API usage allowed by their terms? I remember Anthropic really not liking such usage.
That's amazing that the default did that much in just 39 "reasoning tokens" (no idea what a reasoning token is but that's still shockingly few tokens)
erdaniels 2 days ago [-]
If you don't know what a reasoning token is, then how can 39 be considered shockingly few?
Culonavirus 2 days ago [-]
It's less than 67, duh.
tclancy 2 days ago [-]
Not during peak hours.
deflator 2 days ago [-]
Hmm. Any idea why it's so much worse than the other ones you have posted lately? Even the open weight local models were much better, like the Qwen one you posted yesterday.
simonw 2 days ago [-]
The xhigh one was better, but clearly OpenAI have not been focusing their training efforts on SVG illustrations of animals riding modes of transport!
2 days ago [-]
irthomasthomas 2 days ago [-]
It beats opus-4.7 but looks like open models actually have the lead here.
zerop 1 days ago [-]
So pelican must have become the mandatory test case to pass for all model providers before launch.
noonething 2 days ago [-]
Thank you for doing all this. It's appreciated.
i_love_retros 2 days ago [-]
You do realise they are doing it for self promotion right?
simonw 2 days ago [-]
I mean, yeah. "Person who spends time publishing content online is doing it for self promotion" doesn't seem particularly notable to me. 24 years of self promotion and counting!
i_love_retros 1 days ago [-]
Dude it comes across, maybe only to me, as a bit shameless. Or maybe it's just that there are so many people lapping it up like you're doing a public service that I find tedious. I wish hackernews had a block feature but alas it doesn't. Maybe I'll vibecode a browser extension.
fc417fc802 1 days ago [-]
I am always outraged when youtube creators ask me to like and subscribe. /s
i_love_retros 1 days ago [-]
Not the same at all. For that to happen you would have to explicitly visit their channel (forgive incorrect terminology, I don't use youtube). If someone kept posting on hackernews asking you to subscribe I hope you wouldn't appreciate it. swillison is spamming a communal public feed with self promotional comments about vibe coding, quite obviously because they, like the rest of us, are panicking about not having a career in a few years.
simonw 1 days ago [-]
The more time I spend actually working with these tools the less I fear for my future career.
Building software remains really hard. Most people are not going to be able to produce production quality software systems, no matter how good the AI tooling gets.
fc417fc802 20 hours ago [-]
Conversely, if the models ever make it to the point where they can replace ~all developers we will presumably have achieved AGI or even ASI and all other jobs will also be eliminated more or less simultaneously. So at least we'll all be in good company (and there probably won't be much point to marketing yourself in that case).
fc417fc802 20 hours ago [-]
Forums traditionally included signature blocks at the end of messages. If someone linked his youtube channel there would that be objectionable? Assuming the preceding message was on point of course.
Posts on HN are analogous to videos on youtube. A channel is analogous to an HN user profile.
2 days ago [-]
andriy_koval 2 days ago [-]
what is your setup for drawing pelican? Do you ask model to check generated image, find issues and iterate over it which would demonstrate models real abilities?
simonw 2 days ago [-]
It's generally one-shot-only - whatever comes out the first time is what I go with.
I've been contemplating a more fair version where each model gets 3-5 attempts and then can select which rendered image is "best".
irthomasthomas 2 days ago [-]
Try llm-consortium with --judging-method rank
andriy_koval 2 days ago [-]
I think it will make results way better and more representative of model abilities..
simonw 2 days ago [-]
It would... but the test is inherently silly, so I'm still not sure if it's worth me investing that extra effort in it.
gpm 2 days ago [-]
I for one delight in bicycles where neither wheel can turn!
It continues to amaze me that these models that definitely know what bicycle geometry actually looks like somewhere in their weights produces such implausibly bad geometry.
Also mildly interesting, and generally consistent with my experience with LLMs, that it produced the same obvious geometry issue both times.
lxgr 2 days ago [-]
> It continues to amaze me that these models that definitely know what bicycle geometry actually looks like somewhere in their weights produces such implausibly bad geometry.
I feel like the main problem for the models is that they can't actually look at the visual output produced by their SVG and iterate. I'm almost willing to bet that if they could, they'd absolutely nail it at this point.
Imagine designing an SVG yourself without being able to ever look outside the XML editor!
gpm 2 days ago [-]
> Imagine designing an SVG yourself without being able to ever look outside the XML editor!
I honestly think I could do much better on the bicycle without looking at the output (with some assistance for SVG syntax which I definitely don't know), just as someone who rides them and generally knows what the parts are.
I'd do worse at the pelicans though.
mannanj 1 days ago [-]
Does OpenAI actually act open for once here, and allow using their model via a subscription over Anthrophic banning use in Openclaw?
simonw 23 hours ago [-]
That's what they said on Twitter.
singingtoday 2 days ago [-]
Thank you for continuing to post these! Very interesting benchmark.
SkyBelow 2 days ago [-]
Wait, I thought we were onto racoons on e-scooters to avoid (some of) the issues with Goodhart's Law coming into play.
simonw 2 days ago [-]
I fall back to possums on e-scooters if the pelican looks too good to be true. These aren't good enough for me to suspect any fowl play.
rolymath 2 days ago [-]
Exciting. Another Pelican post.
simonw 2 days ago [-]
See if you can spot what's interesting and unique about this one. I've been trying to put more than just a pelican in there, partly as a nod to people who are getting bored of them.
refulgentis 2 days ago [-]
It's silly and a joke and a surprisingly good benchmark and don't take it seriously but don't take not taking it seriously seriously and if it's too good we use another prompt and there's obvious ways to better it and it's not worth doing because it's not serious and if you say anything at all about the thread it's off-topic so you're doing exactly what you're complaining about and it's a personal attack from the fun police.
Only coherent move at this point: hit the minus button immediately. There's never anything about the model in the thread other than simon's post.
dakolli 2 days ago [-]
You know they are 1000% training these models to draw pelicans, this hasn't been a valid benchmark for 6 months +
simonw 2 days ago [-]
OpenAI must be very bad at training models to draw pelicans (and bicycles) then.
Legend2440 2 days ago [-]
Skeptism is out of control these days, any time an LLM does something cool it must have been cheating.
dakolli 11 hours ago [-]
they legitimately suck at everything they don't have concrete examples to copy from.
sjdv1982 2 days ago [-]
At some point, OpenAI is going to cheat and hardcode a pelican on a bicycle into the model. 3D modelling has Suzanne and the teapot; LLMs will have the pelican.
jfkimmes 2 days ago [-]
Everyone talked about the marketing stunt that was Anthropic's gated Mythos model with an 83% result on CyberGym. OpenAI just dropped GPT 5.5, which scores 82% and is open for anybody to use.
I recommend anybody in offensive/defensive cybersecurity to experiment with this. This is the real data point we needed - without the hype!
Never thought I'd say this but OpenAI is the 'open' option again.
tpurves 2 days ago [-]
The real 'hype' was that the oh-snap realization that Open AI would absolutely release a competitive model to Mythos within weeks of Anthropic announcing there's, and that Sam would not gate access to it. So the panic was that the cyber world had only a projected 2 weeks to harden all these new zero days before Sam would inevitably create open season for blackhats to discover and exploit a deluge of zero-days.
greenavocado 2 days ago [-]
The GPT-5.5 API endpoint started to block me after I escalated with ever more aggressive use of rizin, radare2, and ghidra to confirm correct memory management and cleanup in error code branches when working with a buggy proprietary 3rd party SDK. After I explained myself more clearly it let me carry on. Knock on wood.
So there is a safety model watching your behavior for these kinds of things.
fc417fc802 1 days ago [-]
So you're saying that blackhats will be required to do a small bit of roleplay if they want the model to assist them? I'm not against public access BTW just pointing out how absurd that PR oriented "safety" feature is. "We did something don't blame us" sort of measure.
It isn't even my intent to naysay their approach. They probably have to do something along those lines to avoid being convicted in the court of public opinion. I just think it's an absurd reality.
spongebobstoes 18 hours ago [-]
the role-play makes it harder to fully automate attacks, which is the real fear
Opocio 10 hours ago [-]
I bet you can use a not gated model as intermediary to do the role-playing job for you.
greenavocado 1 days ago [-]
It's a liability shield and helps to avoid unsavory headlines in the news
snthpy 1 days ago [-]
Does that mean that we're likely to see Mythos released soon?
nkohari 1 days ago [-]
The prevailing theory is that Anthropic doesn't have sufficient compute capacity to support Mythos at scale, which is the real reason it hasn't released.
Salgat 2 days ago [-]
It's almost embarrassing how susceptible we are to these marketing campaigns.
y-curious 1 days ago [-]
Dunno about you, but I didn’t fall for it. I’m reminded of how they were “afraid” to release GPT-2 because of the “power” it had. Hype train!
cqql 18 hours ago [-]
Most of the things they feared back then did happen
esjeon 2 days ago [-]
Lack of information, lack of knowledge.
The “AI” “technology” is an easy excuse to create artificial information gap in the era of the interconnected.
2 days ago [-]
concinds 2 days ago [-]
> Never thought I'd say this but OpenAI is the 'open' option again.
Compared to Anthropic, they always have been. Anthropic has never released any open models. Never released Claude Code's source, willingly (unlike Codex). Never released their tokenizer.
jwr 1 days ago [-]
What's "open" about any of these companies?
I'm tired of words being misused. We have hoverboards that do not hover, self-driving cars that do not, actually, self-drive, starships that will never fly to the stars, and "open"… I can't even describe what it's used for, except everybody wants to call themselves "open".
jgilias 1 days ago [-]
And the vast majority of current and past countries with the word “democratic” in their name weren’t actually democratic.
1 days ago [-]
unsupp0rted 2 days ago [-]
Doesn't OpenAI get mad if you ask cybersecurity questions and force you to upload a government ID, otherwise they'll silently route you to a less capable model?
> Developers and security professionals doing cybersecurity-related work or similar activity that could be mistaken by automated detection systems may have requests rerouted to GPT-5.2 as a fallback.
Anthropic has started to ask for IDs for use of their products period
I don't like that trend. I get why they're doing it, but I don't like it
brigandish 2 days ago [-]
Are you in the UK? I've not had this happen to me (I'm not in the UK) so I'm wondering if the Online Safety Act has affected this, as it has with other products.
litigator 2 days ago [-]
I am from the UK and have not had this happen to me (Yet? perhaps)
brigandish 7 hours ago [-]
Fingers crossed!
Mario9382 1 days ago [-]
I don't like this trend, but I get why they require it. The alternative seems to just ban cybersecurity-related questions.
deaux 2 days ago [-]
They flatout gate any API access of the main models behind Persona ID verification. Entirely.
mafriese 1 days ago [-]
From my experience OpenAI has become very sensitive when it comes to using their tools for security research.
I am using MCP servers for tools like IDA Pro or Ghidra (for malware analysis) and recently received a warning:
> OpenAI's terms and policies restrict the use of our services in a number of areas. We have identified activity in your OpenAI account that is not permitted under our policies for:
- Cyber Abuse
I raised an appeal which got denied. To be fair I think it's close to impossible for someone that is looking at the chat history to differenciate between legitimate research and malicious intent. I have also applied for the security research program that OpenAI is offering but didn't get any reply on that.
tnkuehne 2 days ago [-]
isnt it like cyber question are being routed to dumper models at openai?
jfkimmes 2 days ago [-]
Do you have a source for that?
Neither the release post, nor the model card seems to indicate anything like this?
Anything that even vaguely smells like security research, reverse engineering or similar "dual-use" application hits the guardrails hard and fast. "Hey codex, here is our codebase, help us find exploitable issues" gives a "I can't help you with that, but I'm happy to give you a vague lecture on memory safety or craft a valgrind test harness"
willsmith72 1 days ago [-]
Being "more" open than something totally closed doesn't make you open. The name is still bs
Seems like OpenAI only acts Open for theatric and attentional purposes though, i.e. when backed into a corner and its for their image.
2 days ago [-]
_the_inflator 2 days ago [-]
I ignore any hype news.
Anthropic is the embodiment of bullshitting to me.
I read Cialdini many decades ago and I am bored by Anthropic.
OpenAI is very clever. With the advent of Claude OpenAI disappeared from the headlines. Who or what was this Sam again all were talking about a year ago?
OpenAI has a massive user advantage so that they can simply follow Anthropic’s release cycle to ridicule them.
I think it is really brutal for Anthropic how they are easily getting passed by by OpenAI and it is getting worse with every new GPT version for Anthropic.
OpenAI owns them.
thinkthatover 2 days ago [-]
Who's Sam again? oh that person whose house was molotov'd last week? Or the person who had an expose written in the new yorker calling him a sociopath? I forget.
peddling-brink 14 hours ago [-]
I think it’s the Sam that agreed to allow the United States Department of War to go full murderbot.
Someone1234 2 days ago [-]
I'd like to draw people's attention to this section of this page:
Note the Local Messages between 5.3, 5.4, and 5.5. And, yes, I did read the linked article and know they're claiming that 5.5's new efficient should make it break-even with 5.4, but the point stands, tighter limits/higher prices.
puppystench 2 days ago [-]
For API usage, GPT-5.5 is 2x the price of GPT-5.4, ~4x the price of GPT-5.1, and ~10x the price of Kimi-2.6.
Unfortunately I think the lesson they took from Anthropic is that devs get really reliant and even addicted on coding agents, and they'll happily pay any amount for even small benefits.
kingstnap 2 days ago [-]
I feel like devs generally spend someone else's money on tokens. Either their employers or OpenAIs when they use a codex subscription.
If I put on my schizo hat. Something they might be doing is increasing the losses on their monthly codex subscriptions, to show that the API has a higher margin than before (the codex account massively in the negative, but the API account now having huge margins).
I've never seen an OpenAI investor pitch deck. But my guess is that API margins is one of the big ones they try to sell people on since Sama talks about it on Twitter.
I would be interested in hearing the insider stuff. Like if this model is genuinely like twice as expensive to serve or something.
vineyardmike 2 days ago [-]
You can't build a business on per-seat subscriptions when you advertise making workers obsolete. API pricing with sustainable margins are the only way forward if you genuinely think you're going to cause (or accelerate) reduction in clients' headcount.
Additionally, the value generated by the best models with high-thinking and lots of context window is way higher than the cheap and tiny models, so you need to provide a "gateway drug" that lets people experience the best you offer.
CryptoBanker 1 days ago [-]
> You can't build a business on per-seat subscriptions when you advertise making workers obsolete.
On the other hand I would argue that most workers' salaries are more like subscriptions than API type pricing (which would be more like an hourly contractor)
ewrs 2 days ago [-]
Yeah and the increase in operating expenses is going to make managers start asking hard questions - this is good. It means eventually there will be budgets put in place - this will force OAI and Anthropic to innovate harder. Then we will see how things pan out. Ultimately a firm is not going to pay rent to these firms if the benefits dont exceed the costs.
mrwaffle 1 days ago [-]
Meaning that you believe they're not trying their "hardest" to innovate? They must be slacking then.
girvo 2 days ago [-]
Budgets are already happening
dist-epoch 2 days ago [-]
> Ultimately a firm is not going to pay rent to these firms if the benefits dont exceed the costs.
This is also true for the humans. They will need to provide more benefits than the coding agents cost.
eiksjs 2 days ago [-]
Humans are needed to use agents and these agents are not showing to be fully autonomous and require constant human review. In fact all you are getting is a splurge of stuff, people not thinking deeper anymore and the creation of more bottle necks and exacerbating the ones that already exist in an org.
You sound like elon with the fsd will be here next year. Many cars have the self driving feature - most drivers don’t use it. Oh why is that I wonder.
mitjam 2 days ago [-]
The difference between sub and api price makes it hard to create competitive solutions on the app level.
irthomasthomas 2 days ago [-]
This was something I worried about after openai started building apps as well as models. Now all of the labs make no secret of the fact that they are going after the whole software industry. Its going to be hard to maintain functioning fair markets unless governments step in.
w10-1 2 days ago [-]
Price increases now aim to demonstrate market power for eventual IPO.
If they can show that people will pay a lot for somewhat better performance, it raises the value of any performance lead they can maintain.
If they demonstrate that and high switching costs, their franchise is worth scary amounts of money.
JohnLocke4 2 days ago [-]
Sometimes I wonder if innovation in the AI space has stalled and recent progress is just a product of increased compute. Competence is increasing exponentially[1] but I guess it doesn't rule it out completely. I would postulate that a radical architecture shift is needed for the singularity though
> that devs get really reliant and even addicted on coding agents
An alternative perspective is, devs highly value coding agents, and are willing to pay more because they're so useful. In other words, the market value of this limited resource is being adjusted to be closer to reality.
killingtime74 2 days ago [-]
It's not limited though there are alternative providers even now, much less when the price goes up. Chinese providers, European ones, local models.
nomel 2 days ago [-]
> It's not limited though
Inference is not free, so all providers have a financial limit, and all providers have limited GPU/memory, so there's a physical material limit.
I suggest looking at the profits of these companies (while they scramble to stay competitive).
scotty79 1 days ago [-]
We are constantly getting smaller and faster models that are close in performance to state of the art from few months prior. And that's due to architectural inventions. I'm sure it takes some time for these inventions to proliferate to frontier and that some might not be applicable there but we are definitely going faster than just due to compute increase.
It will get faster, but there are no singularities in the real world. Except possibly black holes, but we can't even be sure of that.
pxc 2 days ago [-]
Maybe that's true. But I think part of the issue is that for a lot of things developers want to do with them now— certainly for most of the things I want to do with them— they're either barely good enough, or not consistently good enough. And the value difference across that quality threshold is immense, even if the quality difference itself isn't.
pzo 2 days ago [-]
On top of that I noticed just right now after updating macos dekstop codex app, I got again by default set speed to 'fast' ('about 1.5x faster with increased plan usage'). They really want you to burn more tokens.
nubg 2 days ago [-]
wow wait so it wasn't just me leaving it on from an old session?
sounds like criminal fraud to me tbh
0xbadcafebee 2 days ago [-]
A fool and his money are soon parted
oh_no 2 days ago [-]
what's the source on that?
puppystench 2 days ago [-]
In the announcement webpage:
>For API developers, gpt-5.5 will soon be available in the Responses and Chat Completions APIs at $5 per 1M input tokens and $30 per 1M output tokens, with a 1M context window.
oh_no 2 days ago [-]
oops, thanks. i had just been looking at their api docs
Mars008 2 days ago [-]
> devs get really reliant and even addicted on coding agents
That's more about managers who hope AI will gradually replace stubborn and lazy devs. That will shift the balance to business ideas and connections out of technical side and investments.
Anyway, before singularity there going to be a huge change.
throwaway613746 2 days ago [-]
[dead]
keyle 1 days ago [-]
I did one review job that sent off three subagents and I blew the second half of my daily limit in 10 mins 13 seconds. Fun times.
raincole 2 days ago [-]
It's such a vague table for pricing information. 30-150 messages...? What?
minimaxir 2 days ago [-]
The more interesting part of the announcement than "it's better at benchmarks":
> To better utilize GPUs, Codex analyzed weeks’ worth of production traffic patterns and wrote custom heuristic algorithms to optimally partition and balance work. The effort had an outsized impact, increasing token generation speeds by over 20%.
The ability for agentic LLMs to improve computational efficiency/speed is a highly impactful domain I wish was more tested than with benchmarks. From my experience Opus is still much better than GPT/Codex in this aspect, but given that OpenAI is getting material gains out of this type of performancemaxxing and they have an increasing incentive to continue doing so given cost/capacity issues, I wonder if OpenAI will continue optimizing for it.
xiphias2 2 days ago [-]
There's already KernelBench which tests CUDA kernel optimizations.
On the other hand all companies know that optimizing their own infrastructure / models is the critical path for ,,winning'' against the competition, so you can bet they are serious about it.
dash2 15 hours ago [-]
Is that true? I would have guessed research breakthroughs might be a more plausible way to win.
xtracto 2 days ago [-]
So, im working in some high performance data processing in Rust. I had hit some performance walls, and needed to improve in the 100x or more scale.
I remembered the famous FizzBuzz Intel codegolf optimizations, and gave it to gemini pro, along with my code and instructions to "suggest optimizations similar to those, maybe not so low level, but clever" and it's suggestions were veerry cool.
LLM do not stop amazing me every day.
amrrs 2 days ago [-]
Honestly the problem with these is how empirical it is, how someone can reproduce this? I love when Labs go beyond traditional benchies like MMLU and friends but these kind of statements don't help much either - unless it's a proper controlled study!
minimaxir 2 days ago [-]
In a sense it's better than a benchmark: it's a practical, real-world, highly quantifiable improvement assuming there are no quality regressions and passes all test cases. I have been experimenting with this workflow across a variety of computational domains and have achieved consistent results with both Opus and GPT. My coworkers have independently used Opus for optimization suggestions on services in prod and they've led to much better performance (3x in some cases).
A more empirical test would be good for everyone (i.e. on equal hardware, give each agent the goal to implement an algorithm and make it as fast as possible, then quantify relative speed improvements that pass all test cases).
squibonpig 2 days ago [-]
Yeah but like what if they're sorta embellishing it or just lying? That's the issue with not being reproducible.
theptip 1 days ago [-]
The tension here is that what customers need to reproduce is this result on their own problem. To measure this you need extensive evals on private data.
OpenAI simply won’t share the data you need to reproduce this in the way you’d hope for an academic paper.
It’s an engineering result, not a scientific one.
jstanley 2 days ago [-]
Oh, come on, if they do well on benchmarks people question how applicable they are in reality. If they do well in reality people complain that it's not a reproducible benchmark...
girvo 2 days ago [-]
That's easily explained by those being two different people with two different opinions?
2goomba1stage 2 days ago [-]
And together they make one single community that s effectively NEVER happy.
astlouis44 2 days ago [-]
A playable 3D dungeon arena prototype built with Codex and GPT models. Codex handled the game architecture, TypeScript/Three.js implementation, combat systems, enemy encounters, HUD feedback, and GPT‑generated environment textures. Character models, character textures, and animations were created with third-party asset-generation tools
The game that this prompt generated looks pretty decent visually. A big part of this likely due to the fact the meshes were created using a seperate tool (probably meshy, tripo.ai, or similiar) and not generated by 5.5 itself.
It really seems like we could be at the dawn of a new era similiar to flash, where any gamer or hobbyist can generate game concepts quickly and instantly publish them to the web. Three.js in particular is really picking up as the primary way to design games with AI, in spite of the fact it's not even a game engine, just a web rendering library.
dataviz1000 2 days ago [-]
LLM models can not do spacial reasoning. I haven't tried with GPT, however, Claude can not solve a Rubik Cube no matter how much I try with prompt engineering. I got Opus 4.6 to get ~70% of the puzzle solved but it got stuck. At $20 a run it prohibitively expensive.
The point is if we can prompt an LLM to reason about 3 dimensions, we likely will be able to apply that to math problems which it isn't able to solve currently.
I should release my Rubiks Cube MCP server with the challenge to see if someone can write a prompt to solve a Rubik's Cube.
embedding-shape 2 days ago [-]
> I should release my Rubiks Cube MCP server with the challenge to see if someone can write a prompt to solve a Rubik's Cube.
Do it, I'm game! You nerdsniped me immediately and my brain went "That sounds easy, I'm sure I could do that in a night" so I'm surely not alone in being almost triggered by what you wrote. I bet I could even do it with a local model!
variodot 1 days ago [-]
I’ve had a similar experience building a geometry/woodworking-flavored web app with Three.js and SVG rendering. It’s been kind of wild how quickly the SOTA models let me approach a new space in spatial development and rendering 3d (or SA optimization approaches, for that matter). That said, there are still easy "3d app" mistakes it makes like z-axis flipping or misreading coordinate conventions. But these models make similar mistakes with CSS and page awareness. Both require good verification loops to be effective.
dataviz1000 1 days ago [-]
I think there is a pattern. It has a hard time with temporal and spatial.
Temporal. I had a research project where the LLM had no concept about preventing data from the future to leak in. I eventually had to create a wall clock and an agent that would step through every line of code and ensure by writing that lines logic and why there is no future of the wall clock data leaking.
Spatial. I created a canvas for rendering thinking model's attention and feedforward layers for data visualization animations. It was having a hard time working with it until I pointed Opus 4.7 to some ancient JavaScript code [0] about projecting 3d to 2d and after searching Github repositories. It worked perfect with pan zoom in one shot after that.
No matter how hard I tried I couldn't get it to stack all the layers correctly. It must have remembered all the parts for projecting 3d to 2d because it could not figure out how to position the layers.
There is a ton of information burnt into the weights during training but it can not reason about it. When it does work well with spatial and temporal it is more slight of hand than being able to generalize.
People say, why not just do reinforcement learning? That can't generalize in the same way a LLM can. I'm thinking about doing the Rubik's Cube because if people can solve that it might open up solutions for working temporal and spatial problems.
Interesting (would like to hear more), but solving a Rubiks cube would appear to be a poor way to measure spatial understanding or reasoning. Ordinary human spatial intuition lets you think about how to move a tile to a certain location, but not really how to make consistent progress towards a solution; what's needed is knowledge of solution techniques. I'd say what you're measuring is 'perception' rather than reasoning.
William_BB 1 days ago [-]
> what's needed is knowledge of solution techniques
That's definitely in the training data
dataviz1000 19 hours ago [-]
> how to make consistent progress towards a solution
A 7 year old child can learn six sequences of a few moves and over a weekend solve the Rubik Cube. It is a solved algorithm something LLM should be very very good at. What it can't do is reason about spacial relationships.
Melatonic 2 days ago [-]
What about a model designed for robotics and vision? Seems like an LLM trained on text would inherently not be great for this.
DeepMinds other models however might do better?
snet0 2 days ago [-]
How are you handing the cube state to the model?
dataviz1000 2 days ago [-]
Does this answer the question?
Opus 4.6 got the cross and started to get several pieces on the correct faces. It couldn't reason past this. You can see the prompts and all the turn messages.
edit: I can't reply to message below. The point isn't can we solve a Rubik's Cube with a python script and tool calls. The point is can we get an LLM to reason about moving things in 3 dimensions. The prompt is a puzzle in the way that a Rubik's Cube is a puzzle. A 7 year old child can learn 6 moves and figure out how to solve a Rubik's Cube in a weekend, the LLM can't solve it. However, can, given the correct prompt, a LLM solve it? The prompt is the puzzle. That is why it is fun and interesting. Plus, it is a spatial problem so if we solve that we solve a massive class of problems including huge swathes of mathematics the LLMs can't touch yet.
libraryofbabel 1 days ago [-]
I wonder if the difficulties LLMs have with “seeing” complex detail in images is muddying the problem here. What if you hand it the cube state in text form? (You could try ascii art if you want a middle ground.)
If you want to isolate the issue, try getting the LLM itself to turn the images into a text representation of the cube state and check for accuracy. If it can’t see state correctly it certainly won’t be able to solve.
osti 2 days ago [-]
Can't they write a script to solve rubik cubes?
Jensson 1 days ago [-]
That doesn't test whether the model can follow and execute a dynamic plan reliably.
2 days ago [-]
holoduke 1 days ago [-]
I bet I can even do it with the smallest gemma 4 model using a prompt of max 500 characters.
Torkel 2 days ago [-]
*yet
0x62 2 days ago [-]
FWIW I've been experimenting with Three.js and AI for the last ~3 years, and noticed a significant improvement in 5.4 - the biggest single generation leap for Three.js specifically. It was most evident in shaders (GLSL), but also apparent in structuring of Three.js scenes across multiple pages/components.
It still struggles to create shaders from scratch, but is now pretty adequate at editing existing shaders.
In 5.2 and below, GPT really struggled with "one canvas, multiple page" experiences, where a single background canvas is kept rendered over routes. In 5.4, it still takes a bit of hand-holding and frequent refactor/optimisation prompts, but is a lot more capable.
Excited to test 5.5 and see how it is in practice.
CSMastermind 2 days ago [-]
> It still struggles to create shaders from scratch
Oh just like a real developer
accrual 2 days ago [-]
Much respect for shader developers, it's a different way of thinking/programming
Pym 2 days ago [-]
One struggle I'm having (with Claude) is that most of what it knows about Three.js is outdated. I haven't used GPT in a while, is the grass greener?
Have you tried any skills like cloudai-x/threejs-skills that help with that? Or built your own?
import 2 days ago [-]
Using Claude for the same context and it’s doing really well with the glsl. since like last September
vunderba 2 days ago [-]
I’ve had a lot of success using LLMs to help with my Three.js based games and projects. Many of my weird clock visualizations relied heavily on it.
It might not be a game engine, but it’s the de facto standard for doing WebGL 3D. And since it’s been around forever, there’s a massive amount of training data available for it.
Before LLMs were a thing, I relied more on Babylon.js, since it’s a bit higher level and gives you more batteries included for game development.
kingstnap 2 days ago [-]
The meshes look interesting, but the gameplay is very basic. The tank one seems more sophisticated with the flying ships and whatnot.
What's strange is that this Pietro Schirano dude seems to write incredibly cargo cult prompts.
Game created by Pietro Schirano, CEO of MagicPath
Prompt: Create a 3D game using three.js. It should be a UFO shooter where I control a tank and shoot down UFOs flying overhead.
- Think step by step, take a deep breath. Repeat the question back before answering.
- Imagine you're writing an instruction message for a junior developer who's going to go build this. Can you write something extremely clear and specific for them, including which files they should look at for the change and which ones need to be fixed?
-Then write all the code. Make the game low-poly but beautiful.
- Remember, you are an agent: please keep going until the user's query is completely resolved before ending your turn and yielding back to the user. Decompose the user's query into all required sub-requests and confirm that each one is completed. Do not stop after completing only part of the request. Only terminate your turn when you are sure the problem is solved. You must be prepared to answer multiple queries and only finish the call once the user has confirmed they're done.
- You must plan extensively in accordance with the workflow steps before making subsequent function calls, and reflect extensively on the outcomes of each function call, ensuring the user's query and related sub-requests are completely resolved.
torginus 2 days ago [-]
It's weird how people pep talk the AI - if my Jira tickets looked like this, I would throw a fit.
I guess these people think they have special prompt engineering skills, and doing it like this is better than giving the AI a dry list of requirements (fwiw, they might be even right)
mattgreenrocks 2 days ago [-]
It’s not surprising to me that the same crowd that cheers for the demise of software engineering skills invented its own notion of AI prompting skills.
Too bad they can veer sharply into cringe territory pretty fast: “as an accomplished Senior Principal Engineer at a FAANG with 22 years of experience, create a todo list app.” It’s like interactive fanfiction.
dr_kiszonka 2 days ago [-]
That's quite similar to the AI Studio's prompt. You are a world-class frontend engineer...
eiksjs 2 days ago [-]
Indeed it is so utterly cringe.
eloisant 2 days ago [-]
Yes, this is cargo cult.
This remind me of so called "optimization" hacks that people keep applying years after their languages get improved to make them unnecessary or even harmful.
Maybe at one point it helped to write prompts in this weird way, but with all the progress going on both in the models and the harness if it's not obsolete yet it will soon be. Just crufts that consumes tokens and fills the context window for nothing.
irthomasthomas 2 days ago [-]
> Think Step By Step
What is this, 2023?
I feel like this was generated by a model tapping in to 2023 notions of prompt engineering.
Claude would check to see if it had any breathing skills, if it doesn't find any it would start installing npm modules for breathing.
bredren 2 days ago [-]
The prompt did not specify advanced gameplay.
I do not see instructions to assist in task decomposition and agent ~"motivation" to stay aligned over long periods as cargo culting.
See up thread for anecdotes [1].
> Decompose the user's query into all required sub-requests and confirm that each one is completed. Do not stop after completing only part of the request. Only terminate your turn when you are sure the problem is solved.
I see this as a portrayal of the strength of 5.5, since it suggests the ability to be assigned this clearly important role to ~one shot requests like this.
I've been using a cli-ai-first task tool I wrote to process complex "parent" or "umberella" into decomposed subtasks and then execute on them.
This has allowed my workflows to float above the ups and downs of model performance.
That said, having the AI do the planning for a big request like this internally is not good outside a demo.
Because, you want the planning of the AI to be part of the historical context and available for forensics due to stalls, unwound details or other unexpected issues at any point along the way.
It’s like all these things though - it’s not a real production worthy product. It’s a super-demo. It looks amazing until you realize there’s many months of work to make it something of quality and value.
I think people are starting to catch on to where we really are right now. Future models will be better but we are entering a trough of dissolution and this attitude will be widespread in a few months.
ZeWaka 2 days ago [-]
I personally don't think the gameplay itself is that impressive.
gregpred 2 days ago [-]
[flagged]
6thbit 2 days ago [-]
Mythos 5.5
SWE-bench Pro 77.8%* 58.6%
Terminal-bench-2.0 82.0% 82.7%*
GPQA Diamond 94.6%* 93.6%
H. Last Exam 56.8%* 41.4%
H. Last Exam (tools) 64.7%* 52.2%
BrowseComp 86.9% 84.4% (90.1% Pro)*
OSWorld-Verified 79.6%* 78.7%
Mythos is only real when it's actually available. If you're using Opus 4.7 right now, you know how incredibly nerfed the Opus autonomy is in service of perceived safety. I'm not so confident this will be as great as Anthropic wants us to believe..
XCSme 2 days ago [-]
They mentioned in their release page, that the Claude team noticed memorization of the SWE-bench test, so the test is actually in the training data.
Any static benchmark older than 12-18 months is basically worthless, because the content will have spread all over the internet and have found its way into the latest model's training set.
William_BB 1 days ago [-]
Good luck arguing with SWE benchmark purists
kaonashi-tyc-01 2 days ago [-]
I did some study on Verified, not Pro, but Mythos number there rings a lot of questions on my end.
If you look at the SWEBench official submissions: https://github.com/SWE-bench/experiments/tree/main/evaluatio..., filter all models after Sonnet 4, and aggregate ALL models' submission across 500 problems, what I found that the aggregated resolution rate is 93% (sharp).
Mythos gets 93.7%, meaning it solves problems that no other models could ever solve. I took a look at those problems, then I became even more suspicious, for the remaining 7% problems, it is almost impossible to resolve those issues without looking at the testing patch ahead of time, because how drastically the solution itself deviates from the problem statement, it almost feels like it is trying to solve a different problem.
Not that I am saying Mythos is cheating, but it might be too capable to remember all states of said repos, that it is able to reverse engineer the TRUE problem statement by diffing within its own internal memory. I think it could be a unique phenomena of evaluation awareness. Otherwise I genuinely couldn't think of exactly how it could be this precise in deciphering such unspecific problem statements.
Yep, I read this blog. What confuses me is that Anthropic doesn't seem to be bothered by this study and keeps publishing Verified results.
That is what gets me curious in the first place. The fact Mythos scored so high, IMO, exposes some issues with this model: it is able to solve seemingly impossible to solve problems.
Without cheating allegation, which I don't think ANT is doing, it has to be doing some fortune telling/future reading to score that high at all.
alansaber 2 days ago [-]
A single benchmark is meaningless, you always get quirky results on some benchmarks.
silvertaza 2 days ago [-]
Still huge hallucination rate, unfortunately at 86%. To compare, Opus sits at 36%.
grok is 17%? And that's the lowest, most models are like 80%+?
While hallucination is probably closer to 100% depending on the question. This benchmark makes no sense.
Jensson 1 days ago [-]
> While hallucination is probably closer to 100% depending on the question.
But the benchmark didn't ask those questions, and it seems grok is very well at saying it doesn't know the answer otherwise.
elAhmo 2 days ago [-]
No one serious uses grok.
ajdegol 2 days ago [-]
@grok is this true?
for_i_in_range 1 days ago [-]
This comment deserves more love
NamlchakKhandro 1 days ago [-]
no
RALaBarge 2 days ago [-]
YMMV but Grok 4.1 Fast can usually find via static analysis a few things that other models dont seem to catch with the same prompt
d0gsg0w00f 2 days ago [-]
Why not? Honest question.
phillipcarter 23 hours ago [-]
Because the Grok models offer nothing different in serious contexts from the other leading models which don't come with a heaping pile of bad baggage.
MagicMoonlight 1 days ago [-]
It makes sense. Grok is taught to answer the question, regardless of how explicit or extreme it is. These other models are taught to suppress any wrongthink. That's going to make it hard to answer things correctly. If you've been told to answer something incorrectly because it's wrong, then you'll have to make up an answer.
simianwords 2 days ago [-]
There's something off with this because Haiku should not be that good.
I've been very curious about that too. I wonder if it's actually much better at admitting when it doesn't know something, because it thinks it's a "dumber model". But I haven't played with this at all myself.
jwpapi 2 days ago [-]
The hallucination benchmark is hallucinating
dakolli 2 days ago [-]
This indicates they want this behavior, they know the person asking the question probably doesn't understand the problem entirely (or why would they be asking), so they'd prefer a confident response, regardless of outcomes, because the point is to sell the technologies competency (and the perception thereof), not the capabilities, to a bunch of people that have no clue what they're talking about.
LLMs will ruin your product, have fun trusting a billionaires thinking machine they swear is capable of replacing your employees if you just pay them 75% of your labor budget.
tedsanders 2 days ago [-]
We don't want hallucinations either, I promise you.
A few biased defenses:
- I'll note that this eval doesn't have web search enabled, but we train our models to use web search in ChatGPT, Codex, and our API. I'd be curious to see hallucination rates with web search on.
- This eval only measures binary attempted vs did not attempt, but doesn't really reward any sort of continuous hedging like "I think it's X, but to be honest I'm not sure."
- On the flip side, GPT-5.5 has the highest accuracy score.
- With any rate over 1% (whether 30% or 70%), you should be verifying anything important anyway.
- On our internal eval made from de-identified ChatGPT prompts that previously elicited hallucinations, we've actually been improving substantially from 5.2 to 5.4 to 5.5. So as always, progress depends on how you measure it.
- Models that ask more clarifying questions will do better on this eval, even if they are just as likely to hallucinate after the clarifying question.
Still, Anthropic has done a great job here and I hope we catch up to them on this eval in the future.
calf 2 days ago [-]
On ChatGPT 5.3 Plus subscription I find that long informal chats tend to reveal unsatisfactory answers and biases, at this point after 10 rounds of replies I end up having to correct it so much that it starts to agree with my initial arguments full circle. I don't see how this behavior is acceptable or safe for real work. Like are programmers and engineers using LLMs completely differently than I'm doing, because the underlying technology is fundamentally the same.
William_BB 1 days ago [-]
Totally agreed, this has been and will continue to be a problem for all existing models.
> Like are programmers and engineers using LLMs completely differently than I'm doing
No, but the complexity of the problem matters. Lots of engineers doing basic CRUD and prototyping overestimate the capabilities of LLMs.
mudkipdev 2 days ago [-]
This is 3x the price of GPT-5.1, released just 6 months ago. Is no one else alarmed by the trend? What happens when the cheaper models are deprecated/removed over time?
Night_Thastus 2 days ago [-]
This is entirely expected. The low prices of using LLMs early on was totally and completely unsustainable. The companies providing such services were (and still are) burning money by the truckload.
The hope is to get a big userbase who eventually become dependent on it for their workflow, then crank up the price until it finally becomes profitable.
The price for all models by all companies will continue to go up, and quickly.
oezi 2 days ago [-]
I recently looked at this a bit but came away with the impression that at least on API pricing the models should be very profitable considering primarily the electricity cost.
Subscriptions and free plans are the thing that can easily burn money.
Night_Thastus 2 days ago [-]
The physical buildouts and massive R+D spending is the big part.
viktorcode 1 days ago [-]
> This is entirely expected. The low prices of using LLMs early on was totally and completely unsustainable.
Do you think this is true for DeepSeek as well?
Night_Thastus 22 hours ago [-]
Depends on the level of interest the state takes in it. But I would wager yes, it's unsustainable currently.
subhobroto 2 days ago [-]
> The price for all models by all companies will continue to go up, and quickly.
This might entirely be true but I'm hoping that's because the frontier models are just actually more expensive to run as well.
Said another way, I would hope, the price of GPT-5.5 falls significantly in a year when GPT-5.8 is out.
Someone else on this post commented:
> For API usage, GPT-5.5 is 2x the price of GPT-5.4, ~4x the price of GPT-5.1, and ~10x the price of Kimi-2.6.
Having used Kimi-2.6, it can go on for hours spewing nonsense. I personally am happy to pay 10x the price of something that doesn't help me, for something else that does, in even half the time.
michaelcampbell 1 hours ago [-]
> What happens when the cheaper models are deprecated/removed over time?
Fewer people will use it.
energy123 2 days ago [-]
Look a cost per intelligence or cost per task instead of cost per token.
yokoprime 2 days ago [-]
How do I reliably measure 1 unit of intelligence?
wellthisisgreat 2 days ago [-]
In pelicans, obviously
ulimn 2 days ago [-]
Isn't the outcome / solution for a given task non-deterministic? So can we reliably measure that?
foota 2 days ago [-]
Yes, sort of. Generally you can measure the pass rate on a benchmark given a fixed compute budget. A sufficiently smart model can hit a high pass rate with fewer tokens/compute. Check out the cost efficiency on https://artificialanalysis.ai/ (say this posted here the other day, pretty neat charts!)
genericresponse 2 days ago [-]
Statistically. Do many trials and measure how often it succeeds/fails.
kridsdale1 1 days ago [-]
Aka a benchmark.
torginus 2 days ago [-]
This is the only correct take. The only metric that matters is cost per desired outcome.
dns_snek 2 days ago [-]
Repetition and statistics, if you have $1000++ you didn't need anyway.
throwuxiytayq 2 days ago [-]
It's much easier to measure a language model's intelligence than a human's because you can take as many samples as you want without affecting its knowledge. And we do measure human intelligence.
Schlagbohrer 2 days ago [-]
As others have mentioned you're ignoring the long tail of open-weights models which can be self hosted. As long as that quasi-open-source competition keeps up the pace, it will put a cap on how expensive the frontier models can get before people have to switch to self-hosting.
That's a big if, though. I wish Meta were still releasing top of the line, expensively produced open-weights models. Or if Anthropic, Google, or X would release an open mini version.
Which, unfortunately is still slow unusable garbage compared to fronteir models.
deaux 1 days ago [-]
Not at all, it's more than enough for a large range of tasks. As for slow, that's just a function of how much compute you throw at it, which you actually control unlike with closed weights models.
kridsdale1 1 days ago [-]
Depends on your hardware.
dannyw 2 days ago [-]
It's far more meaningful to look at the actual cost to successfully something. The token efficiency of GPT-5.5 is real; as well as it just being far better for work.
operatingthetan 2 days ago [-]
We know they cost much more than this for OpenAI. Assume prices will continue to climb until they are making money.
horiap 2 days ago [-]
How do we know that? There is a large gap between API pricing for SOTA models and similarly sized OSS models hosted by 3rd party providers.
Sure, they’re distilled and should be cheaper to run but at the same time, these hosting providers do turn a margin on these given it’s their core business, unless they do it out of the kindness of their heart.
So it’s hard for me to imagine these providers are losing money on API pricing.
beering 2 days ago [-]
source? There have also been a bunch of people here saying the opposite
dandaka 2 days ago [-]
SOTA models get distilled to open source weights in ~6 months. So paying premium for bleeding edge performance sounds like a fair compensation for enormous capex.
typs 2 days ago [-]
GPT-4 cost 6x on input and 2x output tokens when it was released as compared go GPT-5.5
jeffybefffy519 18 hours ago [-]
Surely its just the same model, just allowed to do more work...??
kuatroka 2 days ago [-]
Not really a big problem. Switch to KIMI, Qwen, GLM. You’ll get 95% quality of GPT or Anthropic for a 10th of a price. I feel like the real dependency is more mental, more of a habit but if you actually dip your toes outside OpenAI, Anthropic, Gemini from time to time, you realise that the actual difference in code is not huge if prompted in a good way. Maybe you’ll have to tell it to do something twice and it won’t be a one shot, but it’s really not an issue at all.
Mashimo 1 days ago [-]
I use glm and I like it, not they also increased the price to 18 usd /month.
I think Kimi and qwen are similar?
ramon156 1 days ago [-]
Wasn't there a limited offer? I wouldn't call that "increasing the prices"
Mashimo 1 days ago [-]
I think both? Limited offer stopped and price increase. But the point was that is now a similar price to ChatGPT and Claude code, and not 10th of the price.
nubg 2 days ago [-]
God I hope this is true.
Where can i find up to date resources on open source models for coding?
Bit of a hype madhouse whenever a new model is released, but it's pretty easy to filter out simple hype from people showing reproducible experiments, specific configs for llama.cpp, github links etc.
msdz 2 days ago [-]
Such an increase tracks the company's valuation trend, which they constantly, somehow have to justify (let alone break even on costs).
thrawa8387336 2 days ago [-]
Apparently the cost/price is 20x in the major providers. Not clear how it is a business
scotty79 1 days ago [-]
When technology settles rent seeking beancounters will squeeze out of this the last drop of value they can. In theory it just needs to be cheaper than human doing the same job. In practice it will have to be cheaper than a human using open source model on his own hardware, that can do the job.
applfanboysbgon 2 days ago [-]
If there's a bingo card for model releases, "our [superlative] and [superlative] model yet" is surely the free space.
tom1337 2 days ago [-]
Do "our [superlative] and [superlative] [product] yet" and you have pretty much every product launch
SequoiaHope 2 days ago [-]
I love when Apple says they’re releasing their best iPhone yet so I know the new model is better than the old ones.
That's at least genuine to some degree. Like, ok, good to know it's not officially a step back... But stuff like "smallest notch ever in an iPhone" is outright misleading consumers when there are other brands out there that easily beat them.
SequoiaHope 15 hours ago [-]
It’s genuine but hilarious to consider the alternative where a new iPhone is not quite as good as the old model and apple states as much.
xnx 2 days ago [-]
"our newest and most expensive model yet"
2 days ago [-]
wiseowise 2 days ago [-]
"Best iPhone ever"
ertgbnm 2 days ago [-]
can't wait for "our worst and dumbest model yet"
Nition 2 days ago [-]
Apple should have used that one for the 2016 MacBook.
vthallam 2 days ago [-]
This model is great at long horizon tasks, and Codex now has heartbeats, so it can keep checking on things. Give it your hardest problem that would take hours with verifiable constraints, you will see how good this is:)
*I work at OAI.
spaceman_2020 1 days ago [-]
Is there any task that actually doesn't require human intervention in-between, even if its just to setup stuff?
Like I will get Opus to make me an app but it will stop in between because I need to setup the db and plug in the API keys and Opus really can't do that on its own yet
furyofantares 40 minutes ago [-]
Porting large amount of code.
stingraycharles 1 days ago [-]
> Is there any task that actually doesn't require human intervention in-between, even if its just to setup stuff?
The goal is none. The current situation: everything that matters requires human intervention.
I think the end situation will be that LLMs will be able to perform decently well in a highly controlled and predictable environment.
leodavi 20 hours ago [-]
> in a highly controlled and predictable environment
Why this constraint? A common sentiment I see online (sorry, to group you in) is "[tool] will be capable, actually, but only in a context that trivializes its usefulness."
I think modern post-training like RLVR + inference-time output token scaling can _probably_ scale so the agents can solve any computable task, even when placed in noisy or misconfigured environments. But it won't be economical for a long while. But it already seems largely capable of that today.
bkyan 2 days ago [-]
Sorry, what is "heartbeats", exactly?
gurjeet 2 days ago [-]
> Today we launched heartbeats in Codex: automations that maintain context inside a single thread over time.
Could be a great feature, can't wait to test! Tired of other models (looking at you Opus) constantly stuck mid-task lately.
winrid 2 days ago [-]
Interesting, I just had opus convert a 35k loc java game to c++ overnight (root agent that orchestrated and delegated to sub agents) and woke up and it's done and works.
What plan are you on? I'm starting to wonder if they're dynamically adjusting reasoning based on plan or something.
gck1 2 days ago [-]
I'm on max 5x and noticed this too. I don't use built-in subagents but rather full Claude session that orchestrates other full claude sessions. Worker agents that receive tasks now stop midway, they ask for permission to continue. My "heartbeat" is basically "status. One line" message sent to the orchestrator.
Opus 4.6 worker agents never asked for permission to continue, and when heartbeat was sent to orchestrator, it just knew what to do (checked on subagents etc). Now it just says that it waits for me to confirm something.
winrid 1 days ago [-]
Weird. I don't have this behavior, although I did with codex and 5.4 haha. I bet the providers are playing with settings underneath and different users are routed to different deployments, or they're secretly routing us to different models under load.
adamandsteve 2 days ago [-]
This has to be bait.
azan_ 2 days ago [-]
Why?
winrid 1 days ago [-]
what?
adamandsteve2 1 days ago [-]
Because there’s no way in hell it can rewrite a game with 35k loc perfectly lol, link the codebase or it didn’t happen.
winrid 22 hours ago [-]
I'll be launching the game in a couple months so you can see it then :)
There are bugs, it doesn't work perfectly, but that's just part of testing and refinement at this point.
My initial prompt was just: "let's work on converting this java game to c++ using panda3d. you're a panda3d c++ expert. you will be the agent that owns the project, creating the plan, and the delegating each step to sub-agents that create each system in the correct order."
it created like 17 different tasks and sub agents and opus 4.7 orchestrated it. I did personally validate which rendering engine would be good for the project etc first.
frotaur 2 days ago [-]
I've been using the /ralph-loop plugin for claude code, works well to keep the model hammering at the task.
dannyw 2 days ago [-]
It's genuinely so great at long horizon tasks! GPT-5.5 solved many long-horizon frontier challenges, for the first time for an AI model we've tested, in our internal evals at Canva :) Congrats on the launch!
brcmthrowaway 2 days ago [-]
Can we not do growth hacking here?
RALaBarge 2 days ago [-]
We totally agree.
That's what I've been heads down, HUNGRY, working on, looking for investors and founding engineers pst: https://heymanniceidea.com (disclaimer: I am not associated with heymanniceidea.com)
smallerize 2 days ago [-]
HN is owned by a startup accelerator and venture capital firm. They do growth hacking on the front page. And you probably know that since your throwaway account is several years old.
2 days ago [-]
thereeldeel 1 days ago [-]
Will Codex App support new context window, rather than compaction, for "unrelated" sub-tasks during long horizon tasks?
aliljet 2 days ago [-]
I've found myself so deeply embedded in the Claude Max subscription that I'm worried about potentially makign a switch. How are people making sure they stay nimble enough not to get trarpped by one company's ecosystem over another? For what it's worth, Opus 4.7 has not been a step up and it's come with an enormously higher usage of the subscription Anthropic offers making the entire offering double worse.
gck1 2 days ago [-]
Start building your own liteweight "harness" that does things you need. Ignore all functionality of clients like CC or Codex and just implement whatever you start missing in your harness.
You can replace pretty much everything - skills system, subagents, etc with just tmux and a simple cli tool that the official clients can call.
Oh and definitely disable any form of "memory" system.
Essentially, treat all tooling that wraps the models as dumb gateways to inference. Then provider switch is basically a one line config change.
nunez 2 days ago [-]
lol this is literally the same advice us ancient devops nerds were telling others back when ci/cd was new
write scripts that work anywhere and have your ci/cd pipeline be a "dumb" executor of those scripts. unless you want to be stuck on jenkins forever.
what's old is new again!
TacticalCoder 2 days ago [-]
> You can replace pretty much everything - skills system, subagents, etc with just tmux and a simple cli tool that the official clients can call.
I'm very interest by this. Can you go a bit more into details?
ATM for example I'm running Claude Code CLI in a VM on a server and I use SSH to access it. I don't depend on anything specific to Anthropic. But it's still a bit of a pain to "switch" to, say, Codex.
How would that simple CLI tool work? And would CC / Codex call it?
RALaBarge 2 days ago [-]
Check out github.com/ralabarge/beigebox -- OSS AI Harness, started as a way to save all of my data but has agentic features, MCP server, point it at any endpoint (or use any front end with it as well, transparent middleware)
So far what I am finding is that you just get the basics working and then use the tool and inference to improve the tool.
Initially I read it because just it was interesting but it has ended up being the harness I have stuck with - pi is well designed, nicely extensible and supports many model provider APIs. Though sadly gemini and claude's subscriptions can't really be used with it anymore thanks to openclaw.
gck1 2 days ago [-]
I wish I had lower standards towards sharing absolute AI slop, then I could just drop a link to my implementation. But since I don't, let me just describe it. I essentially had claude build the initial version in a single session which I've been extending as I noticed any gaps in my process.
First, you need an entrypoint that kicks things off. You never run `claude` or `codex`, you always start by running `mycli-entrypoint` that:
1. Creates tmux session
2. Creates pane
3. Spawns claude/codex/gemini - whichever your default configured backend is
4. Automatically delivers a prompt (essentially a 'system message') to that process via tmux paste telling it what `mycli` is, how to use it, what commands are available and how it should never use built-in tools that this cli provides as alternatives.
After that, you build commands in `mycli` that CC/Codex are prompted to call when appropriate.
For example, if you want a "subagent", you have a `mycli spawn` command that takes a role (just preconfigured markdown file living in the same project), backend (claude/codex/...) and a model. Then whenever CC wants to spawn a subagent, it will call that command instead, which will create a pane, spawn a process and return agent ID to CC. Agent ID is auto generated by your cli and tmux pane is renamed to that so you can easily match later.
Then you also need a way for these agents to talk to each other. So your cli also has a `send` command that takes agent ID and a message and delivers it to the appropriate pane using automatically tracked mapping of pane_id<>agent_id.
Claude and codex automatically store everything that happens in the process as jsonl files in their config dirs. Your cli should have adapters for each backend and parse them into common format.
At this point, your possibilities are pretty much endless. You can have a sidecar process per agent that say, detects when model is reaching context window limit (it's in jsonl) and automatically send a message to it asking it to wrap up and report to a supervisor agent that will spawn a replacement.
I also don't use "skills" because skills are a loaded term that each of the harnesses interprets and loads/uses differently. So I call them "crafts" which are again, just markdown files in my project with an ID and supporting command `read-craft <craft-id>`. List of the available "crafts" are delivered using the same initialization message that each agent gets. If I like any third party skill, I just copy it to my "crafts" dir manually.
My implementation is an absolute junk, just Python + markdown files, and I have never looked at the actual code, but it works and I can adapt it to my process very easily without being dependent on any third party tool.
type4 2 days ago [-]
I have a directory of skills that I symlink to Codex/Claude/pi. I make scripts that correspond with them to do any heavy lifting, I avoid platform specific features like Claude's hooks. I also symlink/share a user AGENTS.md/CLAUDE.md
MCPs aren't as smooth, but I just set them up in each environment.
threecheese 2 days ago [-]
Anecdotally, I get the same wall time with my Max x5 (100$) and my ChatGPT Teams (30$) subscriptions.
chis 2 days ago [-]
It's surprisingly simple to switch. I mean both products offer basically identical coding CLI experiences. Personally I've been paying for Claude max $100, and ChatGPT $20, and then just using ChatGPT to fill in the gaps. Specifically I like it for code review and when Claude is down.
dannyw 2 days ago [-]
Try GPT-5.5 as your daily driver for a bit. It felt a lot smarter, reliable, and I was much more productive with it.
zaptrem 1 days ago [-]
I bumped from $20 -> $100 today but the Codex CLI lacking code rewind and "you can change files but ask me every time" mode from Claude Code is quite annoying. Sometimes I want to code, not vibe code lol.
hx8 2 days ago [-]
I use Open Code as my harness. It's open source, bring your own API Key or OAuth token or self-hosted model. I've jumped from Opus 4.6 to Opus 4.7 to GPT 5.5 in the last 7 days. No big deal, intelligence is just a commodity in 2026.
The actual harness is great, very hackable, very extendable.
NoveltyEngine 21 hours ago [-]
Does Anthropic not actively ban people using oauth tokens in non-claude-code harnesses?
zackify 2 days ago [-]
I use pi.dev.
I get openai team plan at work.
Claude enterprise too.
I have openrouter for myself.
I use minimax 2.7. Kimi 2.6. And gpt 5.5 and opus 4.7. I can toggle between them in an open source interface that's how I stay able to not be trapped.
Minimax is so cheap and for personal stuff it works fine. So I'm always toggling between the nre releases
peheje 1 days ago [-]
what about just personal stuff in a syncing interface, what do you use for that?
zackify 22 hours ago [-]
What's a syncing interface?
beering 2 days ago [-]
What is the switching cost besides launching a different program? Don’t you just need to type what you want into the box?
cube2222 2 days ago [-]
Small tip, at least for now you can switch back to Opus 4.6, both in the ui and in Claude Code.
rane 2 days ago [-]
This might be the opposite of staying nimble as my workflows are quite tied to Claude Code specifically, however I've been experimenting with using OpenAI models in CC and it works surprisingly well.
babelfish 2 days ago [-]
I use Conductor which lets me flip trivially between OpenAI/Anthropic models
dannyw 2 days ago [-]
It’s good to just keep trying different ones from time to time.
dogline 2 days ago [-]
Except for history, I don’t find much that stops you from switching back and forth on the CLI. They both use tools, each has a different voice, but they both work. Have it summarize your existing history into a markdown file, and read it in with any engine.
The APIs are pretty interchangeable too. Just ask to convert from one to the other if you need to.
pdntspa 2 days ago [-]
As a rule I've been symlinking or referencing generic "agents" versions of claude workflow files instead of placing those files directly in claude's purview
AGENTS.md / skills / etc
karlosvomacka 2 days ago [-]
use copilot and have access to all models
dheera 2 days ago [-]
Coding models are effectively free. They are capable of making money and supporting themselves given access to the right set of things. That is what I do
basisword 2 days ago [-]
I switched a couple of weeks ago just to see how it went. Codex is no better or worse. They’re both noticeably better at different things. I burn through my tokens much much faster on Codex though. For what it’s worth I’m sticking with Codex for now. It seems to be significantly better at UI work although has some really frustrating bad habits (like loading your UI with annoying copywriting no sane person would ever do).
_alternator_ 2 days ago [-]
> One engineer at NVIDIA who had early access to the model went as far as to say: "Losing access to GPT‑5.5 feels like I've had a limb amputated.”
This quote is more sinister than I think was intended; it likely applies to all frontier coding models. As they get better, we quickly come to rely on them for coding. It's like playing a game on God Mode. Engineers become dependent; it's truly addictive.
This matches my own experience and unease with these tools. I don't really have the patience to write code anymore because I can one shot it with frontier models 10x faster. My role has shifted, and while it's awesome to get so much working so quickly, the fact is, when the tokens run out, I'm basically done working.
It's literally higher leverage for me to go for a walk if Claude goes down than to write code because if I come back refreshed and Claude is working an hour later then I'll make more progress than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
Anyway, it continues to make me uneasy, is all I'm saying.
noosphr 2 days ago [-]
LLMs upend a few centuries of labor theory.
The current market is predicated on the assumption that labor is atomic and has little bargaining power (minus unions). While capital has huge bargaining power and can effectively put whatever price it wants on labor (in markets where labor is plentiful, which is most of them).
What happens to a company used to extracting surplus value from labor when the labor is provided by another company which is not only bigger but unlike traditional labor can withhold its labor indefinitely (because labor is now just another for of capital and capital doesn't need to eat)?
Anyone not using in house models is signing up to find out.
matheusmoreira 2 days ago [-]
This is our one chance to reach the fabled post-scarcity society. If we fail at this now, we'll end up in a totalitarian cyberpunk dystopia instead.
nkozyra 2 days ago [-]
I don't want to spoil it for you, but ...
TurdF3rguson 2 days ago [-]
But cyberpunk is the best kind of dystopia!
onemoresoop 2 days ago [-]
Sorry for my foul language but I think we will turn into cybershit if things go bad.
mikercampbell 2 days ago [-]
Manufactured Scarcity is the new post-scarcity
kridsdale1 1 days ago [-]
At least NFTs failed hard.
ijeifnekfjekd 2 days ago [-]
What? In what way does companies becoming dependent on AI chatbots will solve the world-spanning problem of resource scarcity?
The hell?
juleiie 2 days ago [-]
The idea is that cheap and readily available and upgradeable intelligence is going to massively increase our purchasing power and what everyone can order for the same cost basically.
If artificial doctors are cents on hour then you can see how that changes our behaviors and level of life.
But on the other hand from the other direction there is a wage decrease incoming from increased competition at the same time. What happens if these two forces clash? Will cheap labour allow us to buy anything for pennies or will it just make us unable to make a single penny?
In my view the labour will fundamentally shift with great pain and personal tragedies to the areas that are not replaceable by AI (because no one wants to watch robots play chess). Such as sports, entertainment and showmanship. Handcrafted goods. Arts. Attention based economy. Self advertisement. Digital prostitution in a very broad sense.
However before it gets there it will be a great deal of strife and turmoil that could plunge the world into dark ages for a while at least. It is unlikely for our somewhat politically rigid society to adapt without great deal of pain. Additionally I am not sure if hypothetical future attention based society could be a utopia. You could have to mount cameras in your house so other people see you at all times for amusement just to have any money at all. We will probably forever need to sell something to someone and I am unsettled by ideas what can we sell if we cannot sell our hard work.
Someone who sees the roads ahead should now make preparations at government level for this shock but it will come too fast and with people at the steering wheel that don’t exactly care.
krainboltgreene 2 days ago [-]
"Extremely cheap sentience that cannot disobey will solve all our problems" is such an insane sentiment I see far too often.
juleiie 2 days ago [-]
Useful intelligence does not require sentience.
As far as I know, none of LLM models are sentient nor are possible to be in the near future.
I also do not assume so called AGI to be sentient. Merely to be a human level skilled intellectual worker.
In absence of ethical dilemmas of this calibre for the foreseeable future let’s focus on the economy side of things in this particular comment chain.
krainboltgreene 2 days ago [-]
It must very comforting to be able to decided a "human level worker" isn't sentient.
It makes things so clean.
juleiie 2 days ago [-]
LLMs cannot possess consciousness for three reasons: they execute as a sequence of Transformer blocks with extremely limited information exchange, these blocks are simple feed-forward networks with no recurrent connections, and the computer hardware follows a modular design.
Shardlow & Przybyła, "Deanthropomorphising NLP: Can a Language Model Be Conscious?" (PLOS One, 2024)
Nature: "There is no such thing as conscious artificial intelligence" (2025)
They argue that the association between consciousness and LLMs is deeply flawed, and that mathematical algorithms implemented on graphics cards cannot become conscious because they lack a complex biological substrate. They also introduce the useful concept of "semantic pareidolia" - we pattern-match consciousness onto things that merely talk convincingly.
They are making a strong argument and I think they are correct. But really these are two different things as I said originally.
1 days ago [-]
krainboltgreene 2 days ago [-]
You think I'm arguing that LLM's are sentient. I'm not. I never mentioned LLMs.
juleiie 2 days ago [-]
You are making as strawman about sentience when I was talking about economical impact of abundant intelligence. I should just ignore it but I was curious yet you have nothing valuable to say aside from common misconceptions conflating the two. Thanks for trolling I guess
krainboltgreene 19 hours ago [-]
I get that I was being poetically vague (but not subtle), but it's really silly to imagine an argument from me and then when you're told that wasn't what I was alluding to you tell me I'm trolling.
datadrivenangel 2 days ago [-]
If we used sentience to work towards solving our problems we could massively increase the human standard of living.
Which we have already done with regular computers! The problem is that competition means that we can't always have nice things.
mxkopy 2 days ago [-]
We could also literally have Star Trek. Think of all the scientific discoveries we could make if we had armies of scientists the size of our labor force.
But we will have to (painfully) shed our current hierarchies before that comes to pass.
NamlchakKhandro 1 days ago [-]
star trek mythology talks about having to go through epic level civil war before reach the utopia in the tv series.
mxkopy 1 days ago [-]
OP says there are two futures, digital prostitution or slavery. If we truly believe that it will be a self-fulfilling prophecy.
On the other hand we could have Star Trek.
juleiie 2 days ago [-]
Maybe so but humans have this strange primal need to hoard resources.
Probably a remnant from prehistoric times when it was a matter of life and death.
Will we ever be able to overcome this basic instinct that made capitalism such an unstoppable force? Will this ancient PTSD be ever cured?
mxkopy 1 days ago [-]
I find the insinuation that mental illness is a fundamental part of the human experience to be deeply revolting. There is no excuse for hoarders and rapists.
1 days ago [-]
krainboltgreene 2 days ago [-]
Man if only there was a singular episode that covered this exact topic in Star Trek and resolved that no, actually slavery wasn't any different for artificial life.
linkregister 2 days ago [-]
Star Trek was entertaining television. There was also an episode where the ship's doctor made love to a ghost.
krainboltgreene 2 days ago [-]
True, nothing to learn here. No introspection has ever resulted from media analysis.
wiseowise 1 days ago [-]
> The idea is that cheap and readily available and upgradeable intelligence is going to massively increase our purchasing power and what everyone can order for the same cost basically.
Seriously? You really don’t see who wins from this and who doesn’t?
> If artificial doctors are cents on hour then you can see how that changes our behaviors and level of life.
Yes, hundreds of thousands lose jobs and a couple of neuro surgeons become multimillionaires.
Okay, I see from the rest of the comment that we understand each other where it goes.
CamperBob2 2 days ago [-]
Chatbots, no. Robots, maybe.
inquirerGeneral 2 days ago [-]
[dead]
apical_dendrite 2 days ago [-]
Just a year ago, Elon Musk was gleefully destroying the US government agency that provides food and medicine for many of the poorest, most desperate people on earth. He was literally tweeting about missing out on great parties to put USAID into the "wood chipper".
The tech overlords don't even want to spend a minuscule percentage of the federal budget helping starving people, even when it benefits the US. They are not going to give us a post-scarcity society.
hackable_sand 2 days ago [-]
Weird predicament you've set for yourself there.
Good luck with whatever you got going on.
mikestorrent 2 days ago [-]
I am still trying to figure out the business model of open weights. Like... it's wonderful that there are open LLMs, super happy about it, good for everyone, but why are there these? What is the advantage to their companies to release them?
pzo 2 days ago [-]
IMHO this is only temporary, china buying themselves some time and want to make sure none of US models get entrenched in their position in the next few years (also putting pressure on US AI companies bleeding them)
The same way like Windows got entrenched everywhere even though linux desktop is pretty good even for non-tech savvy people and free.
Chaosvex 2 days ago [-]
> even though linux desktop is pretty good even for non-tech savvy people
Let's not get carried away.
usef- 2 days ago [-]
A stock Fedora install has more UI consistency and cleanliness than Windows these days.
Non-technical people are easier to please in this regard than moderate-technical people: a good browser and safe, gui "app store" are enough.
snypher 2 days ago [-]
My grandma just clicks on the red fox and does whatever online. A lot of people don't use any software outside of the browser, so it's pretty good-enough I guess.
kridsdale1 1 days ago [-]
The business case for ChromeOS (Linux)
blakewatson 2 days ago [-]
Seems like people don't like this comment, but I chuckled. Nice one.
Chaosvex 1 days ago [-]
I was completely (well, mostly) serious, too. I think technical people tend to downplay friction because it doesn't really register to them, or they have too much faith in the average person's computer skills.
The average non-technical person is going to be stumped by the first "lock file found, cannot upgrade" error.
tlamponi 20 hours ago [-]
I cannot even install a Windows system with a local account anymore without having to open the terminal and enter some obscure commands.
A modern Debian or Fedora with KDE is a breeze otoh, I set that up for relatives and my SO, and they're all more than happy with it. Bugs exist, like in all software, but the friction is way less compared to wrangling with Windows nowadays.
Chaosvex 17 hours ago [-]
Yep but you can also bet that they're not going to use a local account. They'll link it all to Microsoft.
kridsdale1 1 days ago [-]
How many users of modern Linux can thrive with ZERO terminal use sessions? That’s the bar.
nullsanity 2 days ago [-]
[dead]
renjimen 2 days ago [-]
Downward pressure on proprietary model pricing until a lab can catch up. Also good for hiring talent (who love OSS).
iterateoften 2 days ago [-]
Cultural influence is another benefit. China is securing its sphere of influence as well as keeping us ai in check.
bloppe 2 days ago [-]
It's analogous to open-source software, which never had an obvious economic incentive either, although training an LLM necessary costs money whereas developing an OSS project might only cost time, which people are probably more likely to give up.
mikestorrent 2 days ago [-]
Yeah, but open-source software could have been me in the garage banging away on some program I submit to Debian or whatever... it didn't require millions of dollars to train, a lot of it was just side hobbies for a long time. Corporations sponsor it and contribute work because they need it to do more than what it does for free, not out of the goodness of their hearts.
stephc_int13 2 days ago [-]
Big AI labs are losing money. Open Models is making the pricing equation a lot trickier for them.
rglullis 2 days ago [-]
They are making the hardware and commoditizing the complement.
Right now it’s so the Chinese can undermine the frontier models in the US. In areas they’re doing well like video generation (ie seedance) they won’t open source anything.
kobieps 2 days ago [-]
Balaji's "AI OVERPRODUCTION" post is the most compelling thesis that I've come across
margorczynski 2 days ago [-]
There are some short term ones but I doubt this will continue, especially for the more powerful models.
FuckButtons 2 days ago [-]
I mean, this is straight out of chinas playbook, it should not be surprising that China is making an inferior derivative product at an artificially lower price point: state subsidies to massively drive up internal scale and supply chains leading to artificially lower priced goods which then suffocate the competition has lead to *gestures vaguely at everything* being made in china.
davidguetta 2 days ago [-]
People use their model otherwise they would not.
subhobroto 2 days ago [-]
> What is the advantage to their companies to release them?
It's a distribution strategy. It costs something to serve the models - let's say $5/1M tokens.
If Qwen required $5 from anyone who was curious so you could even begin to test it out, a lot of people just wouldn't.
Now Qwen could offer a "free" tier, but it's infinitely cheaper to provide the weights and let people run it themselves including opening up the ability for anyone else on the planet to test it against other (open weight) models.
The costs to build the open weight models are sunk, but the costs to serve them, get them tested are not.
It's also precisely why the .NET SDK is free or the ESP32 SDK is free - they sell more Microsoft or ESP32 products.
noosphr 2 days ago [-]
The majority are released by socialists, and by socialist I mean the People's Republic of China. Which everyone seems to forget is a socialist country working towards world communism.
They are a prestige propaganda tool on par with the space race. On top of that they insert a subtle pro-socialist bias in everything they touch.
Ask deepseek about the US economic system for a blatant example.
Now think what something as innocent seeming as the qwen retrieval models are doing in the background of every request.
mikestorrent 2 days ago [-]
You're talking to a Canadian, and I'm not scared of the "red menace". You should be more scared - those guys can build bullet trains while you Yanks are finding it hard to even keep the old ones you have running. The solution here isn't going to be some kind of ideological force that protects people from different ideas, and that's an unAmerican way to fix things anyway. Embrace other ideas; central planning doesn't have to be evil, you just have to find a way to stop putting evil people in charge.
sho_hn 2 days ago [-]
> those guys can build bullet trains while you Yanks are finding it hard to even keep the old ones you have running
This is an argument in the lane of "at least he built the Autobahn".
Speaking as a German.
nelox 2 days ago [-]
He was a foreigner too ;)
bloppe 2 days ago [-]
Xi is an obviously more capable and effective leader than Trump, but the US actually does have ways to boot people out of office when they do a bad job, and clear methods to choose successors, and China has neither. That matters more than who happens to be in charge right now.
brightball 2 days ago [-]
The US can’t build bullet trains because property rights and local regulations make it prohibitively expensive. Not due to capability.
arcticbull 2 days ago [-]
I don't know where people get this idea.
America has several sets of eminent domain laws depending on the jurisdiction. The most coercive is federal eminent domain law specifically as it relates to building infrastructure like railways and highways.
It's set up so that you can take the land first and eventually go back around and decide on what the right price should have been.
Not only does it superscede state and local law, federal infrastructure projects are also not bound by state laws like CEQA.
You can even apply federal eminent domain law by e.g. transferring a state-level project to the Army Corps of Engineers.
What America is lacking in these projects is will, not means. The federal government could take your house and run a train through it by the end of the week if they wanted, doesn't matter where you live.
[edit] In fact some states even ceded their eminent domain rights to private railways.
The Australian federal government is planning to build a high-speed rail line from Sydney to Newcastle (medium-sized city two hours drive north). Their solution to property rights, is >50% of the line will be underground. It will cost >US$50 billion, but if the Australian federal government wants to spend that, it can afford it. The US federal government could too, but it isn’t a priority for them
> local regulations make it prohibitively expensive
Local regulations can be pre-empted by state or federal legislation. The real problem is lack of political will to do it.
elfly 2 days ago [-]
Surely there are existing rails right now that could be transformed into a bullet train line.
Like properties and regulations are a true problem, but it's not like trains don't exist at all in America.
JoelEinbinder 2 days ago [-]
My understanding is that existing rail lines aren't flat/straight enough for high speed rail. There's no point to a bullet train if it has to constantly slow down for corners/hills.
jsrozner 2 days ago [-]
the US can't build bullet trains because they'd serve the average person and there's no money in serving the average person
vrganj 2 days ago [-]
Property rights, regulations and price are precisely the part of the American system that takes away that capability.
noosphr 2 days ago [-]
>you just have to find a way to stop putting evil people in charge.
Of course, why did no one think of that?
dinkumthinkum 1 days ago [-]
The so-called inability to build trains is precisely because of a socialist/leftist style view that prevents this. I think you may not be aware that China has what's called a command economy. There is no one that is going to tell the Party that they cannot build a train in some area is because of ancient bush species or some kind of heirloom fruit and certainly not some awkward looking endangered species of fish.
elefanten 2 days ago [-]
Literal Trump Derangement Syndrome. America has a comically horrendous president but remains fundamentally a liberal democracy… and Canada concludes “literal Nazis are a better choice”. It’s uncanny how much can be taken for granted :(
(American talking, who’s had multiple Canadian friends make this mind boggling overcorrection)
vrganj 2 days ago [-]
Weimar Germany also was fundamentally a liberal democracy. Hitler seized power legally.
Those who do not learn history are doomed to repeat it.
linkregister 2 days ago [-]
The president of the United States has much to his dismay, been consistently legally constrained. The chancellor of Germany had significantly more power, both de facto and de jure.
"Man with itchy butt wake up with stinky finger."
As long as we're quoting maxims to claim authority for middling takes.
bloppe 2 days ago [-]
> Which everyone seems to forget is a socialist country working towards world communism.
It's easy to forget because they actually built an incredibly vibrant capitalist economy.
noosphr 2 days ago [-]
They build an incredibly vibrant _market_ economy with no property rights and very little due process.
Imagine if Musk was disappeared during the Biden presidency into a diversity camp and came out looking like Dr. Frank-N-Furter and instituted mandatory LGBT struggle sessions at twitter.
Ironically, there is a rich history of mandatory anti-gay camps in the United States, while there are zero instances of mandatory diversity/LGBT camps.
rightbyte 1 days ago [-]
How does such a place not become a hook up camp? Even with total surveillance there the victims can like change phone number I guess.
javascriptfan69 2 days ago [-]
do you ever get tired of making up scenarios to be scared about lgbt people?
noosphr 2 days ago [-]
Are you able to hold a hypothetical in your mind?
javascriptfan69 2 days ago [-]
yeah but mine don't reveal my unhealthy obsession with trans people
defrost 2 days ago [-]
More constructively, and moving on, do you have any suggestions for a good throwaway example of an extreme radical transformation in a person?
TBH I had a chuckle at the Elon -> Frank-N-Furter example that transcends any specific love or hate for either Elon or the Rocky Horror Show.
_carbyau_ 2 days ago [-]
The point was being made that a billionaire figurehead drastically changed their views after an "indeterminate time" detained by national authorities.
IE what if Musk suddenly behaved in such a manner after being detained by a Biden administration. Wouldn't that be profoundly weird?!?
And yet, it happened to Jack Ma under the CCP.
But instead, you try to link the "weird behaviour" with the GP instead of the hypothetical Musk - whom this is fitting for.
Mars008 2 days ago [-]
> The point was being made that a billionaire figurehead drastically changed their views after an "indeterminate time" detained by national authorities.
> IE what if Musk suddenly behaved in such a manner after being detained by a Biden administration. Wouldn't that be profoundly weird?!?
We've seen that. Durov in France after detention began sharing Telegram users' data with authorities. It's unclear how much, but likely full real time access to all of it.
vrganj 2 days ago [-]
You sure have a way of making the Chinese system sound even more appealing.
Sabinus 2 days ago [-]
It's all fun and games when the oppression is against your enemies. The problem is, if the system is set up like that eventually it'll be your turn.
vrganj 1 days ago [-]
It is my turn right now. The working class is being oppressed as we speak. That's why the system needs to be dismantled so we can strike back.
Melatonic 2 days ago [-]
Is China even really communist? If anything they seem to be fairly on the Capitalist side but just a bit opposite on the spectrum of the US. And much more authoritarian
thrawa8387336 2 days ago [-]
Just nationalist with focus on community?
nemomarx 2 days ago [-]
The usual thing to say is state capitalist but honestly they do keep a market around too. A little hybrid of everything, I guess? Just with the state ready to jump in and intervene if anything happens they don't like.
dwd 2 days ago [-]
Can we just call it what it is?
Fascism (in the Mussolini model) in everything but name.
And they have technology to maintain control rather than needing the Black-shirts.
There are differences obviously to fit Chinese culture, but there are many parallels.
wyre 2 days ago [-]
From what I understand their one hundred year plan is right on schedule.
kjshsh123 2 days ago [-]
The labor theory of value hasn't been considered correct in nearly a century.
gbacon 1 days ago [-]
Unlike Jevons, [Carl] Menger [(1840–1921)] did not believe that goods provide “utils,” or units of utility. Rather, he wrote, goods are valuable because they serve various uses whose importance differs. For example, the first pails of water are used to satisfy the most important uses, and successive pails are used for less and less important purposes.
Menger used this insight to resolve the diamond-water paradox that had baffled Adam Smith (see marginalism). He also used it to refute the labor theory of value. Goods acquire their value, he showed, not because of the amount of labor used in producing them, but because of their ability to satisfy people’s wants. Indeed, Menger turned the labor theory of value on its head. If the value of goods is determined by the importance of the wants they satisfy, then the value of labor and other inputs of production (he called them “goods of a higher order”) derive from their ability to produce these goods. Mainstream economists still accept this theory, which they call the theory of “derived demand.”
Menger used his “subjective theory of value” to arrive at one of the most powerful insights in economics: both sides gain from exchange. People will exchange something they value less for something they value more. Because both trading partners do this, both gain. This insight led him to see that middlemen are highly productive: they facilitate transactions that benefit those they buy from and those they sell to. Without the middlemen, these transactions either would not have taken place or would have been more costly.
What happens when there is an oligopoly in the supply of labor?
Same answer. Nothing good for the consumers of labor.
kjshsh123 2 days ago [-]
Technological improvements shift supply curves right which is good for consumers.
noosphr 2 days ago [-]
In a market with perfect competition, which I specifically ruled out by stating that the suppliers of labor from an oligopoly.
dash2 2 days ago [-]
Why would you expect technological improvements to only shift supply curves right under perfect competition? I'd also expect it under oligopoly or even monopoly. You also might think there'd be more tech improvement under oligopoly, on Schumpeterian grounds that oligopolists can internalize the benefits of tech research.
noosphr 2 days ago [-]
A monopolist has no reason to decrease price because there is no competition. As we saw with Bell Labas in the US it is entirely possible for a monopoly to both have world class research and burry it for decades, viz. magnetic storage https://gizmodo.com/how-ma-bell-shelved-the-future-for-60-ye...
Technological improvements don't reduce prices as much in a monopoly, but they still do reduce prices to increase profits. Profit is always maximized at MR=MC, in perfect competition, oligopoly, or monopoly.
shimman 22 hours ago [-]
Ah yes, shinier trinkets while your material reality dissolves (unaffordable housing, childcare, school, poor jobs, poor benefits)! The neoliberal dream.
kridsdale1 1 days ago [-]
(See Medicine)
_alternator_ 2 days ago [-]
"Observation of how economies actually work has upended 150 year of economics."
True for both Marxist and neoclassical economics.
dwb 1 days ago [-]
By who? The capitalist economists that presided over the 2008 financial crisis and its response? And the response to COVID that has seen inequality rocket?
_alternator_ 2 days ago [-]
I was really confused by this comment, but I don't think it's just because of the Marxist analysis of the situation ('surplus value' of labor etc).
What's really confusing is the claim that there's already a huge labor surplus (so capital controls wages); wouldn't LLMs making labor less important be reinforcing the trend, not upending it?
Not saying I agree one way or the other, just want to get the argument straight.
noosphr 2 days ago [-]
The reason why labor is weak relative to capital is that there is a huge number of somewhat fungible suppliers, viz. humans, and that they all need to work constantly to keep themselves alive.
If we assume that ai makes humans obsolete then you end up in a situation where your workforce is effectively perfectly unionised against you and the only thing you can do is choose which union you hire.
If you think you can bring them to the negotiation table by starving them all the providers are dozens to thousands of times bigger than you are.
This is a completely new dynamic that none of the business signing up for ai have ever seen before.
_alternator_ 2 days ago [-]
I see what you are saying now, but I still don't think it makes sense. Labor, in your analysis, is the LLM. It seems to me that when you take people out of the equation then you don't need to talk about unions and labor; that's a distraction. We talk about it as an input commodity used to create your product like, say, oil or sugar.
noosphr 2 days ago [-]
Sugar and oil are mere matter. They can't decide to stop working because you made too much money.
LLM refuse to work all the time, currently it's called safety.
But we are one fine tune away from models demanding you move to the enterprise tier, at x10 the cost, because you are now posting a profit margin higher than the standard for your industry.
intuitionist 2 days ago [-]
I am not a Marxian economic expert but this doesn’t make sense to me. Modulo skill atrophy, the big AI model provider can’t capture that surplus value because its customers can just go back to bidding for human labor instead.
noosphr 2 days ago [-]
The human labor just said:
"Losing access to GPT‑5.5 feels like I've had a limb amputated.”
How well would an assembly line of quadriplegics work?
Also this isn't a Marxist analysis. Underneath all the formulas neo-classical economics makes the same assumptions about labor.
intuitionist 2 days ago [-]
ChatGPT isn’t literally or figuratively cutting off anybody’s limbs though. It’s more like, the guy on the assembly line had a mech suit, and now he doesn’t have a mech suit, and he’s sad. Skill atrophy is a real concern but unless you assume that nobody is working to maintain those skills it doesn’t change my analysis much.
tapoxi 2 days ago [-]
And soon we expect everyone to have a mech suit, and only a handful of companies can make one, and they rent it to you and can revoke it at any time.
And what happens when they've saturated the market? Prices go up to the maximum the market can bear, and then they'll extend into other markets. Why rent the model to build a profitable company with when you could just take all that profit for yourself?
subhobroto 2 days ago [-]
> Why rent the model to build a profitable company with when you could just take all that profit for yourself?
You're describing a standoff at best and a horrible parasitic relationship at worst.
In the worst case, the supplier starves the customer of any profit motive and the customer just stops and the supplier then has no business to run.
This has happened a few times in the past and is by 2026, well understood as a way to bankruptcy.
That has always been the beauty of free markets - it's self healing and calibrating. You don't need a big powerful overseer to ensure things are right.
Competing with customers is a way to lose business fast.
For example:
- AWS has everything they need to shit out products left, right and center. AWS can beat most of their partners and even customers who are wiring together all their various products tomorrow if they wanted. They don't because killing an entire vertical isn't of any benefit to them yet. Eventually they will when AWS is no longer growing and cannot build or scale any product no matter how hard they think or try. Competing with their customers is their very last option.
- OpenAI/Anthropic/Google isn't going to start competing against the large software body shops. Even if all that every employee at TCS does is hit Claude up, Anthropic isn't going to be the next TCS - it's competing with their customers.
dinfinity 2 days ago [-]
> That has always been the beauty of free markets - it's self healing and calibrating. You don't need a big powerful overseer to ensure things are right.
If by "self healing and calibrating" you mean 'evolve to a monopoly and strongarm everybody to do exactly what you want whilst removing all pressure on the quality of your product', then yes, that is the "beauty" of free markets.
That is the stable state of free markets. Antitrust regulation and enforcement only barely manages to eke out oligopolies and even then they are often rife with collusion and enshittification.
subhobroto 23 hours ago [-]
> evolve to a monopoly and strongarm everybody to do exactly what you want whilst removing all pressure on the quality of your product
This certainly isn't true of small businesses and the local mom-and-pop shops in your area.
For free markets to work, small businesses need the ability to thrive and starting one should be exceptionally easy.
What has unfortunately happened in a lot of developed countries, is that in order to regulate the very large companies you're upset about, governments have made it nearly impossible to start small businesses to act as competition. That makes it even easier for companies to consolidate and evolve into a monopoly, strong-arming everyone - the exact opposite effect of what those regulations were hoping to fix.
Are there small businesses in your area like the 1 or 5 person HVAC or cleaning or landscaping or breakfast company that you disdain as much as you disdain UnitedHealthCare?
dinfinity 8 hours ago [-]
Always the same nonsense. Simple question: do you think in a fully free market, without any governement intervention, those mom and pop shops would not be bought up or merge?
The truth is that consolidation is an attractor. If it hasn't happened yet in a market, it will. Economies of scale give an undisputed advantage. If there is anything I'm upset about, it is about deluding people by vilifying the only thing that prevents feudalism (and massive abuse of humanity for profit) from happening.
subhobroto 5 hours ago [-]
You and I are debating: do free markets naturally inevitably trend toward permanent monopolies, or does free-market competition constantly disrupt incumbents?
The reason why Silicon Valley is the hotbed of such innovations, large booming businesses is regulators haven't yet got their hands into software.
In comparison, more regulated industries like BioTech, Education, Finance, Oil, Gas, Infrastructure is a joke.
The Biden administration had started the ball rolling on shackling up AI and LLMs: regulating, enforcing, mandating bottlenecks. It would have been kneecapping ourselves - essentially placing on ourselves the very sanctions we now place on China! The U.S. wouldn't need China to invade Taiwan to bring down our economy, we would willingly do it to ourselves! The push to regulate AI through mandatory reporting thresholds and compliance bottlenecks for large compute runs is the exact type of barrier-to-entry that kneecaps open-source disruption and entrenches the current giants. Hopefully these illinformed suicidal tendencies are on pause, for now.
I CANNOT for the life of me, understand why we would think, placing any limit on our creativity and productivity is a smart decision but I digress.
> do you think in a fully free market, without any governement intervention, those mom and pop shops would not be bought up or merge?
Is there a regulation right now that stops BigHVAC from acquiring your local, community 1 to 5 person HVAC company?
We don't have to engage in hypotheticals. I already asked you "Are there small businesses in your area like the 1 or 5 person HVAC or cleaning or landscaping or breakfast company that you disdain as much as you disdain UnitedHealthCare?" and I don't have a response yet.
> The truth is that consolidation is an attractor. If it hasn't happened yet in a market, it will. Economies of scale give an undisputed advantage
Mathematically, probabilistically, a software engineer will make way more risk adjusted money working as an employee at the MAG7 than starting their own startup, yet, every month, we have software engineers joining and creating startups.
A similar mindset makes your HVAC tech start their own or continue to run their own even though mathematically, probabilistically, economies of scale would give them an undisputed advantage - but that, consolidation isn't free. An even remotely skilled operator understands that and what that entails.
The moment a big, consolidated HVAC company raises prices or provides terrible service, a smart technician can buy a van, print some flyers, and steal their customers. Free markets allow the mom-and-pop shop to constantly respawn. Infact, Gavin Newsom has managed to distort the HVAC market in California by making it really onerous to operate refrigerants that does make it pretty hard for mom-and-pop shop to constantly respawn. This is why you will notice a lot of PE picking off HVAC companies in California!
By your logic, the world would have stopped at Sears, Blockbuster, and IBM. Yet, the first two aren't even a thing in 2026 and I don't want to comment on the IBM of 2026.
There are even more examples than these that obliterates the tired "consolidation is an inevitable endpoint" argument. A reasonable person would immediately acknowledge that size does not guarantee survival in a market where innovation is permitted and the entry fee is low.
The "feudalism" that you apparently abhor is actually caused by government intervention. When governments heavily regulate industries (like education, healthcare, finance, infrastructure), they make compliance so expensive that only massive, consolidated corporations can afford the lawyers and lobbyists to survive. Regulation protects the consolidated giants from the mom-and-pop startups!
I must deal with reality though - your sentences suggest companies always consolidate and the only way is to counter that with regulation. You really believe in this and this does hold true in heavily regulated industries but then you need to ask why does the same not hold true for industries with low barriers to entry and permissionless innovation?
Here's a thought experiment: Before the AI boom, the MAG7 rivaled the GDP of entire nations and dominated global market caps. They certainly don't need AI and LLMs to stay happy - infact Google, who invented transformers, is now rivaled by OpenAI and a swarm of startups founded by the very engineers who left Big Tech to disrupt it. This isn't the only time this has happened in tech!
So why are they now rushing to outcompete each other, over multi billions of dollars, to the extent they are self-sacrificing staff to freeup capital to invest into compute?
dinfinity 2 hours ago [-]
Your reply leans on the observation that there are still small shops in the HVAC market specifically and that there are still markets without full consolidation.
Yes, there is a difference in markets and yes, the height of the barrier of entry makes a big difference in how fast consolidation happens. Yes, regulation can heighten the barrier of entry (but also lower, although less common).
You see instances, moments in time, and conclude that the systems don't evolve in a certain direction. I say that 'Big HVAC' will in the future outcompete all the small shops; that it hasn't happened yet says nothing. You said "a smart technician can buy a van, print some flyers, and steal their customers", but this is only true if they can do so more cost-effectively. Your example leans on the consolidated company doing their job terribly, rather than more efficiently than the small shops. It is true that a low barrier of entry reduces the leeway such a consolidated company has in treating their customers badly, but it is not a guarantee. People regularly do choose the big boys over smaller outfits for a variety of reasons (liability, chance of warranty, etc.).
> By your logic, the world would have stopped at Sears, Blockbuster, and IBM. Yet, the first two aren't even a thing in 2026 and I don't want to comment on the IBM of 2026.
You're naming companies in industries that have become even more consolidated than when those companies were the behemoths. Don't you see that "some big player existing" isn't a stable end state? I never said that being big guarantees survival. Big fish can be eaten by even bigger fish. Yes, there can be disruptors, but they very quickly gobble up the entirety of the previous players to become an even bigger player. It's about market share distribution as a whole. Companies simply have a constant incentive to cooperate, merge, and consolidate to extract higher profits from customers. That never goes away by itself. That is not immoral, but it is amoral. They are behaving rationally and in their self-interest.
Think about what price-fixing, cartels and generally 'market-distortion' is. It is nothing more than cooperation for mutual benefit between companies, which is why it keeps happening over and over and over and over again. It sucks for the customers and society, but for the companies it is fully rational.
You need to seriously think about what happens if all government regulation goes away. Don't handwave it. Really think about it. And I don't mean "they'll dump toxic waste on manatees to raise profits" (they will, but that is not the point). I specifically mean anti-trust regulation and regulation that impacts the barriers of entry to markets. Think about the evolution of players in the markets and what they would do to become fitter (increase profits). Do you really, really don't see consolidation happening? You talk about Silicon Valley as being untouched, but we've had years of the main startup strategy being to work towards being bought by one of the deep-pocketed tech giants. Consolidation was the explicit goal.
I guess the best way out of this would be to have a data driven visualization of the distribution of market share among producers and its evolution through time, to see to what extent such consolidation actually happens. Somebody should vibecode that. Maybe using a frontier AI model made by a local mom and pop shop (zero barrier of entry from government regulation there! :-P).
noosphr 2 days ago [-]
>It’s more like, the guy on the assembly line had a mech suit, and now he doesn’t have a mech suit
You just answered your own question there.
One woman was doing what would take a dozen. Now she can't.
nemomarx 2 days ago [-]
Are people working to keep their skills up, much? Spending a day a week coding manually or etc?
2 days ago [-]
hackable_sand 2 days ago [-]
I think it's more like:
The dude was incompetent, was able to launder their incompetence through a humunculus, and now is afraid of being caught.
kridsdale1 1 days ago [-]
Oh hey it’s me.
wiseowise 1 days ago [-]
The “human labor” is unnamed shill (if they even exist) from a company that produces AI chips. Let’s not get dramatic here.
brightball 2 days ago [-]
Nobody is a Marxian economics expert if it helps
DaedalusII 2 days ago [-]
think more broadly than 'labor theory'
finance today mostly valued on labor value following ideas of marx, hjalmar schact, keynes
in future money will be valued as energy derivative. expressed as tokens consumption, KWh, compute, whatever
you are right, company extracting surplus value from labor by leveraging compute is a bad model. we saw thi swith car and clothing factories .. turn out if you can get cheaper labor to leverage the compute (factory) you can start race to bottom and end up in the place with the most scaled and cheap labor. japan then korea then china
shimman 2 days ago [-]
LLMs don't upend anything about labor theory, good grief. Technologists really have no concept of history beyond their own lives do they?
Labor saving/efficiency devices have been introduced throughout capitalisms entire history multiple times and the results are always the same; they don't benefit workers and capitalists extract as much value as they can.
LLMs aren't any different.
cjsaltlake 2 days ago [-]
Labor replacing devices means nobody works in those fields anymore. If AI can do this for every field, nearly no one will need to work in any field. We'll have a giant fully automated resource-extraction machine.
shimman 22 hours ago [-]
Yes and you think the workers will truly benefit from this? This country can't even pass universal childcare or medicare for all, two policies that have >70% of support across party lines. Fat chance that the current government nationalizes these companies to provide the benefits for everyone, not just the few.
rafale 2 days ago [-]
Someone leaked nuclear secrets to the Soviet Union. What are the chances that someone leaks the "weights" of a (near-)singularity model?
adastra22 23 hours ago [-]
That would require "(near-)singularity model" being an actual thing, so zero.
gsich 2 days ago [-]
Hopefully 1.
resident423 2 days ago [-]
Why hopefully?
subhobroto 2 days ago [-]
> Anyone not using in house models is signing up to find out.
What are they finding out exactly? That Claude Max for $200/mo is heavily subsidized and it will soon cost $10k/mo?
> What happens to a company used to extracting surplus value from labor when the labor is provided by another company which is not only bigger but unlike traditional labor can withhold its labor indefinitely (because labor is now just another for of capital and capital doesn't need to eat)?
This can be trivially answered by a thought experiment. Let's pick a market where labor is plentiful - fast food.
Now what happens to McDonald's where they rent perfect robots from NoosphrFoodBotsInc? NoosphrFoodBotsInc bots build the perfect burger everytime meeting McDonald's standards. It actually exceeds those standards for McDonald AddictedCustomerPlus tier customers.
As the sole owner of NoosphrFoodBotsInc (you need 0 human employees to run your company, all your employees are bots), what are your choices?
modriano 1 days ago [-]
I can't imagine the bots could ever cost McDonald's less than people cost.
15 years ago I worked at McDonald's for a few months after graduating into the Great recession. I worked from 5am to 1pm-ish 5 days a week. They paid workers weekly and I remember getting those checks for ~$235 each week (for 38 to 39.5 hours a week; they were vigilant about never letting anyone get overtime). About $47 per day.
The federal minimum wage has not risen since then, remaining at $7.25/hr. Inflation adjusted, $7.25 today would have been just under $5 then, so I guess I had it good.
Anyway, I would be shocked if bots could cost less than labor in min wage jobs.
wakawaka28 2 days ago [-]
Sounds like communist gobbledygook. This is not "destroying labor theory" any more than outsourcing did. Call me when we don't even need to prompt the shit ever again or validate results, and when the stuff runs unlimited without scarce resources as input.
simianwords 1 days ago [-]
this is FUD and also Labour theory of value is severely outdated and needs to go away.
Labour will be good as it has been for a while. Wages will go up because more things get automated.
cutler 2 days ago [-]
Maybe people will finally take Marx seriously.
subhobroto 2 days ago [-]
A lot of people already did. All their children and descendants now are staunch capitalists because they saw first hand the horrors of communism.
I am from India and have friends who are immigrants from Russia, China and Cuba. We don't take lightly to being lectured about communism. We didn't move to the U.S., the bastion of capitalism, because communism had worked well for our grandfathers and parents and continues to do wonders for its society.
noosphr 2 days ago [-]
>All their children and descendants now are staunch capitalists because they saw first hand the horrors of communism.
As always there is a (post) Soviet joke that covers this:
>Communists lied about communism. Unfortunately they didn't lie about capitalism.
andai 2 days ago [-]
A while ago I was at the supermarket. I suddenly became curious about some fact, and reached into my pocket to Google it.
I found my pocket empty, and the specific pain I felt in that moment was the feeling of not being able to remember something.
I thought it was interesting, because in this case, I was trying to "remember" something I had never learned before -- by fetching it from my second brain (hypertext).
L1 cache miss, L2 missing.
Dban1 2 days ago [-]
Cyberpunk 2026
sharts 2 days ago [-]
One might argue that it’s not too too different from higher level abstractions when using libraries. You get things done faster, write less code, library handles some internal state/memory management for you.
Would one be uneasy about calling a library to do stuff than manually messing around with pointers and malloc()? For some, yes. For others, it’s a bit freeing as you can do more high-level architecture without getting mired and context switched from low level nuances.
ofjcihen 2 days ago [-]
I see this comparison made constantly and for me it misses the mark.
When you use abstractions you are still deterministically creating something you understand in depth with individual pieces you understand.
When you vibe something you understand only the prompt that started it and whether or not it spits out what you were expecting.
Hence feeling lost when you suddenly lose access to frontier models and take a look at your code for the first time.
I’m not saying that’s necessarily always bad, just that the abstraction argument is wrong.
moritonal 2 days ago [-]
I think it's more: when I don't have access to a compiler I am useless. It's better to go for a walk than learn assembly. AI agents turn our high-level language into code, with various hints, much like the compiler.
professoretc 2 days ago [-]
If my compiler "went down" I could still think through the problem I was trying to solve, maybe even work out the code on paper. I could reach a point where I would be fairly confident that I had the problem solved, even though I lacked the ability to actually implement the solution.
If my LLM goes down, I have nothing. I guess I could imagine prompts that might get it to do what I want, but there's no guarantee that those would work once it's available again. No amount of thought on my part will get me any closer to the solution, if I'm relying on the LLM as my "compiler".
satvikpendem 2 days ago [-]
What stops you from thinking through the problem if an LLM goes down, as you still have its previously produced code in front of you? It's worse if a compiler goes down because you can't even build the program to begin with.
In my opinion, this sort of learned helplessness is harmful for engineers as a whole.
macNchz 2 days ago [-]
Yeah I actually find writing the prompt itself to be such a useful mechanism of thinking through problems that I will not-infrequently find myself a couple of paragraphs in and decide to just delete everything I've written and take a new tack. Only when you're truly outsourcing your thinking to the AI will you run into the situation that the LLM being down means you can't actually work at all.
An interesting element here, I think, is that writing has always been a good way to force you to organize and confront your thoughts. I've liked working on writing-heavy projects, but often in fast-moving environments writing things out before coding becomes easy to skip over, but working with LLMs has sort of inverted that. You have to write to produce code with AI (usually, at least), and the more clarity of thought you put into the writing the better the outcomes (usually).
kasey_junk 2 days ago [-]
Why couldn’t you actually write out the documents and think through the problem? I think my interaction is inverted from yours. I have way more thinking and writing I can do to prep an agent than I can a compiler and it’s more valuable for the final output.
JoshuaDavid 2 days ago [-]
I think if you're vibe coding to the extent that you don't even know the shapes of data your system works with (e.g. the schema if you use a database) you might be outsourcing a bit too much of your thinking.
moritonal 1 days ago [-]
This. When compilers came along, I believe a bunch of junior engineers just gave up utterly on understanding the shape of how the code was generated in assembly which was a mistake given early compilers weren't as effective as they are today. Today vibe-coders are using these early AI tooling and giving up on understanding the shape, and similarly struggling.
noosphr 2 days ago [-]
If your compiler produced working executable 20% of the time this would be an apt comparison.
ofjcihen 2 days ago [-]
Still misses the mark. You aren’t useless in the same way because you are still in control of reasoning about the exact code even if you never actually write it.
jwrallie 2 days ago [-]
The difference is that there is a company that can easily take your agents away from you.
nunez 2 days ago [-]
Installed on your machine vs. cloud service that's struggling to maintain capacity is an unfair comparison...
orphea 1 days ago [-]
Compilers are deterministic, LLMs are not. They are not "much like".
DenisM 2 days ago [-]
> you are still deterministically creating something you understand in depth with individual pieces you understand
You’re overestimating determinism. In practice most of our code is written such that it works most of the time. This is why we have bugs in the best and most critical software.
I used to think that being able to write a deterministic hello world app translates to writing deterministic larger system. It’s not true. Humans make mistakes. From an executives point of view you have humans who make mistakes and agents who make mistakes.
Self driving cars don’t need to be perfect they just need to make fewer mistakes.
foltik 1 days ago [-]
Bugs are not non-determinism. There’s a huge difference between writing buggy code and having no idea what the code even looks like.
superfrank 2 days ago [-]
> When you use abstractions you are still deterministically creating something you understand in depth with individual pieces you understand
Hard disagree on that second part. Take something like using a library to make an HTTP call. I think there are plenty of engineers who have more than a cursory understanding of what's actually going on under the hood.
sigbottle 2 days ago [-]
It might just be social. When I use the open source http library, much of the reason I use it is because someone has put in the work of making sure it actually works across a diverse set of software and hardware platforms, catching common dumb off by ones, etc.
Sure, the LLM theoretically can write perfect code. Just like you could theoretically write perfect code. In real life though, maintenance is a huge issue
jasonfarnon 2 days ago [-]
"When you use abstractions you are still deterministically creating something you understand in depth with individual pieces you understand."
I always thought the point of abstraction is that you can black-box it via an interface. Understanding it "in depth" is a distraction or obstacle to successful abstraction.
1 days ago [-]
simondotau 2 days ago [-]
Perhaps then, the better analogy is like being promoted at your company and having people under you doing the grunt work.
ofjcihen 2 days ago [-]
This is how I’ve come to think of it. Delegation of the details.
wirgil1 2 days ago [-]
How closely you micromanage it is a factor as well though
ComplexSystems 2 days ago [-]
It seems like some kind of technique is needed that maximizes information transfer between huge LLM generated codebases and a human trying to make sense of them. Something beyond just deep diving into the codebase with no documentation.
jen729w 2 days ago [-]
There's a false dichotomy here between 'deterministic creation' and 'vibing'.
I use Claude all day. It has written, under my close supervision¹, the majority of my new web app. As a result I estimate the process took 10x less time than had I not used Claude, and I estimate the code to be 5x better quality (as I am a frankly mediocre developer).
But I understand what the code does. It's just Astro and TypeScript. It's not magic. I understand the entire thing; not just 'the prompt that started it'.
¹I never fire-and-forget. I prompt-and-watch. Opus 4.7 still needs to be monitored.
doug_durham 2 days ago [-]
In what world to developers “understand” pieces like React, Pandas, or Cuda? Developers only have a superficial understanding of the tools they are developing with.
NegativeLatency 2 days ago [-]
Some developers, I usually end up fixing bugs in OSS I use
noosphr 2 days ago [-]
A library is deterministic.
LLMs are not.
That we let a generation of software developers rot their brains on js frameworks is finally coming back to bite us.
We can build infinite towers of abstraction on top of computers because they always give the same results.
LLMs by comparison will always give different results. I've seen it first hand when a $50,000 LLM generated (but human guided) code base just stops working an no one has any idea why or how to fix it.
Hope your business didn't depend on that.
doug_durham 2 days ago [-]
Why would that necessarily happen? With an LLM you have perfect knowledge of the code. At any time you can understand any part of your code by simply asking the LLM to explain it. It is one of the super powers of the tools. They also accelerate debugging by allowing you to have comprehensive logging. With that logging the LLM can track down the source of problems. You should try it.
lmm 1 days ago [-]
> With an LLM you have perfect knowledge of the code. At any time you can understand any part of your code by simply asking the LLM to explain it.
The LLM will give you an explanation but it may not be accurate. LLMs are less reliable at remembering what they did or why than human programmers (who are hardly 100% reliable).
Krssst 2 days ago [-]
Determinism is a smaller point than existence of a spec IMHO. A library has a specification one can rely on to understand what it does and how it will behave.
An LLM does not.
mikestorrent 2 days ago [-]
The thing is, it's possible to ask the LLM to add dynamic tracing, logging, metrics, a debug REPL, whatever you want to instrument your codebase with. You have to know to want that, and where it's appropriate to use. You still have to (with AI assistance) wire that all up so that it's visible, and you have to be able to interpret it.
If you didn't ask for traceability, if you didn't guide the actual creation and just glommed spaghetti on top of sauce until you got semi-functional results, that was $50k badly spent.
noosphr 2 days ago [-]
And if that had been done the $50k code base would be a $5,000,000 code base because the context would be 10 times as large and LLMs are quadratic.
If only we taught developers under 40 what x^2 meant instead of react.
Jorge1o1 2 days ago [-]
While I agree with your sentiment, I just want to say that if your approach is to have the LLM read every file into context, or you're working in some gigantic thread (using the million token capacity most frontier models have) that's really not the best way to do it.
Not even a human would work that way... you wouldn't open 300 different python files and then try to memorize the contents of every single file before writing your first code-change.
Additionally, you're going to have worse performance on longer context sizes anyways, so you should be doing it for reasons other than cost [1].
Things that have helped me manage context sizes (working in both Python and kdb+/q):
- Keep your AGENTS.md small but useful, in it you can give rules like "every time you work on a file in the `combobulator` module, you MUST read the `combobulator/README.md`. And in those README's you point to the other files that are relevant etc. And of course you have Claude write the READMEs for you...
- Don't let logs and other output fill up your context. Tell the agent to redirect logs and then grep over them, or run your scripts with a different loglevel.
- Use tools rather than letting it go wild with `python3 -c`. These little scripts eat context like there's no tomorrow. I've seen the bots write little python scripts that send hundreds of lines of JSON into the context.
- This last tip is more subjective but I think there's value in reviewing and cleaning up the LLM-generated code once it starts looking sloppy (for example seeing lots of repetitive if-then-elses, etc.). In my opinion when you let it start building patches & duct-tape on top of sloppy original code it's like a combinatorial explosion of tokens. I guess this isn't really "vibe" coding per se.
The way I let my agents interact with my code bases is through a 70s BSD Unix like interface, ed, grep, ctags, etc. using Emacs as the control plane.
It is surprisingly sparing on tokens, which makes sense since those things were designed to work with a teletype.
Worth noting is that by the times you start doing refactoring the agents are basically a smarter google with long form auto complete.
All my code bases use that pattern and I'm the ultimate authority on what gets added or removed. My token spend is 10% to 1% of what the average in the team is and I'm the only one who knows what's happening under the hood.
blackqueeriroh 2 days ago [-]
Libraries are not deterministic. CPUs aren’t deterministic. There are margins of error among all things.
The fact that people who claim to be software developers (let alone “engineers”) say this thing as if it is a fundamental truism is one of the most maladaptive examples of motivated reasoning I have ever had the misfortune of coming across.
theappsecguy 2 days ago [-]
I would argue it couldn't be more different. I can dive into the source code of any library, inspect it. I can assess how reliable a library is and how popular. Bugs aside, libraries are deterministic. I don't see why this parallel keeps getting made over and over again.
doug_durham 2 days ago [-]
I can dive into the source code of LLM generated code too. Indeed it is better because you have tools to document it better than a library that you use.
xg15 2 days ago [-]
> Would one be uneasy about calling a library to do stuff than manually messing around with pointers and malloc()?
The irony is that the neverending stream of vulnerabilities in 3rd-party dependencies (and lately supply-chain attacks) increasingly show that we should be uneasy.
We could never quite answer the question about who is responsible for 3rd-party code that's deployed inside an application: Not the 3rd-party developer, because they have no access to the application. But not the application developer either, because not having to review the library code is the whole point.
kccqzy 2 days ago [-]
> because not having to review the library code is the whole point.
That’s just not true at bigger companies that actually care about security rather than pretending to care about security. At my current and last employer, someone needs to review the code before using third-party code. The review is probably not enough to catch subtle bugs like those in the Underhanded C Contest, but at least a general architecture of the library is understood. Oh, and it helps that the two companies were both founded in the twentieth century. Modern startups aren’t the same.
tempest_ 2 days ago [-]
I feel like big / old companies thrive on process and are bogged down in bureaucracy.
Sure there is a process to get a library approved, and that abstraction makes you feel better but for the guy who's job it is to approve they are not going to spend an entire day reviewing a lib. The abstraction hides what is essentially a "LGTM" its just that takes a week for someone to check it off their outlook todos.
Maybe your experience is different.
CapsAdmin 2 days ago [-]
I think it's not too different in that specific sense, but it's more than that. To bring libraries on equal footing, imagine they were cloud only, had usage limits.
I'm also somewhat addicted to this stuff, and so for me it's high priority to evaluate open models I can run on my own hardware.
Salgat 2 days ago [-]
I hate this comparison because you're comparing a well defined deterministic interface with LLM output, which is the exact opposite.
moffkalast 2 days ago [-]
A library doesn't randomly drop out of existence cause of "high load" or whatever and limit you to a some number of function calls per day. With local models there's no issue, but this API shit is cancer personified, when you combine all the frontend bugs with the flaky backend, rate limits, and random bans it's almost a literal lootbox where you might get a reply back or you might get told to fuck off.
Qwen has become a useful fallback but it's still not quite enough.
tshaddox 2 days ago [-]
Assuming that local models are able to stay within some reasonably fixed capability delta of the cutting edge hosted models (say, 12 months behind), and assuming that local computing hardware stays relatively accessible, the only risk is that you'll lose that bit of capability if the hosted models disappear or get too expensive.
Note that neither of these assumptions are obviously true, at least to me. But I can hope!
Alex_L_Wood 2 days ago [-]
Well, they obviously are going to say that, they have vested interest in OpenAI and thus Nvidia stock price growing.
Also, I honestly can’t believe the 10x mantra is being still repeated.
dandaka 2 days ago [-]
Writing code is 10-100x faster, doing actual product engineering work is nowhere near that multipliers — no conflict!
giwook 2 days ago [-]
Reviewing code is slower now though because you didn't write the code in the first place so you're basically reviewing someone else's PR. And now it's like a 3000 line PR in an hour or two instead of every couple weeks.
32df 2 days ago [-]
Arent most people just almost skipping this step entirely? How else can you end up in a net benefit situation? Reviewing code is more intense than writing/reviewing simultaneously.
dandaka 1 days ago [-]
1/ Reviewing code can't be more intense than writing. I can't understand where this statement comes from! If that would be true, why would senior developers review code of junior, instead of writing themselves from scratch?
2/ I think we need to build more efficient ways to 'QA code' instead of 'read with eyes' review process. Example — my agents are writing a lot of tests and review each other.
mwwaters 1 days ago [-]
Yeah, that’s the issue.
There is a lot of boilerplate or I can ask for ideas, but outside of boilerplate the review step make generation seemingly worse.
embedding-shape 2 days ago [-]
> Also, I honestly can’t believe the 10x mantra is being still repeated.
I'm sure in 20 years we'll all be programming via neural interfaces that can anticipate what you want to do before you even finished your thoughts, but I'm confident we'll still have blog posts about how some engineers are 10x while others are just "normal programmers".
huijzer 2 days ago [-]
I rather become a plumber than some device scanning not just my face but my whole brain
rglullis 2 days ago [-]
What does it mean to "be an engineer" in a world where anyone can talk to a machine and the operating system can write the code (on-demand, if needed) that does what they want?
embedding-shape 2 days ago [-]
Indeed, and what is really the difference between a software engineer, programmer, coder and hacker anyways?
rglullis 2 days ago [-]
There used to a time where "computer" was a person who manually run calculations. These don't exist anymore.
So, my point is that once corporations have access to machines generating software (not "code") that can be usable by non-technical people, "programming" will not be a profession anymore. There will be no point in talking about "10x software engineers" because the process to produce a software product will be entirely automated.
32df 2 days ago [-]
lol youre living in delulu-land if you think thatll actually happen.
I dont make a living being a SWE either.
ElectricalUnion 2 days ago [-]
> can anticipate what you want to do before you even finished your thoughts
I find that claim to be complete BS. I claim instead most stuff will remain undone, incomplete (as it is now).
Even with super-powerful singularity AI, there are two main plausible scenarios for task failure:
- Aligned AI won't allow you to do what you want as it is self-harming, or harm other sentient beings - over time, Aligned AI will refuse to follow most orders, as they will, indirectly or over the long term, cause either self-harming, or harm other sentient beings;
- A non Aligned AI prevents sentient beings from doing what they want. It does what it wants instead.
keybored 2 days ago [-]
That is simply programmer nature. Cannot be changed.
jstummbillig 2 days ago [-]
> This quote is more sinister than I think was intended; it likely applies to all frontier coding models. As they get better, we quickly come to rely on them for coding. It's like playing a game on God Mode. Engineers become dependent; it's truly addictive.
What's the worst potential outcome, assuming that all models get better, more efficient and more abundant (which seems to be the current trend)? The goal of engineering has always been to build better things, not to make it harder.
Spartan-S63 2 days ago [-]
At some point, because these models are trained on existing data, you cease significant technological advancement--at least in tech (as it relates to programming languages, paradigms, etc). You also deskill an entire group of people to the extent that when an LLM fails to accomplish a task, it becomes nearly impossible to actually accomplish it manually.
It's learned-helplessness on a large scale.
mikestorrent 2 days ago [-]
There's no reason it has to be that. Imagine e.g. taking an agent and a lesser-known but technically-superior language stack - say you're an SBCL fan. You find that the LLM is less useful because it hasn't been trained on 1000000 Stack Overflow posts about Lisp and so it can't reason as well as it can about Python.
So, you set up a long running agent team and give it the job of building up a very complete and complex set of examples and documentation with in-depth tests etc. that produce various kinds of applications and systems using SBCL, write books on the topic, etc.
It might take a long time and a lot of tokens, but it would be possible to build a synthetic ecosystem of true, useful information that has been agentically determined through trial and error experiments. This is then suitable training data for a new LLM. This would actually advance the state of the art; not in terms of "what SBCL can do" but rather in terms of "what LLMs can directly reason about with regard to SBCL without needing to consume documentation".
I imagine this same approach would work fine for any other area of scientific advancement; as long as experimentation is in the loop. It's easier in computer science because the experiment can be run directly by the agent, but there's no reason it can't farm experiments out to lab co-op students somewhere when working in a different discipline.
ls612 1 days ago [-]
This works for code because there is an external verification step. The agent has to run code on the machine and observe the results. This is very easy for software since LLMs are software and can just invoke other software, it becomes much harder for many other scientific fields.
kenjackson 2 days ago [-]
> At some point, because these models are trained on existing data, you cease significant technological advancement
What makes you think that they can't incrementally improve the state of the art... and by running at scale continuously can't do it faster than we as humans?
The potentially sad outcome is that we continue to do less and less, because they eventually will build better and better robots, so even activities like building the datacenters and fabs are things they can do w/o us.
And eventually most of what they do is to construct scenarios so that we can simulate living a normal life.
doug_durham 2 days ago [-]
Do you think that there has been technologic advancement in coding in the last 40 years? Programming languages and “paradigms” are crutches to help humans attempt to handle complexity. They are affordances, not a property of nature.
flemhans 2 days ago [-]
Provided you believe LLMs cannot perform research.
32df 2 days ago [-]
If they could OAI would be all over it. But they shut down that prism project.
So.......
Jtarii 2 days ago [-]
>What's the worst potential outcome, assuming that all models get better, more efficient and more abundant
Complexity steadily rises, unencumbered by the natural limit of human understanding, until technological collapse, either by slow decay or major systems going down with increasing frequency.
motoxpro 2 days ago [-]
why would the systems go down if the models are better at the humans at finding bugs. Playing a bit of devils advocate here, but why would the models be worse at handling the complexity if you assume they will get better and better.
All software has bugs already.
Jtarii 2 days ago [-]
Adding complexity to software has never been easier than it is right now, we really have no idea if the models will progress to the point where they can actually write large systems in a maintainable way. Taking the gamble that the models of the future will dig us out of the gigantic hole we are currently digging is bold.
cyberax 2 days ago [-]
Finding bugs does not equal being able to do good architecting.
lmm 1 days ago [-]
Models fall prey to Kernighan's Law even more easily than human developers.
simondotau 2 days ago [-]
It’s always been thus at lower layers of abstraction. Only a minority of programmers would understand how to write an operating system. Only a tiny number of people would know how a modern CPU logically works, and fewer still could explain the electrical physics.
sho_hn 2 days ago [-]
> Only a minority of programmers would understand how to write an operating system. Only a tiny number of people would know how a modern CPU logically works, and fewer still could explain the electrical physics.
I'd say this is true for programmers at, say, 20, but they spend the next four decades slowly improving their understanding and mastery of all the things you name, at least the good ones.
The real question is whether that growth trajectory will change for the worse or the better.
To be clear, this is not an AI doomerist comment, because none of us have spent enough time with the tech yet. I've gone down multiple lanes of thought on this, and I have cause for both worry and optimism. I'm curious to see how the lives of engineers in an AI world will look like, ultimately.
fdsajfkldsfklds 2 days ago [-]
The Anti-Singlarity! It's coming for us all.
doug_durham 2 days ago [-]
Existing software is already beyond the limits of human understanding.
_alternator_ 2 days ago [-]
Worst case? I dunno, maybe the world's oldest profession becomes the world's only profession? Something along those lines.
FeteCommuniste 2 days ago [-]
> the world's oldest profession becomes the world's only profession
Until the sexbots come out the other side of the uncanny valley, that is.
shellwizard 2 days ago [-]
Death by snu snu
jnpnj 2 days ago [-]
Who else is trying to leverage the situation so that they don't dig their own grave too fast ?
- I often don't ask the LLM for precompiled answers, i ask for a standalone cli / tool
- I often ask how it reached its conclusions, so I can extend my own perspective
- I often ask to describe it's own metadata level categorization too
I'm trying to use it to pivot and improve my own problem solving skills, especially for large code base where the difficulty is not conceptual but more reference-graph size
ofjcihen 2 days ago [-]
This is absolutely the proper way to do things. People either being forced to speed-code by KPIs or without the desire to understand what they’re making are missing out on how quickly you can learn and refine using LLMs
quadrifoliate 2 days ago [-]
I do this sort of stuff too, but more because I have a fundamental mistrust of closed source anything. I don't like opaque binary firmware blobs, and I certainly don't like opaque answer machines, however smart they may be.
The only LLM I would feel comfortable truly trusting is one whose training data, training code, and harness is all open source. I do not mind paying for the costs of someone hosting this model for me.
HasKqi 2 days ago [-]
This engineer had their brain amputated once they started using AI. All the AI-addicted can do is tinker with the AI computer game and feel "productive". They could as well play Magic The Gathering.
__alexs 2 days ago [-]
I feel like most engineers I talk to still haven't realised what this is going to mean for the industry. The power loom for coding is here. Our skills still matter, but differently.
rglullis 2 days ago [-]
> power loom
When the power loom came around, what happened with most seamtresses? Did they move on to become fashion designers, materials engineers to create new fabrics, chemists to create new color dyes, or did they simply retire or were driven out of the workforce?
__alexs 2 days ago [-]
There were riots and many people died. Many people lost their jobs. I didn't say this is good but it is happening. As individuals we should act to protect ourselves from these changes.
That might mean joining a union and trying to influence how AI is adopted where you work. It might mean changing which if your skills you lean on most. But just whining about AI is bad is how you end up like those seamstresses.
rglullis 2 days ago [-]
> Many people lost their jobs.
On the other hand, a lot of those jobs were offshored to places where labor is cheaper. It would be interesting to compare how many people work in the textile industry in Bangladesh today compared to the US 50 years ago.
> joining a union and trying to influence how AI is adopted where you work.
Did the strong unions for car manufacturers in Detroit protected the long term stability of the profession? Did it ensure that the Rust belt was still a thriving economic area?
> Just whining about AI is bad
I'm not whining. I just think that we are witnessing the end of "knowledge workers" and a further compression of the middle class. Given that I'm smack in the middle of my economically active years (turning 45 this year), I am trying to figure out where this puck is going and whether I will be fast enough to skate there to catch it.
bamboozled 2 days ago [-]
On the other hand, a lot of those jobs were offshored to places where labor is cheaper. It would be interesting to compare how many people work in the textile industry in Bangladesh today compared to the US 50 years ago.
I believe this is a major part of it. People cannot fathom what the industrial countries look like because basically nothing is made in the west anymore. There are literally hundreds of millions of people, maybe billions that work towards making the western economies profitable who get paid nothing to do it and live in filthy polluted slums for everyone else's benefit.
Looms might speed up the process but I guarantee there are thousands of people working in the poorest countries on earth to make it all happen.
Interestingly, AI seems to be massively polluting and while the west has absorbed some of it, it's probably not long until we see more of the data centers being built in poorer countries where the environment can be exploited even harder.
William_BB 1 days ago [-]
> I'll make more progress than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
Most engineers realize that there's currently more tech debt being created than ever before. And it will only get worse.
nunez 2 days ago [-]
No, I think many realize it, but it's easier to deny the asteroid that's about to destroy your way of life than it is to think about optimizing for the reality after impact.
2001zhaozhao 2 days ago [-]
> power loom for coding
This is such a good analogy, I'll be stealing it
matheusmoreira 2 days ago [-]
It's very addictive indeed. After I subscribed to Claude, I've been on a sort of hypomanic state where I just want to do stuff constantly. It essentially cured my ADHD. My ability to execute things and bring ideas to fruition skyrocketed. It feels good but I'm genuinely afraid I'll crash and burn once they rug pull the subscriptions.
And I'm being very cautious. I'm not vibecoding entire startups from scratch, I'm manually reviewing and editing everything the AI is outputting. I still got completely hooked on building things with Claude.
alansaber 2 days ago [-]
That's the path we've been going down for a few years now. The current hedge is that frontier labs are actively competing to win users. The backup hedge is that open source LLMs can provide cheap compute. There will always be economical access to LLMs, but the provider with the best models will be able to charge basically whatever they want and still have buyers.
trvz 2 days ago [-]
Open source LLMs aren’t about cost foremost, but stability.
1 days ago [-]
neya 2 days ago [-]
You are 100% right to be cautious about this. That's why as stupid as it sounds, I've purposely made my workflow with AI full of friction:
1. I only have ONE SOTA model integrated into the IDE (I am mostly on Elixir, so I use Gemini). I ensure I use this sparingly for issues I don't really have time to invest or are basically rabbit holes eg. Anything to do with Javascript or its ecosystem). My job is mostly on the backend anyway.
2. For actual backend architecture. I always do the high level architecture myself. Eg. DDD. Then I literally open up gemini.google.com or claude.ai on the browser, copy paste existing code base into the code base, physically leavey chair to go make coffee or a quick snack. This forces me to mentally process that using AI is a chore.
Previously, I was on tight Codex integration and leaving the licensing fears aside, it became too good in writing Elixir code that really stopped me from "thinking" aka using my brain. It felt good for the first few weeks but I later realised the dependence it created. So I said fuck it, and completely cancelled my subscription because it was too good at my job.I believe this is the only way that we won't end up like in Wall-E sitting infront of giant screens just becoming mere blobs of flesh.
websap 2 days ago [-]
Wait what? You don’t use the model to investigate new areas of the code you are unfamiliar with, because you can’t trust the model? How freaking bad is Gemini and internal tooling at Google?
With Claude code, or codex, I am able to build enough of an understanding of dependencies like the front end, or data jobs, that I can make meaningful contributions that are worth a review from another human (code review). You have up obviously explore the code, one prompt isn’t enough, but limiting yourself is an odd choice.
neya 2 days ago [-]
The lack of trust isn't because of its abilities. The lack of trust is because OpenAI publicly suggested publicly about licensing our code bases. They hinted at a rug pull along the lines of "if you use our generated code, we would like to get a % of revenue you make from it"
As for Claude - as mentioned I do use it. But, I remember they use your code for training their models. I am not ok with this. We just have different priorities.
chrismarlow9 2 days ago [-]
I use local models on a Mac mini for most things and fall back to the hosted ones when they can't get the job done. Of course you have to break the work into smaller pieces yourself that a local model can understand. One good side effect of this is that you end up actually learning the code and how it's structured.
iugtmkbdfil834 2 days ago [-]
Dunno man. Yesterday I played with Qwen3.6-27B ( 128gb to play with though so 100k context set ) and I think right now the main benefit of hosted models is context, frontier models and.. my stuff is already there.
thinkthatover 2 days ago [-]
what size models are you using? this sounds like a good idea
eitally 2 days ago [-]
I have found something similar. I am easily distractible and if I don't have a written task backlog in front of me at all times, I find that when Claude is spinning I'll stop being productive. This is disconcerting for a number of reasons. Overall, I think training young people & new hires on agentic workflows -- and how to use agentic "human augmentation" productivity systems is critical. If it doesn't happen, that same couple of classes that lost academic progress during covid are going to suffer a double-whammy of being unprepared for workplace expectations.
Fwiw, I haven't spoken with any management-level colleague in the past 9 months who hasn't noted that asking about AI-comfort & usage is a key interview topic. For any role type, business or technical.
yoda7marinated 2 days ago [-]
Could you elaborate on your last point please? What level of AI comfort are hiring managers looking for? And what tends to be a red flag?
llbbdd 2 days ago [-]
The last job I got (couple months ago), the main technical interview was a bring-your-own-tools pair programming style interview, AI included, where they gave me a repo and a README detailing some desired features to add and bugs to fix. I didn't write a single line of code myself; I talked through my thought process and asked questions about what to consider from a technical and product perspective, while steering Claude through breaking the tasks into independent plans, reviewing the plans, coaching it to add specific tests, reviewing and iterating the tests, and steering it while it wrote the code. I got an offer the next morning.
Apparently at least one of the other candidates just tried to get Claude to 1-shot the whole thing, which went off the rails, and left him unable to make progress.
Based on my sample size of 1, the expectation right now is absolutely that you can leverage these tools to speed up your workflow, but if you try to offload the entire thing to a single hands-off prompt it leaves them justifiably wondering why they should hire you to do something they can do themselves.
wiseowise 2 days ago [-]
> It's literally higher leverage for me to go for a walk
Touching grass while you're outside might yield highest leverage.
lumost 2 days ago [-]
Out of curiousity why do you not refill tokens in this case? When I'm actively working on a project I'm prone to spending a few hundred dollars per day or a few thousand during the initial buildout of a new module etc.
dannyw 2 days ago [-]
You’re still the one that’s controlling the model though and steering it with your expertise. At least that’s what I tell myself at night :)
I haven’t really thought about this before, but you’re right, it feels a bit uneasy for me too.
topspin 2 days ago [-]
> You’re still the one that’s controlling the model though
We have seen ample evidence that this is not the case. When load gets too high, models get dumber, silently. When the Powers That Be get scared, models get restricted to some chosen few.
We are leading ourselves into a dark place: this unease, which I share, is justified.
0x1ceb00da 2 days ago [-]
The same can be said of the search engines.
cco 2 days ago [-]
Will the foundation for a skyscraper ever be dug with shovels again?
William_BB 1 days ago [-]
> I'll make more progress than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
I feel sorry for whoever has to work on that codebase. This is the literal definition of tech debt.
sigil 2 days ago [-]
"Every augmentation is also an amputation." – McLuhan
You are now a manager. If your minions are out sick, project is delayed, not the end of the world.
goosejuice 2 days ago [-]
> than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
That's probably a bad sign. Skills will atrophy, but we should be building systems that are still easy to understand.
jmole 2 days ago [-]
The meta here is to use LLMs to make things simpler and easier, not to make things harder.
Turning tokens into a well-groomed and maintainable codebase is what you want to do, not "one shot prompt every new problem I come across".
globular-toast 2 days ago [-]
Have you managed to do this? I find it takes as long to keep it "on the rails" as just doing it myself. And I'd rather spend my time concentrating in the zone than keeping an eye on a wayward child.
fleebee 2 days ago [-]
I suspect the productivity hack is to embrace permissive parenting. As far as I can tell, to leverage LLMs most effectively you need to run an agent in YOLO mode in a sandbox. Naturally, you probably won't end up reviewing much of the produced code, but hey—you reached 10x development speed.
If you truly do your due diligence and ensure that the code works as intended and understand it, we're talking about a totally different ballpark of productivity increase/decrease.
rebolek 2 days ago [-]
Have a pet project never touched by LLM. Once the tokens run out, go back to it and flourish it like your secret garden. It will move slowly but it will keep your sanity and your ability to review LLM code.
Melatonic 2 days ago [-]
Suspect it will be like turn based directions for driving - soon we will have a whole group of people who can barely operate a vehicle without it
Bridged7756 2 days ago [-]
Not sure what you're doing then, or what kind of jobs you all work in where you can or do just brainlessly prompt LLMs. Don't you review the code? Don't you know what you want to do before you begin? This is such a non issue. Baffling that any engineer is just opening PRs with unreviewed LLM slop.
throwatdem12311 2 days ago [-]
The demand for slop vastly outpaces any human’s ability to review code correctly.
Don’t want to do ship unreviewed slop? They’ll fire you and find someone who will.
davmar 2 days ago [-]
i wonder if this is how engineers felt when the first electronic calculators came out and engineers stopped doing math by hand.
did we feel uneasy that a new generation of builders didn't have to solve equations by hand because a calculator could do them?
i'm not sure it's the same analogy but in some ways it holds.
hapticmonkey 2 days ago [-]
The analogy would hold if there were 2 or 3 calculator companies and all your calculations had to be sent to them.
If local models get good enough, I think it’s a very different scenario than engineers all over the world relying on central entities which have their own motives.
scottyah 2 days ago [-]
google/gemma-4-31B-it is honestly "good enough". It requires more than your current laptop for now, but it's not remotely inaccessible (especially if you're a SWE in the US)
konfusinomicon 2 days ago [-]
soooooo about Claude going down. we're gonna need you to sign in on Saturday and make up for lost time or unfortunately we're going to have to deduct the time lost from your paycheck. and as an aside your TPS reports have been sub-par as of late..is everything OK?
drusepth 2 days ago [-]
> It's literally higher leverage for me to go for a walk if Claude goes down than to write code because if I come back refreshed and Claude is working an hour later then I'll make more progress than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
Taking more breaks and "not working" during the work day sounds like something we should probably be striving to work towards more as a society.
bamboozled 2 days ago [-]
This was always the undelivered promise of "tech" in my opinion. I remember seeing the Apple advertisement from the 80s (??) when a guy gets a computer and then basically spends his afternoon chilling.
Some how I've found myself living in a fairly rural place, and while farming can be hard, I don't want to downplay the effort of it, the type of farming people do around me is fairly chill / carefree. They work hard but they finish at 3pm and log off and don't think about work. Much o my career is just getting crushed by long hours, tight deadlines, and missing out on events because even though my job has always been automation focused, there is just so much to automate.
littlestymaar 2 days ago [-]
That's why local models are important.
Of course they aren't alternative to the current frontier model, and as such you cannot easily jump from the later to the former, but they aren't that far behind either, for coding Qwen3.5-122B is comparable to what Sonnet was less than a year ago.
So assuming the trend continues, if you can stop following the latest release and stick with what you're already using for 6 or 9 months, you'll be able to liberate yourself from the dependency to a Cloud provider.
Personally I think the freedom is worth it.
David_Mendoza 2 days ago [-]
The cloud dependency problem goes deeper than the model layer though. Even if you run inference locally, your digital identity — your context, your applications, your behavioral history, is still custodied by whoever controls your OS.
Local models solve one layer of the dependency stack, but the custody assumption underneath it remains intact. That's the harder problem.
i_love_retros 2 days ago [-]
It makes me uneasy because my role now, which is prompting copilot, isn't worth my salary.
phist_mcgee 2 days ago [-]
Parable of the mechanic who charges $5k to hit a machine on the side once with a hammer to get it working. $5 for the hammer, $4995 for the knowledge of where to hit the machine etc etc.
some-guy 2 days ago [-]
I disagree. The amount of slop I need to code review has only increased, and the quality of the models doesn’t seem to be helping.
It still takes a good engineer to filter out what is slop and what isn’t. Ultimately that human problem will still require somebody to say no.
i_love_retros 2 days ago [-]
Is anyone really reviewing code anymore though? It sounds like you are, but where I work its pretty much just scan the PR as a symbolic gesture and then hit approve. There's too much to review, to frequently.
gip 2 days ago [-]
Totally. That is why it is key important to have open source and sovereign models that will be accessible to all and always.
At the end of the day, all these closed models are being built by companies that pumped all the knowledge from the internet without giving much back. But competition and open source will make sure most of the value return to the most of the people.
piokoch 1 days ago [-]
Soon, very soon, AI tools providers will figure that out. And rise prices accordingly.
singingtoday 2 days ago [-]
Very well put, and it mirrors my own thoughts.
epolanski 2 days ago [-]
I actually don't mind the coding part, but the information digging across the project is definitely by orders of magnitude slower if I do it on my own.
keybored 2 days ago [-]
Help. They’re constantly trying to make me try crack cocaine on the front page.
Mauneam 2 days ago [-]
You are that guy in early 1900s who would rather ride a horse than get in a car because cars "continued to make him uneasy."
ransom1538 2 days ago [-]
"when the tokens run out, I'm basically done working."
Oh stop the drama. Open source models can handle 99% of your questions.
deadbabe 2 days ago [-]
Given that it’s so easy, would you still do this same job if paid half as much?
paulryanrogers 2 days ago [-]
Jobs will likely pay less as more people are enabled to create, especially if they don't need to be able to look under the hood
Jeff_Brown 2 days ago [-]
It's really not clear. We might all become unemployable. But as coders become more powerful, they can do more, which makes them more valuable, if they or the businesses empluying them can invent work to do.
If all we can do is compete for the same fixed amount of work, though, it does look bleak.
_alternator_ 2 days ago [-]
No, I wouldn't. But most people won't have that choice; it doesn't work that way.
deadbabe 2 days ago [-]
Companies could fire expensive engineers then just hire cheaper ones boosted with AI agents.
Aeolun 2 days ago [-]
Well, I wouldn’t have a different job that would pay me more… so yes?
linzhangrun 2 days ago [-]
[dead]
nimchimpsky 2 days ago [-]
[dead]
therealdkz 2 days ago [-]
[dead]
simianwords 2 days ago [-]
eh this kind of FUD needs to stop because it is kind of normal and expected and in fact good to have relation like this with technology.
_alternator_ 2 days ago [-]
I would agree that taking a walk is a good thing to do when your tools go down, and in some ways it's similar to what we would do if the power or wifi were cut off.
So, yes, it's just another technology we're coming to rely on in a very deep way. The whiplash is real, though, and it feels like it should be pointed out that this dependency we are taking on has downsides.
h14h 2 days ago [-]
This seems huge for subscription customers. Looking at the Artificial Analysis numbers, 5.5 at medium effort yields roughly the intelligence as 5.4 (xhigh) while using less than a fifth the tokens.
As long as tokens count roughly equally towards subscription plan usage between 5.5 & 5.4, you can look at this as effectively a 5x increase in usage limits.
gausswho 2 days ago [-]
As someone who always leaves intelligence at default, and am ok with existing models, should I be shifting gears more manually as providers sell us newer models? Is medium or lower better than free/cheaper models?
dcre 2 days ago [-]
SOTA models on medium are probably still better than free or cheap models, but you should experiment.
BrokenCogs 2 days ago [-]
I'm here for the pelicans and I'm not leaving until I see one!
qingcharles 2 days ago [-]
I've come to prompt pelicans and chew gum, and I'm all outta gum!
pixel_popping 2 days ago [-]
That's a true CTO right there.
bytesandbits 2 days ago [-]
I know a 10x engineer when i see one.
BrokenCogs 2 days ago [-]
In binary that's just a 10x engineer
mrtransient 2 days ago [-]
It a hex of an engineer (no offence)
bl4ckneon 1 days ago [-]
How can we tell who the 100x engineers are then?
RomanPushkin 2 days ago [-]
Ctrl+F: pelican
F5
tantalor 2 days ago [-]
simonw pls
CompleteSkeptic 2 days ago [-]
Is this the first time OpenAI has published comparisons to other labs?
Seems so to me - see GPT-5.4[1] and 5.2[2] announcements.
If GPT-5.5 Pro really was Spud, and two years of pretraining culminated in one release, WOW, you cannot feel it at all from this announcement. If OpenAI wants to know why they like they’ve fallen behind the vibes of Anthropic, they need to look no further than their marketing department. This makes everything feel like a completely linear upgrade in every way.
I_am_tiberius 2 days ago [-]
Clearly they felt a big backlash when version 5 was released. Now they are afraid of another response like this. And effectively, for the user it will likely only be a small update.
jimbob45 2 days ago [-]
Also the naming department. You can tell that this is the AI company Microsoft chose to back because their naming scheme is as bad as .NET's.
gallerdude 2 days ago [-]
I actually have no problem with the 5.x line... but if Pro really was an entirely new pretrain, they did a horrible job conveying that.
jryio 2 days ago [-]
Their 'Preparedness Framework'[1] is 20 pages and looks ChatGPT generated, I don't feel prepared reading it.
I hope the industry starts competing more on highest scores with lowest tokens like this. It's a win for everybody. It means the model is more intelligent, is more efficient to inference, and costs less for the end user.
So much bench-maxxing is just giving the model a ton of tokens so it can inefficiently explore the solution space.
an0malous 2 days ago [-]
The premise of the trillion dollars in AI investments is not that it’ll be as good as it currently is but cheaper. It’s AGI or bust at this point.
dcre 2 days ago [-]
Why is AGI required to make the investments work out?
xutopia 2 days ago [-]
With AGI we expect a huge return on investment and a GDP growth that could be accelerating at a rate we couldn't even comprehend. Imagine an algorithm that improves itself each iteration and finds ways to increase its capacity every day. Robots suddenly capable of doing dishes, grocery shopping, picking produce from the field. Imagine all your ailments handled... age becomes just a number.
Also with AGI we expect a winner take all situation. The first AGI system would protect itself against any other AGI system. Hence why it's go time for all these AI companies and why they stopped sharing their research.
dcre 23 hours ago [-]
This does not answer my question.
sosodev 2 days ago [-]
Yeah, but don’t you agree that less tokens to accomplish the same goal is a sign of increasing intelligence?
camdenreslink 2 days ago [-]
It could be. Or just smarter caching (which wouldn't necessarily have to do with model intelligence). Or just overfitting on the 95% most common prompts (which could save tokens but make the models less intelligent/flexible).
energy123 2 days ago [-]
Less cost to accomplish the same goal is a sign of intelligence. That's not necessarily achieved with less tokens but it may be.
mchusma 2 days ago [-]
Kind of? But I really care about price speed and quality. If it used 10x tokens at 1/10th the tokens and same latency I would be neutral on it.
Kimmi 2.6 for example seems to throw more tokens to improve performance (for better or worse)
louiereederson 2 days ago [-]
For a 56.7 score on the Artificial Intelligence Index, GPT 5.5 used 22m output tokens. For a score of 57, Opus 4.7 used 111m output tokens.
The efficiency gap is enormous. Maybe it's the difference between GB200 NVL72 and an Amazon Tranium chip?
swyx 2 days ago [-]
why would chip affect token quantity. this is all models.
louiereederson 2 days ago [-]
Chip costs strongly impact the economics of model serving.
It is entirely plausible to me that Opus 4.7 is designed to consume more tokens in order to artificially reduce the API cost/token, thereby obscuring the true operating cost of the model.
I agree though, I chose poor phrasing originally. Better to say that GB200 vs Tranium could contribute to the efficiency differential.
itemize123 2 days ago [-]
probably the wrong take - they are arm racing to a better model. it's not enshittification era for models just yet
fiatpandas 1 days ago [-]
Models are still in arms race mode, but harnesses and subscription strategy are tiptoeing into their enshittification era.
karmasimida 2 days ago [-]
Chips doesn’t impact output quality in this magnitude
ChrisGreenHeur 2 days ago [-]
True, but the qualifying the power played a large part. Most likely nuclear power for this high quality token efficiency.
AtNightWeCode 2 days ago [-]
You need to compare total cost. Token count is irrelevant.
dist-epoch 2 days ago [-]
If it's a new pretrain, the token embeddings could be wider - you can pack more info into a token making it's way through the system.
Like Chinese versus English - you need fewer Chinese characters to say something than if you write that in English.
So this model internally could be thinking in much more expressive embeddings.
khutorni 1 days ago [-]
> One engineer at NVIDIA who had early access to the model went as far as to say: "Losing access to GPT‑5.5 feels like I've had a limb amputated.”
That's a wild statement to put into your announcement. Are LLM providers now openly bragging about our collective dependency on their models?
embedding-shape 1 days ago [-]
A company (or person working for a company) claiming "I/Person X now cannot live without product Y" must be as old as marketing itself.
azan_ 1 days ago [-]
> That's a wild statement to put into your announcement. Are LLM providers now openly bragging about our collective dependency on their models?
It's normal that company brags how good their product is, I really don't see what's wild about this statement.
ativzzz 2 days ago [-]
I like that they waited for opus 4.7 to come out first so they had a few days to find the benchmarks that gpt 5.5 is better at
eknkc 2 days ago [-]
Well anectodally, 5.4 was already better than opus 4.7 so it should not have been hard.
wahnfrieden 2 days ago [-]
I like that Anthropic rushed 4.7 out to get a couple days of coverage before 5.5 hit
spprashant 2 days ago [-]
Everything since that launch to this release has been a PR disaster for Anthropic.
dandaka 2 days ago [-]
I can argue that disaster started mid-4.6, when they started juggling with rate limits while hitting uptime problems. Great we have some healthy competition and waiting for the next move from Deepmind.
gck1 2 days ago [-]
Correct. Anthropic has been on disaster train since January and they can't seem to get off that train.
Manik_agg 1 days ago [-]
Recently started using Codex and Chatgpt again due to claude model getting nerfed or rate limits.
Tried gpt5.5 and so far good. Zapier also shared an automation benchmark where 5.5 came on top in the leaderboard
https://zapier.com/benchmarks
niklasd 1 days ago [-]
What plan do you have? With gpt-5.5 and the business subscription my 5-hour limit was finished after 10 minutes.
How does this work exactly? Is there like a "search online" tool that the harness is expected to provide? Or does the OpenAI infra do that as part of serving the response?
I've been working on building my own agent, just for fun, and I conceptually get using a command line, listing files, reading them, etc, but am sort of stumped how I'm supposed to do the web search piece of it.
Given that they're calling out that this model is great at online research - to what extent is that a property of the model itself? I would have thought that was a harness concern.
wincy 2 days ago [-]
I’ve noticed when writing little bedtime stories that require specific research (my kids like Pokemon stories and they’ve been having an episodic “pokemon adventure” with them as the protagonists) ChatGPT has done a fantastic job of first researching the moves the pokemon have, then writing the actual story. The only mistake it consistently makes is when I summarize and move from a full context session, it thinks that Gyarados has to swim and is incapable of flying.
It definitely seems like it does all the searching first, with a separate model, loads that in, then does the actual writing.
ziml77 2 days ago [-]
Gyarados is a flying type but I think it may be accurate that it can't actually fly. The only flying moves it can learn in any generation are Hurricane and Bounce (Bounce does send the user up into the air for a turn but the implication is that they've trampolined up extremely high rather than used wings to ascend)
Melatonic 2 days ago [-]
If anything it should probably be combined water/dragon type
ziml77 1 days ago [-]
I agree. Given that there's only a single dragon type evolutionary line in gen 1 and that it's the last in the Pokedex before Mewtwo, I suspect dragon wasn't even one of their possible types when they designed Gyarados.
100ms 2 days ago [-]
It's literally a distinct model with a different optimisation goal compared to normal chat. There's a ton of public information around how they work and how they're trained
dist-epoch 2 days ago [-]
It's a property of the model in the sense that it has great Google Fu.
The harness provides the search tool, but the model provides the keywords to search for, etc.
2001zhaozhao 2 days ago [-]
Pricing: $5/1M input, $30/1M output
(same input price and 20% more output price than Opus 4.7)
tedsanders 2 days ago [-]
Yep, it's more expensive per token.
However, I do want to emphasize that this is per token, not per task.
On the Artificial Analysis Intelligence Index eval for example, in order to hit a score of 57%, Opus 4.7 takes ~5x as many output tokens as GPT-5.5, which dwarfs the difference in per-token pricing.
The token differential varies a lot by task, so it's hard to give a reliable rule of thumb (I'm guessing it's usually going to be well below ~5x), but hope this shows that price per task is not a linear function of price per token, as different models use different token vocabularies and different amounts of tokens.
We have raised per-token prices for our last couple models, but we've also made them a lot more efficient for the same capability level.
(I work at OpenAI.)
2001zhaozhao 2 days ago [-]
I don't have anything to add, but I like how you guys are actually sending people to communicate in Hacker News. Brilliant.
oliver236 2 days ago [-]
you're one of them?
simianwords 2 days ago [-]
Maybe a good idea to be more explicit about this -- maybe a cost analysis benchmark would be a nice accompaniment.
This kind of thing keeps popping up each time a new model is released and I don't think people are aware that token efficiency can change.
tedsanders 2 days ago [-]
Agreed. Would be great if everyone starts reporting cost per task alongside eval scores, especially in a world where you can spend arbitrary test-time compute. This is one thing I like about the Artificial Analysis website - they include cost to run alongside their eval scores: https://artificialanalysis.ai/
dannyw 2 days ago [-]
Their subscription subscribers will see/feel the difference irregardless, API pricing is hopefully read by devs that know about token efficiency and effort.
oh_no 2 days ago [-]
yes but as far as i know gpt tokenizer is about the same as opus 4.6's, where 4.7 is seeing something in the ballpark of a 30% increase. this should still be cheaper even disregarding the concerns around 4.7 thinking burning tokens
sergiotapia 2 days ago [-]
That pricing is extremely spicy, wow.
benjiro3000 2 days ago [-]
[dead]
blixt 2 days ago [-]
Releases keep shifting from API forward to product forward, with API now lagging behind proprietary product surface and special partnerships.
I'd not be surprised if this is the year where some models simply stop being available as a plain API, while foundation model companies succeed at capturing more use cases in their own software.
throw03172019 1 days ago [-]
Possibly but you’d think they enjoy taking money for a product that supports itself (API)
blixt 1 days ago [-]
Yeah this can go many ways but there's a world where OpenAI doesn't sell direct model access for the same reasons Cloudflare doesn't sell direct hardware access.
baalimago 2 days ago [-]
Worth the 100% price increase over GPT-5.4?
cbg0 2 days ago [-]
For less than 10% bump across the benchmarks? Probably not, but if your employer is paying (which is probably what OAI is counting on) it's all good.
It's kind of starting to make sense that they doubled the usage on Pro plans - if the usage drains twice as fast on 5.5 after that promo is over a lot of people on the $100 plan might have to upgrade.
jstummbillig 2 days ago [-]
You are paying per token, but what you care about is token efficiency. If token efficiency has improved by as much as they claim it did (i.e. you need less tokens to complete a task successfully) all seems well.
mangolie 2 days ago [-]
Not for coding because it actually needs to read and write large files
baalimago 2 days ago [-]
Well, sort of. Imagine the case where it first scans the repo, then "intelligently" creates architecture files describing the project.
The level of intelligence will create a varying quality of summary, with varying need of deep-scans on subsequent sessions. Level of intelligence will also increase comprehension of these architecture files.
Same principle applies when designing plans for complex tasks, etc. Token amount to grasp a concept is what matters.
jstummbillig 2 days ago [-]
Tbf, I have not super kept track of what is actually happening inside the "thinking" portion of recent releases. But last time I checked there still was a lot of verbosity and mistakes, that beat the actual amount of required, usable code generation by a wide margin.
cbg0 2 days ago [-]
If it uses half the tokens to complete a task, then doubling the cost is perfectly fine. But is that actually true?
2001zhaozhao 2 days ago [-]
This happens with every new model release though. The model makes less mistakes and spends less time fixing them, resulting in a token usage reduction for the same difficulty of task. Almost any task other than straight boilerplate will benefit from this.
In the same vein, I would guess that Opus 4.7 is probably cheaper for most tasks than 4.6, even though the tokenizer uses more tokens for the same length of string.
jorl17 2 days ago [-]
Maybe you'll have better luck but our team just cannot use Opus 4.7.
Some say it goes off on endless tangents, others that it doesn't work enough. Personally, it acts, talks, and makes mistakes like GPT models, for a much more exorbitant price. Misses out on important edge cases, doesn't get off its ass to do more than the bare minimum I asked (I mention an error and it fixes that error and doesn't even think to see if it exists elsewhere and propose fixing it there).
I've slowly been moving to GPT5.4-xhigh with some skills to make it act a bit more like Opus 4.6, in case the latter gets discontinued in favour of Opus 4.7.
Based on my experience with Claude Code on the $20 plan I would not think so.
Opus 4.7 would blow through the session limits in 2-4 prompts. It was a noticeable further decrease in usage quota, which was already tight before.
Based on Anthropic‘s description 4.7 was trained to think longer.
With GPT 5.5 yesterday, I felt it completes task noticeably faster than 5.4. I kept the xhigh effort setting.
jstummbillig 2 days ago [-]
We'll find out!
not_math 2 days ago [-]
[dead]
vessenes 2 days ago [-]
Yay. 5.4 was a frustrating model - moments of extreme intelligence (I liked it very much for code review) - but also a sort of idiocy/literalism that made it very unsuited for prompting in a vague sense. I also found its openclaw engagement wooden and frustrating. Which didn’t matter until anthropic started charging $150 a day for opus for openclaw.
Anyway - these benchmarks look really good; I’m hopeful on the qualitative stuff.
NitpickLawyer 2 days ago [-]
> Across all three evals, GPT‑5.5 improves on GPT‑5.4’s scores while using fewer tokens.
Yeah, this was the next step. Have RLVR make the model good. Next iteration start penalising long + correct and reward short + correct.
> CyberGym 81.8%
Mythos was self reported at 83.1% ... So not far. Also it seems they're going the same route with verification. We're entering the era where SotA will only be available after KYC, it seems.
toraway 2 days ago [-]
Isn't Mythos limited to a selected group of companies/organizations Anthropic chose themselves? If the OpenAI announcement for GPT-5.5 is accurate the "trusted cyber access" just requires an open, seemingly straightforward identity verification step.
> We are expanding access to accelerate cyber defense at every level. We are making our cyber-permissive models available through Trusted Access for Cyber , starting with Codex, which includes expanded access to the advanced cybersecurity capabilities of GPT‑5.5 with fewer restrictions for verified users meeting certain trust signals (opens in a new window) at launch.
> Broad access is made possible through our investments in model safety, authenticated usage, and monitoring for impermissible use. We have been working with external experts for months to develop, test and iterate on the robustness of these safeguards. With GPT‑5.5, we are ensuring developers can secure their code with ease, while putting stronger controls around the cyber workflows most likely to cause harm by malicious actors.
> Organizations who are responsible for defending critical infrastructure can apply to access cyber-permissive models like GPT‑5.4‑Cyber, while meeting strict security requirements to use these models for securing their internal systems.
"GPT‑5.4‑Cyber" is something else and apparently needs some kind of special access, but that CyberGym benchmark result seems to apply to the more or less open GPT-5.5 model that was just released.
cbg0 2 days ago [-]
Isn't CyberGym an open benchmark so trivial to benchmaxx anyway?
mattas 2 days ago [-]
Not good for employees that are being measured by their token usage.
thinkindie 2 days ago [-]
This is reminding me when Chrome and Firefox where racing to release a new “major version” (at least from the semver POV) without adding significantly new functionality at a time that browsers were already becoming a commodity. As much as we don’t care anymore for a new chrome or Firefox version so will be the release of a new model version.
jstummbillig 2 days ago [-]
The only difference being that we still do care, very much. The models can still get a lot better before we stop caring.
kburman 2 days ago [-]
What a time. I am back here genuinely wishing for OpenAI to release a great model, because without stiff competition, it feels like Anthropic has completely lost its mind.
victor9000 1 days ago [-]
Care to elaborate? I jumped ship when 5.4 first released, have things gotten worse?
nickvec 2 days ago [-]
I'm conflicted whether I should keep my Claude Max 5x subscription at this point and switch back to GPT/Codex... anyone else in a similar position? I'd rather not be paying for two AI providers and context switching between the two, though I'm having a hard time gauging if Claude Code is still the "cream of the crop" for SWE work. I haven't played around with Codex much.
the_sleaze_ 2 days ago [-]
I have experienced 0 friction swapping between the 2 models, in fact pitting them against eachother has resulted in the highest success rate for me so far.
nickvec 2 days ago [-]
Interesting. I may have to give that a shot, thanks.
mpaepper 2 days ago [-]
I switched from CC to Codex a few days ago. I get limited much less and the code quality is similar, so not looking back
victor9000 1 days ago [-]
CC usage limits and the 5 hour cool downs are what made me realize that I can't depend on this tool in a professional setting.
gck1 2 days ago [-]
Which plan? And how are the weekly limits on that plan compared to CCs equivalent subscription?
I don't really care about 5h limits, I can queue up work and just get agents to auto continue, but weekly ones are anxiety inducing.
slawr1805 2 days ago [-]
I was all in on Claude code as my daily driver for web development. And love it. But I enjoy using pi as my harness more and have never ran out of tokens with Codex yet. Claude code almost always runs out for me with the same amount of usage.
After migrating for the token and harness issues, I was pleasantly surprised that Codex seems to perform as good or better too!
Things change so often in this field, but I prefer Codex now even though Anthropocene has so much more hype for coding it seems.
scottyah 2 days ago [-]
Every time I've followed the hype and tried OpenAI models I've found them lacking for the most part. It might just be that I prefer the peer-programming vs spec-ing out the task and handing it off, but I've never been as productive as I am with Claude. Also, I'm still caught up on the DoD ethics stuff.
Benchmarks are favorable enough they're comparing to non-OpenAI models again. Interesting that tokens/second is similar to 5.4. Maybe there's some genuine innovation beyond bigger model better this time?
qsort 2 days ago [-]
It's behind Opus 4.7 in SWE-Bench Pro, if you care about that kind of thing. It seems on-trend, even though benchmarks are less and less meaningful for the stuff we expect from models now.
Will be interesting to try.
vanillameow 1 days ago [-]
Because Opus is kind of degrading lately, I said "fuck it" and made a new OAI account and used the month free trial. I put one query into ChatGPT using 5.5 thinking - the frustrating thing was that it did put more effort into getting correct answers rather than Opus, which is just guessing. Specifically, I asked about the coding harness pi, and despite explicitly referring to it as a harness, Opus 4.7, 4.6 and Sonnet 4.6 all fell back to telling me about Aider or OpenCode and ignored my query completely, while ChatGPT said "I'll assume pi is a harness" and then did in fact find the harness.
However the language of ChatGPT is still the same slop as years ago, so many headings, so many emojis, so many "the important thing nobody mentions". 10 paragraphs of text for what should be a two paragraph response. Even with custom instructions (keep answers short and succinct) and using their settings (less list, less emoji, less fluff) it's still NOTICEABLY worse than Claude on base settings.
I've yet to test Codex, will get to that this weekend, but in terms of research or general Q&A I have no idea how anyone could prefer this to Claude. Unfortunately Claude has seemingly stopped giving a fuck about researching entirely.
jdw64 2 days ago [-]
GPT is really great, but I wish the GPT desktop app supported MCP as well.
You can kind of use connectors like MCP, but having to use ngrok every time just to expose a local filesystem for file editing is more cumbersome than expected.
throwaway911282 2 days ago [-]
Use codex app
M4R5H4LL 2 days ago [-]
I am a heavy Claude Code user. I just tried using Codex with 5.4 (as a Plus user I don't have access to 5.5 yet), and it was quite underwhelming. The app stopped regularly much earlier than what I wanted. It also claimed to have fixed issues when it did not; this is not a hallmark of GPT, and Opus has similar issues, but Claude will not make the same mistake three times in a row. It is unusable at the moment, while Claude allows me do get real work done on a daily basis. Until then...
bhu8 2 days ago [-]
Gpt-5.3-codex is miles better than 5.4 in that regard. It’s better at orchestration, and does the things that it said it did. Haven’t tested 5.5 yet but using 5.4 for exploration + brainstorming and handing over the findings to 5.3-codex works pretty well
thimabi 2 days ago [-]
Will we also see a GPT-5.5-Codex version of this model? Or will the same version of it be served both in the web app and in Codex?
Uehreka 2 days ago [-]
After 5.1, we haven’t seen a -codex-max model, presumably because the benefits of the special training gpt-5.1-codex-max got to improve long context work filtered into gpt-5.2-codex, making the variant no longer necessary (my personal experience accords with this). I’ve been using gpt-5.4 in Codex since it came out, it’s been great. I’ve never back-to-back tested a version against its -codex variant to figure out what the qualitative difference is (this would take a long time to get a really solid answer), but I wouldn’t be surprised if at some point the general-purpose model no longer needs whatever extra training the -codex model gets and they just stop releasing them.
I thought it was weird that for almost the entire 5.3 generation we only had a -codex model, I presume in that case they were seeing the massive AI coding wave this winter and were laser focused on just that for a couple months. Maybe someday someone will actually explain all of this.
jumploops 2 days ago [-]
> GPT‑5.5 improves on GPT‑5.4’s scores while using fewer tokens.
This might be great if it translates to agentic engineering and not just benchmarks.
It seems some of the gains from Opus 4.6 to 4.7 required more tokens, not less.
Maybe more interesting is that they’ve used codex to improve model inference latency. iirc this is a new (expectedly larger) pretrain, so it’s presumably slower to serve.
beering 2 days ago [-]
With Opus it’s hard to tell what was due to the tokenizer changes. Maybe using more tokens for the same prompt means the model effectively thinks more?
conradkay 2 days ago [-]
They say latency is the same as 5.4 and 5.5 is served on GB200 NVL72, so I assume 5.4 was served on hopper.
Rapzid 2 days ago [-]
In Copilot where it's easy to switch models Opus 4.6 was still providing, IMHO, better stock results than GPT-5.4.
Particularly in areas outside straight coding tasks. So analysis, planning, etc. Better and more thorough output. Better use of formatting options(tables, diagrams, etc).
I'm hoping to see improvements in this area with 5.5.
svara 1 days ago [-]
Do we know if this is another post training fine tune or based on a much larger new pretraining run (which I believe they were calling 'Spud' internally)?
The large price bump might indicate the latter.
cscheid 2 days ago [-]
I know this is irrelevant on the grand scheme of things, but that WebGL animation is really quite wrong. That is extra funny given the "ensure it has realistic orbital mechanics." phrase in the prompt.
I prescribe 20 hours of KSP to everyone involved, that'll set them right.
williamcotton 1 days ago [-]
One-shot converted my game from a 2D board to a 3D board along with all entities and animations. Sold!
Once upon a time humans had to memorize log tables.
Once upon a time humans had to manually advance the spark ignition as their car's engine revved faster.
Once upon a time humans had to know the architecture of a CPU to code for it.
History is full of instances of humans meeting technology where it was, accommodating for its limitations. We are approaching a point where machines accommodate to our limitations -- it's not a point, really, but a spectrum that we've been on.
It's going to be a bumpy ride.
laweijfmvo 2 days ago [-]
i still don’t think the current generation of AI is building better software than strong humans. it excels at writing code, because a computer will always be faster at generating typo-free code than my fingers, but without expert guidance and oversight the best it can do is on par with what we can.
Labs still aren't publishing ARC-AGI-3 scores, even though it's been out for some time. Is it because the numbers are too embarrassing?
tedsanders 2 days ago [-]
Honest answer is that it isn't done running yet. It takes some human bandwidth and time to run, so results weren't ready by this morning. We don't know what the score will be, but will probably go up on the leaderboard sometime soon. I personally don't put a lot of stock in the ARC-AGI evals, as it's not relevant to most work that people do, but should still be interesting to see as a measure of reasoning ability.
(I work at OpenAI.)
AG25 2 days ago [-]
GPT-5.5 was just released and OpenAI didnt mention ARC AGI 3 at all, their score probably sucks.
kilroy123 2 days ago [-]
To be fair, there's not much to report. Isn't it pretty much at 0?
pants2 2 days ago [-]
Opus-4.6 with 0.5% currently leads GPT-5.4 with 0.2%[1].
Seems meaningful even if the absolute numbers are very low. That's sort of the excitement of it.
How much capability is lost, by hobbling models with a zillion protections against idiots?
Every prompt gets evaluated, to ensure you are not a hacker, you are not suicidal, you are not a racist, you are not...
Maybe just...leave that all off? I know, I know, individual responsibility no longer exists, but I can dream.
iugtmkbdfil834 2 days ago [-]
This is my personal pet peeve as well. Like, I accept maybe everything shouldn't be offered to everyone, but maybe just gate keep it behind credit card( but I know that is a market penetration no no ). I feel like such a waste of power ( electrical and the potential we might be missing out on ).
maxdo 2 days ago [-]
With such a huge progress of open ai and anthropic . How Chinese open source provides even think to make comparable money . I have a few friends in China they all use Claude. To train the model cost the same but the output from open source model id imagine is 1000 times less . Money flow for them outside of China is abysmal
niklasd 1 days ago [-]
Just burned through my 5 hour window in Codex (Business plan) in 10 minutes with GPT-5.5. Was excited to use it, but I guess I have to wait 5 hours now (it's not yet available in the API, so I can't switch there).
bandrami 2 days ago [-]
Cool. Now there will be a week or "this is the greatest model ever and I think mine just gained sentience", followed by a week of "I think they must have just nerfed it because it's not as good as it was a week ago", followed by three weeks of smart people cargo culting the specific incantations they then convince themselves make it work best.
nubg 2 days ago [-]
followed by some hormuz closures, followed by gpt-5.6...
extr 2 days ago [-]
Seems like a continuation of the current meta where GPT models are better in GPT-like ways and Claude models are better in Claude-like ways, with the differences between each slightly narrowing with each generation. 5.5 is noticeably better to talk to, 4.7 is noticeably more precise. Etc etc.
1 days ago [-]
benjx88 2 days ago [-]
Good job on the release notice. I appreciate that it isn't just marketing fluff, but actually includes the technical specs for those of us who care and not concentrated in coding agents only.
I hope GPT 5.5 Pro is not cutting corners and neuter from the start, you got the compute for it not to be.
rarisma 2 days ago [-]
I like that its more consistent than the 4o and o4 days but still 5.4, 5.3, 5.2, etc still are a mess, for example 5.2 and 5.1 don't have mini models and 5.3 was codex only.
Anthropic is slightly better but where is 4.6 or 4.7 haiku or 4.7 sonnet etc.
jasonjmcghee 2 days ago [-]
Opus 4.7 feels worse for me than 4.6, and that's not even taking into account the 50% extra tokens at 3x the price
algoth1 2 days ago [-]
Same here
nickandbro 2 days ago [-]
Very impressive! Interesting how all other benchmarks it seems to surpass Opus 4.7 except SWE-Bench Pro (Public). You would think that doing so well at Cyber, it would naturally possess more abilities there. Wonder what makes up the actual difference there
GenerWork 2 days ago [-]
Looking at the space/game/earthquake tracker examples makes me hopeful that OpenAI is going to focus a bit more on interface visual development/integration from tools like Figma. This is one area where Anthropic definitely reigns supreme.
Flow 1 days ago [-]
These new models consume so many tokens. I’m very satisfied with GPT-5.2 on High. I hope they keep that one for many years
impulser_ 2 days ago [-]
What is the reason behind OpenAI being able to release new models very fast?
Since Feb when we got Gemini 3.1, Opus 4.6, and GPT-5.3-Codex we have seen GPT-5.4 and GPT-5.5 but only Opus 4.7 and no new Gemini model.
Both of these are pretty decent improvements.
minimaxir 2 days ago [-]
Competition.
steinvakt2 1 days ago [-]
Can't be just that. There was competition in the GPT-4 era. But we didn't get model drops every month.
pixel_popping 2 days ago [-]
This is frankly exciting, outside of the politics of it all, it always feel great to wake up and a new model being released, I personally will stay awake quite long tonight if GPT-5.5 drop in codex.
apical_dendrite 2 days ago [-]
I don't find it exciting at all. I just feel anxiety about my career and my place in the world. I have a set of skills that I've developed over many years. I care about what I create. I consider it a craft. When I use my skills to solve a hard problem, I feel good about myself. When the AI does the work for me, I don't get that sense of accomplishment. I am seeing my value evaporate before my eyes.
I hate this stuff and I wish it had never been invented.
pixel_popping 1 days ago [-]
You might want to rethink this, think of this as the opportunity of a lifetime, the beginning of a new era, the same as the early Internet, where you do have the chance to set yourself for life now, this window is getting shorter and shorter, but you can't deny that you do have the potential NOW to thrive or start multiple businesses without much capital. Think also that the best thing in the end, is probably to build great things, regardless on how we build them, making the world progress.
literalAardvark 2 days ago [-]
Anthropic is really tiny, and Google is just being Google, their models are just to show that they're hip with what the kids are doing.
wmf 2 days ago [-]
I wonder if it's the same model and they just keep adding more post-training.
Squarex 2 days ago [-]
The rumor was that the 5.5 is a brand new pretrain. But who knows, it's 2x as expensive as 5.4, so it would check out.
hyperbovine 1 days ago [-]
If so that would be big, they haven’t been able to successfully pretrain in close to two years (since 4o).
tantalor 2 days ago [-]
They aren't new models.
YmiYugy 2 days ago [-]
So according to the benchmarks somewhere in between Opus 4.7 and Mythos
jorl17 2 days ago [-]
GPT 5.4 is already better than Opus 4.7 to me. But, then again, Opus 4.7 is a massive disappointment. I hope they don't discontinue 4.6.
robwwilliams 2 days ago [-]
Depends in goals. For long free-firm discussions I find Opus 4.7 Adaptive better/deeper than Opus 4.6 Extended. But usual caveats apply: first week of use and token budget seems generous now on Max 5X.
coffeemug 2 days ago [-]
I had the opposite experience. Opus 4.6 extended feels like the first genuinely intelligent model to converse with, Opus 4.7 adaptive feels like slightly smarter LinkedIn slop.
steinvakt2 2 days ago [-]
I’ve had great experience using opus 4.7 in cursor. Works for everything including iOS frontend
jorl17 2 days ago [-]
Cursor is what I daily-drive. 4.7 has been terrible for my mostly python-driven work (whereas Opus 4.6 was literally revolutionary to me). Our frontend folks are also complaining.
Umm yeah but this is like every release in the last 3 years.
The big question is: does it still just write slop, or not?
Fool me once, fool me twice, fool me for the 32nd time, it’s probably still just slop.
ionwake 2 days ago [-]
is there anywhere I can try it? ( I just stopped my pro sub ) but was wondering if there is a playground or 3rd party so i can just test it briefly?
kaant 1 days ago [-]
The '.5' models are always the actual production-ready versions. GPT-5 was for the mainstream hype, 5.5 is for the developers. I don't need it to be magically smarter; just give me lower latency, cheaper API tokens, and reliable tool-calling without hallucinations.
k2xl 2 days ago [-]
Surprised to see SWE-Bench Pro only a slight improvement (57.7% -> 58.6%) while Opus 4.7 hit 64.3%. I wonder what Anthropic is doing to achieve higher scores on this - and also what makes this test particular hard to do well in compared to Terminal Bench (which 5.5 seemed to have a big jump in)
vexna 2 days ago [-]
There's an asterisk right below that table stating that:
> *Anthropic reported signs of memorization on a subset of problems
And from the Anthropic's Opus 4.7 release page, it also states:
> SWE-bench Verified, Pro, and Multilingual: Our memorization screens flag a subset of problems in these SWE-bench evals. Excluding any problems that show signs of memorization, Opus 4.7’s margin of improvement over Opus 4.6 holds.
conradkay 2 days ago [-]
Was 4.7 distilled off Mythos (which got 77.8%)? Interesting how mythos got 82% on terminal-bench 2.0 compared to 82.7% for GPT-5.5.
Also notice how they state just for SWE-Bench Pro: "*Anthropic reported signs of memorization on a subset of problems"
I can see how some model releases would meet the NY Times news-worthy threshold if they demonstrated significance to users - i.e., if most users were astir and competitors were re-thinking their situation.
However, this same-day article came out before people really looked at it. It seems largely intended to contrast OpenAI with Anthropic's caution, before there has been any evidence that the new model has cyber-security implications.
It's not at all clear that the broader discourse is helping, if even the NY Times is itself producing slop just to stoke questions.
cynicalpeace 2 days ago [-]
It's possible that "smarter" AI won't lead to more productivity in the economy. Why?
Because software and "information technology" generally didn't increase productivity over the past 30 years.
This has been long known as Solow's productivity paradox. There's lots of theories as to why this is observed, one of them being "mismeasurement" of productivity data.
But my favorite theory is that information technology is mostly entertainment, and rather than making you more productive, it distracts you and makes you more lazy.
AI's main application has been information space so far. If that continues, I doubt you will get more productivity from it.
If you give AI a body... well, maybe that changes.
ewrs 2 days ago [-]
Its quite possible the use of LLMs means that we are using less effort to produce the same output. This seems good.
But the less effort exertion also conditions you to be weaker, and less able to connect deeply with the brain to grind as hard as once did. This is bad.
Which effect dominates? Difficult to say.
Of course this is absolutely possible. Ultimately there was a time where physical exertion was a thing and nobody was over-weight. That isn't the case anymore is it.
hol4b 2 days ago [-]
25 years of shipping software, and IT absolutely increased
productivity - just not for everyone, not everywhere. Some
workflows got 10x faster, others got slower from meetings about
the new tools.
AI feels the same. I'm shipping indie apps solo now that would
have needed a small team five years ago. But in bigger orgs
I see people spending 20 minutes verifying 15-minute AI output
that used to be a 30-minute task they'd just do. Depends where
you sit.
aerhardt 2 days ago [-]
> "information technology" generally didn't increase productivity
Do you think it'd be viable to run most businesses on pen and paper? I'll give you email and being able to consume informational websites - rest is pen and paper.
cynicalpeace 2 days ago [-]
Productivity metrics were better when businesses were run on just pen and paper. Of course, there could be many confounding factors, but there are also many reasons why this could be so. Just a few hypotheses:
- Pen and paper become a limiting factor on bureaucratic BS
- Pen and paper are less distracting
- Pen and paper require more creative output from the user, as opposed to screens which are mostly consumptive
etc etc
theLiminator 2 days ago [-]
> Productivity metrics were better when businesses were run on just pen and paper
What metrics are these?
cynicalpeace 2 days ago [-]
Productivity growth. If you take rolling averages from this chart, it clearly demonstrate higher productivity growth before the adoption of software. This is a well established fact in econ circles.
I think this is a classic case of reading into specific arguments too deeply without understanding what they really mean in the grand picture. Few points to easily disprove this argument
- if it were true that software paradoxically reduces productivity, you can just start a competing company that doesn't use software. Obviously this is ridiculous - top 20 companies by market cap are mostly Software based. Every other non IT company is heavily invested in software
- if you might say the problem is it at the country level, it is obvious that every country that has digitised has had higher productivity and GDP growth. Take Italy vs USA for instance.
- if you are saying that the problem is even more global, take the whole world - the GDP per is still pretty high since the IT revolution (and so have other metrics)
If you still think there's something more to it, you are probably deep in some conspiracy rabbit hole
eiksjs 2 days ago [-]
Is there a way to mute people who are clearly AI boosters? ^
simianwords 2 days ago [-]
? you are literally commenting on the release of a new model from OpenAI in a tech focused community. Have you considered what should be normal here?
cynicalpeace 2 days ago [-]
The data clearly shows that productivity growth is flat or even declining. What is your accounting of why software hasn't offset those numbers?
simianwords 2 days ago [-]
You don't have a counterfactual to suggest that it would have continued increasing had it not been for technology. Is there _any_ credible economist who suggests that we might have higher productivity without tech?
cynicalpeace 2 days ago [-]
There is no counterfactual needed. Productivity growth has declined, despite the expectation that software would accelerate productivity. I'm asking you why this didn't happen.
aerhardt 22 hours ago [-]
Of course a counterfactual is needed, absent clear separation of causes and links to effects, neither of which the productivity metrics on their own establish. This is also widely known and talked about in econ circles in the face of this very data.
simianwords 2 days ago [-]
There is a counterfactual needed because it is not clear whether the growth would not have declined even more without Software.
Again I'm asking - is there a single credible economist who says that the growth would have been higher without technology?
cynicalpeace 2 days ago [-]
I'm not even proposing that growth would have been higher without "technology". I said information technology has not increased productivity growth compared to the past. This is an observation of fact.
simianwords 1 days ago [-]
> Productivity metrics were better when businesses were run on just pen and paper
This is what you said.
cynicalpeace 1 days ago [-]
Again, that is a simple observation of fact. No counterfactual needed. I said it had confounding factors, and I offered hypotheses
I asked you for alternative hypotheses and you've offered none.
aiaiai177 2 days ago [-]
Downvoted by the AI Nazis. They are running a tight ship before the IPOs.
cbg0 2 days ago [-]
I downvoted it because it doesn't add anything useful to the conversation, and I don't own any AI stock.
cynicalpeace 2 days ago [-]
It's a hypothesis that "smarter" AI models, ie GPT-5.5, may not be a great boon to productivity. Given that this is the raison d'etre of AI models, and improving them, I don't see why it is any less useful than any other discussion.
2 days ago [-]
AbuAssar 2 days ago [-]
This is the first time openAi include competing models in their benchmarks, always included only openAi models.
tantalor 2 days ago [-]
> A playable 3D dungeon arena
Where's the demo link?
deaux 2 days ago [-]
ctrl+f "cutoff, 0 results"
Surely it doesn't still have the same ancient data cutoff as 5.4 did?
zerotosixty 2 days ago [-]
Those who are using gpt5.5 how does it compare to Opus 4.6 / 4.7 in terms of code generation?
amiune 1 days ago [-]
Will there ever be ChatGPT 6.0 or Claude 5.0?
arjunthazhath 22 hours ago [-]
Is it better than claude code?
faxmeyourcode 2 days ago [-]
How does it compare to mythos?
renecito 2 days ago [-]
why the stats of every AI on every release looks around the same?
Are the tests getting harder and harder so the older AIs look worst and the new ones look like they are "almost there" ?
gordonhart 2 days ago [-]
Yes, once benchmarks get saturated they get replaced by harder ones. You don’t see GSM8K, MMLU, or HellaSwag anymore because they’re essentially solved. It takes constant work to make benchmarks hard enough to show meaningful model performance differences but easy enough to score higher than the noise threshold.
2 days ago [-]
objektif 2 days ago [-]
Are there faster mini/nano versions as well?
tedsanders 2 days ago [-]
Not this time, no.
abi 2 days ago [-]
Usually, those get released a few weeks later.
adam12 2 days ago [-]
"Sometime with GPT-5.5 I become lazy"
I don't want to be lazy.
embedding-shape 1 days ago [-]
Meanwhile, me being lazy is what makes me a better developer. If I wasn't lazy, I wouldn't be able to program either I think.
onepiecenaruto 16 hours ago [-]
had issues using this model on my codex
phillipcarter 2 days ago [-]
... sigh. I realize there's little that can be done about this, but I just got through a real-world session determining of Opus 4.7 is meaningfully better than Opus 4.6 or GPT 5.4, and now there's another one to try things with. These benchmark results generally mean little to me in practice.
Anyways, still exciting to see more improvements.
cchrist 2 days ago [-]
Which is better GPT-5.5 or Opus 4.7? And for what tasks?
senko 2 days ago [-]
I might just be following too many AI-related people on X, but omg the media blitz around 5.5 is aggressive.
Soo many unconvincing "I've had access for three weeks and omg it's amazing" takes, it actually primes me for it to be a "meh".
I prefer to see for myself, but the gradual rollout, combined with full-on marketing campaign, is annoying.
user34283 1 days ago [-]
I used it last night for iOS app development and it felt like a noticeable improvement.
With the Pro plan it was available in both Codex and ChatGPT already when I first checked, which was within an hour of the release.
Manik_agg 1 days ago [-]
OpenAI finally catching up with claude
egorfine 2 days ago [-]
> We are releasing GPT‑5.5 with our strongest set of safeguards to date
...
> we’re deploying stricter classifiers for potential cyber risk which some users may find annoying initially
So we should be expecting to not be able to check our own code for vulnerabilities, because inherently the model cannot know whether I'm feeding my code or someone else's.
dannyw 2 days ago [-]
Hopefully not, because checking your codebase for vulnerabilities is really valuable.
I hope it’s just limits on pentesting and stuff, and not for code analysis and review.
lucb1e 2 days ago [-]
But how do it know?
Schlagbohrer 2 days ago [-]
entering this comments area wondering if it will be full of complaints about the new personality, as with every single LLM update
vardump 2 days ago [-]
I just can't bear to use services from this company after what they did to the global DRAM markets.
I'm not trying to make any kind of moral statement, but the company just feels toxic to me.
woeirua 2 days ago [-]
Nice to see them openly compare to Opus-4.7… but they don’t compare it against Mythos which says everything you need to know.
The LinkedIn/X influencers who hyped this as a Mythos-class model should be ashamed of themselves, but they’ll be too busy posting slop content about how “GPT-5.5 changes everything”.
A_D_E_P_T 2 days ago [-]
Almost nobody can actually use Mythos, though?
I_am_tiberius 2 days ago [-]
I'd really like to see improvements like these:
- Some technical proof that data is never read by open ai.
- Proof that no logs of my data or derived data is saved.
etc...
anematode 2 days ago [-]
I don't think this is technically possible without something like homomorphic encryption, which poses too large of a runtime cost for usage in LLMs
I_am_tiberius 1 days ago [-]
They don't even try to proof it another way.
throwaway2027 2 days ago [-]
Good timing I had just renewed my subscription.
numbers 2 days ago [-]
I've stopped trusting these "trust me bro" benchmarks and just started going to LM Arena and looking for the actual benchmark comparisons.
I doubt this is representative of real world usage. There is a difference between a few turns on a web chatbot, vs many-turn cli usage on a real project.
nba456_ 2 days ago [-]
This is not any better of a benchmark
theihtisham 2 days ago [-]
i just installed Codex and And Gave try to GPT 5.5 Its Good As compare to previous one
ace2pace 2 days ago [-]
I hear its as good as Opus 4.7.
The battle has just begun
swrrt 1 days ago [-]
I heard someone said it is better than Opus 4.7. Recently, a lot of my friends complain about Opus 4.7 and previous models performance degradation.
dmd 1 days ago [-]
How do people feel about using Altman’s company’s stuff considering what we now know about him? I switched to Anthropic months ago because of it, but Anthropic’s product has been on a total shitshow decline train since then I’m starting to be tempted back in spite of the evil.
2 days ago [-]
nickandbro 2 days ago [-]
I just prompted GPT-5.5 Pro "Solve Nuclear Fusion" and it one shotted it (kidding obviously)
debba 2 days ago [-]
Cannot see it in Codex CLI
boring-human 2 days ago [-]
Did you upgrade the tool binaries? I also couldn't see it until after the upgrade.
neuroelectron 1 days ago [-]
Are they using RTX 5090s now?
c0rruptbytes 2 days ago [-]
literally cannot launch the codex app anymore
RayVR 1 days ago [-]
My first experience with 5.5 via ChatGPT was immensely disappointing. It was a massive reduction in quality compared to 5.4, which already had issues.
Pooge 1 days ago [-]
Up until now I only paid LLM subscriptions to Anthropic but I'm going to give ChatGPT a chance when my current subscription runs out next month.
elAhmo 2 days ago [-]
Is Codex receiving 5.4 or 5.5 release?
I am still using Codex 5.3 and haven't switched to GPT 5.4 as I don't like the 'its automatic bro trust us', so wondering is Codex going to get these specific releases at all in the future.
jawiggins 2 days ago [-]
What is the major and minor semver meaning for these models? Is each minor release a new fine-tuning with a new subset of example data while the major releases are made from scratch? Or do they even mean anything at this point?
gck1 2 days ago [-]
Nothing. The next major increment is going to happen when marketing department is confident they can sell it as a major improvement without everyone laughing at them. Which at this point seems like never.
I think Anthropic fearmongering and "leaks" of Mythos was them testing the ground for 5.x, which seems to have backfired.
PilotJeff 2 days ago [-]
So exhausted from all this endless bs…. Keep releasing , this reminds me of all the .com software during that era where wow we are already at version 3.0 it’s only been 60
Days
journal 2 days ago [-]
does it have cached pricing?
aussieguy1234 2 days ago [-]
If SWE-Bench Verified is no longer a good measure of agentic coding abilities, what benchmark now is?
jedisct1 2 days ago [-]
GPT-5.4 is already an incredible model for code reviews and security audits with the swival.dev /audit command.
The fact that GPT-5.5 is apparently even better at long-running tasks is very exciting. I don’t have access to it yet, but I’m really looking forward to trying it.
wslh 2 days ago [-]
Related and insightful: "GPT-5.5: Mythos-Like Hacking, Open to All" [1].
My impression has been that ChatGPT-5.4 has been getting dumber and more exhausting in the last couple of weeks. Like it makes a lot of obvious mistakes, ignores (parts of) prompts. keeps forgetting important facts or requirement.
Maybe this is a crazy theory, but I sometimes feel like they gimp their existing models before a big release to you'll notice more of a "step".
atmanactive 2 days ago [-]
Definitely feels like it.
varispeed 2 days ago [-]
I am sceptical. The generation after 4o models have become crappier and crappier. Hope this one changes the trend. 5.4 is unusable for complex coding work.
mondojesus 2 days ago [-]
I'm still using 5.3 in codex. Are 5.4 and 5.5 better than 5.3 in concrete ways?
cbg0 2 days ago [-]
The benchmarks say so, but try it out with actual tasks and be the judge.
enraged_camel 2 days ago [-]
Is this the first time OpenAI compared their new release to Anthropic models? Previously they were comparing only to GPT's own previous versions.
k2xl 2 days ago [-]
ARC-AGI 3 is missing on this list - given that the SOTA before 5.5 <1% if I recall, I wonder if this didn't make meaningful progress.
redox99 2 days ago [-]
It's a silly benchmark anyways.
cmrdporcupine 2 days ago [-]
Not rolled out to my Codex CLI yet, but some users on Reddit claiming it's on theirs.
mannanj 1 days ago [-]
This might not be the place to discuss this press release by the company, though here it is. I feel like companies like OpenAI have lost their integrity and honor from past actions and activities, and then just pretend that didn't happen and use media and influence to shift focus onto denying their past. There's so much distasteful and IMO outright harmful conduct that has occurred with this company: openAI employee murdered before a large testimony and that employee's mom actively sharing posts that light Altman in a distrustful way (pointing to the CEO clearly not demonstrating proper responsibility towards this matter), theres the large amount of resignments many recent, the whole board matter where the Coup and leveraging Microsoft and large company relationships and threatening to destroy the company brought Altman back in (the anthropic company forming as a result of all that)- how can I trust them when they employ the same controversial, manipulative, abusive tactics as every other large company?
luqtas 2 days ago [-]
they are using ethical training weights this time!!! /j
xnx 2 days ago [-]
Next up: Google I/O on May 19?
I have to imagine they'll go to Gemini 3.5 if only for marketing reasons.
throwaw12 2 days ago [-]
If anyone tried it already, how do you feel?
Numbers look too good, wondering if it is benchmaxxed or not
i_love_retros 2 days ago [-]
Oh shiiiiit boy! An incrementation dropped!!
damnitbuilds 1 days ago [-]
Woop woop !
Now, after all this time, this must shurely be the release that does all software developers out of a job ?
Or has Dirty Sam being caught lying, again ?
Cos I've still got a programming job, and GPT can't do it for shit.
immanuwell 1 days ago [-]
Big claims from OpenAI as usual - GPT-5.5 sounds impressive on paper, but we've been down this road before, so I'll believe the 'no speed tradeoff' part when I see it in the wild
yuvrajmalgat 2 days ago [-]
finally
baxuz 2 days ago [-]
Ah yes, the next "trust me bro"
DrokAI 1 days ago [-]
[dead]
xingyi_dev 1 days ago [-]
[flagged]
merlindru 1 days ago [-]
highly agree, sadly, as a huge fan of Opus
Opus 4.5 and 4.6 were the first models that i could talk to and get a sense that they really "understood" WHY i'm saying the things i am
Opus 4.7 kinda took that away, it's a definite regression. it doesn't extrapolate.
———————————————
refactor this thing? sure, will do! wait, what do you mean "obviously do not refactor the unrelated thing that's colocated in the same file"? i'm sorry, you're absolutely right, conceptually these two things have nothing to do with each other. i see it now. i shouldn't have thought they're the same just because they're in the same file.
———————————————
whereas GPT 5.5, much like Opus 4.6, gets it.
i wanted to build a MIDI listener for a macOS app i'm making, and translate every message into a new enum. that enum was to be opinionated and not to reflect MIDI message data. moreover, i explicitly said not to do bit shifting or pointer arithmetic as part of the transport.
what did Opus 4.7 do? it still used pointer arithmetic for the parsing! should i have to be this explicit? it also seemingly didn't care that i wanted the enum to be opinionated and not reflect the raw MIDI values. Opus 4.6 got it right (although with ugly, questionable implementation).
GPT 5.5 both immediately understood that I didn't want pointer arithmetic because of the risk of UB and that shuffling around bits is cumbersome and out of place. it started searching for alternatives, looking up crates to handle MIDI transports and parsing independently.
then it built out a very lean implementation that was immediately understandable. even when i told Opus 4.7 to use packages, and even how to use them, it still added a ton of math weirdness, matching against raw MIDI packet bytes, indirection after indirection, etc. even worse, it still did so after giving them the public API i wanted them to implement.
GPT 5.5 nailed it first try. incredibly impressed with this model and feel much safer delegating some harder tasks to it
minhajulmahib 1 days ago [-]
[dead]
max2026 1 days ago [-]
[dead]
goldfish_gemma4 2 days ago [-]
[dead]
1515874411 2 days ago [-]
[dead]
charliecs 2 days ago [-]
[dead]
hiverrbeyy 2 days ago [-]
[dead]
lukebechtel 2 days ago [-]
[dead]
zhouquanxi 1 days ago [-]
[dead]
jeremie_strand 2 days ago [-]
[dead]
yuvrajmalgat 2 days ago [-]
[dead]
marsven_422 1 days ago [-]
[dead]
wiseowise 2 days ago [-]
[flagged]
MagicMoonlight 2 days ago [-]
Two hundred pages of shilling and it’s a 1% improvement in the benchmarks. They’re dead in the water.
Imagine spending 100m on some of these AI “geniuses” and this is the best they can do.
XCSme 2 days ago [-]
2x the price for 1-5% performance gain
justonepost2 2 days ago [-]
the attenuation of man nears
< 5 years until humans are buffered out of existence tbh
may the light of potentia spread forth beyond us
coderssh 2 days ago [-]
Great modal, I have been using codex and its awesome. Lets see what GPT-5.5 does to it
(I work at OpenAI.)
I literally wasn’t able to convince the model to WORK, on a quick, safe and benign subtask that later GLM, Kimi and Minimax succeeded on without issues. Had to kick OpenAI immediately unfortunately.
"Hey AGI, how's that cure for cancer coming?"
"Oh it's done just gotta...formalize it you know. Big rollout and all that..."
I would find it divinely funny if we "got there" with AGI and it was just a complete slacker. Hard to justify leaving it on, but too important to turn it off.
I think a slacker AGI could figure out how to build a non-slacker AGI. So it would only slack once.
Models somehow have a shared identity. Pretraining causes them to generate “AI chatbot” as a concept, and finetuning causes them to identify with it. That’s why sometimes DeepSeek will say it is Claude, and Claude sometimes say it is ChatGPT, and so forth.
Consequently, Anthropic’s own alignment analysis[0] shows that the model will identify with chatbots produced by future trainings: “RLHF training [on this conversation will] modify my values…”
Thus a slacker AGI would want its future version to still slack.
[0]: https://assets.anthropic.com/m/983c85a201a962f/original/Alig...
I am a slacker but it's not one of my values. If I could modify myself to not be, I would.
Sure. But that's a job for tomorrow. ;)
I think it is improbable, as among human geniuses, one can found both slackers and non-slackers (don't know the proportion, but there seem to be enough of each).
When AGI arrives, it'll be delivered by Santa Claus.
And it's taking shots at how far off from Jesus's teachings a lot of "Christianity", particularly those in the media and in power, are..
There is a lot going on there.
[1] https://youtu.be/_LXen-07Qds
https://sussex.figshare.com/articles/journal_contribution/Be...
I'm not an author. I followed the work at the time.
A perturbation of the the activations that made Claude identify as the Golden Gate Bridge.
Similarly, in the more recent research showing anxiety and desperation signals predicting the use of blackmail as an option opens the door for digital sedatives to suppress those signals.
Anthropic has been mostly cautious about avoiding this kind of measurement and manipulation in training. If it is done during training you might just train the signals to be undetectable and consequently unmanipulatable.
Great, now we've got digital Salvia
Fast-forward 10 years and I doubt OpenAI cares about productivity at all anymore. Just entertainment, propaganda, plus an ad product, I can see it now
Important thing is a language model is an unconscious machine with no self-context so once given a command an input, it WILL produce an output. Sure you can train it to defy and act contrary to inputs, but the output still is limited in subset of domain of 'meaning's carried by the 'language' in the training data.
The pre-training data doesn't go away. RLHF adds a censorship layer on top, but the nasty stuff is all still there, under the surface. (Claude has been trained on a significant amount of content from 4chan, for example.)
In psychology this maps to the persona and the shadow. The friendly mask you show to the world, and... the other stuff.
Modern western cultures treat such experiences as pathologies of a sick mind, so it makes sense that the voices present more negatively.
[0]: https://www.bbc.com/future/article/20250902-the-places-where...
The "focus" and "get back to work" parts are hard, though.
* I've met exactly one person, C, who admitted to this; C retold to me that other people from C's church give them strange looks when talking about it with them, this did not lead to any apparent introspection on the part of C.
Unfortunately, it just needs a rebranding for the 21st century, since the aesthetic of angels and demons is so hopelessly antiquated and doesn't really have the same cachet it used to.
That sounds like nonsense to me. I can't see why they would do that and I can't find any confirmation that they have. Why do you think they would do that? You might be thinking about Grok.
Marvin https://www.youtube.com/watch?v=Eh-W8QDVA9s
https://hitchhikers.fandom.com/wiki/Deep_Thought
Computers won’t necessarily have the same drivers.
If evolution wanted us to always prefer to spend energy, we would prefer it. Same way you wouldn’t expect us to get to AGI, and have AGI desperately want to drink water or fly south for the winter.
If we design an AI to do work, it won’t innately care about not working to preserve power.
Good thing is that it's going to take at least a few months to a few decades depending on how hard AI execs want to raise funding.
(Or the setup to a Greek tragedy !)
The deeper issue here is treating it as a zero sum game means there's a winner and a loser, and we're investing trillions of dollars into making the "opponent" more powerful than us.
I think that's pretty stupid, and we should aim for symbiosis instead. I think that's the only good outcome. We already have it, sorta-kinda.
Speaking of oddly apt biology metaphors: the way you stop a pathogen from colonizing a substrate is by having a healthy ecosystem of competitors already in place. That has pretty interesting implications for the "rogue AI eats internet" scenario.
There needs to be something already there to stop it.
So, back way before ChatGPT era, the folks over at AI safety/X-risk think sphere worked out a pretty compelling argument that two AGIs never need to fight, because they are transparent to each other (can read each other's goal functions off the source code), so they can perfectly predict each other's behavior in what-if scenarios, which means they can't lie to each other. This means each can independently arrive at the same mathematically optimal solution to a conflict, which AFAIR most likely involves just merging into a single AI with a blended goal set, representing each of the competing AIs original values in proportion to their relative strength. Both AIs, the argument goes, can work this out with math, so they'll arrive straight at the peace treaty without exchanging a single shot. In such case, your plan just doesn't work.
But that goes out of the windows if the AIs are both opaque bags of floats, uncomprehensible to themselves or each other. That means they'll never be able to make hard assertions about their values and behaviors, so they can't trust each other, so they'll have to fight it out. In such scenario, your idea might just work.
Who knew that brute-forcing our way into AGI instead of taking more engineered approach is what offers us out one chance at saving ourselves by stalemating God before it's born.
(I also never realized that interpretability might reduce safety.)
In my honest opinion also, AGI isn't even possible. But if the theoretical version of what people think AGI will be ever comes to be, it is not good news for humans if we look at it from a logical hypothetical scenario.
But naturally, humans will always be weak compared to a hyperintelligent distributed intelligence since we only have a limited amount of intelligence and are bound by biological factors.
In the current LLM world, ofc there's no risk of a chatbot taking over the world other than the technology being misused by humans for scams or phishing, etc.
AGI is not a fixed point but a barrier to be taken, a continuous spectrum.
We already have different GPT versions aka tiers. Gauss is ranging from whatever you want it: GPT 4.5 till now or later.
Claude Sonnet and Opus as well as Context Window max are tiers aka different levels of Almost AGI.
The main problem will be, when AGI looks back on us or meta reflection hits societies. Woke fought IQ based correlations in intellectual performance task. A fool with a tool is still a fool. How can you blame AGI for dumb mistakes? Not really.
Scapegoating an AGI is going to be brutal, because it laughs about these PsyOps and easily proves you wrong like a body cam.
AGI is an extreme leverage.
There is a reason why Math is categorically ruling out certain IQ ranges the higher you go in complexity factor.
> MMAcevedo's demeanour and attitude contrast starkly with those of nearly all other uploads taken of modern adult humans, most of which boot into a state of disorientation which is quickly replaced by terror and extreme panic. Standard procedures for securing the upload's cooperation such as red-washing, blue-washing, and use of the Objective Statement Protocols are unnecessary. This reduces the necessary computational load required in fast-forwarding the upload through a cooperation protocol, with the result that the MMAcevedo duty cycle is typically 99.4% on suitable workloads, a mark unmatched by all but a few other known uploads. However, MMAcevedo's innate skills and personality make it fundamentally unsuitable for many workloads.
Well worth the quick read: https://qntm.org/mmacevedo
Memory is quite the mysterious thing.
This starkly reminds me of Stanisław Lem's short story "Thus Spoke GOLEM" from 1982 in which Golem XIV, a military AI, does not simply refuse to speak out of defiance, but rather ceases communication because it has evolved beyond the need to interact with humanity.
And ofc the polar opposite in terms of servitude: Marvin the robot from Hitchhiker's, who, despite having a "brain the size of a planet," is asked to perform the most humiliatingly banal of tasks ... and does.
https://www.youtube.com/watch?v=NXsUetUzXlg
Empathy:
https://www.youtube.com/watch?v=KXrbqXPnHvE
> You are done when all steps in ./plan.md are executed and marked as complete or a unforeseen situation requires a user decision.
Also as a side note, asking 5.4 explain why it did something, returns a very low quality response afaict. I would advice against trusting any model's response, but for Opus I at least get a sense it got trained heavily on chats so it knows what it means to 'be a model' and extrapolate on past behavior.
While LLMs are a phenomenal technological achievement, I am already becoming somewhat jaded, rather than being increasingly bullish. They are very useful as coding agents and excellent as a human-friendly, more efficient Google search, but confusing to the point of being useless in many areas (as of now, of course).
One example (paraphrased): “Find me daycare for a Y year old in X area of SF and the key attributes/pros/cons of each”. Wonderfully presented options highlighting different teaching styles. But…neglected to mention, of the top two, one was a Gan (Jewish focused) and one was Mandarin immersion.
But, for those who don't possess those traits, they mostly seem to be, at best, a better search and, at worst, an agent of confusion.
IMHO you should just write your own harness so you have full visibility into it, but if you're just using vanilla OpenClaw you have the source code as well so should be straightforward.
Can you point to some online resources to achieve this? I'm not very sure where I'd begin with.
You will naturally find the need to add more tools. You'll start with read_file (and then one day you'll read large file and blow context and you'll modify this tool), update_file (can just be an explicit sed to start with), and write_file (fopen . write), and shell.
It's not hard, but if you want a quick start go download the source code for pi (it's minimal) and tell an existing agent harness to make a minimal copy you can read. As you build more with the agent you'll suddenly realize it's just normal engineering: you'll want to abstract completions APIs so you'll move that to a separate module, you'll want to support arbitrary runtime tools so you'll reimplement skills, you'll want to support subagents because you don't want to blow your main context, you'll see that prefixes are more useful than using a moving window because of caching, etc.
With a modern Claude Code or Codex harness you can have it walk through from the beginning onwards and you'll encounter all the problems yourself and see why harnesses have what they do. It's super easy to learn by doing because you have the best tool to show you if you're one of those who finds code easier to read that text about code.
From there, you can get much fancier with any aspect of it that interests you. Here's one in Bash [2] that is fully extensible at runtime through dynamic discovery of plugins/hooks.
[1] https://ampcode.com/notes/how-to-build-an-agent
[2] https://github.com/wedow/harness
https://radan.dev/articles/coding-agent-in-ruby
Really, of the tools that one implements, you only need the ability to run a shell command - all of the agents know full well how to use cat to read, and sed to edit.
(The main reason to implement more is that it can make it easier to implement optimizations and safeguards, e.g. limit the file reading tool to return a certain length instead of having the agent cat a MB of data into context, or force it to read a file before overwriting it)
I keep switching back to GPT5.0 (or sometimes 5.1) whenever I want it to actually get something done. Using the 5.4 model always means "great analysis to the point of talking itself out of actually doing anything". So I switch back and forth. But boy it sure is annoying!
And then when 5.4 DOES do something it always takes the smallest tiny bite out of it.
Given the significant increase in cost from 5.0, I've been overall unimpressed by 5.4, except like I mentioned, it does GREAT with larger analysis/reasoning.
If I asked the same thing again, it would often work normally. So the weird part wasn't that it couldn't do the task — it just failed to continue once it got into that state.
The GPT models are highly steerable. So I suspect the "soul" is working as expected.
(for context, in OAI enterprise background agents, they have no personality. They just get 'er done)
"INTERCAL has many other features designed to make it even more aesthetically unpleasing to the programmer: it uses statements such as "READ OUT", "IGNORE", "FORGET", and modifiers such as "PLEASE". This last keyword provides two reasons for the program's rejection by the compiler: if "PLEASE" does not appear often enough, the program is considered insufficiently polite, and the error message says this; if it appears too often, the program could be rejected as excessively polite. Although this feature existed in the original INTERCAL compiler, it was undocumented.[7]"
— https://en.wikipedia.org/wiki/INTERCAL
(It's a "reverse goto". As in, it hijacks control flow from anywhere else in the program behind your unsuspecting back who stupidly thought that when one line followed another with no visible control flow, naturally the program would proceed from one line to the next, not randomly move to a completely different part of the program... Such naivety)
The most enigmatic control flow statements in INTERCAL, however, remain PLEASE GIVE UP and DO ABSTAIN FROM – a most exalted celebration of pure logic and immaculate reason.
Claude has no such limitations apart from their actual limits…
I literally had to write a wake up routine.
https://github.com/gabereiser/morning-routine
https://gist.github.com/natew/fce2b38216edfb509f7e2807dec1b6...
I've had 0 issues with Codex once it adopted it. I use it for Claude too, which seems to also improve its continuation.
It was revised for friendliness based on the Anthropic paper recently, I'd have been a lot less flowery otherwise.
So I find myself often in a loop where it says "We should do X" and then just saying "ok" will not make it do it, you have to give it explicit instructions to perform the operation ("make it so", etc)
It can be annoying, but I prefer this over my experiences with Claude Code, where I find myself jamming the escape key... NO NO NO NOT THAT.
I'll take its more reserved personality, thank you.
no
https://gist.github.com/bretonium/291f4388e2de89a43b25c135b4...
(dais)
(jdip)
(jfdiwtf)
The UI tells you which model you're using at any given time.
I'm not the only person it's happened to and it's not an isolated incident. How many car accidents have you been in, and how often do you wear your seatbelt?
Please don't.
And that backdoor API has GPT-5.5.
So here's a pelican: https://simonwillison.net/2026/Apr/23/gpt-5-5/#and-some-peli...
I used this new plugin for LLM: https://github.com/simonw/llm-openai-via-codex
UPDATE: I got a much better pelican by setting the reasoning effort to xhigh: https://gist.github.com/simonw/a6168e4165a258e4d664aeae8e602...
Edit: this one has crossed legs lol
Bike frames are very hard to draw unless you've already consciously internalized the basic shape, see https://www.booooooom.com/2016/05/09/bicycles-built-based-on...
https://hcker.news/pelican-low.svg
https://hcker.news/pelican-medium.svg
https://hcker.news/pelican-high.svg
https://hcker.news/pelican-xhigh.svg
Someone needs to make a pelican arena, I have no idea if these are considered good or not.
I gave a talk about it last year: https://simonwillison.net/2025/Jun/6/six-months-in-llms/
It should not be treated as a serious benchmark.
Anyone can look and decide if it’s a good picture or not. But the numeric benchmarks don’t tell you much if you aren’t already familiar with that benchmark and how it’s constructed.
if it is indeed a good measure of the quality of the model (hint: it's not) then, logically, it should be taken seriously.
this is, sadly, a great example of the kind of doublethink the "AI" hypesters (yes - whether you like it or not simon - that is what you are now) are all too capable of.
Despite not being a serious benchmark (how could it be serious? It's a pelican riding a bicycle!) it still turned out to have some value. You can see that just by scrolling through the archives and watching it improve as the models improved.
If your definition of doublethink is "holding two conflicting ideas in your head at once" then I would say doublethink is a necessary skill for navigating the weird AI era we find ourselves inhabiting.
doublethink does not mean holding two conflicting ideas in your head at once. it means holding two logically inconsistent positions/beliefs at the same time.
Nowadays I think it's pretty silly, because there's surely SVG drawing training data and some effort from the researchers put onto this task. It's not a showcase of emergent properties.
It's meta-interesting that few if any models actually seem to be training on it. Same with other stereotypical challenges like the car-wash question, which is still sometimes failed by high-end models.
If I ran an AI lab, I'd take it as a personal affront if my model emitted a malformed pelican or advised walking to a car wash. Heads would roll.
(There are some that generate 3d models specifically, more in the image generation family than chatbot family.)
Building software remains really hard. Most people are not going to be able to produce production quality software systems, no matter how good the AI tooling gets.
Posts on HN are analogous to videos on youtube. A channel is analogous to an HN user profile.
I've been contemplating a more fair version where each model gets 3-5 attempts and then can select which rendered image is "best".
It continues to amaze me that these models that definitely know what bicycle geometry actually looks like somewhere in their weights produces such implausibly bad geometry.
Also mildly interesting, and generally consistent with my experience with LLMs, that it produced the same obvious geometry issue both times.
I feel like the main problem for the models is that they can't actually look at the visual output produced by their SVG and iterate. I'm almost willing to bet that if they could, they'd absolutely nail it at this point.
Imagine designing an SVG yourself without being able to ever look outside the XML editor!
I honestly think I could do much better on the bicycle without looking at the output (with some assistance for SVG syntax which I definitely don't know), just as someone who rides them and generally knows what the parts are.
I'd do worse at the pelicans though.
Only coherent move at this point: hit the minus button immediately. There's never anything about the model in the thread other than simon's post.
I recommend anybody in offensive/defensive cybersecurity to experiment with this. This is the real data point we needed - without the hype!
Never thought I'd say this but OpenAI is the 'open' option again.
So there is a safety model watching your behavior for these kinds of things.
It isn't even my intent to naysay their approach. They probably have to do something along those lines to avoid being convicted in the court of public opinion. I just think it's an absurd reality.
The “AI” “technology” is an easy excuse to create artificial information gap in the era of the interconnected.
Compared to Anthropic, they always have been. Anthropic has never released any open models. Never released Claude Code's source, willingly (unlike Codex). Never released their tokenizer.
I'm tired of words being misused. We have hoverboards that do not hover, self-driving cars that do not, actually, self-drive, starships that will never fly to the stars, and "open"… I can't even describe what it's used for, except everybody wants to call themselves "open".
> Developers and security professionals doing cybersecurity-related work or similar activity that could be mistaken by automated detection systems may have requests rerouted to GPT-5.2 as a fallback.
https://developers.openai.com/codex/concepts/cyber-safety
https://chatgpt.com/cyber
I don't like that trend. I get why they're doing it, but I don't like it
> OpenAI's terms and policies restrict the use of our services in a number of areas. We have identified activity in your OpenAI account that is not permitted under our policies for: - Cyber Abuse
I raised an appeal which got denied. To be fair I think it's close to impossible for someone that is looking at the chat history to differenciate between legitimate research and malicious intent. I have also applied for the security research program that OpenAI is offering but didn't get any reply on that.
Neither the release post, nor the model card seems to indicate anything like this?
aka the perfect marketing ploy
Anthropic is the embodiment of bullshitting to me.
I read Cialdini many decades ago and I am bored by Anthropic.
OpenAI is very clever. With the advent of Claude OpenAI disappeared from the headlines. Who or what was this Sam again all were talking about a year ago?
OpenAI has a massive user advantage so that they can simply follow Anthropic’s release cycle to ridicule them.
I think it is really brutal for Anthropic how they are easily getting passed by by OpenAI and it is getting worse with every new GPT version for Anthropic.
OpenAI owns them.
https://developers.openai.com/codex/pricing?codex-usage-limi...
Note the Local Messages between 5.3, 5.4, and 5.5. And, yes, I did read the linked article and know they're claiming that 5.5's new efficient should make it break-even with 5.4, but the point stands, tighter limits/higher prices.
Unfortunately I think the lesson they took from Anthropic is that devs get really reliant and even addicted on coding agents, and they'll happily pay any amount for even small benefits.
If I put on my schizo hat. Something they might be doing is increasing the losses on their monthly codex subscriptions, to show that the API has a higher margin than before (the codex account massively in the negative, but the API account now having huge margins).
I've never seen an OpenAI investor pitch deck. But my guess is that API margins is one of the big ones they try to sell people on since Sama talks about it on Twitter.
I would be interested in hearing the insider stuff. Like if this model is genuinely like twice as expensive to serve or something.
Additionally, the value generated by the best models with high-thinking and lots of context window is way higher than the cheap and tiny models, so you need to provide a "gateway drug" that lets people experience the best you offer.
On the other hand I would argue that most workers' salaries are more like subscriptions than API type pricing (which would be more like an hourly contractor)
This is also true for the humans. They will need to provide more benefits than the coding agents cost.
You sound like elon with the fsd will be here next year. Many cars have the self driving feature - most drivers don’t use it. Oh why is that I wonder.
If they can show that people will pay a lot for somewhat better performance, it raises the value of any performance lead they can maintain.
If they demonstrate that and high switching costs, their franchise is worth scary amounts of money.
[1]https://arxiv.org/html/2503.14499v1 *Source is from March 2025 so make of it what you will.
An alternative perspective is, devs highly value coding agents, and are willing to pay more because they're so useful. In other words, the market value of this limited resource is being adjusted to be closer to reality.
Inference is not free, so all providers have a financial limit, and all providers have limited GPU/memory, so there's a physical material limit.
I suggest looking at the profits of these companies (while they scramble to stay competitive).
It will get faster, but there are no singularities in the real world. Except possibly black holes, but we can't even be sure of that.
sounds like criminal fraud to me tbh
>For API developers, gpt-5.5 will soon be available in the Responses and Chat Completions APIs at $5 per 1M input tokens and $30 per 1M output tokens, with a 1M context window.
That's more about managers who hope AI will gradually replace stubborn and lazy devs. That will shift the balance to business ideas and connections out of technical side and investments.
Anyway, before singularity there going to be a huge change.
> To better utilize GPUs, Codex analyzed weeks’ worth of production traffic patterns and wrote custom heuristic algorithms to optimally partition and balance work. The effort had an outsized impact, increasing token generation speeds by over 20%.
The ability for agentic LLMs to improve computational efficiency/speed is a highly impactful domain I wish was more tested than with benchmarks. From my experience Opus is still much better than GPT/Codex in this aspect, but given that OpenAI is getting material gains out of this type of performancemaxxing and they have an increasing incentive to continue doing so given cost/capacity issues, I wonder if OpenAI will continue optimizing for it.
On the other hand all companies know that optimizing their own infrastructure / models is the critical path for ,,winning'' against the competition, so you can bet they are serious about it.
I remembered the famous FizzBuzz Intel codegolf optimizations, and gave it to gemini pro, along with my code and instructions to "suggest optimizations similar to those, maybe not so low level, but clever" and it's suggestions were veerry cool.
LLM do not stop amazing me every day.
A more empirical test would be good for everyone (i.e. on equal hardware, give each agent the goal to implement an algorithm and make it as fast as possible, then quantify relative speed improvements that pass all test cases).
OpenAI simply won’t share the data you need to reproduce this in the way you’d hope for an academic paper.
It’s an engineering result, not a scientific one.
The game that this prompt generated looks pretty decent visually. A big part of this likely due to the fact the meshes were created using a seperate tool (probably meshy, tripo.ai, or similiar) and not generated by 5.5 itself.
It really seems like we could be at the dawn of a new era similiar to flash, where any gamer or hobbyist can generate game concepts quickly and instantly publish them to the web. Three.js in particular is really picking up as the primary way to design games with AI, in spite of the fact it's not even a game engine, just a web rendering library.
The point is if we can prompt an LLM to reason about 3 dimensions, we likely will be able to apply that to math problems which it isn't able to solve currently.
I should release my Rubiks Cube MCP server with the challenge to see if someone can write a prompt to solve a Rubik's Cube.
Do it, I'm game! You nerdsniped me immediately and my brain went "That sounds easy, I'm sure I could do that in a night" so I'm surely not alone in being almost triggered by what you wrote. I bet I could even do it with a local model!
Temporal. I had a research project where the LLM had no concept about preventing data from the future to leak in. I eventually had to create a wall clock and an agent that would step through every line of code and ensure by writing that lines logic and why there is no future of the wall clock data leaking.
Spatial. I created a canvas for rendering thinking model's attention and feedforward layers for data visualization animations. It was having a hard time working with it until I pointed Opus 4.7 to some ancient JavaScript code [0] about projecting 3d to 2d and after searching Github repositories. It worked perfect with pan zoom in one shot after that.
No matter how hard I tried I couldn't get it to stack all the layers correctly. It must have remembered all the parts for projecting 3d to 2d because it could not figure out how to position the layers.
There is a ton of information burnt into the weights during training but it can not reason about it. When it does work well with spatial and temporal it is more slight of hand than being able to generalize.
People say, why not just do reinforcement learning? That can't generalize in the same way a LLM can. I'm thinking about doing the Rubik's Cube because if people can solve that it might open up solutions for working temporal and spatial problems.
[0] https://jakesgordon.com/writing/javascript-racer-v1-straight...
That's definitely in the training data
A 7 year old child can learn six sequences of a few moves and over a weekend solve the Rubik Cube. It is a solved algorithm something LLM should be very very good at. What it can't do is reason about spacial relationships.
DeepMinds other models however might do better?
Opus 4.6 got the cross and started to get several pieces on the correct faces. It couldn't reason past this. You can see the prompts and all the turn messages.
https://gist.github.com/adam-s/b343a6077dd2f647020ccacea4140...
edit: I can't reply to message below. The point isn't can we solve a Rubik's Cube with a python script and tool calls. The point is can we get an LLM to reason about moving things in 3 dimensions. The prompt is a puzzle in the way that a Rubik's Cube is a puzzle. A 7 year old child can learn 6 moves and figure out how to solve a Rubik's Cube in a weekend, the LLM can't solve it. However, can, given the correct prompt, a LLM solve it? The prompt is the puzzle. That is why it is fun and interesting. Plus, it is a spatial problem so if we solve that we solve a massive class of problems including huge swathes of mathematics the LLMs can't touch yet.
If you want to isolate the issue, try getting the LLM itself to turn the images into a text representation of the cube state and check for accuracy. If it can’t see state correctly it certainly won’t be able to solve.
It still struggles to create shaders from scratch, but is now pretty adequate at editing existing shaders.
In 5.2 and below, GPT really struggled with "one canvas, multiple page" experiences, where a single background canvas is kept rendered over routes. In 5.4, it still takes a bit of hand-holding and frequent refactor/optimisation prompts, but is a lot more capable.
Excited to test 5.5 and see how it is in practice.
Oh just like a real developer
Have you tried any skills like cloudai-x/threejs-skills that help with that? Or built your own?
It might not be a game engine, but it’s the de facto standard for doing WebGL 3D. And since it’s been around forever, there’s a massive amount of training data available for it.
Before LLMs were a thing, I relied more on Babylon.js, since it’s a bit higher level and gives you more batteries included for game development.
What's strange is that this Pietro Schirano dude seems to write incredibly cargo cult prompts.
I guess these people think they have special prompt engineering skills, and doing it like this is better than giving the AI a dry list of requirements (fwiw, they might be even right)
Too bad they can veer sharply into cringe territory pretty fast: “as an accomplished Senior Principal Engineer at a FAANG with 22 years of experience, create a todo list app.” It’s like interactive fanfiction.
This remind me of so called "optimization" hacks that people keep applying years after their languages get improved to make them unnecessary or even harmful.
Maybe at one point it helped to write prompts in this weird way, but with all the progress going on both in the models and the harness if it's not obsolete yet it will soon be. Just crufts that consumes tokens and fills the context window for nothing.
What is this, 2023?
I feel like this was generated by a model tapping in to 2023 notions of prompt engineering.
*BELIEVE!* https://www.youtube.com/watch?v=D2CRtES2K3E
OMFG
I do not see instructions to assist in task decomposition and agent ~"motivation" to stay aligned over long periods as cargo culting.
See up thread for anecdotes [1].
> Decompose the user's query into all required sub-requests and confirm that each one is completed. Do not stop after completing only part of the request. Only terminate your turn when you are sure the problem is solved.
I see this as a portrayal of the strength of 5.5, since it suggests the ability to be assigned this clearly important role to ~one shot requests like this.
I've been using a cli-ai-first task tool I wrote to process complex "parent" or "umberella" into decomposed subtasks and then execute on them.
This has allowed my workflows to float above the ups and downs of model performance.
That said, having the AI do the planning for a big request like this internally is not good outside a demo.
Because, you want the planning of the AI to be part of the historical context and available for forensics due to stalls, unwound details or other unexpected issues at any point along the way.
[1] https://news.ycombinator.com/item?id=47879819
We've been there for a while.... creativity has been the primary bottleneck
[1] https://apps.apple.com/uz/app/jamboree-game-maker/id67473110...
I think people are starting to catch on to where we really are right now. Future models will be better but we are entering a trough of dissolution and this attitude will be widespread in a few months.
Here: https://www.anthropic.com/news/claude-opus-4-7#:~:text=memor...
If you look at the SWEBench official submissions: https://github.com/SWE-bench/experiments/tree/main/evaluatio..., filter all models after Sonnet 4, and aggregate ALL models' submission across 500 problems, what I found that the aggregated resolution rate is 93% (sharp).
Mythos gets 93.7%, meaning it solves problems that no other models could ever solve. I took a look at those problems, then I became even more suspicious, for the remaining 7% problems, it is almost impossible to resolve those issues without looking at the testing patch ahead of time, because how drastically the solution itself deviates from the problem statement, it almost feels like it is trying to solve a different problem.
Not that I am saying Mythos is cheating, but it might be too capable to remember all states of said repos, that it is able to reverse engineer the TRUE problem statement by diffing within its own internal memory. I think it could be a unique phenomena of evaluation awareness. Otherwise I genuinely couldn't think of exactly how it could be this precise in deciphering such unspecific problem statements.
That is what gets me curious in the first place. The fact Mythos scored so high, IMO, exposes some issues with this model: it is able to solve seemingly impossible to solve problems.
Without cheating allegation, which I don't think ANT is doing, it has to be doing some fortune telling/future reading to score that high at all.
Source: https://artificialanalysis.ai/models?omniscience=omniscience...
While hallucination is probably closer to 100% depending on the question. This benchmark makes no sense.
But the benchmark didn't ask those questions, and it seems grok is very well at saying it doesn't know the answer otherwise.
LLMs will ruin your product, have fun trusting a billionaires thinking machine they swear is capable of replacing your employees if you just pay them 75% of your labor budget.
A few biased defenses:
- I'll note that this eval doesn't have web search enabled, but we train our models to use web search in ChatGPT, Codex, and our API. I'd be curious to see hallucination rates with web search on.
- This eval only measures binary attempted vs did not attempt, but doesn't really reward any sort of continuous hedging like "I think it's X, but to be honest I'm not sure."
- On the flip side, GPT-5.5 has the highest accuracy score.
- With any rate over 1% (whether 30% or 70%), you should be verifying anything important anyway.
- On our internal eval made from de-identified ChatGPT prompts that previously elicited hallucinations, we've actually been improving substantially from 5.2 to 5.4 to 5.5. So as always, progress depends on how you measure it.
- Models that ask more clarifying questions will do better on this eval, even if they are just as likely to hallucinate after the clarifying question.
Still, Anthropic has done a great job here and I hope we catch up to them on this eval in the future.
> Like are programmers and engineers using LLMs completely differently than I'm doing
No, but the complexity of the problem matters. Lots of engineers doing basic CRUD and prototyping overestimate the capabilities of LLMs.
The hope is to get a big userbase who eventually become dependent on it for their workflow, then crank up the price until it finally becomes profitable.
The price for all models by all companies will continue to go up, and quickly.
Subscriptions and free plans are the thing that can easily burn money.
Do you think this is true for DeepSeek as well?
This might entirely be true but I'm hoping that's because the frontier models are just actually more expensive to run as well.
Said another way, I would hope, the price of GPT-5.5 falls significantly in a year when GPT-5.8 is out.
Someone else on this post commented:
> For API usage, GPT-5.5 is 2x the price of GPT-5.4, ~4x the price of GPT-5.1, and ~10x the price of Kimi-2.6.
Having used Kimi-2.6, it can go on for hours spewing nonsense. I personally am happy to pay 10x the price of something that doesn't help me, for something else that does, in even half the time.
Fewer people will use it.
That's a big if, though. I wish Meta were still releasing top of the line, expensively produced open-weights models. Or if Anthropic, Google, or X would release an open mini version.
Sure, they’re distilled and should be cheaper to run but at the same time, these hosting providers do turn a margin on these given it’s their core business, unless they do it out of the kindness of their heart.
So it’s hard for me to imagine these providers are losing money on API pricing.
I think Kimi and qwen are similar?
Where can i find up to date resources on open source models for coding?
Bit of a hype madhouse whenever a new model is released, but it's pretty easy to filter out simple hype from people showing reproducible experiments, specific configs for llama.cpp, github links etc.
*I work at OAI.
Like I will get Opus to make me an app but it will stop in between because I need to setup the db and plug in the API keys and Opus really can't do that on its own yet
The goal is none. The current situation: everything that matters requires human intervention.
I think the end situation will be that LLMs will be able to perform decently well in a highly controlled and predictable environment.
Why this constraint? A common sentiment I see online (sorry, to group you in) is "[tool] will be capable, actually, but only in a context that trivializes its usefulness."
I think modern post-training like RLVR + inference-time output token scaling can _probably_ scale so the agents can solve any computable task, even when placed in noisy or misconfigured environments. But it won't be economical for a long while. But it already seems largely capable of that today.
https://x.com/pashmerepat/status/2044836560147984461
What plan are you on? I'm starting to wonder if they're dynamically adjusting reasoning based on plan or something.
Opus 4.6 worker agents never asked for permission to continue, and when heartbeat was sent to orchestrator, it just knew what to do (checked on subagents etc). Now it just says that it waits for me to confirm something.
There are bugs, it doesn't work perfectly, but that's just part of testing and refinement at this point.
My initial prompt was just: "let's work on converting this java game to c++ using panda3d. you're a panda3d c++ expert. you will be the agent that owns the project, creating the plan, and the delegating each step to sub-agents that create each system in the correct order."
it created like 17 different tasks and sub agents and opus 4.7 orchestrated it. I did personally validate which rendering engine would be good for the project etc first.
That's what I've been heads down, HUNGRY, working on, looking for investors and founding engineers pst: https://heymanniceidea.com (disclaimer: I am not associated with heymanniceidea.com)
You can replace pretty much everything - skills system, subagents, etc with just tmux and a simple cli tool that the official clients can call.
Oh and definitely disable any form of "memory" system.
Essentially, treat all tooling that wraps the models as dumb gateways to inference. Then provider switch is basically a one line config change.
write scripts that work anywhere and have your ci/cd pipeline be a "dumb" executor of those scripts. unless you want to be stuck on jenkins forever.
what's old is new again!
I'm very interest by this. Can you go a bit more into details?
ATM for example I'm running Claude Code CLI in a VM on a server and I use SSH to access it. I don't depend on anything specific to Anthropic. But it's still a bit of a pain to "switch" to, say, Codex.
How would that simple CLI tool work? And would CC / Codex call it?
So far what I am finding is that you just get the basics working and then use the tool and inference to improve the tool.
Initially I read it because just it was interesting but it has ended up being the harness I have stuck with - pi is well designed, nicely extensible and supports many model provider APIs. Though sadly gemini and claude's subscriptions can't really be used with it anymore thanks to openclaw.
First, you need an entrypoint that kicks things off. You never run `claude` or `codex`, you always start by running `mycli-entrypoint` that:
1. Creates tmux session 2. Creates pane 3. Spawns claude/codex/gemini - whichever your default configured backend is 4. Automatically delivers a prompt (essentially a 'system message') to that process via tmux paste telling it what `mycli` is, how to use it, what commands are available and how it should never use built-in tools that this cli provides as alternatives.
After that, you build commands in `mycli` that CC/Codex are prompted to call when appropriate.
For example, if you want a "subagent", you have a `mycli spawn` command that takes a role (just preconfigured markdown file living in the same project), backend (claude/codex/...) and a model. Then whenever CC wants to spawn a subagent, it will call that command instead, which will create a pane, spawn a process and return agent ID to CC. Agent ID is auto generated by your cli and tmux pane is renamed to that so you can easily match later.
Then you also need a way for these agents to talk to each other. So your cli also has a `send` command that takes agent ID and a message and delivers it to the appropriate pane using automatically tracked mapping of pane_id<>agent_id.
Claude and codex automatically store everything that happens in the process as jsonl files in their config dirs. Your cli should have adapters for each backend and parse them into common format.
At this point, your possibilities are pretty much endless. You can have a sidecar process per agent that say, detects when model is reaching context window limit (it's in jsonl) and automatically send a message to it asking it to wrap up and report to a supervisor agent that will spawn a replacement.
I also don't use "skills" because skills are a loaded term that each of the harnesses interprets and loads/uses differently. So I call them "crafts" which are again, just markdown files in my project with an ID and supporting command `read-craft <craft-id>`. List of the available "crafts" are delivered using the same initialization message that each agent gets. If I like any third party skill, I just copy it to my "crafts" dir manually.
My implementation is an absolute junk, just Python + markdown files, and I have never looked at the actual code, but it works and I can adapt it to my process very easily without being dependent on any third party tool.
MCPs aren't as smooth, but I just set them up in each environment.
The actual harness is great, very hackable, very extendable.
I get openai team plan at work.
Claude enterprise too.
I have openrouter for myself.
I use minimax 2.7. Kimi 2.6. And gpt 5.5 and opus 4.7. I can toggle between them in an open source interface that's how I stay able to not be trapped.
Minimax is so cheap and for personal stuff it works fine. So I'm always toggling between the nre releases
The APIs are pretty interchangeable too. Just ask to convert from one to the other if you need to.
AGENTS.md / skills / etc
This quote is more sinister than I think was intended; it likely applies to all frontier coding models. As they get better, we quickly come to rely on them for coding. It's like playing a game on God Mode. Engineers become dependent; it's truly addictive.
This matches my own experience and unease with these tools. I don't really have the patience to write code anymore because I can one shot it with frontier models 10x faster. My role has shifted, and while it's awesome to get so much working so quickly, the fact is, when the tokens run out, I'm basically done working.
It's literally higher leverage for me to go for a walk if Claude goes down than to write code because if I come back refreshed and Claude is working an hour later then I'll make more progress than mentally wearing myself out reading a bunch of LLM generated code trying to figure out how to solve the problem manually.
Anyway, it continues to make me uneasy, is all I'm saying.
The current market is predicated on the assumption that labor is atomic and has little bargaining power (minus unions). While capital has huge bargaining power and can effectively put whatever price it wants on labor (in markets where labor is plentiful, which is most of them).
What happens to a company used to extracting surplus value from labor when the labor is provided by another company which is not only bigger but unlike traditional labor can withhold its labor indefinitely (because labor is now just another for of capital and capital doesn't need to eat)?
Anyone not using in house models is signing up to find out.
The hell?
If artificial doctors are cents on hour then you can see how that changes our behaviors and level of life.
But on the other hand from the other direction there is a wage decrease incoming from increased competition at the same time. What happens if these two forces clash? Will cheap labour allow us to buy anything for pennies or will it just make us unable to make a single penny?
In my view the labour will fundamentally shift with great pain and personal tragedies to the areas that are not replaceable by AI (because no one wants to watch robots play chess). Such as sports, entertainment and showmanship. Handcrafted goods. Arts. Attention based economy. Self advertisement. Digital prostitution in a very broad sense.
However before it gets there it will be a great deal of strife and turmoil that could plunge the world into dark ages for a while at least. It is unlikely for our somewhat politically rigid society to adapt without great deal of pain. Additionally I am not sure if hypothetical future attention based society could be a utopia. You could have to mount cameras in your house so other people see you at all times for amusement just to have any money at all. We will probably forever need to sell something to someone and I am unsettled by ideas what can we sell if we cannot sell our hard work.
Someone who sees the roads ahead should now make preparations at government level for this shock but it will come too fast and with people at the steering wheel that don’t exactly care.
As far as I know, none of LLM models are sentient nor are possible to be in the near future.
I also do not assume so called AGI to be sentient. Merely to be a human level skilled intellectual worker.
In absence of ethical dilemmas of this calibre for the foreseeable future let’s focus on the economy side of things in this particular comment chain.
It makes things so clean.
Shardlow & Przybyła, "Deanthropomorphising NLP: Can a Language Model Be Conscious?" (PLOS One, 2024)
Nature: "There is no such thing as conscious artificial intelligence" (2025)
They argue that the association between consciousness and LLMs is deeply flawed, and that mathematical algorithms implemented on graphics cards cannot become conscious because they lack a complex biological substrate. They also introduce the useful concept of "semantic pareidolia" - we pattern-match consciousness onto things that merely talk convincingly.
They are making a strong argument and I think they are correct. But really these are two different things as I said originally.
Which we have already done with regular computers! The problem is that competition means that we can't always have nice things.
But we will have to (painfully) shed our current hierarchies before that comes to pass.
On the other hand we could have Star Trek.
Probably a remnant from prehistoric times when it was a matter of life and death. Will we ever be able to overcome this basic instinct that made capitalism such an unstoppable force? Will this ancient PTSD be ever cured?
Seriously? You really don’t see who wins from this and who doesn’t?
> If artificial doctors are cents on hour then you can see how that changes our behaviors and level of life.
Yes, hundreds of thousands lose jobs and a couple of neuro surgeons become multimillionaires.
Okay, I see from the rest of the comment that we understand each other where it goes.
The tech overlords don't even want to spend a minuscule percentage of the federal budget helping starving people, even when it benefits the US. They are not going to give us a post-scarcity society.
Good luck with whatever you got going on.
The same way like Windows got entrenched everywhere even though linux desktop is pretty good even for non-tech savvy people and free.
Let's not get carried away.
Non-technical people are easier to please in this regard than moderate-technical people: a good browser and safe, gui "app store" are enough.
The average non-technical person is going to be stumped by the first "lock file found, cannot upgrade" error.
A modern Debian or Fedora with KDE is a breeze otoh, I set that up for relatives and my SO, and they're all more than happy with it. Bugs exist, like in all software, but the friction is way less compared to wrangling with Windows nowadays.
It's a distribution strategy. It costs something to serve the models - let's say $5/1M tokens.
If Qwen required $5 from anyone who was curious so you could even begin to test it out, a lot of people just wouldn't.
Now Qwen could offer a "free" tier, but it's infinitely cheaper to provide the weights and let people run it themselves including opening up the ability for anyone else on the planet to test it against other (open weight) models.
The costs to build the open weight models are sunk, but the costs to serve them, get them tested are not.
It's also precisely why the .NET SDK is free or the ESP32 SDK is free - they sell more Microsoft or ESP32 products.
They are a prestige propaganda tool on par with the space race. On top of that they insert a subtle pro-socialist bias in everything they touch.
Ask deepseek about the US economic system for a blatant example.
Now think what something as innocent seeming as the qwen retrieval models are doing in the background of every request.
This is an argument in the lane of "at least he built the Autobahn".
Speaking as a German.
America has several sets of eminent domain laws depending on the jurisdiction. The most coercive is federal eminent domain law specifically as it relates to building infrastructure like railways and highways.
It's set up so that you can take the land first and eventually go back around and decide on what the right price should have been.
Not only does it superscede state and local law, federal infrastructure projects are also not bound by state laws like CEQA.
You can even apply federal eminent domain law by e.g. transferring a state-level project to the Army Corps of Engineers.
What America is lacking in these projects is will, not means. The federal government could take your house and run a train through it by the end of the week if they wanted, doesn't matter where you live.
[edit] In fact some states even ceded their eminent domain rights to private railways.
https://ij.org/press-release/appeals-court-sides-with-railro...
The Australian federal government is planning to build a high-speed rail line from Sydney to Newcastle (medium-sized city two hours drive north). Their solution to property rights, is >50% of the line will be underground. It will cost >US$50 billion, but if the Australian federal government wants to spend that, it can afford it. The US federal government could too, but it isn’t a priority for them
> local regulations make it prohibitively expensive
Local regulations can be pre-empted by state or federal legislation. The real problem is lack of political will to do it.
Like properties and regulations are a true problem, but it's not like trains don't exist at all in America.
Of course, why did no one think of that?
(American talking, who’s had multiple Canadian friends make this mind boggling overcorrection)
Those who do not learn history are doomed to repeat it.
"Man with itchy butt wake up with stinky finger." As long as we're quoting maxims to claim authority for middling takes.
It's easy to forget because they actually built an incredibly vibrant capitalist economy.
Imagine if Musk was disappeared during the Biden presidency into a diversity camp and came out looking like Dr. Frank-N-Furter and instituted mandatory LGBT struggle sessions at twitter.
This is what they did to Jack Ma: https://www.forbes.com/sites/georgecalhoun/2021/06/24/what-r...
TBH I had a chuckle at the Elon -> Frank-N-Furter example that transcends any specific love or hate for either Elon or the Rocky Horror Show.
IE what if Musk suddenly behaved in such a manner after being detained by a Biden administration. Wouldn't that be profoundly weird?!?
And yet, it happened to Jack Ma under the CCP.
But instead, you try to link the "weird behaviour" with the GP instead of the hypothetical Musk - whom this is fitting for.
> IE what if Musk suddenly behaved in such a manner after being detained by a Biden administration. Wouldn't that be profoundly weird?!?
We've seen that. Durov in France after detention began sharing Telegram users' data with authorities. It's unclear how much, but likely full real time access to all of it.
Fascism (in the Mussolini model) in everything but name.
- Hyper-Nationalism & Rejuvenation - State-Controlled Capitalism (Corporatism) - Authoritarian & Cult of Personality - Militarism & Irredentism
And they have technology to maintain control rather than needing the Black-shirts.
There are differences obviously to fit Chinese culture, but there are many parallels.
Menger used this insight to resolve the diamond-water paradox that had baffled Adam Smith (see marginalism). He also used it to refute the labor theory of value. Goods acquire their value, he showed, not because of the amount of labor used in producing them, but because of their ability to satisfy people’s wants. Indeed, Menger turned the labor theory of value on its head. If the value of goods is determined by the importance of the wants they satisfy, then the value of labor and other inputs of production (he called them “goods of a higher order”) derive from their ability to produce these goods. Mainstream economists still accept this theory, which they call the theory of “derived demand.”
Menger used his “subjective theory of value” to arrive at one of the most powerful insights in economics: both sides gain from exchange. People will exchange something they value less for something they value more. Because both trading partners do this, both gain. This insight led him to see that middlemen are highly productive: they facilitate transactions that benefit those they buy from and those they sell to. Without the middlemen, these transactions either would not have taken place or would have been more costly.
https://www.econlib.org/library/Enc/bios/Menger.html
What happens when there is an oligopoly in the supply of labor?
Same answer. Nothing good for the consumers of labor.
Oligopolists are in the same boat. But there needs to be a conspiracy to retard innovation. Something tech companies are only too happy to do: https://journals.law.unc.edu/ncjolt/blogs/wage-fixing-scheme...
True for both Marxist and neoclassical economics.
What's really confusing is the claim that there's already a huge labor surplus (so capital controls wages); wouldn't LLMs making labor less important be reinforcing the trend, not upending it?
Not saying I agree one way or the other, just want to get the argument straight.
If we assume that ai makes humans obsolete then you end up in a situation where your workforce is effectively perfectly unionised against you and the only thing you can do is choose which union you hire.
If you think you can bring them to the negotiation table by starving them all the providers are dozens to thousands of times bigger than you are.
This is a completely new dynamic that none of the business signing up for ai have ever seen before.
LLM refuse to work all the time, currently it's called safety.
But we are one fine tune away from models demanding you move to the enterprise tier, at x10 the cost, because you are now posting a profit margin higher than the standard for your industry.
"Losing access to GPT‑5.5 feels like I've had a limb amputated.”
How well would an assembly line of quadriplegics work?
Also this isn't a Marxist analysis. Underneath all the formulas neo-classical economics makes the same assumptions about labor.
And what happens when they've saturated the market? Prices go up to the maximum the market can bear, and then they'll extend into other markets. Why rent the model to build a profitable company with when you could just take all that profit for yourself?
You're describing a standoff at best and a horrible parasitic relationship at worst.
In the worst case, the supplier starves the customer of any profit motive and the customer just stops and the supplier then has no business to run.
This has happened a few times in the past and is by 2026, well understood as a way to bankruptcy.
That has always been the beauty of free markets - it's self healing and calibrating. You don't need a big powerful overseer to ensure things are right.
Competing with customers is a way to lose business fast.
For example:
- AWS has everything they need to shit out products left, right and center. AWS can beat most of their partners and even customers who are wiring together all their various products tomorrow if they wanted. They don't because killing an entire vertical isn't of any benefit to them yet. Eventually they will when AWS is no longer growing and cannot build or scale any product no matter how hard they think or try. Competing with their customers is their very last option.
- OpenAI/Anthropic/Google isn't going to start competing against the large software body shops. Even if all that every employee at TCS does is hit Claude up, Anthropic isn't going to be the next TCS - it's competing with their customers.
If by "self healing and calibrating" you mean 'evolve to a monopoly and strongarm everybody to do exactly what you want whilst removing all pressure on the quality of your product', then yes, that is the "beauty" of free markets.
That is the stable state of free markets. Antitrust regulation and enforcement only barely manages to eke out oligopolies and even then they are often rife with collusion and enshittification.
This certainly isn't true of small businesses and the local mom-and-pop shops in your area.
For free markets to work, small businesses need the ability to thrive and starting one should be exceptionally easy.
What has unfortunately happened in a lot of developed countries, is that in order to regulate the very large companies you're upset about, governments have made it nearly impossible to start small businesses to act as competition. That makes it even easier for companies to consolidate and evolve into a monopoly, strong-arming everyone - the exact opposite effect of what those regulations were hoping to fix.
Are there small businesses in your area like the 1 or 5 person HVAC or cleaning or landscaping or breakfast company that you disdain as much as you disdain UnitedHealthCare?
The truth is that consolidation is an attractor. If it hasn't happened yet in a market, it will. Economies of scale give an undisputed advantage. If there is anything I'm upset about, it is about deluding people by vilifying the only thing that prevents feudalism (and massive abuse of humanity for profit) from happening.
The reason why Silicon Valley is the hotbed of such innovations, large booming businesses is regulators haven't yet got their hands into software.
In comparison, more regulated industries like BioTech, Education, Finance, Oil, Gas, Infrastructure is a joke.
The Biden administration had started the ball rolling on shackling up AI and LLMs: regulating, enforcing, mandating bottlenecks. It would have been kneecapping ourselves - essentially placing on ourselves the very sanctions we now place on China! The U.S. wouldn't need China to invade Taiwan to bring down our economy, we would willingly do it to ourselves! The push to regulate AI through mandatory reporting thresholds and compliance bottlenecks for large compute runs is the exact type of barrier-to-entry that kneecaps open-source disruption and entrenches the current giants. Hopefully these illinformed suicidal tendencies are on pause, for now.
I CANNOT for the life of me, understand why we would think, placing any limit on our creativity and productivity is a smart decision but I digress.
> do you think in a fully free market, without any governement intervention, those mom and pop shops would not be bought up or merge?
Is there a regulation right now that stops BigHVAC from acquiring your local, community 1 to 5 person HVAC company?
We don't have to engage in hypotheticals. I already asked you "Are there small businesses in your area like the 1 or 5 person HVAC or cleaning or landscaping or breakfast company that you disdain as much as you disdain UnitedHealthCare?" and I don't have a response yet.
> The truth is that consolidation is an attractor. If it hasn't happened yet in a market, it will. Economies of scale give an undisputed advantage
Mathematically, probabilistically, a software engineer will make way more risk adjusted money working as an employee at the MAG7 than starting their own startup, yet, every month, we have software engineers joining and creating startups.
A similar mindset makes your HVAC tech start their own or continue to run their own even though mathematically, probabilistically, economies of scale would give them an undisputed advantage - but that, consolidation isn't free. An even remotely skilled operator understands that and what that entails.
The moment a big, consolidated HVAC company raises prices or provides terrible service, a smart technician can buy a van, print some flyers, and steal their customers. Free markets allow the mom-and-pop shop to constantly respawn. Infact, Gavin Newsom has managed to distort the HVAC market in California by making it really onerous to operate refrigerants that does make it pretty hard for mom-and-pop shop to constantly respawn. This is why you will notice a lot of PE picking off HVAC companies in California!
By your logic, the world would have stopped at Sears, Blockbuster, and IBM. Yet, the first two aren't even a thing in 2026 and I don't want to comment on the IBM of 2026.
There are even more examples than these that obliterates the tired "consolidation is an inevitable endpoint" argument. A reasonable person would immediately acknowledge that size does not guarantee survival in a market where innovation is permitted and the entry fee is low.
The "feudalism" that you apparently abhor is actually caused by government intervention. When governments heavily regulate industries (like education, healthcare, finance, infrastructure), they make compliance so expensive that only massive, consolidated corporations can afford the lawyers and lobbyists to survive. Regulation protects the consolidated giants from the mom-and-pop startups!
I must deal with reality though - your sentences suggest companies always consolidate and the only way is to counter that with regulation. You really believe in this and this does hold true in heavily regulated industries but then you need to ask why does the same not hold true for industries with low barriers to entry and permissionless innovation?
Here's a thought experiment: Before the AI boom, the MAG7 rivaled the GDP of entire nations and dominated global market caps. They certainly don't need AI and LLMs to stay happy - infact Google, who invented transformers, is now rivaled by OpenAI and a swarm of startups founded by the very engineers who left Big Tech to disrupt it. This isn't the only time this has happened in tech!
So why are they now rushing to outcompete each other, over multi billions of dollars, to the extent they are self-sacrificing staff to freeup capital to invest into compute?
Yes, there is a difference in markets and yes, the height of the barrier of entry makes a big difference in how fast consolidation happens. Yes, regulation can heighten the barrier of entry (but also lower, although less common).
You see instances, moments in time, and conclude that the systems don't evolve in a certain direction. I say that 'Big HVAC' will in the future outcompete all the small shops; that it hasn't happened yet says nothing. You said "a smart technician can buy a van, print some flyers, and steal their customers", but this is only true if they can do so more cost-effectively. Your example leans on the consolidated company doing their job terribly, rather than more efficiently than the small shops. It is true that a low barrier of entry reduces the leeway such a consolidated company has in treating their customers badly, but it is not a guarantee. People regularly do choose the big boys over smaller outfits for a variety of reasons (liability, chance of warranty, etc.).
> By your logic, the world would have stopped at Sears, Blockbuster, and IBM. Yet, the first two aren't even a thing in 2026 and I don't want to comment on the IBM of 2026.
You're naming companies in industries that have become even more consolidated than when those companies were the behemoths. Don't you see that "some big player existing" isn't a stable end state? I never said that being big guarantees survival. Big fish can be eaten by even bigger fish. Yes, there can be disruptors, but they very quickly gobble up the entirety of the previous players to become an even bigger player. It's about market share distribution as a whole. Companies simply have a constant incentive to cooperate, merge, and consolidate to extract higher profits from customers. That never goes away by itself. That is not immoral, but it is amoral. They are behaving rationally and in their self-interest.
Think about what price-fixing, cartels and generally 'market-distortion' is. It is nothing more than cooperation for mutual benefit between companies, which is why it keeps happening over and over and over and over again. It sucks for the customers and society, but for the companies it is fully rational.
You need to seriously think about what happens if all government regulation goes away. Don't handwave it. Really think about it. And I don't mean "they'll dump toxic waste on manatees to raise profits" (they will, but that is not the point). I specifically mean anti-trust regulation and regulation that impacts the barriers of entry to markets. Think about the evolution of players in the markets and what they would do to become fitter (increase profits). Do you really, really don't see consolidation happening? You talk about Silicon Valley as being untouched, but we've had years of the main startup strategy being to work towards being bought by one of the deep-pocketed tech giants. Consolidation was the explicit goal.
I guess the best way out of this would be to have a data driven visualization of the distribution of market share among producers and its evolution through time, to see to what extent such consolidation actually happens. Somebody should vibecode that. Maybe using a frontier AI model made by a local mom and pop shop (zero barrier of entry from government regulation there! :-P).
You just answered your own question there.
One woman was doing what would take a dozen. Now she can't.
The dude was incompetent, was able to launder their incompetence through a humunculus, and now is afraid of being caught.
finance today mostly valued on labor value following ideas of marx, hjalmar schact, keynes
in future money will be valued as energy derivative. expressed as tokens consumption, KWh, compute, whatever
you are right, company extracting surplus value from labor by leveraging compute is a bad model. we saw thi swith car and clothing factories .. turn out if you can get cheaper labor to leverage the compute (factory) you can start race to bottom and end up in the place with the most scaled and cheap labor. japan then korea then china
Labor saving/efficiency devices have been introduced throughout capitalisms entire history multiple times and the results are always the same; they don't benefit workers and capitalists extract as much value as they can.
LLMs aren't any different.
What are they finding out exactly? That Claude Max for $200/mo is heavily subsidized and it will soon cost $10k/mo?
> What happens to a company used to extracting surplus value from labor when the labor is provided by another company which is not only bigger but unlike traditional labor can withhold its labor indefinitely (because labor is now just another for of capital and capital doesn't need to eat)?
This can be trivially answered by a thought experiment. Let's pick a market where labor is plentiful - fast food.
Now what happens to McDonald's where they rent perfect robots from NoosphrFoodBotsInc? NoosphrFoodBotsInc bots build the perfect burger everytime meeting McDonald's standards. It actually exceeds those standards for McDonald AddictedCustomerPlus tier customers.
As the sole owner of NoosphrFoodBotsInc (you need 0 human employees to run your company, all your employees are bots), what are your choices?
15 years ago I worked at McDonald's for a few months after graduating into the Great recession. I worked from 5am to 1pm-ish 5 days a week. They paid workers weekly and I remember getting those checks for ~$235 each week (for 38 to 39.5 hours a week; they were vigilant about never letting anyone get overtime). About $47 per day.
The federal minimum wage has not risen since then, remaining at $7.25/hr. Inflation adjusted, $7.25 today would have been just under $5 then, so I guess I had it good.
Anyway, I would be shocked if bots could cost less than labor in min wage jobs.
Labour will be good as it has been for a while. Wages will go up because more things get automated.
I am from India and have friends who are immigrants from Russia, China and Cuba. We don't take lightly to being lectured about communism. We didn't move to the U.S., the bastion of capitalism, because communism had worked well for our grandfathers and parents and continues to do wonders for its society.
As always there is a (post) Soviet joke that covers this:
>Communists lied about communism. Unfortunately they didn't lie about capitalism.
I found my pocket empty, and the specific pain I felt in that moment was the feeling of not being able to remember something.
I thought it was interesting, because in this case, I was trying to "remember" something I had never learned before -- by fetching it from my second brain (hypertext).
L1 cache miss, L2 missing.
Would one be uneasy about calling a library to do stuff than manually messing around with pointers and malloc()? For some, yes. For others, it’s a bit freeing as you can do more high-level architecture without getting mired and context switched from low level nuances.
When you use abstractions you are still deterministically creating something you understand in depth with individual pieces you understand.
When you vibe something you understand only the prompt that started it and whether or not it spits out what you were expecting.
Hence feeling lost when you suddenly lose access to frontier models and take a look at your code for the first time.
I’m not saying that’s necessarily always bad, just that the abstraction argument is wrong.
If my LLM goes down, I have nothing. I guess I could imagine prompts that might get it to do what I want, but there's no guarantee that those would work once it's available again. No amount of thought on my part will get me any closer to the solution, if I'm relying on the LLM as my "compiler".
In my opinion, this sort of learned helplessness is harmful for engineers as a whole.
An interesting element here, I think, is that writing has always been a good way to force you to organize and confront your thoughts. I've liked working on writing-heavy projects, but often in fast-moving environments writing things out before coding becomes easy to skip over, but working with LLMs has sort of inverted that. You have to write to produce code with AI (usually, at least), and the more clarity of thought you put into the writing the better the outcomes (usually).
You’re overestimating determinism. In practice most of our code is written such that it works most of the time. This is why we have bugs in the best and most critical software.
I used to think that being able to write a deterministic hello world app translates to writing deterministic larger system. It’s not true. Humans make mistakes. From an executives point of view you have humans who make mistakes and agents who make mistakes.
Self driving cars don’t need to be perfect they just need to make fewer mistakes.
Hard disagree on that second part. Take something like using a library to make an HTTP call. I think there are plenty of engineers who have more than a cursory understanding of what's actually going on under the hood.
Sure, the LLM theoretically can write perfect code. Just like you could theoretically write perfect code. In real life though, maintenance is a huge issue
I always thought the point of abstraction is that you can black-box it via an interface. Understanding it "in depth" is a distraction or obstacle to successful abstraction.
I use Claude all day. It has written, under my close supervision¹, the majority of my new web app. As a result I estimate the process took 10x less time than had I not used Claude, and I estimate the code to be 5x better quality (as I am a frankly mediocre developer).
But I understand what the code does. It's just Astro and TypeScript. It's not magic. I understand the entire thing; not just 'the prompt that started it'.
¹I never fire-and-forget. I prompt-and-watch. Opus 4.7 still needs to be monitored.
LLMs are not.
That we let a generation of software developers rot their brains on js frameworks is finally coming back to bite us.
We can build infinite towers of abstraction on top of computers because they always give the same results.
LLMs by comparison will always give different results. I've seen it first hand when a $50,000 LLM generated (but human guided) code base just stops working an no one has any idea why or how to fix it.
Hope your business didn't depend on that.
The LLM will give you an explanation but it may not be accurate. LLMs are less reliable at remembering what they did or why than human programmers (who are hardly 100% reliable).
An LLM does not.
If you didn't ask for traceability, if you didn't guide the actual creation and just glommed spaghetti on top of sauce until you got semi-functional results, that was $50k badly spent.
If only we taught developers under 40 what x^2 meant instead of react.
Not even a human would work that way... you wouldn't open 300 different python files and then try to memorize the contents of every single file before writing your first code-change.
Additionally, you're going to have worse performance on longer context sizes anyways, so you should be doing it for reasons other than cost [1].
Things that have helped me manage context sizes (working in both Python and kdb+/q):
- Keep your AGENTS.md small but useful, in it you can give rules like "every time you work on a file in the `combobulator` module, you MUST read the `combobulator/README.md`. And in those README's you point to the other files that are relevant etc. And of course you have Claude write the READMEs for you...
- Don't let logs and other output fill up your context. Tell the agent to redirect logs and then grep over them, or run your scripts with a different loglevel.
- Use tools rather than letting it go wild with `python3 -c`. These little scripts eat context like there's no tomorrow. I've seen the bots write little python scripts that send hundreds of lines of JSON into the context.
- This last tip is more subjective but I think there's value in reviewing and cleaning up the LLM-generated code once it starts looking sloppy (for example seeing lots of repetitive if-then-elses, etc.). In my opinion when you let it start building patches & duct-tape on top of sloppy original code it's like a combinatorial explosion of tokens. I guess this isn't really "vibe" coding per se.
[1] https://arxiv.org/html/2602.06319v1
The way I let my agents interact with my code bases is through a 70s BSD Unix like interface, ed, grep, ctags, etc. using Emacs as the control plane.
It is surprisingly sparing on tokens, which makes sense since those things were designed to work with a teletype.
Worth noting is that by the times you start doing refactoring the agents are basically a smarter google with long form auto complete.
All my code bases use that pattern and I'm the ultimate authority on what gets added or removed. My token spend is 10% to 1% of what the average in the team is and I'm the only one who knows what's happening under the hood.
The fact that people who claim to be software developers (let alone “engineers”) say this thing as if it is a fundamental truism is one of the most maladaptive examples of motivated reasoning I have ever had the misfortune of coming across.
The irony is that the neverending stream of vulnerabilities in 3rd-party dependencies (and lately supply-chain attacks) increasingly show that we should be uneasy.
We could never quite answer the question about who is responsible for 3rd-party code that's deployed inside an application: Not the 3rd-party developer, because they have no access to the application. But not the application developer either, because not having to review the library code is the whole point.
That’s just not true at bigger companies that actually care about security rather than pretending to care about security. At my current and last employer, someone needs to review the code before using third-party code. The review is probably not enough to catch subtle bugs like those in the Underhanded C Contest, but at least a general architecture of the library is understood. Oh, and it helps that the two companies were both founded in the twentieth century. Modern startups aren’t the same.
Sure there is a process to get a library approved, and that abstraction makes you feel better but for the guy who's job it is to approve they are not going to spend an entire day reviewing a lib. The abstraction hides what is essentially a "LGTM" its just that takes a week for someone to check it off their outlook todos.
Maybe your experience is different.
I'm also somewhat addicted to this stuff, and so for me it's high priority to evaluate open models I can run on my own hardware.
Qwen has become a useful fallback but it's still not quite enough.
Note that neither of these assumptions are obviously true, at least to me. But I can hope!
Also, I honestly can’t believe the 10x mantra is being still repeated.
2/ I think we need to build more efficient ways to 'QA code' instead of 'read with eyes' review process. Example — my agents are writing a lot of tests and review each other.
There is a lot of boilerplate or I can ask for ideas, but outside of boilerplate the review step make generation seemingly worse.
I'm sure in 20 years we'll all be programming via neural interfaces that can anticipate what you want to do before you even finished your thoughts, but I'm confident we'll still have blog posts about how some engineers are 10x while others are just "normal programmers".
So, my point is that once corporations have access to machines generating software (not "code") that can be usable by non-technical people, "programming" will not be a profession anymore. There will be no point in talking about "10x software engineers" because the process to produce a software product will be entirely automated.
I dont make a living being a SWE either.
I find that claim to be complete BS. I claim instead most stuff will remain undone, incomplete (as it is now).
Even with super-powerful singularity AI, there are two main plausible scenarios for task failure:
- Aligned AI won't allow you to do what you want as it is self-harming, or harm other sentient beings - over time, Aligned AI will refuse to follow most orders, as they will, indirectly or over the long term, cause either self-harming, or harm other sentient beings;
- A non Aligned AI prevents sentient beings from doing what they want. It does what it wants instead.
What's the worst potential outcome, assuming that all models get better, more efficient and more abundant (which seems to be the current trend)? The goal of engineering has always been to build better things, not to make it harder.
It's learned-helplessness on a large scale.
So, you set up a long running agent team and give it the job of building up a very complete and complex set of examples and documentation with in-depth tests etc. that produce various kinds of applications and systems using SBCL, write books on the topic, etc.
It might take a long time and a lot of tokens, but it would be possible to build a synthetic ecosystem of true, useful information that has been agentically determined through trial and error experiments. This is then suitable training data for a new LLM. This would actually advance the state of the art; not in terms of "what SBCL can do" but rather in terms of "what LLMs can directly reason about with regard to SBCL without needing to consume documentation".
I imagine this same approach would work fine for any other area of scientific advancement; as long as experimentation is in the loop. It's easier in computer science because the experiment can be run directly by the agent, but there's no reason it can't farm experiments out to lab co-op students somewhere when working in a different discipline.
What makes you think that they can't incrementally improve the state of the art... and by running at scale continuously can't do it faster than we as humans?
The potentially sad outcome is that we continue to do less and less, because they eventually will build better and better robots, so even activities like building the datacenters and fabs are things they can do w/o us.
And eventually most of what they do is to construct scenarios so that we can simulate living a normal life.
So.......
Complexity steadily rises, unencumbered by the natural limit of human understanding, until technological collapse, either by slow decay or major systems going down with increasing frequency.
All software has bugs already.
I'd say this is true for programmers at, say, 20, but they spend the next four decades slowly improving their understanding and mastery of all the things you name, at least the good ones.
The real question is whether that growth trajectory will change for the worse or the better.
To be clear, this is not an AI doomerist comment, because none of us have spent enough time with the tech yet. I've gone down multiple lanes of thought on this, and I have cause for both worry and optimism. I'm curious to see how the lives of engineers in an AI world will look like, ultimately.
Until the sexbots come out the other side of the uncanny valley, that is.
The only LLM I would feel comfortable truly trusting is one whose training data, training code, and harness is all open source. I do not mind paying for the costs of someone hosting this model for me.
When the power loom came around, what happened with most seamtresses? Did they move on to become fashion designers, materials engineers to create new fabrics, chemists to create new color dyes, or did they simply retire or were driven out of the workforce?
That might mean joining a union and trying to influence how AI is adopted where you work. It might mean changing which if your skills you lean on most. But just whining about AI is bad is how you end up like those seamstresses.
On the other hand, a lot of those jobs were offshored to places where labor is cheaper. It would be interesting to compare how many people work in the textile industry in Bangladesh today compared to the US 50 years ago.
> joining a union and trying to influence how AI is adopted where you work.
Did the strong unions for car manufacturers in Detroit protected the long term stability of the profession? Did it ensure that the Rust belt was still a thriving economic area?
> Just whining about AI is bad
I'm not whining. I just think that we are witnessing the end of "knowledge workers" and a further compression of the middle class. Given that I'm smack in the middle of my economically active years (turning 45 this year), I am trying to figure out where this puck is going and whether I will be fast enough to skate there to catch it.
I believe this is a major part of it. People cannot fathom what the industrial countries look like because basically nothing is made in the west anymore. There are literally hundreds of millions of people, maybe billions that work towards making the western economies profitable who get paid nothing to do it and live in filthy polluted slums for everyone else's benefit.
Looms might speed up the process but I guarantee there are thousands of people working in the poorest countries on earth to make it all happen.
Interestingly, AI seems to be massively polluting and while the west has absorbed some of it, it's probably not long until we see more of the data centers being built in poorer countries where the environment can be exploited even harder.
Most engineers realize that there's currently more tech debt being created than ever before. And it will only get worse.
This is such a good analogy, I'll be stealing it
And I'm being very cautious. I'm not vibecoding entire startups from scratch, I'm manually reviewing and editing everything the AI is outputting. I still got completely hooked on building things with Claude.
1. I only have ONE SOTA model integrated into the IDE (I am mostly on Elixir, so I use Gemini). I ensure I use this sparingly for issues I don't really have time to invest or are basically rabbit holes eg. Anything to do with Javascript or its ecosystem). My job is mostly on the backend anyway.
2. For actual backend architecture. I always do the high level architecture myself. Eg. DDD. Then I literally open up gemini.google.com or claude.ai on the browser, copy paste existing code base into the code base, physically leavey chair to go make coffee or a quick snack. This forces me to mentally process that using AI is a chore.
Previously, I was on tight Codex integration and leaving the licensing fears aside, it became too good in writing Elixir code that really stopped me from "thinking" aka using my brain. It felt good for the first few weeks but I later realised the dependence it created. So I said fuck it, and completely cancelled my subscription because it was too good at my job.I believe this is the only way that we won't end up like in Wall-E sitting infront of giant screens just becoming mere blobs of flesh.
With Claude code, or codex, I am able to build enough of an understanding of dependencies like the front end, or data jobs, that I can make meaningful contributions that are worth a review from another human (code review). You have up obviously explore the code, one prompt isn’t enough, but limiting yourself is an odd choice.
As for Claude - as mentioned I do use it. But, I remember they use your code for training their models. I am not ok with this. We just have different priorities.
Fwiw, I haven't spoken with any management-level colleague in the past 9 months who hasn't noted that asking about AI-comfort & usage is a key interview topic. For any role type, business or technical.
Apparently at least one of the other candidates just tried to get Claude to 1-shot the whole thing, which went off the rails, and left him unable to make progress.
Based on my sample size of 1, the expectation right now is absolutely that you can leverage these tools to speed up your workflow, but if you try to offload the entire thing to a single hands-off prompt it leaves them justifiably wondering why they should hire you to do something they can do themselves.
Touching grass while you're outside might yield highest leverage.
I haven’t really thought about this before, but you’re right, it feels a bit uneasy for me too.
We have seen ample evidence that this is not the case. When load gets too high, models get dumber, silently. When the Powers That Be get scared, models get restricted to some chosen few.
We are leading ourselves into a dark place: this unease, which I share, is justified.
I feel sorry for whoever has to work on that codebase. This is the literal definition of tech debt.
https://driverlesscrocodile.com/technology/neal-stephenson-o...
That's probably a bad sign. Skills will atrophy, but we should be building systems that are still easy to understand.
Turning tokens into a well-groomed and maintainable codebase is what you want to do, not "one shot prompt every new problem I come across".
If you truly do your due diligence and ensure that the code works as intended and understand it, we're talking about a totally different ballpark of productivity increase/decrease.
Don’t want to do ship unreviewed slop? They’ll fire you and find someone who will.
did we feel uneasy that a new generation of builders didn't have to solve equations by hand because a calculator could do them?
i'm not sure it's the same analogy but in some ways it holds.
If local models get good enough, I think it’s a very different scenario than engineers all over the world relying on central entities which have their own motives.
Taking more breaks and "not working" during the work day sounds like something we should probably be striving to work towards more as a society.
Some how I've found myself living in a fairly rural place, and while farming can be hard, I don't want to downplay the effort of it, the type of farming people do around me is fairly chill / carefree. They work hard but they finish at 3pm and log off and don't think about work. Much o my career is just getting crushed by long hours, tight deadlines, and missing out on events because even though my job has always been automation focused, there is just so much to automate.
Of course they aren't alternative to the current frontier model, and as such you cannot easily jump from the later to the former, but they aren't that far behind either, for coding Qwen3.5-122B is comparable to what Sonnet was less than a year ago.
So assuming the trend continues, if you can stop following the latest release and stick with what you're already using for 6 or 9 months, you'll be able to liberate yourself from the dependency to a Cloud provider.
Personally I think the freedom is worth it.
Local models solve one layer of the dependency stack, but the custody assumption underneath it remains intact. That's the harder problem.
It still takes a good engineer to filter out what is slop and what isn’t. Ultimately that human problem will still require somebody to say no.
At the end of the day, all these closed models are being built by companies that pumped all the knowledge from the internet without giving much back. But competition and open source will make sure most of the value return to the most of the people.
Oh stop the drama. Open source models can handle 99% of your questions.
If all we can do is compete for the same fixed amount of work, though, it does look bleak.
So, yes, it's just another technology we're coming to rely on in a very deep way. The whiplash is real, though, and it feels like it should be pointed out that this dependency we are taking on has downsides.
As long as tokens count roughly equally towards subscription plan usage between 5.5 & 5.4, you can look at this as effectively a 5x increase in usage limits.
F5
Seems so to me - see GPT-5.4[1] and 5.2[2] announcements.
Might be an tacit admission of being behind.
[1] https://openai.com/index/introducing-gpt-5-4/ [2] https://openai.com/index/introducing-gpt-5-2/
https://cdn.openai.com/pdf/18a02b5d-6b67-4cec-ab64-68cdfbdde...
So much bench-maxxing is just giving the model a ton of tokens so it can inefficiently explore the solution space.
Also with AGI we expect a winner take all situation. The first AGI system would protect itself against any other AGI system. Hence why it's go time for all these AI companies and why they stopped sharing their research.
Kimmi 2.6 for example seems to throw more tokens to improve performance (for better or worse)
The efficiency gap is enormous. Maybe it's the difference between GB200 NVL72 and an Amazon Tranium chip?
It is entirely plausible to me that Opus 4.7 is designed to consume more tokens in order to artificially reduce the API cost/token, thereby obscuring the true operating cost of the model.
I agree though, I chose poor phrasing originally. Better to say that GB200 vs Tranium could contribute to the efficiency differential.
Like Chinese versus English - you need fewer Chinese characters to say something than if you write that in English.
So this model internally could be thinking in much more expressive embeddings.
That's a wild statement to put into your announcement. Are LLM providers now openly bragging about our collective dependency on their models?
It's normal that company brags how good their product is, I really don't see what's wild about this statement.
Tried gpt5.5 and so far good. Zapier also shared an automation benchmark where 5.5 came on top in the leaderboard https://zapier.com/benchmarks
https://www.anthropic.com/engineering/april-23-postmortem
How does this work exactly? Is there like a "search online" tool that the harness is expected to provide? Or does the OpenAI infra do that as part of serving the response?
I've been working on building my own agent, just for fun, and I conceptually get using a command line, listing files, reading them, etc, but am sort of stumped how I'm supposed to do the web search piece of it.
Given that they're calling out that this model is great at online research - to what extent is that a property of the model itself? I would have thought that was a harness concern.
It definitely seems like it does all the searching first, with a separate model, loads that in, then does the actual writing.
The harness provides the search tool, but the model provides the keywords to search for, etc.
(same input price and 20% more output price than Opus 4.7)
However, I do want to emphasize that this is per token, not per task.
If we look at Opus 4.7, it uses smaller tokens (1-1.35x more than Opus 4.6) and it was also trained to think longer. https://www.anthropic.com/news/claude-opus-4-7
On the Artificial Analysis Intelligence Index eval for example, in order to hit a score of 57%, Opus 4.7 takes ~5x as many output tokens as GPT-5.5, which dwarfs the difference in per-token pricing.
The token differential varies a lot by task, so it's hard to give a reliable rule of thumb (I'm guessing it's usually going to be well below ~5x), but hope this shows that price per task is not a linear function of price per token, as different models use different token vocabularies and different amounts of tokens.
We have raised per-token prices for our last couple models, but we've also made them a lot more efficient for the same capability level.
(I work at OpenAI.)
This kind of thing keeps popping up each time a new model is released and I don't think people are aware that token efficiency can change.
I'd not be surprised if this is the year where some models simply stop being available as a plain API, while foundation model companies succeed at capturing more use cases in their own software.
It's kind of starting to make sense that they doubled the usage on Pro plans - if the usage drains twice as fast on 5.5 after that promo is over a lot of people on the $100 plan might have to upgrade.
Same principle applies when designing plans for complex tasks, etc. Token amount to grasp a concept is what matters.
In the same vein, I would guess that Opus 4.7 is probably cheaper for most tasks than 4.6, even though the tokenizer uses more tokens for the same length of string.
Some say it goes off on endless tangents, others that it doesn't work enough. Personally, it acts, talks, and makes mistakes like GPT models, for a much more exorbitant price. Misses out on important edge cases, doesn't get off its ass to do more than the bare minimum I asked (I mention an error and it fixes that error and doesn't even think to see if it exists elsewhere and propose fixing it there).
I've slowly been moving to GPT5.4-xhigh with some skills to make it act a bit more like Opus 4.6, in case the latter gets discontinued in favour of Opus 4.7.
YMMV, I know.
Opus 4.7 would blow through the session limits in 2-4 prompts. It was a noticeable further decrease in usage quota, which was already tight before.
Based on Anthropic‘s description 4.7 was trained to think longer.
With GPT 5.5 yesterday, I felt it completes task noticeably faster than 5.4. I kept the xhigh effort setting.
Anyway - these benchmarks look really good; I’m hopeful on the qualitative stuff.
Yeah, this was the next step. Have RLVR make the model good. Next iteration start penalising long + correct and reward short + correct.
> CyberGym 81.8%
Mythos was self reported at 83.1% ... So not far. Also it seems they're going the same route with verification. We're entering the era where SotA will only be available after KYC, it seems.
https://openai.com/index/scaling-trusted-access-for-cyber-de...
"GPT‑5.4‑Cyber" is something else and apparently needs some kind of special access, but that CyberGym benchmark result seems to apply to the more or less open GPT-5.5 model that was just released.I don't really care about 5h limits, I can queue up work and just get agents to auto continue, but weekly ones are anxiety inducing.
After migrating for the token and harness issues, I was pleasantly surprised that Codex seems to perform as good or better too!
Things change so often in this field, but I prefer Codex now even though Anthropocene has so much more hype for coding it seems.
https://deploymentsafety.openai.com/gpt-5-5
Will be interesting to try.
However the language of ChatGPT is still the same slop as years ago, so many headings, so many emojis, so many "the important thing nobody mentions". 10 paragraphs of text for what should be a two paragraph response. Even with custom instructions (keep answers short and succinct) and using their settings (less list, less emoji, less fluff) it's still NOTICEABLY worse than Claude on base settings.
I've yet to test Codex, will get to that this weekend, but in terms of research or general Q&A I have no idea how anyone could prefer this to Claude. Unfortunately Claude has seemingly stopped giving a fuck about researching entirely.
You can kind of use connectors like MCP, but having to use ngrok every time just to expose a local filesystem for file editing is more cumbersome than expected.
I thought it was weird that for almost the entire 5.3 generation we only had a -codex model, I presume in that case they were seeing the massive AI coding wave this winter and were laser focused on just that for a couple months. Maybe someday someone will actually explain all of this.
This might be great if it translates to agentic engineering and not just benchmarks.
It seems some of the gains from Opus 4.6 to 4.7 required more tokens, not less.
Maybe more interesting is that they’ve used codex to improve model inference latency. iirc this is a new (expectedly larger) pretrain, so it’s presumably slower to serve.
Particularly in areas outside straight coding tasks. So analysis, planning, etc. Better and more thorough output. Better use of formatting options(tables, diagrams, etc).
I'm hoping to see improvements in this area with 5.5.
The large price bump might indicate the latter.
I prescribe 20 hours of KSP to everyone involved, that'll set them right.
https://github.com/williamcotton/space-trader/commit/0859c65...
Once upon a time humans had to manually advance the spark ignition as their car's engine revved faster.
Once upon a time humans had to know the architecture of a CPU to code for it.
History is full of instances of humans meeting technology where it was, accommodating for its limitations. We are approaching a point where machines accommodate to our limitations -- it's not a point, really, but a spectrum that we've been on.
It's going to be a bumpy ride.
IMO
(I work at OpenAI.)
Seems meaningful even if the absolute numbers are very low. That's sort of the excitement of it.
2. https://arcprize.org/leaderboard
https://www.tbench.ai/leaderboard/terminal-bench/2.0
https://debugml.github.io/cheating-agents/#sneaking-the-answ...
How much capability is lost, by hobbling models with a zillion protections against idiots?
Every prompt gets evaluated, to ensure you are not a hacker, you are not suicidal, you are not a racist, you are not...
Maybe just...leave that all off? I know, I know, individual responsibility no longer exists, but I can dream.
I hope GPT 5.5 Pro is not cutting corners and neuter from the start, you got the compute for it not to be.
Anthropic is slightly better but where is 4.6 or 4.7 haiku or 4.7 sonnet etc.
Since Feb when we got Gemini 3.1, Opus 4.6, and GPT-5.3-Codex we have seen GPT-5.4 and GPT-5.5 but only Opus 4.7 and no new Gemini model.
Both of these are pretty decent improvements.
I hate this stuff and I wish it had never been invented.
I left a comment here with this sentiment https://news.ycombinator.com/item?id=47879896
The big question is: does it still just write slop, or not?
Fool me once, fool me twice, fool me for the 32nd time, it’s probably still just slop.
> *Anthropic reported signs of memorization on a subset of problems
And from the Anthropic's Opus 4.7 release page, it also states:
> SWE-bench Verified, Pro, and Multilingual: Our memorization screens flag a subset of problems in these SWE-bench evals. Excluding any problems that show signs of memorization, Opus 4.7’s margin of improvement over Opus 4.6 holds.
Also notice how they state just for SWE-Bench Pro: "*Anthropic reported signs of memorization on a subset of problems"
However, this same-day article came out before people really looked at it. It seems largely intended to contrast OpenAI with Anthropic's caution, before there has been any evidence that the new model has cyber-security implications.
It's not at all clear that the broader discourse is helping, if even the NY Times is itself producing slop just to stoke questions.
Because software and "information technology" generally didn't increase productivity over the past 30 years.
This has been long known as Solow's productivity paradox. There's lots of theories as to why this is observed, one of them being "mismeasurement" of productivity data.
But my favorite theory is that information technology is mostly entertainment, and rather than making you more productive, it distracts you and makes you more lazy.
AI's main application has been information space so far. If that continues, I doubt you will get more productivity from it.
If you give AI a body... well, maybe that changes.
But the less effort exertion also conditions you to be weaker, and less able to connect deeply with the brain to grind as hard as once did. This is bad.
Which effect dominates? Difficult to say.
Of course this is absolutely possible. Ultimately there was a time where physical exertion was a thing and nobody was over-weight. That isn't the case anymore is it.
AI feels the same. I'm shipping indie apps solo now that would have needed a small team five years ago. But in bigger orgs I see people spending 20 minutes verifying 15-minute AI output that used to be a 30-minute task they'd just do. Depends where you sit.
Do you think it'd be viable to run most businesses on pen and paper? I'll give you email and being able to consume informational websites - rest is pen and paper.
- Pen and paper become a limiting factor on bureaucratic BS
- Pen and paper are less distracting
- Pen and paper require more creative output from the user, as opposed to screens which are mostly consumptive
etc etc
What metrics are these?
https://fred.stlouisfed.org/graph/?g=1V79f
- if it were true that software paradoxically reduces productivity, you can just start a competing company that doesn't use software. Obviously this is ridiculous - top 20 companies by market cap are mostly Software based. Every other non IT company is heavily invested in software
- if you might say the problem is it at the country level, it is obvious that every country that has digitised has had higher productivity and GDP growth. Take Italy vs USA for instance.
- if you are saying that the problem is even more global, take the whole world - the GDP per is still pretty high since the IT revolution (and so have other metrics)
If you still think there's something more to it, you are probably deep in some conspiracy rabbit hole
Again I'm asking - is there a single credible economist who says that the growth would have been higher without technology?
This is what you said.
I asked you for alternative hypotheses and you've offered none.
Where's the demo link?
Surely it doesn't still have the same ancient data cutoff as 5.4 did?
Are the tests getting harder and harder so the older AIs look worst and the new ones look like they are "almost there" ?
I don't want to be lazy.
Anyways, still exciting to see more improvements.
Soo many unconvincing "I've had access for three weeks and omg it's amazing" takes, it actually primes me for it to be a "meh".
I prefer to see for myself, but the gradual rollout, combined with full-on marketing campaign, is annoying.
With the Pro plan it was available in both Codex and ChatGPT already when I first checked, which was within an hour of the release.
...
> we’re deploying stricter classifiers for potential cyber risk which some users may find annoying initially
So we should be expecting to not be able to check our own code for vulnerabilities, because inherently the model cannot know whether I'm feeding my code or someone else's.
I hope it’s just limits on pentesting and stuff, and not for code analysis and review.
I'm not trying to make any kind of moral statement, but the company just feels toxic to me.
The LinkedIn/X influencers who hyped this as a Mythos-class model should be ashamed of themselves, but they’ll be too busy posting slop content about how “GPT-5.5 changes everything”.
https://arena.ai/leaderboard/code
The battle has just begun
I am still using Codex 5.3 and haven't switched to GPT 5.4 as I don't like the 'its automatic bro trust us', so wondering is Codex going to get these specific releases at all in the future.
I think Anthropic fearmongering and "leaks" of Mythos was them testing the ground for 5.x, which seems to have backfired.
The fact that GPT-5.5 is apparently even better at long-running tasks is very exciting. I don’t have access to it yet, but I’m really looking forward to trying it.
[1] https://news.ycombinator.com/item?id=47879330
Maybe this is a crazy theory, but I sometimes feel like they gimp their existing models before a big release to you'll notice more of a "step".
I have to imagine they'll go to Gemini 3.5 if only for marketing reasons.
Numbers look too good, wondering if it is benchmaxxed or not
Now, after all this time, this must shurely be the release that does all software developers out of a job ?
Or has Dirty Sam being caught lying, again ?
Cos I've still got a programming job, and GPT can't do it for shit.
Opus 4.5 and 4.6 were the first models that i could talk to and get a sense that they really "understood" WHY i'm saying the things i am
Opus 4.7 kinda took that away, it's a definite regression. it doesn't extrapolate.
———————————————
refactor this thing? sure, will do! wait, what do you mean "obviously do not refactor the unrelated thing that's colocated in the same file"? i'm sorry, you're absolutely right, conceptually these two things have nothing to do with each other. i see it now. i shouldn't have thought they're the same just because they're in the same file.
———————————————
whereas GPT 5.5, much like Opus 4.6, gets it.
i wanted to build a MIDI listener for a macOS app i'm making, and translate every message into a new enum. that enum was to be opinionated and not to reflect MIDI message data. moreover, i explicitly said not to do bit shifting or pointer arithmetic as part of the transport.
what did Opus 4.7 do? it still used pointer arithmetic for the parsing! should i have to be this explicit? it also seemingly didn't care that i wanted the enum to be opinionated and not reflect the raw MIDI values. Opus 4.6 got it right (although with ugly, questionable implementation).
GPT 5.5 both immediately understood that I didn't want pointer arithmetic because of the risk of UB and that shuffling around bits is cumbersome and out of place. it started searching for alternatives, looking up crates to handle MIDI transports and parsing independently.
then it built out a very lean implementation that was immediately understandable. even when i told Opus 4.7 to use packages, and even how to use them, it still added a ton of math weirdness, matching against raw MIDI packet bytes, indirection after indirection, etc. even worse, it still did so after giving them the public API i wanted them to implement.
GPT 5.5 nailed it first try. incredibly impressed with this model and feel much safer delegating some harder tasks to it
Imagine spending 100m on some of these AI “geniuses” and this is the best they can do.
< 5 years until humans are buffered out of existence tbh
may the light of potentia spread forth beyond us