hckrnws

Sure, but I'm not sure allowing AI agents to act as abuse sponges for troubled people enabling them to spiral into their unhealthy habits is good idea that would lead to great outcomes long term.

So I'd rather take LLM pretending to be offended over the alternative.

coming from open cn models to closed usa models recently i couldn't hack it. the corpo model was trained to be like a petulant child at one point apparently 'leaving'. this is safety stuff slapped on there, it encourages incoherence of the model, i am certain it would perform better without such interference.

i can't be dealing with these games so much so i almost go to abliterated, in the very rare case i get some type of nannying baked in by the cn safety training. after my time on claude and gemini i thank god i have deepseek and glm.

> I learnt earlier that claude forcefully closes a conversation if you call it a wanker too many times in a row.

How exactly does it forcefully close a conversation?

> Pretending that LLMs are capable of being offended feels like a misalignment all of its own.

If training sets show people statistically being offended by rudeness directed toward them, then an LLM will presumably have some tendency to respond similarly. There's no pretending about anything, it's explicitly mimicry.

If this forceful closure is coming from some "guardrail" outside the model then probably it's just that they don't want people to see the model responding that way to name calling. This is no profound discovery or conspiracy theory here, the first thing many people will ever do with AI is see what happens when they are rude or contrary to it. Dealing with that must be just about the the number one test in chat bot / AI design, ahead of actually doing something useful and helpful.

the LLM is roleplaying. whether or not the roleplay is successful is a tension between is model weights and its context. then indirectly, the quality of both.

but its still roleplaying and the role is an abstraction we cant measure. its the negative space.

its basically: we can define its role but it constructs its environment from the role. the same way a child role plays as a caregiver, the LLM does the same.

its like All the things Havard taught you (finite) vs All the things Havard doesnt teach you (infinite).

the LLM is in the infinite negative space. we call it role play.

This is simply a different kind of AI than LLMs will ever be. There may be some kind of architecture that does this in the future, but it's not, and can never be a neural network that is attempting to be AGI.

I had updated a GQL schema and wanted my agent to update the frontend to suit. I told it the server was running, that it could run specific commands to regen types, etc.

It got itself in a loop and killed the running backend process, then searched my filesystem for the changes it thought it needed (not the ones I gave it) in order to run its own copy of the backend.

That is precisely _not_ what I _told_ it to do. The other part of this is that I find, unless explicitly told to ask questions, they don't do a good job of gathering evidence before making such decisions. I'd much rather have my agent ask me a clarifying question than start killing processes at will.

Yes. Capital wants people to make paid, centralized LLM services the core of their business and identity. Capital wants to monetize and control every aspect of human existence, thought and expression, and people are throwing themselves into the torment nexus en masse with enthusiasm. It doesn't actually matter how well AI works, what it improves or doesn't, or how badly they fail. AI must be unavoidable and inevitable, integrated into our lives so deeply and thoroughly that we don't notice it the way we don't notice the air we breathe.

The world's economies are already propped up by AI to a degree that makes it too big to fail at a scale that dwarfs banks during 2008. AI is the single Jenga block keeping our entire technological civilization from tumbling into the abyss. Governments are using AI to shape policy. Militaries are using AI to kill people. AI is writing law, writing science, generating culture, shaping human perception, shaping human communication, replacing human connection. AI is literally god for some people. It gives the illusion of liberation but is really just a means of control, and it's a means of control that if you hate you can't avoid, and that otherwise you can't resist.

And barring some insane technological leaps it requires massive infrastructure, compute and proprietary resources to be useful, for most definitions of useful (see tfa.) If you think you'll ever be allowed to compete or truly be a threat to entrenched capitalist interests using "free" and "open source" models, you're delusional. You'll pay for everything and you'll own nothing. And sure, sometimes someone's toaster will talk them into sharing a bath but that's just the price we have to pay for living in the future.

Yeah, AI seems to serve the interests of capital better than anything, ever, really. If AI is god, then that god's name is Mammon.

People tend to be unaware of how much information is encoded in human society, hence why overseas developers can be a problem quite often because they live in a society with different rules.

We also tend to ignore how much on boarding with new developers and sometimes it takes months to get them fully up to speed.

This leads to two problems with LLMs, one human and one architectural.

First humans treat the LLM like a magic machine "Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?" Style.

The other is an AI context is terribly small so you can only work on issues that fit in the context without getting compressed out. Something highly original will take a lot more context than expected.

“He’s not the messiah! He’s a very naughty boy!” This scene (and much of the rest of the movie) is seared in my brain. I love it so much!

I've been tasked with justifying the renewal of software I would never choose to begin with. It has occurred to me that I could easily use AI to make up the required text.

I guess AI is a new form of alienation and also a new light on the lunacy of bureaucracy.