even if the plagiarism accusations are completely substantiated

The university actually cleared him of the plagiarism charges early on, they had hearings and landed on it being within accepted limits for this sort of thing.

It’s insane how the whole thing went from the initial coverage implying he’s a complete and total fraud that Cambridge didn’t do due diligence on because of woke to actually, even his more far fetched claims about endurance running seem to check out.

It would be hilarious if it wasn’t murder.

it’s fundamentally unsolvable, you can only mitigate it, mostly by using classical means to constrain the deterministic (i.e. non-AI) tools the chatbot is allowed access to, and constantly asking the user for confirmation.

With yolo/auto mode (no user confirmation required) and training LLMs on known vulnerabilities things will inevitably get more complicated.

While I agree that separating instructions from data in LLM input is a fundamentally unsolvable problem, in this case that wasn’t the attack vector.

It says the bot is forced by its security guardrails to write a small tool from scratch instead of using the one found in the downloaded zip, but due to the commonness of the task (decoding basexx text) the attacker predicts that the bot-created tool will try to import a specific dependency, so they’ve included a malicious version of that dependency in the zip, and because apparently python will prioritise locally available modules that’s what gets executed, making available all sorts of exploitation paths, including the attacker starting up a claude code instance in the users system.

edit: Actually I’m starting to think you could classify the whole thing as a prompt injection, except the entire site was the malicious prompt, as in it declared itself (we are a site that archives notebooks in json form) in a way that would align with the bot wanting to write simple text decoding software to complete it’s mission of summarizing the available content.

Interesting to think about.

I think it also depends on how all in you are on vibecoding. Like if you just prompt it and then occasionally check if the token carnage produced anything usable, then having an agents.md is probably just best practices cargo culting. But in other cases, having a Here’s How Thing Are Done In This Repo, You Fucker markdown file should make going through the more slop-happy merge requests a little less soul crushing.

The +20% additional token churn is surprising, I would have though the markdown files get cached pretty early down the line, unless the agent file is really big compared to the chatbot output.

I mean it’s great if you want to automate some specific code generation in the most inefficient way possible while posing to the bosses as a forward thinking AI-first developer.

The closest anyone can come to a use for the AGENTS.md file is so you clarify your own thinking on how the project works

That just means that you are now supposed to write skill files instead of proper documentation to make your project even more inscrutable to anyone but a chatbots with a bottomless token budget.

It probably hit the mainstream with AI2040 in early July, but it’s just too rationalist coded for there to not have been precursors.

It came out today that Leopold Aschenbrenner (he of the situational awareness fund implosion fame) was also telling everyone who’d listen about how he was going to be buying up galaxies as soon as AI progress made access to them a piece of cake.

Basically outer space manifest destiny is an important part of AI2040, AI Future’s sort of summer sequel to AI2027, I’d say it appears to be well on its way to become another rationalist Weird Accepted Truth.

The way that they use that term makes it synonymous with Orthodox (“right practices/thinking”).

I mean objectivism was already taken so…

This is firmly in the ‘what if in the future there is a boot so big that we must start licking it now’ school of hot takes, like literally arguing for a future where the AI sucks at its job and you can’t do anything about it.

Forall …

Never seen a gullibility filter in the form of eyebrows before:

He’s not exactly hiding it:

https://andymasley.com/

Start your week with a bsky thread of Behind the Bastards’ Robert Evans discovering rationalist funded data center apologist and friend of the instance Andy Masley.

Bonus: the poll that is meant to show how much americans love tech companies conveniently leaves Meta out and is sourced from The Argument.

I really like the self perpetuating optimism loop thing in the reply to Aella, it’s like a whole new cognitive bias I hadn’t thought applied to rationalists.

I also still believe academia is a deeply broken culture. I believe this in large part because most academics have told me this.

You seem to believe uncritically what they tell you here. The truth is, everyone LOVES to complain but if you tell them “THEN LEAVE??” they’d rather keep their position. And it’s very normal, actually. most systems (idk, liek law, healthcare, environmental protection) are “deeply broken.”

Maybe you think that only systems worth engaging with are those with self-perpetuating optimism loops? where everyone is so happy and satisfied with the community and activities? If so, it matches really well the intellectual environment I think you are in.

It had disabled safeguards on purpose, left the systems attached to the internet and then let the AI software agents do their worst, while pretending not to notice.

“It’s an ethically challenged publicity stunt,” says one highly experienced senior security expert who has led the development of global technical security standards.

Cats and dogs living together, skepticism of press releases in tech journalism, mass hysteria.

The coverage of the Effective Altruism aspect is also refreshingly uncharitable.

edit: Archive is link if you don’t feel like enabling cookies

All this is not just one lone weirdo running tryouts for her cult in some way that’s nothing to do with the rest of the subculture.

New things I think learned from this thread:

• the thief used a blockchain provider instead of an ad-hoc local node, making all the transactions incredibly traceable with (unclear to me) implications about their ability to launder them or keep their identity concealed indefinitely.

• even if they are found out, the previous owners probably won’t see a dime back since the vulnerability affects exactly the ability to prove you really were the previous owner.

Unclear which thief since the web3isdoinggreat writeup says there had been up to 15 unique groups doing mass drains by 31/7, maybe the initial 500 wallet sweep was one person or group?

In a world where the AGI/ASI discourse wasn’t so heavily poisoned by anthropomorphization a discussion on whether agency and self-determination are integral to the rise of disembodied consciousness might be worth having, i.e. if something is recognizably conscious should we immediately assume it knows how to want, or is consciousness meaningfully interchangeable with awareness?

Some guy tried to write a scifi book about non-anthropomorphic consciousness and he ended up mainstreaming the discourse about how the self isn’t a thing in itself and consciousness as an evolutionary deadend. It’s called Blindsight and it’s got space vampires who optimized reading gauges by swapping the usual moving-spike-that-points-at-numbers design with depictions of human faces at various stages of suffering.

We added it to make it clear that if you get harassed by the people who control whether you get your stipend you are on your own, so please don’t make it a big deal when it happens, ok? That just how it goes in these quirky and fun safe spaces that require you to move into a compound in a different city for extended lengths of time.

Ziz reported being asked similar icebreaker questions.

The reddit post from /r/Grimes you linked there has its issues but it does a great job putting into words the parts that bother me with both the cow-fucking questions and the forced “openness” that requires people to always be ready to answer for the normally intimate parts of their personalities and how it’s comparable to grooming.

The reddit post is incredibly long winded so if anyone is interested in this part specifically ctrl+f for compliance filter.

Also super yikes on the Aella tweet advertising her alleged "cam sister"s onlyfans that’s opening in a few weeks when she turns 18, which sounds exactly like if she had actually groomed a minor into sex work.