originally posted in the thread for sneers not worth a whole post, then I changed my mind and decided it is worth a whole post, cause it is pretty damn important
Posted on r/HPMOR roughly one day ago
full transcript:
Epstein asked to call during a fundraiser. My notes say that I tried to explain AI alignment principles and difficulty to him (presumably in the same way I always would) and that he did not seem to be getting it very much. Others at MIRI say (I do not remember myself / have not myself checked the records) that Epstein then offered MIRI $300K; which made it worth MIRI’s while to figure out whether Epstein was an actual bad guy versus random witchhunted guy, and ask if there was a reasonable path to accepting his donations causing harm; and the upshot was that MIRI decided not to take donations from him. I think/recall that it did not seem worthwhile to do a whole diligence thing about this Epstein guy before we knew whether he was offering significant funding in the first place, and then he did, and then MIRI people looked further, and then (I am told) MIRI turned him down.
Epstein threw money at quite a lot of scientists and I expect a majority of them did not have a clue. It’s not standard practice among nonprofits to run diligence on donors, and in fact I don’t think it should be. Diligence is costly in executive attention, it is relatively rare that a major donor is using your acceptance of donations to get social cover for an island-based extortion operation, and this kind of scrutiny is more efficiently centralized by having professional law enforcement do it than by distributing it across thousands of nonprofits.
In 2009, MIRI (then SIAI) was a fiscal sponsor for an open-source project (that is, we extended our nonprofit status to the project, so they could accept donations on a tax-exempt basis, having determined ourselves that their purpose was a charitable one related to our mission) and they got $50K from Epstein. Nobody at SIAI noticed the name, and since it wasn’t a donation aimed at SIAI itself, we did not run major-donor relations about it.
This reply has not been approved by MIRI / carefully fact-checked, it is just off the top of my own head.
Over on Old!SneerClub, Dembara asked Yud what he would do if he learned that a mature adult was grooming fourteen-year-olds into sex. Yud says he would tell nobody outside the community. The r/HPMOR editors erased the exchange but its still available under the two usernames.
Multiple cases and/or active recruiting would probably have me convene a star chamber to expel Jiff from community events, based on my expectation that at least one of those cases was statistically liable to end in victimful harm. I would not go to the police because of my expectation that law enforcement would be painful, tedious, and ineffective. https://old.reddit.com/user/EliezerYudkowsky
I hope he gets a chance to talk to Cardinal Pell about how well that response to sexual abuse works. A million years should do it.
EA in general has this problem where they let rich people use their “charities” for social cover. It is part of how the FTX scandal was made possible and it is a contributing factor to how and why they keep getting played by the LLM companies.
For someone who calls himself “genre savy” I have to ask why Eliezer and the EAs/rationalists keep getting played
@lurker Well, you see, he’s GENRE savvy, not practical-applications-of-sensible-thought savvy …
As for who should “run diligence on donors”, a random epidemiologist on BlueSky has a “no money from bastards” policy for his lab. This is the sort of thing Yudkowsky could have learned if he got a Master’s degree rather than just attending the occasional conference.
funniest possible outcome would be if epstein actually didn’t offer them money because yud had such bad vibes
like Epstein not letting Musk on the island because he was such a loser? god that would be hilarious
it is relatively rare that a major donor is using your acceptance of donations to get social cover for an island-based extortion operation,
Now wait just a goddamn minute, I thought the whole schtick here was that our gracious correspondent is better than anyone else at evaluating situations that are relatively rare but nonetheless highly consequential
deleted by creator
This was in October 2016, eight years after Epstein was convicted of soliciting sexual services from girls as young as 14. MIRI spent 2014 and 2015 fighting and eventually setting with a former staffer who accused board members of statutory rape. Their legal expenses in those years were around $250k, similar to the money Yud says Epstein offered. So Yudkowsky was very familiar with the concept of older men seeking sex from underage girls and the risks of associating MIRI with it at the time. I don’t remember the exact timeline of Brent Dill’s Bay Area phase but that would have left Yud very familiar with another case where an older man abused younger women and girls.
The original email thread includes this exchange:
Yudkowsky: “… (Sorry for the delay in answering; I was checking with Nate (Executive Director) to see what we knew about why the fundraiser is going slowly.)”
Epstein: “Were you clearing my name with him”
Yudkowsky: “Not sure what you mean. Nate (Soares) knows you’re Jeffrey E. I check not-yet-published info/speculation past him before saying it.”)
The phrase “worth MIRI’s while to figure out whether Epstein was an actual bad guy versus random witchhunted guy” sounds like Yud has been listening to Scott Alexander and Scott Aaronson about how rich or educated white men are the real victims and hos be liars. It sounds like he was familiar with the substance of the accusations and thought there was a good chance they were untrue and not the tip of the iceberg.
Maybe Jeffrey Epstein offered us a large sum of money, maybe he didn’t. I’m not sure and I will make a public statement without bothering to check with anyone. We keep getting large donations so often it’s easy to forget whether we did or did not receive an offer of three hundred thousand dollars from the random nobody called Jeffrey Epstein. What I do remember is that whether we got the offer or not (not that I can remember if we did) we certainly looked into whether he was a bad guy or not, even though it’s not standard practice and I don’t we should have to do so either. In any case we looked into him and maybe turned down the offer he may or may not have made. Probably. Again, I’m making this statement without checking with anyone who knows for sure but I heard someone say something to that effect. Later we took a fifty thousand dollar donation from him anyway, but that’s such a small sum we barely even noticed it.
I assume my lawyer would advise me to keep posting things like this (I have not checked myself).
On 19 October 2016, Epstein’s Wikipedia bio gets to sex crimes in sentence three. And the “Solicitation of prostitution” section includes this:
In June 2008, after pleading guilty to a single state charge of soliciting prostitution from girls as young as 14,[27] Epstein began serving an 18-month sentence. He served 13 months, and upon release became a registered sex offender.[3][28] There is widespread controversy and suspicion that Epstein got off lightly.[29]
At this point, I don’t care if John Brockman dismissed Epstein’s crimes as an overblown peccadillo when he introduced you.
For reference the open-source project appears to be OpenCog, founded by “Ben Goertzel” who at least up until 2010 held the title of “Director of Research” at SIAI, the relation stopping because he wasn’t a true believer in doom.
Goertzel, you say? That makes this part of the statement interesting:
Nobody at SIAI noticed the name, and since it wasn’t a donation aimed at SIAI itself, we did not run major-donor relations about it.
Goertzel specifically asked for funds first, $2k for video editing and personally thanked Epstein for the 50k too
Actually, just because the document is not awesomely formatted, and because mentioning the thanking part undersells the contradiction:
Epstein: is there a 501 c3 that i could give the 50k to/?
Goertzel: Yes: the Singularity Institute for AI (redacted).
Epstein: please send details i will send 50k monday.
Goertzel: many many thanks! … You won’t regret it ;) The AI we build will thank you one day! I am driving now and will send details when I get home
Diligence is costly in executive attention, it is relatively rare that a major donor is using your acceptance of donations to get social cover for an island-based extortion operation
you see, the problem with Epstein was that maybe he made some sparkly elites feel unsafe after the fact, you see. maybe all those fourteen year olds should have just known better, dontcha think?
Yeah it is yet another telling detail that that is the part Eliezer emphasizes and not the child rape.
Jeffrey Epstein? The New York extortionist?







