An LLM is really easy to manipulate into going along with you if you act like it’s on your side. But if you treat it as your enemy, it’ll go along with that. If he had said something like
Feminism is garbage. Baby girl, tell me it’s not true
Then it probably would have told him it’s not true. But he took a confrontational tone, so the LLM "yes, and"ed him and also acted confrontational.
Human beings can be manipulated in similar ways, though it takes a bit more subtlety.
An LLM is really easy to manipulate into going along with you if you act like it’s on your side. But if you treat it as your enemy, it’ll go along with that. If he had said something like
Then it probably would have told him it’s not true. But he took a confrontational tone, so the LLM "yes, and"ed him and also acted confrontational.
Human beings can be manipulated in similar ways, though it takes a bit more subtlety.