Once again not much new. On the regulation as well as capability front, things keep grinding along.
Last week there was a claim that Pi AI cannot be jailbroken. This week, a Twitter user has it giving steps to manufacture heroin and C4. So it goes.
Most interesting progress for me is the paper that notes that “grokking” is caused by the network picking up two separate circuits: one for memorization and one for generalization. But there’s no inherent preference for generalization, it’s just a blessing of scale: retrain the grokked network on a too-small dataset and it forgets its generalization.
You must log in or # to comment.
- Open source was a pretty contentious issue, and a hard one to discuss due to the varying degrees of access that are possible. A system with NDA for top universities/institutions and tiers of access according to how trustworthy they are seemed to be something pretty acceptable.
In case you needed any more convincing to start being a data hoarder, new arguments for it surface every day.
