Discover the magic of the internet at Imgur, a community powered entertainment destination. Lift your spirits with funny jokes, trending memes, entertaining gifs, inspiring stories, viral videos, and so much more from users.
I’d guess that with so many top subs going dark, the mixing algorithm needs to dig deeper and it’s not tuned for that. These algorithms are hard to get right at Reddit’s scale.
As an example to populate the frontpage or /r/all it might would need to scan all posts from the private subs before even getting a sizeable amount of candidate posts from the public ones to rank. Then the public subs won’t be in cache nor will caching help as much on those long tail subreddits. Not being in cache means more hits to the DB and that’s going to affect nearly all requests to Reddit.
I’d guess that with so many top subs going dark, the mixing algorithm needs to dig deeper and it’s not tuned for that. These algorithms are hard to get right at Reddit’s scale.
As an example to populate the frontpage or /r/all it might would need to scan all posts from the private subs before even getting a sizeable amount of candidate posts from the public ones to rank. Then the public subs won’t be in cache nor will caching help as much on those long tail subreddits. Not being in cache means more hits to the DB and that’s going to affect nearly all requests to Reddit.