Even if you don’t want cold bread, you shouldn’t skip the fridge step. The slower the thawing process, the better the bread.

Maybe it’s just me, but fridge bread doesn’t taste stale. The cold bread tastes more like a desert than room temperature bread.