Magento guest checkout option not showing up regardless of allow guest checkout setting

I’m having a strange problem with my fresh magento installation. There is no option for guest checkout even though I have Disable Onepage Checkout: NO, and Allow Guest Checkout: YES.