Hi linus,
The "always on screen" turns itself off when in your pocket. It uses the proximity sensor to do this. If there is a problem with your proximity sensor then it may turn off randomly. Or not at all...
Mine is faulty... Just figured it out
Kind regards.
Jelle.