It’s not too early to go to sleep. Too early only applies to waking up.

It's not too early to go to sleep. Too early only applies to waking up.
It’s not too early to go to sleep. Too early only applies to waking up.