Morning rides? Hell yes!
There are some things that are different when riding in colder temperatures opposed to riding when the weather is warm. There’s definitely only riders out there, that can cope with the lower temperatures. Sometimes it’s not only what you wear, but there’s a mental thing to it too. There’s no extrinsic motivation to go outside when you expect to feel the cold for at least some kilometer until your body is ready.