It depends where you live. Generally Spring and Fall are the best. But people who are serious about it will do it year round, as long as the weather is not extreme.
You ride at different times of day depending on the season. For example, it's not a good idea to go out in the middle of the day during summer.