You can't always shoot in perfect light. But if you have a camera that captures infrared, any time of day is good.
I carry my Fujifilm X20 set in RAW+JPEG, with the B&W Film Simulation mode enabled. When I attach the Hoya R72 filter (to assist with IR capture), the JPEG is B&W infrared and the RAW is color infrared.
Aside from creating a look that is very different than typical photography, you can shoot any time of day.
Just something to keep in your back pocket.