People say I shouldn't .Y ?
Depends on the time you are speaking of. I read once a few yrs back(might have changed) your body os at its peak physically between 4 and 6 pm.
I work out between 6 to8 pm go to bed 9to 10 pm
I do my workouts mostly in the evening never had any troubles sleeping after it. But that's me, you have to try couple of times to know if it's right time for you.
Just get it done. Whatever works for you. You know your schedule and your body. Sometimes special circumstances call foe varied times. Just get it done...