Unless you wake up with stiff muscles or being seated for too long stiffens you up, stretching may be worth considering. Yet, not many people dedicate time to solely making flexibility training a part of their weekly workout. Stretching is very important just like the rest of your workout progam. However, it's not easy to spend time holding a position as you stretch it out because it feels so ineffective compared to a cardio or strength training exercise. You are reaping benefits because you will get to a point where you feel great afterwards and look forward to it the next time but it took a little investment, 10-30 seconds at a time, to ahieve that sense of satisfaction.
Remember it is not a waste of time and that's the point.