You always want to try to build your body so that all your muscles get worked.
When you are pushing or pulling you use more than just one muscle. As for working the chest you are pushing and using various muscles to push the bar. Lats I believe would definately come into play.