Left Car Speaker Doesn't Work Unless I Push on the Head Deck?

I recently bought a '91 corolla and noticed only the right speaker was working. Sometimes the left would kick in when I go over speed bumps, etc, but always kicks back in when I push really hard on the stereo knobs. Is it a problem with the wiring? How can I fix it? Thanks for your feedback in advance :)