What I mean by this is that it is never to late to start learning English. Most importantly is to prepare yourself for the time when you do need to use it.
Even if you cannot speak the language well, as long as you can pick up some of the words being said, you will be better prepared to understand and answer.
Here is an example of a person, who probably hasn't had much experience with listening in English.
-------->横山さんの英語<--------