What is your biggest struggle whe learning a new language?

Learning a new language is certainly a difficult process and, for various reasons, many people fail. What is or are your biggest problems and challenges when it comes to learning a new language? What do you do to overcome those? I personally struggle with speaking and it has always been a challenge for me psychologically to try to speak a new language. I try to do some language exchanges but with mixed results...