This is a little off the wall but it worked for me…
Ok this may sound weird but when I was first starting out I always associated notes with colors. Since you can’t see music I feel it’s good to associate notes/intervals/modes with colors and flavors.
What I did was get a color chart (you can Google a color chart) and then take a scale like the C Major scale and work on the first 4 notes C – D – E – F. Grab you guitar or a piano and play each note, looking at the color chart see what you feel like assigning to each note.
Now this is a repetitive/accumulative process. Even if you were to spend a month on those 4 notes and by that time when you hear E you see the color Blue you are making progress! Try to get some one to play those notes out of order and see if you can guess them.
Now intervals and modes you’re really going to think I am a nut. Because they involve more than one “Note” I think of flavors… Usually Ice Cream…Think about it Play a Minor 2nd (Jaws) can you associate a taste/flavor to that. You know when you hear a Minor 2nd it makes you think of the theme from Jaws, why not a Flavor. How about a Minor 7th “Have You Driven A Ford Lately” play that interval and I guarantee you’ll hear it!
When I hear a Minor 2nd interval I think of Chocolate Ice cream… Dark and Rich When I hear a Minor 7th I think Strawberry Sweet and Tart.

Bottom line is you need to come up with an association that works for you. With music I always use colors and flavors. I hope this helps someone and you don’t think I am nut…
