Does it matter if I use anndan'm or nan mwen when I want to say 'within me'?

It will matter if you care about being specific.
And anndan mwen (inside of me, within me) and nan mwen (in me, within me) might be translated differently in different contexts and may not be interchangeable at that point.

Haitian Creole ↔ English Reference, Look up Haitian Creole and English Words