The Google Mail App does not have the ability to change your passphrase manually in Settings. So when you change your Directory ID passphrase, you will need to go into the app and delete the old account and then load it back in using the new passphrase. You will not need to download the app itself again.