Once you completed the exchange a window popped with the address and passphrase. It gives you the option to download the credentials to a text file and afterwards you close the dialog box by "accepting" or basically saying that you've recorded the pass phrase.
THIS is the problem, right here. The window should not have closed (i.e, "trusted you") after you clicked "accept". The window should have kept going, stopped displaying your pass phrase, and said "Prove to me you've got it, buddy.
Type it in right now while I'm not showing it to you, or we're going to a password reset screen."
If the GUI had been set up like THIS, none of us would be having this conversation right now.