Not to belabor the point but you said...
It's a 32-byte hexadecimal string.
then you also said...
As soon as I typed the last word in thats how the address looked...
Are you saying you typed in words but are giving clues to the sha256 resulting hash (i.e. what brain wallet calls the 'secret exponent') and not the passphrase itself?
If so, then your clues would give hints to each nibble/byte or some other sequence of the sha256 hex string, not the passphrase. (Can you clarify?)
So, for example, clue #3 may refer to 'DEAF'.