Not paying attention to where you send the btc.
not backing up your shit
backing up your shit and storing the backup improperly (or in the open or near flames)
not secure enough pin
not keeping your btc secret
No. The most glaring defect of hardware wallets is the presence of the physical device itself, which identifies you as an owner of bitcoins. It's like painting a bullseye on your back. How can you answer What bitcoins, sir? to the customs officer, when he's looking right at your Trezor or Ledger device? Or to your nosy neighbor? Or to the random house guest?
Use an online/offline software wallet with freely-available, open source code. Never put your keys on a network-connected machine. Sign all your transactions offline. Memorize your seed mnemonic. That way, wherever you go, your bitcoins go with you. Invisibly, without leaving any physical trace.
Once you've arrived at your new location, buy a Raspberry Pi and an SD card and download and install the wallet software on it for use as a signing machine. Sign transactions using your mnemonic, so your seed is never stored on any physical medium. Run a full node with a watch-only wallet for broadcasting transactions and tracking your balances.
Difficult? Yes, but true security is always difficult. All the easy solutions involve relinquishing control to some trusted third party, and reliance on third parties is exactly what Bitcoin was created to free us from.