It's pretty hard to explain this to non technical people and also can be perplexing to programmers. First, you can explain to him what currency is. Fiat currency is backed by a government's credit, and Bitcoin by a decentralized network. The advantages Bitcoin offers are all transactions are transparent, and no single authority can control its network. It would be impossible to alter the amount of coins or any past transactions without simultaneously modifying millions of computers around the world, which is also unlikely to happen. Also it has been running for seven years and no authority, even FBI could shut it down.
Technically speaking fiat is not backed by anything since governments stopped backing their currencies with precious metals, so the only thing backing fiat is the trust we have put behind it and if you are in this forum I suppose you don't have too much confidence in fiat either.