I felt the same when I started my journey with Bitcoin. I couldn't afford any hardware wallet so I decided to use a paper wallet. After a long time, I decided to buy a Ledger Nano S which is quite good. Honestly, I think I should have bought a Trezor. I don't use anything beside Bitcoin, Litecoin and Ethereum so it wouldn't be an issue. The most secure way would be to use an old laptop with some linux distribution installed on it. It's easier to download a malware on Windows than on Linux.
This is why people need to take care of their coins, people have hundreds of bitcoins but are using a pirated copy of windows to store their coins, it is obvious that money is going to get stolen, it is like leaving your wallet with a lot of money in the middle of the street.