I personally expect an explosion in hashing power as more fpga and butterfly like units come online. Who won't want to hedge the USD against a nice small form unit plugged into their PC at the side of their desk?
This will be very good for Bitcoin.
On the cost of having massive offline hashing capabilities:
We are already seeing the significant cost to mining as being the electricity usage. Even with the massive change per year in hashing efficiency gained by new technologies.
Over time it is likely that the cost to mining will become much more dependent on the cost of electricity than it is now. The main reason is that the technology isnt going to progress at the same rate as it is progressing now.
We have seen the 500x improvement from going from CPU mining to GPU mining, 2years ago.
We are now seeing the 10x improvement from going from GPU to FPGA.
And we are just now beginning the 5x improvement from going from FPGA to ASIC.
The trend is clear. Do you think that the generation 4 ASIC miner is going much, faster than the generation 3? Then what about the generation 6 or 7 or 10 miners?? The improvement as the technology for hashing for bitcoin matures, always decreases.
This means that while it is better to buy the newest generation miners. The old miners are not completely made oblique. CPUs are never going to be useful in hashing for bitcoin again
However FPGAs may have quite a long life-time.
When it is no-longer profitable to run your FPGA all the time
What happens when a group of insurance companies offer you a quite profitable rate for on-demand hashing? Do you just say no or do you take up the offer for additional income.
The hashing needs of the network are going to become more and more dynamic, depending on the price. If an attack is happening against the network, there will be many players who will be happy to pay, temporally, a higher price, for more hashing power. Meaning that the old miners will be dusted off, and switched on
probably automatically via auctions for hashing power.