I am using 64 bit Java but anything above 2k stagger will crash my gpu driver. I am using NVIDIA 750 ti
What we need is a fast merge tool which can merge 5-10 Tb in less than a day. Maybe a gpu merge tool
A fast merge tool is important for miner because it help increase hardware life span in long term. The current merge tool is like the CPU plotter. Too slow for big TB. We need an upgrade
Well, to merge some 10 TB/day the data rate would have to be ~127 MB/s reading AND writing concurrently.
As the process is all about de-interleaving data, the reads naturally are scattered all about the disk - the access times and data rate depend on the original stagger size, your disks RPM and possibly filesystem fragmentation. Then you need enough RAM to hold a decent chunk to be written sequentially. I'd say that for stagger 2048 the data rate can't be higher than 20 MB/s on a 7200 rpm drive, so there is the limiting factor, it is not the software.