Upgrade to hsd v3.0.1

[pinheadmz]

by "hsd v3.0.0 staging" I mean the master branch of hsd plus this PR still in review: handshake-org/hsd#643

TODO:

• migration message (again)
• replace TEMP commit with hsd v3.0.0 when released
• also bump up hs-client version, which should have matching updated dependencies to hsd

Note now the "export log" function will only export current file (see bcoin-org/blgr#8) I think this is probably fine, if a developer really needs all the user's backlogs, they can direct that user to the data directory and zip all the debug files.

Benchmark testing method: I start a built Bob package from scratch and let it sync to height 80,000. Then I use this script to parse the log file(s). The script is ready for the new logger update which rotates files and there might be multiple files in the hsd_data directory. hsd chain module runs an internal benchmark test on every single block and prints the result to the debug log, so the script just totals these up. The "block time" therefore should be independent of network conditions since at this point the block has already been downloaded, its just the processing time. The "total time" is the user-experienced total run time to height 80,000 which may be affected by slow peers or bad network conditions, and should not be considered an accurate comparison between trials. It's just included here for completeness.

OSX 10.14.6 (x86_64):

• MASTER to height 80,000: block time: 4.029 hours / total time: 4.101 hours
• BRANCH to height 80,000: block time: 3.431 hours / total time: 3.466 hours
• 15% savings

OSX 11.5.2 (arm64 -- although electron says it built for x64)

• MASTER to height 80,000: block time: 2.219 hours / total time: 2.262 hours
• BRANCH to height 80,000: block time: 1.744 hours / total time: 1.767 hours
• 22% savings

Windows 10 (x86_64):

• MASTER to height 80,000: block time: 6.215 hours / total time: 6.252 hours
• BRANCH to height 80,000: block time: 4.997 hours / total time: 5.099 hours
• 20% savings

Ubuntu 20.04 (x86_64):

• MASTER to height 80,000: block time: 0.828 hours / total time: 0.851 hours
• BRANCH to height 80,000: block time: 0.466 hours / total time: 0.487 hours
• 44% savings

[pinheadmz]

[pinheadmz]

MIGRATION details:

On my OSX M1 laptop, migration took about approximately 5 minutes

Once complete, the hsd_data directory ended up being actually a bit larger. You can see /tree and /wallet are not affected, but /chain is split up in to /chain and /blocks

--> du -h <<BEFORE MIGRATION>>/hsd_data/
4.7G	/Users/matthewzipkin/Library/Application Support/Electron-master-80000-synced/hsd_data/tree
8.6G	/Users/matthewzipkin/Library/Application Support/Electron-master-80000-synced/hsd_data/chain
4.9M	/Users/matthewzipkin/Library/Application Support/Electron-master-80000-synced/hsd_data/wallet
 13G	/Users/matthewzipkin/Library/Application Support/Electron-master-80000-synced/hsd_data/

--> du -h <<AFTER MIGRATION>>/hsd_data 
8.7M	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data/blocks/index
3.9G	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data/blocks
4.7G	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data/tree
4.9G	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data/chain
3.8M	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data/wallet
 14G	/Users/matthewzipkin/Library/Application Support/Electron/hsd_data

[chikeichan]

tested in dev and found no issues 👍