chore(all): dependency inject databases and tables

[qdm12]

Changes

Improves codebase health + simplify migration to newer database interface

• Dependency inject to storeInitialValues
• Dependency inject to createRuntimeStorage
• Dependency inject to NewGrandpaState
• Dependency inject to NewEpochStateFromGenesis
• Dependency inject to NewEpochState
• Dependency inject to NewGrandpaStateFromGenesis
• Dependency inject to NewBlockStateFromGenesis
• Dependency inject to NewBlockState
• Remove LoadChainDB, LoadBadgerDB, runtime.NewInMemoryDB and utils.SetupDatabase, newInMemoryGrandpaDatabase
• Minor test database setup simplifications
  • dot/state: make newInMemoryDB test only
  • Remove unneeded datadir setting for in memory databases
  • Add test .Close() no error assertions
  • Add missing test database .Close() calls
  • Use in memory database when amount is not big (TestTrieDiff)
  • Do not create unneeded trie table in lib/trie's newTestDB
  • dot/state: use t.TempDir() as data dir directly
  • lib/trie: do not create table for TestTrieDiff

Tests

Issues

Fixes #2981

Primary Reviewer

[codecov]

Codecov Report

Merging #2994 (7d33f1a) into development (39e3150) will increase coverage by 0.27%.
The diff coverage is 38.29%.

Additional details and impacted files

@@               Coverage Diff               @@
##           development    #2994      +/-   ##
===============================================
+ Coverage        51.50%   51.78%   +0.27%     
===============================================
  Files              221      221              
  Lines            28281    28267      -14     
===============================================
+ Hits             14566    14637      +71     
+ Misses           12399    12306      -93     
- Partials          1316     1324       +8     

[timwu20]

Not sure why we need to merge this PR if you're going to be swapping out the DB entirely.

[qdm12]

Not sure why we need to merge this PR if you're going to be swapping out the DB entirely.

Since we dependency inject the database/tables as locally-defined interfaces, it means there will be less changes to be made (no need to repeat update database/table constructors)

[qdm12]

I can't push to this branch, it would be nice if someone can pick it up and

git checkout development
git pull
git checkout qdm12/dep-inject-db
git rebase development
git push -f

Thanksss