Commitment evolving

[awskii]

Commitment evolving

• Research on prefetching branches using RO trie while Write trie computes update and do not use IO Research on prefetching branches using RO trie while Write trie computes update and do not use IO #14273
• fold: simplify branch collection by the end of folding (collect update in one place, not in 4) commitment: refactor fold() into smaller methods #20152
• fold: do not use closure of cellGetter to get cell from the row, use internal hph method instead commitment: eliminate CellGetter callback — hashRow + pure EncodeBranch #20306
• Review Commitment interface to ease support of other commitment scheme
• Add support of ERIGON_COMMITMENT_TRACE variable to allow collection of statistics per each commitment run (levels heatmap, counters, skip rates, depths, fat accounts, whatever) into csv file so we could visualize stats using python and get better insights collect commitment processing data #14490
• Commitment: rehash code only with asserts #14536
• Commitment: remove unused parameter tempdir #14481
• Commitment: no embedded keccak #14482
• Use MaxUint64 as return value to HistoryStartFrom() if no files present #17308
• Trie: reduce cell size - by using int16 for prefix lengths #17134
• integration print_commitment (already implemented)
• Produce comprehensive documentation on HPH trie internals and tricks (memoisation, referenced key in branches) https://github.com/erigontech/erigon-documents/pull/91

Experiments

• Concurrent warmup for Commitment #15658
• Parallel subtrie computation for trie Commitment: parallel subtrie computation #13696
• Split read and write trie Hex patricia reader #13784

[VBulikov]

@AskAlexSharov added Imp1 as Importance

[VBulikov]

VBulikov changed Importance from Imp1 to Imp2