backport 19361 v17 #19380

brooksprumo · 2021-08-23T21:19:49Z

Remove redundant copy from RocksDB get_cf() wrapper (Remove redundant copy from RocksDB get_cf() wrapper #17529) (Remove redundant copy from RocksDB get_cf() wrapper (backport #17529) #17543)
Allow configuring testnet slots-per-epoch (Allow configuring testnet slots-per-epoch #17545) (Allow configuring testnet slots-per-epoch (backport #17545) #17551)
Bump serde_bytes from 0.11.4 to 0.11.5 (Bump serde_bytes from 0.11.4 to 0.11.5 #16299) (Bump serde_bytes from 0.11.4 to 0.11.5 (backport #16299) #17546)
chore: bump chrono-humanize from 0.1.1 to 0.2.1 (chore: bump chrono-humanize from 0.1.1 to 0.2.1 #16895) (chore: bump chrono-humanize from 0.1.1 to 0.2.1 (backport #16895) #17549)
Bump console from 0.11.3 to 0.14.1 (Bump console from 0.11.3 to 0.14.1 #16301) (Bump console from 0.11.3 to 0.14.1 (backport #16301) #17552)
Revert bpf-tools to version 1.8 because of a codegen bug suspicion (Revert bpf-tools to version 1.8 because of a codegen bug suspicion #17568) (Revert bpf-tools to version 1.8 because of a codegen bug suspicion (backport #17568) #17577)
test-validator: add an arg to control faucet genesis balance (test-validator: add an arg to control faucet genesis balance (backport #17570) #17582)
Always bail if program modifies a ro account (backport Always bail if program modifies a ro account #17569) (Always bail if program modifies a ro account (backport #17569) #17584)
Make initialize public (stake_program: Make stake_instruction::initialize public #17605) (stake_program: Make stake_instruction::initialize public (backport #17605) #17607)
Rework Improve missing default signer error messaging #17486 (backport Rework #17486 #17566) (Rework #17486 (backport #17566) #17597)
Make the sys-tuner oneliner actually copy-pastable (Make the sys-tuner oneliner actually copy-pastable #17615) (Make the sys-tuner oneliner actually copy-pastable (backport #17615) #17619)
Add BPF rustc option to reduce the optimizations to safer level (Add BPF rustc option to reduce the optimizations to safer level #17590) (Add BPF rustc option to reduce the optimizations to safer level (backport #17590) #17594)
Purge expired BlockHeight data from blockstore (backport Purge expired BlockHeight data from blockstore #17634) (Purge expired BlockHeight data from blockstore (backport #17634) #17641)
Add create-stake command to solana-tokens CLI (Add create-stake command to solana-tokens CLI #17550) (Add create-stake command to solana-tokens CLI (backport #17550) #17649)
Add memory operation syscalls (backport Add memory operation syscalls #16447) (Add memory operation syscalls (backport #16447) #17648)
Bump version to v1.7.1
Cli: Decode known program custom errors returned from simulation (Cli: Decode known program custom errors returned from simulation #17652) (Cli: Decode known program custom errors returned from simulation (backport #17652) #17658)
fix getBlock API reference (Fix getBlock API reference #17661) (Fix getBlock API reference (backport #17661) #17662)
Fix test instruction count (Fix test instruction count #17655) (Fix test instruction count (backport #17655) #17660)
Fix test instruction count (Fix test instruction count #17655) (Fix test instruction count (backport #17655) #17660)
Fix CPI recursion depth (Fix CPI recursion depth #17659) (Fix CPI recursion depth (backport #17659) #17670)
remove unnecessary clone (Remove unnecessary code #17559) (Remove unnecessary code (backport #17559) #17677)
add check_hash to non-index hash calculation (add check_hash to non-index hash calculation #17558) (add check_hash to non-index hash calculation (backport #17558) #17676)
minor test code cleanup (minor test code cleanup #17645) (minor test code cleanup (backport #17645) #17680)
remove antiquated assert (remove antiquated assert #17643) (remove antiquated assert (backport #17643) #17689)
RollingBitField: bug fixes and add tests (RollingBitField: bug fixes and add tests #17525) (RollingBitField: bug fixes and add tests (backport #17525) #17674)
refactor SnapshotStorage helpers to prepare for later changes (refactor SnapshotStorage helpers to prepare for later changes #17560) (refactor SnapshotStorage helpers to prepare for later changes (backport #17560) #17678)
add metric for collecting storages (add metric for collecting storages #17527) (add metric for collecting storages (backport #17527) #17675)
parallel get_snapshot_storages (parallel get_snapshot_storages #17589) (parallel get_snapshot_storages (backport #17589) #17679)
implement ancestors as rolling bit field (implement ancestors as rolling bit field #17482) (implement ancestors as rolling bit field (backport #17482) #17673)
rework test for flexibility (rework test for flexibility #17592) (rework test for flexibility (backport #17592) #17681)
reduce copy (reduce copy #17672) (reduce copy (backport #17672) #17688)
Add missing ProgramError to InstructionError mappings (Add missing ProgramError to InstructionError mappings #16231) (Add missing ProgramError to InstructionError mappings (backport #16231) #17723)
sort storages by slot before scan (sort storages by slot before scan #17411) (sort storages by slot before scan (backport #17411) #17724)
Rename ValidatorExit and move to sdk (Rename ValidatorExit and move to sdk #17728) (Rename ValidatorExit and move to sdk (backport #17728) #17729)
add info for vm.max_map_count incorrectly set. (add info for vm.max_map_count incorrectly set. #17727) (add info for vm.max_map_count incorrectly set. (backport #17727) #17730)
```
remove slot lookup (#17691) (#17694)
```
support bin divisions up to 65536 (support bin divisions up to 65536 #17563) (support bin divisions up to 65536 (backport #17563) #17692)
Avoid full-range compactions with periodic filtered b.g. ones (backport Avoid full-range compactions with periodic filtered b.g. ones #16697) (Avoid full-range compactions with periodic filtered b.g. ones (backport #16697) #17741)
use slots returned from get_snapshot_storages to sort (use slots returned from get_snapshot_storages to sort #17638) (use slots returned from get_snapshot_storages to sort (backport #17638) #17695)
writes epoch-slots to crds table synchronously (writes epoch-slots to crds table synchronously #17719) (writes epoch-slots to crds table synchronously (backport #17719) #17743)
excludes caller's crds values from pull responses (excludes caller's crds values from pull responses #17542) (excludes caller's crds values from pull responses (backport #17542) #17744)
simplify test construction (simplify test construction #17686) (simplify test construction (backport #17686) #17693)
adds fallback logic if retransmit multicast fails (adds fallback logic if retransmit multicast fails #17714) (adds fallback logic if retransmit multicast fails (backport #17714) #17742)
increase bin count for hash scan (increase bin count for hash scan #17562) (increase bin count for hash scan (backport #17562) #17747)
Create solana-poh and move remaining rpc modules to solana-rpc (backport Create solana-poh and move remaining rpc modules to solana-rpc #17698) (Create solana-poh and move remaining rpc modules to solana-rpc (backport #17698) #17745)
add data point for cap mismatch (add data point for cap mismatch #17746) (add data point for cap mismatch (backport #17746) #17751)
Document ProgramTest::new and fix ProgramTest::add_program (Document ProgramTest::new and fix ProgramTest::add_program #17754) (Document ProgramTest::new and fix ProgramTest::add_program (backport #17754) #17768)
system-program: Remove zero lamport check on transfers (system-program: Remove zero lamport check on transfers #17726) (system-program: Remove zero lamport check on transfers (backport #17726) #17764)
Support out of band dumping of unrooted slots in AccountsDb (Support out of band dumping of unrooted slots in AccountsDb #17269) (Support out of band dumping of unrooted slots in AccountsDb (backport #17269) #17777)
rework hash calculation to not keep slot and write version (rework hash calculation to not keep slot and write version #17685) (rework hash calculation to not keep slot and write version (backport #17685) #17794)
Bump jsonrpc crates (backport Bump jsonrpc crates #17797) (Bump jsonrpc crates (backport #17797) #17805)
parallelizes gossip packets receiver with processing of requests (parallelizes gossip packets receiver with processing of requests #17647) (parallelizes gossip packets receiver with processing of requests (backport #17647) #17807)
break out hash time in metric (add hash_time_pre_us metric to disambiguate #17721) (add hash_time_pre_us metric to disambiguate (backport #17721) #17753)
Switch EpochSlots to be frozen slots, not completed slots (Switch EpochSlots to be frozen slots, not completed slots #17168) (Switch EpochSlots to be frozen slots, not completed slots (backport #17168) #17776)
Remove budget program (backport Remove budget program #17816) (Remove budget program (backport #17816) #17822)
update dependence version for gag to latest support windows (update dependence version for gag to latest support windows #17801) (update dependence version for gag to latest support windows (backport #17801) #17825)
Bump version to v1.7.2 (Bump version to v1.7.2 #17831)
add min to roots_tracker (add min to roots_tracker #17806) (add min to roots_tracker (backport #17806) #17835)
Update a dangling devnet endpoint doc (Update a dangling devnet endpoint doc #17836) (Update a dangling devnet endpoint doc (backport #17836) #17839)
Add more info about how to safely change the identity of a staked validator (Add more info about how to safely change the identity of a staked validator (backport #17841) #17843)
test: simple CalculateHashIntermediate refactoring (test: simple CalculateHashIntermediate refactoring #17813) (test: simple CalculateHashIntermediate refactoring (backport #17813) #17846)
Wrap long lines (replay_stage.rs: Wrap long lines (backport #17840) #17842)
refactor: create type (refactor: create type #17818) (refactor: create type (backport #17818) #17848)
Add local cluster tests that broadcast duplicate slots (Add local cluster tests that broadcast duplicate slots #13995) (Add local cluster tests that broadcast duplicate slots (backport #13995) #17863)
programs/config: Disallow duplicate signers
Warn about InstructionError meta (Warn about InstructionError meta #17864) (Warn about InstructionError meta (backport #17864) #17878)
Check for undefined symbols in .so and warn about run-time errors (Check for undefined symbols in .so and warn about run-time errors #17850) (Check for undefined symbols in .so and warn about run-time errors (backport #17850) #17880)
Account for duplicate before a bank is frozen or replayed (Account for duplicate before a bank is frozen or replayed #17866) (Account for duplicate before a bank is frozen or replayed (backport #17866) #17883)
Port unconfirmed duplicate tracking logic from ProgressMap to ForkChoice (Port unconfirmed duplicate tracking logic from ProgressMap to ForkChoice #17779) (Port unconfirmed duplicate tracking logic from ProgressMap to ForkChoice (backport #17779) #17889)
Don't require non-existent param for keygen new (Don't require non-existent param for solana-keygen new #17896) (Don't require non-existent param for solana-keygen new (backport #17896) #17897)
excludes epoch-slots from nodes with unknown or different shred version (excludes epoch-slots from nodes with unknown or different shred version #17899) (excludes epoch-slots from nodes with unknown or different shred version (backport #17899) #17916)
short cuts expiration check if origin's contact-info is still valid (short cuts expiration check if origin's contact-info is still valid #17918) (short cuts expiration check if origin's contact-info is still valid (backport #17918) #17921)
minor fixes to punctuation and typos (minor fixes to punctuation and typos #17881) (minor fixes to punctuation and typos (backport #17881) #17923)
Don't use pinned memory when unnecessary (Don't use pinned memory for gossip and repair responses #17832) (Don't use pinned memory for gossip and repair responses (backport #17832) #17934)
Fix accounts index panic in purge_exact (Fix accounts index panic in purge_exact #17757) (Fix accounts index panic in purge_exact (backport #17757) #17935)
Fix typo in docs (Fix typo in docs #17920) (Fix typo in docs (backport #17920) #17938)
binary search in slices for hashing (binary search in slices for hashing #17755) (binary search in slices for hashing (backport #17755) #17804)
add metrics to handle_snapshot_requests (add metrics to handle_snapshot_requests #17937) (add metrics to handle_snapshot_requests (backport #17937) #17945)
Pass iterator for SortedStorages::new_with_slots (Pass iterator for SortedStorages::new_with_slots #17811) (Pass iterator for SortedStorages::new_with_slots (backport #17811) #17847)

use trait to simplify and consolidate cumulative code (#17852) (#17931)

calculate_capitalization uses hash calculation (calculate_capitalization uses hash calculation #17443) (calculate_capitalization uses hash calculation (backport #17443) #17932)
Bump spl-token to v3.1.1 (backport Bump spl-token to v3.1.1 #17951) (Bump spl-token to v3.1.1 (backport #17951) #17958)

name arguments to help with confusion (#17942) (#17948)

removes port-based forwarding logic from turbine retransmit (removes port-based forwarding logic from turbine retransmit #17716) (removes port-based forwarding logic from turbine retransmit (backport #17716) #17973)
refactor so hash verify can be done by more callers (refactor so hash verify can be done by more callers #17941) (refactor so hash verify can be done by more callers (backport #17941) #17947)
remove unused parameters from CalculateHashIntermediate (remove unused parameters from CalculateHashIntermediate #17949) (remove unused parameters from CalculateHashIntermediate (backport #17949) #17976)
v1.7: Stake refactor (Manual backport of Refactor stake program into solana_program #17906) (v1.7: Stake refactor (Manual backport of #17906) #17978)
Refactor bank_forks_utils::load() and some snapshot logic (Refactor bank_forks_utils::load() and some snapshot logic #17492) (Refactor bank_forks_utils::load() and some snapshot logic (backport #17492) #17979)
add metrics for startup (add metrics for startup #17913) (add metrics for startup (backport #17913) #17975)
Properly handle block_height in Bigtable bincode deserialization (Properly handle block_height in Bigtable bincode deserialization #17990) (Properly handle block_height in Bigtable bincode deserialization (backport #17990) #17994)
verify bank hash on startup with ledger tool option (backport verify bank hash on startup with ledger tool option #17939) (verify bank hash on startup with ledger tool option (backport #17939) #17996)
nit: rename measure (nit: rename measure #17946) (nit: rename measure (backport #17946) #17995)
parallel storage -> accounts folder (parallel storage -> accounts folder #17955) (parallel storage -> accounts folder (backport #17955) #18004)
refactor generate_index process_storage_slot (refactor generate_index process_storage_slot #17982) (refactor generate_index process_storage_slot (backport #17982) #18007)
Improve program deployment error message (Improve program deployment error message #17717) (Improve program deployment error message (backport #17717) #17725)
set hash bins to 65k (set hash bins to 65k #17912) (set hash bins to 65k (backport #17912) #18009)
avoid unnecessary empty arrays when binning (avoid unnecessary empty arrays when binning #17944) (avoid unnecessary empty arrays when binning (backport #17944) #18011)
Don't store votes unless we are leader soon (Don't store votes unless we are leader soon #17803) (Don't store votes unless we are leader soon (backport #17803) #17894)
do not use index for verify_bank_hash_and_lamports (do not use index for verify_bank_hash_and_lamports #17812) (do not use index for verify_bank_hash_and_lamports (backport #17812) #18010)
break out generate index reporting (break out generate index reporting #17980) (break out generate index reporting (backport #17980) #18015)
Startup optimization in shrink - don't shrink non-shrinkable slots (backport Startup optimization in shrink - don't shrink non-shrinkable slots #17405) (Startup optimization in shrink - don't shrink non-shrinkable slots (backport #17405) #17792)
validator: run poh speed test earlier in start up (validator: run poh speed test earlier in start up (backport #18012) #18024)
accounts-cluster-bench, close all accounts in a sliding window (accounts-cluster-bench, close all accounts in a sliding window #17993) (accounts-cluster-bench, close all accounts in a sliding window (backport #17993) #18026)
Clean up remove_all_authorized_voters() (Clean up remove_all_authorized_voters() (backport #18014) #18029)
ledger tool limit_load_slot_count_from_snapshot avoids assert failures (backport ledger tool limit_load_slot_count_from_snapshot avoids assert failures #17974) (ledger tool limit_load_slot_count_from_snapshot avoids assert failures (backport #17974) #18008)
Log more info on runtime account verification errors (Log more info on runtime account verification errors #17861) (Log more info on runtime account verification errors (backport #17861) #17879)
metrics: Don't unwrap client instantiation errors (metrics: Don't unwrap client instantiation errors (backport #18005) #18019)
validator: expose max active pubsub subscriptions to CLI (validator: expose max active pubsub subscriptions to CLI (backport #18034) #18036)
Make account shrink configurable Accounts shrink could be configurable #17544 (backport Make account shrink configurable #17544 #17778) (Make account shrink configurable #17544 (backport #17778) #18013)
refactor rebuild_bank_from_snapshots (backport refactor rebuild_bank_from_snapshots #17988) (refactor rebuild_bank_from_snapshots (backport #17988) #18006)
Bump version to v1.7.3
introduce LockMapType for accounts_index (introduce LockMapType for accounts_index #18021) (introduce LockMapType for accounts_index (backport #18021) #18051)
Fix build issues downstream due to stake state shuffle
adds mapping from nodes pubkeys to their shred-version (adds mapping from nodes pubkeys to their shred-version #17940) (adds mapping from nodes pubkeys to their shred-version (backport #17940) #18067)
Fix Nightly Clippy Warnings (backport Fix Nightly Clippy Warnings #18065) (Fix Nightly Clippy Warnings (backport #18065) #18070)
fix loader instruction checker (fix loader instruction checker #18047) (fix loader instruction checker (backport #18047) #18074)
Drop Error suffix from enum values to avoid the enum_variant_names clippy lint
Add additional subscription metrics (Add additional subscription metrics #18071) (Add additional subscription metrics (backport #18071) #18076)
generate_index timings (generate_index timings #17983) (generate_index timings (backport #17983) #18049)
remove unused code (remove unused code #17981) (remove unused code (backport #17981) #18048)
Add logging when RpcHealthStatus::Unknown (Add logging when RpcHealthStatus::Unknown #18098) (Add logging when RpcHealthStatus::Unknown (backport #18098) #18107)
refactor reconstruct_accountsdb_from_fields (refactor reconstruct_accountsdb_from_fields #17987) (refactor reconstruct_accountsdb_from_fields (backport #17987) #18100)
user process.accounts_db_test_hash_calculation for debug_verify hash (user process.accounts_db_test_hash_calculation for debug_verify hash #18053) (user process.accounts_db_test_hash_calculation for debug_verify hash (backport #18053) #18109)
More nightly clippy fixes (More nightly clippy fixes (backport #18078) #18081)
eliminate flatten and sort in hash calculation (eliminate flatten and sort in hash calculation #17802) (eliminate flatten and sort in hash calculation (backport #17802) #18115)
adds shred-version to ip-echo-server response (backport adds shred-version to ip-echo-server response #18066) (adds shred-version to ip-echo-server response (backport #18066) #18113)
refactor generate_index_for_slot (refactor generate_index_for_slot #17984) (refactor generate_index_for_slot (backport #17984) #18116)
Move stake_weighted_timestamp module (Move stake_weighted_timestamp module #18114) (Move stake_weighted_timestamp module (backport #18114) #18120)
Handle removing slots during account scans (Handle removing slots during account scans #17471) (Handle removing slots during account scans (backport #17471) #17953)
Docs val net reqs (backport Docs val net reqs #18122) (Docs val net reqs (backport #18122) #18130)
Fix flaky optimistic violation detection cluster test (Fix flaky optimistic violation detection cluster test #18027) (Fix flaky optimistic violation detection cluster test (backport #18027) #18126)
ci: isolate release builds (ci: isolate release builds (backport #18132) #18133)
Update sysvar docs (Update sysvar docs #18125) (Update sysvar docs (backport #18125) #18147)
sdk: refactor pda generation
ci: fix release build agent targeting
Bump version to v1.7.4
correctly calculate hash_total for hash/lamport calculation (correctly calculate hash_total for hash/lamport calculation #18144) (correctly calculate hash_total for hash/lamport calculation (backport #18144) #18146)
Add metrics for rpc send-tx failures (Add metrics for rpc send-transaction failures #18156) (Add metrics for rpc send-transaction failures (backport #18156) #18164)
Keep track of dirty stores on remove accounts to clean (Keep track of dirty stores on remove accounts to clean #17601) (Keep track of dirty stores on remove accounts to clean (backport #17601) #18173)
capture sort time in hash calculation (capture sort time in hash calculation #18118) (capture sort time in hash calculation (backport #18118) #18153)
chore(pubkey): remove dead code (Chore: remove dead code (backport #17302) #18162)
filters crds values obtained through gossip by their shred version (backport filters crds values obtained through gossip by their shred version #18072) (filters crds values obtained through gossip by their shred version (backport #18072) #18175)
apply 'debug_do_not_add_builtins' to feature activations (apply 'debug_do_not_add_builtins' to feature activations #18110) (apply 'debug_do_not_add_builtins' to feature activations (backport #18110) #18150)
Add batch stats (Add execution batch stats #18096) (Add execution batch stats (backport #18096) #18142)
add min/max bin size metrics to hash calculation (add min/max bin size metrics to hash calculation #18155) (add min/max bin size metrics to hash calculation (backport #18155) #18181)
Update leader-rotation.md (DOCS: Update leader-rotation.md #18192) (DOCS: Update leader-rotation.md (backport #18192) #18193)
Update README.md (Update README.md #18191) (Update README.md (backport #18191) #18195)
rework dirty_pubkeys from insert_new_if_missing_into_primary_index (rework dirty_pubkeys from insert_new_if_missing_into_primary_index #18200) (rework dirty_pubkeys from insert_new_if_missing_into_primary_index (backport #18200) #18208)
untar in parallel (untar in parallel #18184) (untar in parallel (backport #18184) #18210)
remove unnecessary copies from accounts index code paths (remove unnecessary copies from accounts index code paths #18196) (remove unnecessary copies from accounts index code paths (backport #18196) #18212)
ci: use versioned cargo wrapper for crate ordering
ci: nvidia persistence mode isn't a hard requirement
sdk: ensure ld can find criterion when running BPF tests
ci: give localnet nodes a more time to startup
ci: add downstream build wrapper
ci: add wrapper script for running ci locally
metric for accounts index insertion time (metric for accounts index insertion time #18202) (metric for accounts index insertion time (backport #18202) #18226)
Added notes to running validator documentation to ensure that 'exec' is used from scripts when starting the validator to prevent logrotate signals from killing the validator. (Added notes to running validator documentation to ensure that 'exec' … #18234) (Added notes to running validator documentation to ensure that 'exec' … (backport #18234) #18236)
Bump borsh from 0.8.1 to 0.9.0 (Bump borsh from 0.8.1 to 0.9.0 #18230)
replace account index bulk insert with iterator (replace account index bulk insert with iterator #18198) (replace account index bulk insert with iterator (backport #18198) #18235)
Zelcore wallet support for SOL/SPLs info added (Zelcore wallet support for SOL/SPLs info added #17580) (Zelcore wallet support for SOL/SPLs info added (backport #17580) #18249)
Only print Foundation inflation rate if it is greater than 0
Don't update if already an executable
reduce pubkey copies on insert path (reduce pubkey copies on insert path #18240) (reduce pubkey copies on insert path (backport #18240) #18276)
Ignore flaky tests (Ignore flaky optimistic-confirmation local-cluster tests #18278) (Ignore flaky optimistic-confirmation local-cluster tests (backport #18278) #18282)
Cli epoch-info: generate epoch-completed time from block times (Cli epoch-info: generate epoch-completed time from block times #18258) (Cli epoch-info: generate epoch-completed time from block times (backport #18258) #18285)
tx-status: Don't assume a memo instruction succeeded (tx-status: Don't assume a memo instruction succeeded (backport #18281) #18288)
bin accounts index (bin accounts index #18111) (bin accounts index (backport #18111) #18280)
debug logs when crds table trim failed (debug logs when crds table trim failed #18307) (debug logs when crds table trim failed (backport #18307) #18309)
Use timeout to allow RpcClient to retry initial transaction confirmation (Use timeout to allow RpcClient to retry initial transaction confirmation #18311) (Use timeout to allow RpcClient to retry initial transaction confirmation (backport #18311) #18316)
test-validator: hold rent constant with --slots-per-epoch (test-validator: hold rent constant with --slots-per-epoch (backport #18291) #18318)
refactor untar_snapshot_in to push parallelism deeper for further refactoring (refactor untar_snapshot_in to push parallelism deeper for further refactoring #18310) (refactor untar_snapshot_in to push parallelism deeper for further refactoring (backport #18310) #18312)
Add repair number per slot (Add repair and recovered metrics per slot #18082) (Add repair and recovered metrics per slot (backport #18082) #18329)
Fail simulation if transaction contains duplicate accounts (Fail simulation if transaction contains duplicate accounts #18304) (Fail simulation if transaction contains duplicate accounts (backport #18304) #18334)
Fixed an issue doing the set_roots repeatedly for the same set. Instead doing the per chunks. (Fixed an issue doing the set_roots repeatedly for the same set. #18314) (Fixed an issue doing the set_roots repeatedly for the same set. (backport #18314) #18337)
Document slotsUpdates (Document slotsUpdates #18335) (Document slotsUpdates (backport #18335) #18339)
solana validators output now includes average skip rate
Bump version to v1.7.5
Update notification format info to be consistent (Docs: Update notification format info to be consistent #18354) (Docs: Update notification format info to be consistent (backport #18354) #18356)
Cleanup ReplayStage tests (Cleanup ReplayStage test replay_blockstore_components() #18241) (Cleanup ReplayStage test replay_blockstore_components() (backport #18241) #18292)
Remove feature switch for using message hash for already processed check (Remove feature switch for using message hash for already processed check #18340) (Remove feature switch for using message hash for already processed check (backport #18340) #18367)
Remove hackathon banner
Reject transactions with extra signatures (Reject transactions with extra signatures #18306) (Reject transactions with extra signatures (backport #18306) #18370)
Consider all peers as potential candidates during pull-request in case of offline nodes (Consider all peers as potential candidates during pull-request in case of offline nodes #18333) (Consider all peers as potential candidates during pull-request in case of offline nodes (backport #18333) #18372)
report on min/max bin stats for accounts index (report on min/max bin stats for accounts index #18338) (report on min/max bin stats for accounts index (backport #18338) #18347)
Revert "Clean up build warning"
Add sdk and program READMEs (Add sdk and program READMEs #18154)
Add proposal for transactions v2 and address map program (Add proposal for transactions v2 and address map program #17103) (Add proposal for transactions v2 and address map program (backport #17103) #18376)
Docs expose Transaction v2 proposal (backport Docs expose Transaction v2 proposal #18283) (Docs expose Transaction v2 proposal (backport #18283) #18286)
More detailed voting timings in replay stage (More detailed voting timings in replay stage #18229)
test (Test coverage for unrooted slots and cleaning zero lamport accounts #18159) (Test coverage for unrooted slots and cleaning zero lamport accounts (backport #18159) #18289)
Removed unused purged_slots in purge_older_root_entries (Removed unused purged_slots in purge_older_root_entries #18102)
Added formats to notifications in WebSocket RPC client. (Added formats to notifications in WebSocket RPC client. #18231)
Make set roots an iterator (Make set roots an iterator #18357) (Make set roots an iterator (backport #18357) #18377)
Document order of recent blockhashes sysvar (Document order of recent blockhashes sysvar (backport #18368) #18379)
Allow a solana-validator to join a cluster established by solana-test-validator (backport Allow a solana-validator to join a cluster established by solana-test-validator #18394) (Allow a solana-validator to join a cluster established by solana-test-validator (backport #18394) #18399)
SDK: Add test for illegal Pubkey::create_with_seed owners (SDK: Add test for illegal Pubkey::create_with_seed owners (backport #18398) #18402)
Rename Tower::lockouts to Tower::vote_state
sdk: add is_interactive() method Signer trait (sdk: add is_interactive() method Signer trait (backport #18405) #18407)
Cli: expose --with-memo to nonce and stake commands (Cli: expose --with-memo to nonce and stake commands #18404) (Cli: expose --with-memo to nonce and stake commands (backport #18404) #18410)
borsh: add bool type (borsh: add bool type (backport #18425) #18429)
Update terminology.md (Update terminology.md #18430) (Update terminology.md (backport #18430) #18431)
Improve account unlock performance (Improve account unlock performance #18442) (Improve account unlock performance (backport #18442) #18447)
docs: Correct integration validator cli reference (docs: Correct integration validator cli reference (backport #18455) #18458)
Fix transaction logs and inner ixs for leader nodes (backport Fix transaction logs and inner ixs for leader nodes #18395) (Fix transaction logs and inner ixs for leader nodes (backport #18395) #18448)
Remove feature switch for demoting sysvar write locks (Remove feature switch for demoting sysvar write locks #18373) (Remove feature switch for demoting sysvar write locks (backport #18373) #18454)
Remove obsolete stake-monitor command (backport Remove obsolete stake-monitor command #18020) (Remove obsolete stake-monitor command (backport #18020) #18462)
Add vote/stake checked instructions (backport Add vote/stake checked instructions #18345) (Add vote/stake checked instructions (backport #18345) #18457)
encapsulates turbine peers computations of broadcast & retransmit stages (encapsulates turbine peers computations of broadcast & retransmit stages #18238) (encapsulates turbine peers computations of broadcast & retransmit stages (backport #18238) #18464)
persists repair-peers cache across repair service loops (persists repair-peers cache across repair service loops #18400) (persists repair-peers cache across repair service loops (backport #18400) #18483)
implements an unbiased weighted shuffle using binary indexed tree (implements an unbiased weighted shuffle using binary indexed tree #18343) (implements an unbiased weighted shuffle using binary indexed tree (backport #18343) #18485)
Refactoring: Unify account_deps and accounts (backport Refactoring: Unify account_deps and accounts #17898) (Refactoring: Unify account_deps and accounts (backport #17898) #18486)
Record parent slot to reconstruct fork tree from influxdb (Record parent slot to reconstruct fork tree from influxdb #18482) (Record parent slot to reconstruct fork tree from influxdb (backport #18482) #18488)
Fix example in docs for getInflationReward (Fix example in docs for getInflationReward #18494) (Fix example in docs for getInflationReward (backport #18494) #18496)
Fix cargo check (Fix cargo check #18497)
Update verify policy (backport Update verify policy #18459) (Update verify policy (backport #18459) #18491)
Refactor verify_and_update write privileges check (Refactor verify_and_update write privileges check #18468) (Refactor verify_and_update write privileges check (backport #18468) #18484)
featurize_policy_update (featurize_policy_update #18492) (featurize_policy_update (backport #18492) #18502)
Temporarily ignore prost-types advisory (backport Temporarily ignore prost-types advisory #18525) (Temporarily ignore prost-types advisory (backport #18525) #18527)
Add ecrecover syscall (backport Add ecrecover syscall #17720) (Add ecrecover syscall (backport #17720) #18500)
Remove dead solana airdrop parameters (Cli: Remove dead solana airdrop parameters #18520) (Cli: Remove dead solana airdrop parameters (backport #18520) #18524)
Show grcov version as well (Show grcov version as well #18549) (Show grcov version as well (backport #18549) #18551)
skips process_push_message for local messages (backport skips process_push_message for local messages #18493) (skips process_push_message for local messages (backport #18493) #18532)
removes id and shred_version from CrdsGossip (backport removes id and shred_version from CrdsGossip #18505) (removes id and shred_version from CrdsGossip (backport #18505) #18554)
Bump compute budget for neon evm (Bump compute budget for neon evm #17700) (Bump compute budget for neon evm (backport #17700) #18522)
Remove sysvar special cases for rent and assign
Bump prost, prost-types, and tonic (backport Bump prost, prost-types, and tonic #18537) (Bump prost, prost-types, and tonic (backport #18537) #18558)
Add storage-proto build.rs and readme (backport Add storage-proto build.rs and readme #18353) (Add storage-proto build.rs and readme (backport #18353) #18562)
adds a generic implementation of Gossip{Read,Write}Lock (adds a generic implementation of Gossip{Read,Write}Lock #18559) (adds a generic implementation of Gossip{Read,Write}Lock (backport #18559) #18569)
CI: Make BPF test suite a first-class citizen (backport CI: Make BPF test suite a first-class citizen #18535) (CI: Make BPF test suite a first-class citizen (backport #18535) #18571)
chore: bump ouroboros from 0.5.1 to 0.9.3 (chore: bump ouroboros from 0.5.1 to 0.9.3 #18189) (Update ouroboros [fix potential UB] (backport #18567) #18573)
removes redundant (mutable) self receivers (backport removes redundant (mutable) self receivers #18574) (removes redundant (mutable) self receivers (backport #18574) #18580)
storage-proto: Rework source generation (storage-proto: Rework source generation (backport #18577) #18584)
Fix typo (Fix typo #18595) (Fix typo (backport #18595) #18596)
Update neon program id (backport Update neon program id #18607) (Update neon program id (backport #18607) #18608)
Unignore spl downstream build (Unignore spl downstream build #18218) (Unignore spl downstream build (backport #18218) #18611)
serial insertion of bins into accounts index (serial insertion of bins into accounts index #18469) (serial insertion of bins into accounts index (backport #18469) #18617)
Record vote account commission with voting/staking rewards and surface in RPC
refactor(rpc_client): const number of retries for send and confirm transaction (refactor(rpc_client): const number of retries for send and confirm transaction #18390) (refactor(rpc_client): const number of retries for send and confirm transaction (backport #18390) #18427)
Cli: expose last valid block height (Cli: expose last valid block height #18620) (Cli: expose last valid block height (backport #18620) #18627)
Cleanup secp256k1 deps (backport Cleanup secp256k1 deps #18618) (Cleanup secp256k1 deps (backport #18618) #18625)
Drop default_on_eof attribute from Reward struct
Add method id to SysbarId trait (Add method id to SysbarId trait #18604)
Replace get_clock by get_sysvar in BanksClient
Align vote-account output with stake-account output
Remove tour-de-sol/
Remove Tour de SOL more
Remove zh tds pages
Remove tour-de-sol.md link
Gate libsecp256k1 update (backport Gate libsecp256k1 update #18656) (Gate libsecp256k1 update (backport #18656) #18701)
Cli configurable validators (backport Cli configurable validators #18630) (Cli configurable validators (backport #18630) #18666)
nonce: Unify NonceError with SystemError
Cli: Support checked stake and vote operations (Cli: Support checked stake and vote operations #18449) (Cli: Support checked stake and vote operations (backport #18449) #18705)
Bump 1.7 version (Bump 1.7 version #18723)
removes id from push_lowest_slot args (backport removes id from push_lowest_slot args #18645) (removes id from push_lowest_slot args (backport #18645) #18649)
Add voting service (Add voting service #18552) (Add voting service (backport #18552) #18722)
Use rustup default profile (Use rustup default profile in travis ci mac image #18727) (Use rustup default profile in travis ci mac image (backport #18727) #18731)
excludes private ip addresses (skips bad addresses before sending packets (backport #18728) #18740)
CI Tweaks (backport CI Tweaks #18738) (CI Tweaks (backport #18738) #18742)
Bump version to v1.7.7
correct typo (backport correct typo #18750) (correct typo (backport #18750) #18751)
prevent excess allocation with AccountsIndexIterator (prevent excess allocation with AccountsIndexIterator #18605) (prevent excess allocation with AccountsIndexIterator (backport #18605) #18642)
Bump BPF tools to v1.9 (Bump BPF tools to v1.9 (backport #17722) #18766)
feature: add new token program feature (backport feature: add new token program feature #18780) (feature: add new token program feature (backport #18780) #18803)
Disambiguate archive_snapshot_package IO error sources (Disambiguate archive_snapshot_package IO error sources (backport #18789) #18798)
Fixed broken links and added more context to getTokenAccountBalance docs (Fixed broken links and added more context to getTokenAccountBalance docs (backport #18807) #18811)
docs: fix link to Native Programs page in transactions.md (Docs: fix link to Native Programs page in transactions.md #18830) (Docs: fix link to Native Programs page in transactions.md (backport #18830) #18832)
token: Swap new token program id for consistency on all networks (token: Swap new token program id for consistency on all networks #18823) (token: Swap new token program id for consistency on all networks (backport #18823) #18837)
Clarify entities in docs (Clarify entities in docs #18821) (Clarify entities in docs (backport #18821) #18845)
Really start caching by fixing swapped CAS... (Really start broadcast stage caching by fixing swapped CAS... #18842) (Really start broadcast stage caching by fixing swapped CAS... (backport #18842) #18853)
Rpc: getProgramAccounts, restruct base58 account data size (Rpc: getProgramAccounts, restrict base58 account data size #18852) (Rpc: getProgramAccounts, restrict base58 account data size (backport #18852) #18855)
Bump version to v1.7.8 (Bump version to v1.7.8 #18866)
Sigverify refactor (Sigverify refactor (1.7) #18872)
Bump version to v1.7.9
RpcClient::send now supports client-defined RPC methods via RpcRequest::Custom (RpcClient::send<T> now supports client-defined RPC methods via RpcRequest::Custom (backport #18881) #18882)
Disable reed-solomon-erasure/simd-accel feature on aarch64 (Apple M1)
Put is_x86_feature_detected behind a target_arch check
rebase
v1.7: backport new column families from master (v1.7: backport new column families from master #18897)
filters crds values in parallel when responding to gossip pull-requests (backport filters crds values in parallel when responding to gossip pull-requests #18877) (filters crds values in parallel when responding to gossip pull-requests (backport #18877) #18901)
Add cli-output helpers (backport Add cli-output helpers #18933) (Add cli-output helpers (backport #18933) #18935)
Auto-generate shell completions for solana-cli (issue No tab completion in CLI #8879 and cli: bash auto-completion for solana cli #14005) (Auto-generate shell completions for solana-cli (issue #8879 and #14005) #18931) (Auto-generate shell completions for solana-cli (issue #8879 and #14005) (backport #18931) #18945)
Added missing method to index and updated token account methods docs. (Added missing method to index and updated token account methods docs. #18906) (Added missing method to index and updated token account methods docs. (backport #18906) #18954)
Fix erroneous default start_slot (Rpc: Fix erroneous default start_slot in getBlocks #18948) (Rpc: Fix erroneous default start_slot in getBlocks (backport #18948) #18952)
Cli: app and wallet command reorg (backport Cli: app and wallet command reorg #18955) (Cli: app and wallet command reorg (backport #18955) #18959)
Tiny typo fix (Tiny typo fix #18978) (Tiny typo fix (backport #18978) #18979)
adds validator flag to allow private ip addresses (backport adds validator flag to allow private ip addresses #18850) (adds validator flag to allow private ip addresses (backport #18850) #18975)
allows private addresses by default in test-validator (backport allows private addresses by default in test-validator #18976) (allows private addresses by default in test-validator (backport #18976) #18980)
Fix unstable retransmit-num_nodes (Fix unstable retransmit-num_nodes #18970) (Fix unstable retransmit-num_nodes (backport #18970) #18974)
Improve target CPU feature checks (backport Improve target CPU feature checks #18940) (Improve target CPU feature checks (backport #18940) #18958)
Add get_clock to BanksClient (Add get_clock to BanksClient (backport #18590) #18591)
Fix serialization of parameters in RpcClient::get_block_production_with_config (backport Fix serialization of parameters in RpcClient::get_block_production_with_config #18998) (Fix serialization of parameters in RpcClient::get_block_production_with_config (backport #18998) #19000)
Bump version to v1.7.10
v1.7: Fix broken test validator
Exit stable-bpf CI runs before localnet-sanity (Exit stable-bpf CI runs before localnet-sanity #19016) (Exit stable-bpf CI runs before localnet-sanity (backport #19016) #19018)
Add some docs for RpcClient and friends (backport Add some docs for RpcClient and friends #18748) (Add some docs for RpcClient and friends (backport #18748) #19036)
stake: Allow stakes with unmatched credits observed to merge (backport stake: Allow stakes with unmatched credits observed to merge #18985) (stake: Allow stakes with unmatched credits observed to merge (backport #18985) #19055)
bump recommended maps/nofiles (bump recommended maps/nofiles (backport #19047) #19059)
Add more API documentation for Rust RpcClient (Add more API documentation for Rust RpcClient #19021) (Add more API documentation for Rust RpcClient (backport #19021) #19091)
Clean within shrink_all_slots (Clean within shrink_all_slots #19042) (Clean within shrink_all_slots (backport #19042) #19109)
v1.7: Handle new security advisories (v1.7: Handle new security advisories #19131)
Fix deserialization of RPC errors in HttpSender (Fix deserialization of RPC errors in HttpSender #19110) (Fix deserialization of RPC errors in HttpSender (backport #19110) #19127)
add validator option --accounts-db-skip-shrink (backport add validator option --accounts-db-skip-shrink #19028) (add validator option --accounts-db-skip-shrink (backport #19028) #19128)
Updated transaction fee burn description. (Updated transaction fee burn description. #19161) (Updated transaction fee burn description. (backport #19161) #19164)
Use last_valid_block_height in services and client apps (backport Use last_valid_block_height in services and client apps #19163) (Use last_valid_block_height in services and client apps (backport #19163) #19171)
Handle 0-lamport account in index generation (Handle 0-lamport account in index generation #19041) (Handle 0-lamport account in index generation (backport #19041) #19160)
Bump version to v1.7.11
Fixing missing pubsub notification for programSubscribe and logsSubscribe (backport Fixing missing pubsub notification for programSubscribe and logsSubscribe #19092) (Fixing missing pubsub notification for programSubscribe and logsSubscribe (backport #19092) #19207)
Add AsRef for AccountInfo (backport Add AsRef<AccountInfo> for AccountInfo #19235) (Add AsRef<AccountInfo> for AccountInfo (backport #19235) #19238)
Revert TestValidatorGenesis::start() to v1.7.8 signature; add TestValidatorGenesis::start_with_socket_addr_space() (Revert TestValidatorGenesis::start() to v1.7.8 signature; add TestValidatorGenesis::start_with_socket_addr_space() (backport #19240) #19241)
Expose genesis block time via rpc (backport Expose genesis block time via rpc #19267) (Expose genesis block time via rpc (backport #19267) #19277)
Fix memoverlap check (backport Fix memoverlap check #19232) (Fix memoverlap check (backport #19232) #19259)
RPC: add option to exclude accounts from get_supply (backport RPC: add option to exclude accounts from get_supply #19270) (RPC: add option to exclude accounts from get_supply (backport #19270) #19283)
Plumb accounts-db-skip-shrink through testnet scripts (backport Plumb accounts-db-skip-shrink through testnet scripts #19290) (Plumb accounts-db-skip-shrink through testnet scripts (backport #19290) #19303)
Enable booting testnet validators without tower required (backport Enable booting testnet validators without tower required #19298) (Enable booting testnet validators without tower required (backport #19298) #19306)
ci: pin patched solana crates version for downstream project builds (ci: pin patched solana crates version for downstream project builds (backport #19305) #19322)
updates cluster-slots with root-bank instead of root-slot + bank-forks (backport updates cluster-slots with root-bank instead of root-slot + bank-forks #19058) (updates cluster-slots with root-bank instead of root-slot + bank-forks (backport #19058) #19324)
discards epoch-slots epochs ahead of the current root (discards epoch-slots epochs ahead of the current root #19256) (discards epoch-slots epochs ahead of the current root (backport #19256) #19328)
Minimize trust (backport Minimize trust #19279) (Minimize trust (backport #19279) #19335)
stake: Remove v2 program references (backport stake: Remove v2 program references #19308) (stake: Remove v2 program references (backport #19308) #19336)
Add note about ASK keyword to paper wallet doc (Add note about ASK keyword to paper wallet doc #19330) (Add note about ASK keyword to paper wallet doc (backport #19330) #19343)
change untar to use unpack instead of unpack_in (backport change untar to use unpack instead of unpack_in #19216) (change untar to use unpack instead of unpack_in (backport #19216) #19340)
Remove tar-rs audit ignore (Remove tar-rs audit ignore #19344) (Remove tar-rs audit ignore (backport #19344) #19352)
Only encode data with <128 bytes in base58 (Only encode data with <128 bytes in base58 #19317) (Only encode data with <128 bytes in base58 (backport #19317) #19351)
Correct JSON-RPC docs for getSlot (Correct JSON-RPC docs for getSlot #19355) (Correct JSON-RPC docs for getSlot (backport #19355) #19356)
Update crossbeam-deque to 0.8.1 (Update crossbeam-deque to 0.8.1 #19361)

Problem

Summary of Changes

Fixes #

…17804) (cherry picked from commit 817d48b) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…abs#17945) (cherry picked from commit e6bbd4b) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…olana-labs#17847) Co-authored-by: Carl Lin <carl@solana.com> (cherry picked from commit 2a9b127) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…7852) (solana-labs#17931) (cherry picked from commit 2dc6969) # Conflicts: # runtime/src/accounts_hash.rs Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

…olana-labs#17932) * calculate_capitalization uses hash calculation * feedback * remove debugging code, clean up slot math Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

) * Bump spl-token to v3.1.1 (solana-labs#17951) (cherry picked from commit b7de369) # Conflicts: # Cargo.lock # account-decoder/Cargo.toml # accounts-cluster-bench/Cargo.toml # programs/bpf/Cargo.lock # rpc/Cargo.toml # tokens/Cargo.toml * Fix conflicts Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…bs#17948) (cherry picked from commit 7fde9b6) # Conflicts: # runtime/src/accounts_db.rs Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

…abs#17716) (solana-labs#17973) Turbine retransmit logic is based on which socket it received the packet from (i.e `packet.meta.forward`): https://github.com/solana-labs/solana/blob/708bbcb00/core/src/retransmit_stage.rs#L467-L470 This can leave the cluster vulnerable to spoofing and selective propagation of packets; see solana-labs#6672 solana-labs#7774 This commit identifies if the node is on the "critical path" based on its index in the shuffled cluster. If so, it forwards the packet to both neighbors and children; otherwise, the packet is only forwarded to the children. The metrics added in solana-labs#17351 shows that the number of times the index does not match the port is very rare, and therefore this change should be safe. (cherry picked from commit 1618386) Co-authored-by: behzad nouri <behzadnouri@gmail.com>

… (solana-labs#17947) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…17949) (solana-labs#17976) (cherry picked from commit 4d8ffdc) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…abs#17978) * Refactor stake program into solana_program (solana-labs#17906) * Move stake state / instructions into solana_program * Update account-decoder * Update cli and runtime * Update all other parts * Commit Cargo.lock changes in programs/bpf * Update cli stake instruction import * Allow integer arithmetic * Update ABI digest * Bump rust mem instruction count * Remove useless structs * Move stake::id() -> stake::program::id() * Re-export from solana_sdk and mark deprecated * Address feedback * Run cargo fmt * Run cargo fmt post cherry-pick

…s#17492) (solana-labs#17979) Refactor a few functions that are on the load-from-snapshot path, to facilitate adding in incremental snapshots more easily. Additionally, add some tests and doc comments. (cherry picked from commit 1953543) Co-authored-by: Brooks Prumo <brooks@solana.com>

* add metrics for startup * roll timings up higher * fix test * fix duplicate (cherry picked from commit 471b341) # Conflicts: # ledger/src/bank_forks_utils.rs # runtime/src/snapshot_utils.rs conflicts because solana-labs#17778 is not present. Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…ana-labs#17990) (solana-labs#17994) * Default block_height on eof * Add comment to prevent future errors (cherry picked from commit c57d1b4) Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

…labs#17939) (solana-labs#17996) * verify bank hash on startup with ledger tool option (solana-labs#17939) (cherry picked from commit f558b9b) # Conflicts: # core/tests/snapshots.rs # ledger/src/bank_forks_utils.rs # runtime/src/snapshot_utils.rs * fix merge errors Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com> Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

(cherry picked from commit 5ecb30f) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…18004) (cherry picked from commit 7de7942) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…ana-labs#18007) (cherry picked from commit 7ca04d6) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…labs#17725) (cherry picked from commit 39654d3) Co-authored-by: Jack May <jack@solana.com>

(cherry picked from commit 55ee3b5) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…na-labs#18011) (cherry picked from commit eee5414) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…na-labs#17894) (cherry picked from commit 0feac57) Co-authored-by: sakridge <sakridge@gmail.com>

solana-labs#18010) (cherry picked from commit adc6839) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…8015) (cherry picked from commit 71796f4) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

…ackport solana-labs#17405) (solana-labs#17792) * Skip shrink when it doesn't save anything (solana-labs#17405) (cherry picked from commit 14c52ab) # Conflicts: # runtime/src/accounts_db.rs * fix merge error Co-authored-by: sakridge <sakridge@gmail.com> Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

(cherry picked from commit 5bc6c89) Co-authored-by: Trent Nelson <trent@solana.com>

…a-labs#17993) (solana-labs#18026) (cherry picked from commit ed18add) Co-authored-by: carllin <carl@solana.com>

(cherry picked from commit f1ebbba) Co-authored-by: Michael Vines <mvines@gmail.com>

…s (backport solana-labs#17974) (solana-labs#18008) * ledger tool limit_load_slot_count_from_snapshot avoids assert failures (solana-labs#17974) (cherry picked from commit dbd4dc0) # Conflicts: # core/tests/snapshots.rs # ledger/src/blockstore_processor.rs # runtime/benches/accounts.rs # runtime/src/bank.rs * fix merge errors Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com> Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

…) (solana-labs#17879) (cherry picked from commit a1fab0c) Co-authored-by: Jack May <jack@solana.com>

Co-authored-by: Carl Lin <carl@solana.com> (cherry picked from commit 592013e) Co-authored-by: sakridge <sakridge@gmail.com>

* Update hyper 0.14 * Add audit ignores * Bump assert_cmd and remove audit ignore * Remove pin-project-lite warning

…olana-labs#19127) Fixes solana-labs#15576 (cherry picked from commit e4b66a5) Co-authored-by: Brian Anderson <andersrb@gmail.com>

…19028) (solana-labs#19128) * add validator option --accounts-db-skip-shrink (solana-labs#19028) * add validator option --accounts-db-skip-shrink * typo (cherry picked from commit 3280ae3) # Conflicts: # core/tests/snapshots.rs # ledger/src/bank_forks_utils.rs # ledger/src/blockstore_processor.rs # replica-node/src/replica_node.rs # runtime/src/snapshot_utils.rs * Fix conflicts Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…-labs#19164) (cherry picked from commit 83f0915) Co-authored-by: bji <bryan@ischo.com>

…ana-labs#19163) (solana-labs#19171) * Use last_valid_block_height in services and client apps (solana-labs#19163) * Add deprecated tag to Bank::get_blockhash_last_valid_slot * Update SendTransactionService to use last_valid_block_height * Update solana-tokens to use last_valid_block_height * Remove dangling file * Update solana program to use last_valid_block_height * Update Banks crates to use last_valid_block_height (cherry picked from commit 5970083) # Conflicts: # cli/src/program.rs * Fix conflict Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…ana-labs#19160) * Handle 0-lamport account in index generation * rename duplicate to dirty keys Co-authored-by: Carl Lin <carl@solana.com> (cherry picked from commit 5a4979f) Co-authored-by: sakridge <sakridge@gmail.com>

…ribe (backport solana-labs#19092) (solana-labs#19207) * Fixing missing pubsub notification for programSubscribe and logsSubscribe (solana-labs#19092) solana-labs#18587: programSubscribe is missing notifications randomly. The issue is because of two reasons Not all rooted slots get OptimisticallyConfirmed notifications The OptimisticallyConfirmed notifications can be out of order for slots: slot A and B with A < B can see notification for B first before A. Summary of Changes Changed OptimisticallyConfirmedBankTracker to send notifications for parent banks if they have not been notified yet. We use a new variable last_notified_slot to track that. Tests: With my validator running against testnet, before the fix, it was failing 75% of time, with the fix, it is passing consistently. Using the program mentioned in solana-labs#18587. (cherry picked from commit 1a372a7) * Use v1.7 api Co-authored-by: Lijun Wang <83639177+lijunwangs@users.noreply.github.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…olana-labs#19238) * Add AsRef<AccountInfo> for AccountInfo (cherry picked from commit 930465e) * add test for AsRef (cherry picked from commit d10e37a) Co-authored-by: Kirill Fomichev <fanatid@ya.ru>

…ValidatorGenesis::start_with_socket_addr_space()` (solana-labs#19241) (cherry picked from commit 3e5ba59) Co-authored-by: Michael Vines <mvines@gmail.com>

…a-labs#19277) * Expose genesis block time via rpc (solana-labs#19267) * Expose genesis_creation_time from Bank * Backfill genesis_creation_time for block/block-time requests of slot 0 (cherry picked from commit c167211) # Conflicts: # rpc/src/rpc.rs * Fix conflict Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

* Fix memoverlap check (solana-labs#19232) (cherry picked from commit 9be988d) # Conflicts: # programs/bpf_loader/src/syscalls.rs # sdk/src/feature_set.rs * Resolve conflicts Co-authored-by: Jack May <jack@solana.com>

…labs#19270) (solana-labs#19283) * RPC: add option to exclude accounts from get_supply (solana-labs#19270) (cherry picked from commit c053df1) # Conflicts: # rpc/src/rpc.rs * resolve conflicts Co-authored-by: Justin Starry <justin@solana.com>

…a-labs#19290) (solana-labs#19303) * Plumb accounts-db-skip-shrink through testnet scripts (solana-labs#19290) (cherry picked from commit 1d375ff) # Conflicts: # multinode-demo/bootstrap-validator.sh # multinode-demo/validator.sh # net/net.sh * Fix conflicts Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…lana-labs#19298) (solana-labs#19306) * Enable booting testnet validators without tower required (solana-labs#19298) (cherry picked from commit 7d135f1) # Conflicts: # net/net.sh * Fix conflicts Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

…olana-labs#19322) (cherry picked from commit b59b557) Co-authored-by: Trent Nelson <trent@solana.com>

…s (backport solana-labs#19058) (solana-labs#19324) * removes unused code from cluster-slots (cherry picked from commit 2fc112e) # Conflicts: # core/src/cluster_slots.rs * updates cluster-slots with root-bank instead of root-slot + bank-forks ClusterSlots::update is taking both root-slot and bank-forks only to later lookup root-bank from bank-forks, which is redundant. Also potentially by the time bank-forks is locked to obtain root-bank, root-slot may have already changed and so be inconsistent with the root-slot passed in as the argument. https://github.com/solana-labs/solana/blob/6d95d679c/core/src/cluster_slots.rs#L32-L39 https://github.com/solana-labs/solana/blob/6d95d679c/core/src/cluster_slots.rs#L122 (cherry picked from commit 40914de) * removes backport merge conflicts Co-authored-by: behzad nouri <behzadnouri@gmail.com>

) (solana-labs#19328) Cross cluster gossip contamination is causing cluster-slots hash map to contain a lot of bogus values and consume too much memory: solana-labs#17789 If a node is using the same identity key across clusters, then these erroneous values might not be filtered out by shred-versions check, because one of the variants of the contact-info will have matching shred-version: solana-labs#17789 (comment) The cluster-slots hash-map is bounded and trimmed at the lower end by the current root. This commit also discards slots epochs ahead of the root. (cherry picked from commit 563aec0) Co-authored-by: behzad nouri <behzadnouri@gmail.com>

* docs: Mainnet Beta inflation has been enabled for quite some time (cherry picked from commit 169ded9) * validator: Trusted validators are now called known validators (cherry picked from commit e0bc5fa) * docs: trust minimize (cherry picked from commit 4061316) * docs: correct known validator operator (cherry picked from commit eced50d) * docs: Remove decommissioned testnet archetype validator (cherry picked from commit a587eec) * docs: update devnet start args with new validators (cherry picked from commit 2a877ae) Co-authored-by: Trent Nelson <trent@solana.com>

…ana-labs#19336) * stake: Remove v2 program references (solana-labs#19308) * stake: Remove v2 program references * Remove stake v2 feature, along with stake rewrite (cherry picked from commit 73aa004) # Conflicts: # runtime/src/bank.rs * Fix merge conflict * Fix uses of old `stake` function Co-authored-by: Jon Cinque <jon.cinque@gmail.com>

…olana-labs#19343) * Add note about ASK keyword to paper wallet doc Per solana-labs#17325 (comment), this change adds a note to the paper wallet docs mentioning the use of the `ASK` keyword. Also specifes that the `solana-keygen pubkey prompt://` command returns a derived bip44 base address. (I'm new to Solana development and this was a point of confusion for me, only resolved by finding this issue) * Update docs/src/wallet-guide/paper-wallet.md Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com> Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com> (cherry picked from commit 3be5715) Co-authored-by: Brent Fitzgerald <burnto@gmail.com>

…#19216) (solana-labs#19340) * change untar to use unpack instead of unpack_in (solana-labs#19216) * change untar to use unpack instead of unpack_in * hacky, but maybe passes tests * chore: bump tar from 0.4.35 to 0.4.37 Bumps [tar](https://github.com/alexcrichton/tar-rs) from 0.4.35 to 0.4.37. - [Release notes](https://github.com/alexcrichton/tar-rs/releases) - [Commits](alexcrichton/tar-rs@0.4.35...0.4.37) --- updated-dependencies: - dependency-name: tar dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * [auto-commit] Update all Cargo lock files * cleanup * cleanup, add validate_inside_dst * collapse use Co-authored-by: Tyera Eulberg <teulberg@gmail.com> * delete comment line * add comments Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com> Co-authored-by: Tyera Eulberg <teulberg@gmail.com> (cherry picked from commit 89a31ff) # Conflicts: # Cargo.lock # download-utils/Cargo.toml # install/Cargo.toml # programs/bpf/Cargo.lock # runtime/Cargo.toml # sdk/cargo-build-bpf/Cargo.toml * Fix conflicts Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com> Co-authored-by: Tyera Eulberg <tyera@solana.com>

(cherry picked from commit 17978c2) Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

…a-labs#19351) * Only encode data with <128 bytes in bs58 * Use same MAX_BS58_BYTES const in rpc * Fix test * Spell out base Co-authored-by: Tyera Eulberg <tyera@solana.com> (cherry picked from commit 967746a) Co-authored-by: sakridge <sakridge@gmail.com>

) * Correct JSON-RPC docs for getSlot * Update docs/src/developing/clients/jsonrpc-api.md Co-authored-by: Tyera Eulberg <teulberg@gmail.com> Co-authored-by: Tyera Eulberg <teulberg@gmail.com> (cherry picked from commit 9483866) Co-authored-by: Brian Anderson <andersrb@gmail.com>

(cherry picked from commit 2ccbe47)

mergify bot and others added 30 commits June 14, 2021 17:32

binary search in slices for hashing (solana-labs#17755) (solana-labs#…

0446f89

…17804) (cherry picked from commit 817d48b) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

add metrics to handle_snapshot_requests (solana-labs#17937) (solana-l…

d6b83e3

…abs#17945) (cherry picked from commit e6bbd4b) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

Pass iterator for SortedStorages::new_with_slots (solana-labs#17811) (s…

60b43a1

…olana-labs#17847) Co-authored-by: Carl Lin <carl@solana.com> (cherry picked from commit 2a9b127) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

use trait to simplify and consolidate cumulative code (solana-labs#1…

15b2f28

…7852) (solana-labs#17931) (cherry picked from commit 2dc6969) # Conflicts: # runtime/src/accounts_hash.rs Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

name arguments to help with confusion (solana-labs#17942) (solana-la…

8b5ba77

…bs#17948) (cherry picked from commit 7fde9b6) # Conflicts: # runtime/src/accounts_db.rs Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>

refactor so hash verify can be done by more callers (solana-labs#17941)…

0dbe343

… (solana-labs#17947) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

remove unused parameters from CalculateHashIntermediate (solana-labs#…

cdd2a51

…17949) (solana-labs#17976) (cherry picked from commit 4d8ffdc) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

Properly handle block_height in Bigtable bincode deserialization (sol…

4ee366e

…ana-labs#17990) (solana-labs#17994) * Default block_height on eof * Add comment to prevent future errors (cherry picked from commit c57d1b4) Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

nit: rename measure (solana-labs#17946) (solana-labs#17995)

67e1814

(cherry picked from commit 5ecb30f) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

parallel storage -> accounts folder (solana-labs#17955) (solana-labs#…

bff7259

…18004) (cherry picked from commit 7de7942) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

refactor generate_index process_storage_slot (solana-labs#17982) (sol…

8492031

…ana-labs#18007) (cherry picked from commit 7ca04d6) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

Improve program deployment error message (solana-labs#17717) (solana-…

a84953c

…labs#17725) (cherry picked from commit 39654d3) Co-authored-by: Jack May <jack@solana.com>

set hash bins to 65k (solana-labs#17912) (solana-labs#18009)

296a8ad

(cherry picked from commit 55ee3b5) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

avoid unnecessary empty arrays when binning (solana-labs#17944) (sola…

4ed0fcd

…na-labs#18011) (cherry picked from commit eee5414) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

Don't store votes unless we are leader soon (solana-labs#17803) (sola…

6479c11

…na-labs#17894) (cherry picked from commit 0feac57) Co-authored-by: sakridge <sakridge@gmail.com>

do not use index for verify_bank_hash_and_lamports (solana-labs#17812) (

c28e6eb

solana-labs#18010) (cherry picked from commit adc6839) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

break out generate index reporting (solana-labs#17980) (solana-labs#1…

2f0f1fd

…8015) (cherry picked from commit 71796f4) Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>

validator: run poh speed test earlier in start up (solana-labs#18024)

4df9da5

(cherry picked from commit 5bc6c89) Co-authored-by: Trent Nelson <trent@solana.com>

accounts-cluster-bench, close all accounts in a sliding window (solan…

bacf1b9

…a-labs#17993) (solana-labs#18026) (cherry picked from commit ed18add) Co-authored-by: carllin <carl@solana.com>

Clean up remove_all_authorized_voters() (solana-labs#18029)

f633f34

(cherry picked from commit f1ebbba) Co-authored-by: Michael Vines <mvines@gmail.com>

Log more info on runtime account verification errors (solana-labs#17861…

962a212

…) (solana-labs#17879) (cherry picked from commit a1fab0c) Co-authored-by: Jack May <jack@solana.com>

mergify bot and others added 27 commits August 7, 2021 06:16

Clean within shrink_all_slots (solana-labs#19042) (solana-labs#19109)

e8040a8

Co-authored-by: Carl Lin <carl@solana.com> (cherry picked from commit 592013e) Co-authored-by: sakridge <sakridge@gmail.com>

v1.7: Handle new security advisories (solana-labs#19131)

4b13350

* Update hyper 0.14 * Add audit ignores * Bump assert_cmd and remove audit ignore * Remove pin-project-lite warning

Fix deserialization of RPC errors in HttpSender (solana-labs#19110) (s…

894f121

…olana-labs#19127) Fixes solana-labs#15576 (cherry picked from commit e4b66a5) Co-authored-by: Brian Anderson <andersrb@gmail.com>

Updated transaction fee burn description. (solana-labs#19161) (solana…

422044f

…-labs#19164) (cherry picked from commit 83f0915) Co-authored-by: bji <bryan@ischo.com>

Bump version to v1.7.11

ab5d032

Add AsRef<AccountInfo> for AccountInfo (backport solana-labs#19235) (s…

ddda94e

…olana-labs#19238) * Add AsRef<AccountInfo> for AccountInfo (cherry picked from commit 930465e) * add test for AsRef (cherry picked from commit d10e37a) Co-authored-by: Kirill Fomichev <fanatid@ya.ru>

Revert TestValidatorGenesis::start() to v1.7.8 signature; add `Test…

1c9d052

…ValidatorGenesis::start_with_socket_addr_space()` (solana-labs#19241) (cherry picked from commit 3e5ba59) Co-authored-by: Michael Vines <mvines@gmail.com>

ci: pin patched solana crates version for downstream project builds (s…

fa5a71d

…olana-labs#19322) (cherry picked from commit b59b557) Co-authored-by: Trent Nelson <trent@solana.com>

Remove tar-rs audit ignore (solana-labs#19344) (solana-labs#19352)

ed18d6d

(cherry picked from commit 17978c2) Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

Update crossbeam-deque to 0.8.1 (solana-labs#19361)

3178808

(cherry picked from commit 2ccbe47)

brooksprumo closed this Aug 23, 2021

CriesofCarrots mentioned this pull request Aug 23, 2021

Update crossbeam-deque to 0.8.1 (#19361) #19382

Merged

brooksprumo deleted the backport-19361-v17 branch August 30, 2021 21:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

backport 19361 v17 #19380

backport 19361 v17 #19380

brooksprumo commented Aug 23, 2021

backport 19361 v17 #19380

backport 19361 v17 #19380

Conversation

brooksprumo commented Aug 23, 2021

Problem

Summary of Changes