Lotus v1.13.2 is a highly recommended feature release with remarkable retrieval improvements, new features like worker management, schedule enhancements and so on.
- 🚀🚀🚀Improve retrieval deal experience
- Testing result with MinerX.3 shows the retrieval deal success rate has increased dramatically with faster transfer speed, you can join or follow along furthur performance testings here. We recommend application developers to integrate with the new retrieval APIs to provide a better client experience.
- 🌟🌟🌟 Reduce retrieval Time-To-First-Byte over 100x (#7693)
- This change makes most free, small retrievals sub-second
- 🌟🌟🌟 Partial retrieval ux improvements (#7610)
- New retrieval commands for clients:
lotus client ls
: retrieve and list desired object linkslotus client cat
: retrieve and print the data from the network
- 🌟🌟 The monolith
ClientRetrieve
method was broken into:ClientRetrieve
which retrieves data into the local repo (or into an IPFS node if ipfs integration is enabled)ClientRetrieveWait
which will wait for the retrieval to completeClientExport
which will export data from the local node- Note: this change only applies to v1 API. v0 API remains unchanged.
- 🌟 Support for full ipld selectors was added (for example making it possible to only retrieve list of directories in a deal, without fetching any file data)
- To learn more, see here
- New retrieval commands for clients:
- 🚀🚀 Sealing scheduler enhancements (#7703,
#7269), #7714
- Workers are now aware of cgroup memory limits
- Multiple tasks which use a GPU can be scheduled on a single worker
- Workers can override default resource table through env vars
- Default value list: https://gist.github.com/magik6k/c0e1c7cd73c1241a9acabc30bf469a43
- 🚀🚀 Sector storage groups (#7453)
- Storage groups allow for better control of data flow between workers, for example, it makes it possible to define that data from PC1 on a given worker has to have it's PC2 step executed on the same worker
- To set it up, follow the instructions under the
Sector Storage Group
section here
- Add RLE dump code (#7691)
- Shed: Add a util to list miner faults (#7605)
- lotus-shed msg: Decode submessages/msig proposals (#7639)
- CLI: Add a lotus multisig cancel command (#7645)
- shed: simple wallet balancer util (#7414)
- balancing token balance between multiple accounts
- Add verbose mode to
lotus-miner pieces list-cids
(#7699) - retrieval: Only output matching nodes, MatchPath dagspec (#7706)
- Cleanup partial retrieval codepaths ( zero functional changes ) (#7688)
- storage: Use 1M buffers for Tar transfers (#7681)
- Chore/dm level tests plus merkle proof cars (#7673)
- Shed: Add a util to create miners more easily (#7595)
- add timeout flag to wait-api command (#7592)
- add log for restart windows post scheduler (#7613)
- remove jaeger envvars (#7631)
- remove api and jaeger env from docker file (#7624)
- Wdpost worker: Reduce challenge confidence to 1 epoch (#7572)
- add additional methods to lotus gateway (#7644)
- Add caches to lotus-stats and splitcode (#7329)
- remote store: Remove debug printf (#7664)
- docsgen-cli: Handle commands with no description correctly (#7659)
- fix docker logic error (#7709)
- add missing NodeType tag (#7559)
- checkCommit should return SectorCommitFailed (#7555)
- ffiwrapper: Validate PC2 by calling C1 with random seeds (#7710)
- Update go-graphsync v0.10.6 (#7708)
- update go-libp2p-pubsub to v0.5.6 (#7581)
- Update go-state-types (#7591)
- disable mplex stream muxer (#7689)
- Bump ws from 5.2.2 to 5.2.3 in /lotuspond/front (#7660)
- Bump color-string from 1.5.3 to 1.6.0 in /lotuspond/front (#7658)
- Bump postcss from 7.0.17 to 7.0.39 in /lotuspond/front (#7657)
- Bump path-parse from 1.0.6 to 1.0.7 in /lotuspond/front (#7656)
- Bump tmpl from 1.0.4 to 1.0.5 in /lotuspond/front (#7655)
- Bump url-parse from 1.4.7 to 1.5.3 in /lotuspond/front (#7654)
- github.com/filecoin-project/go-state-types (v0.1.1-0.20210915140513-d354ccf10379 -> v0.1.1):
- Update archive script (#7690)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 89 | +5200/-1818 | 232 |
Travis Person | 5 | +1473/-953 | 38 |
@arajasek | 6 | +550/-38 | 19 |
@clinta | 4 | +393/-123 | 26 |
@ribasushi | 3 | +334/-68 | 7 |
@jennijuju | 13 | +197/-120 | 67 |
@Kubuxu | 10 | +153/-30 | 10 |
@coryschwartz | 6 | +18/-26 | 6 |
Marten Seemann | 2 | +6/-34 | 5 |
@vyzo | 1 | +3/-3 | 2 |
@hannahhoward | 1 | +3/-3 | 2 |
@zenground0 | 2 | +2/-2 | 2 |
@yaohcn | 2 | +2/-2 | 2 |
@jennijuju | 1 | +1/-1 | 1 |
@hunjixin | 1 | +1/-0 | 1 |
This is an optional Lotus v1.13.1 release.
- Shed: Add a util to find miner based on peerid (filecoin-project/lotus#7544)
- Collect and expose graphsync metrics (filecoin-project/lotus#7542)
- Shed: Add a util to find the most recent null tipset (filecoin-project/lotus#7456)
- Show prepared tasks in sealing jobs (filecoin-project/lotus#7527)
- To make Deep happy (filecoin-project/lotus#7546)
- Expose per-state sector counts on the prometheus endpoint (filecoin-project/lotus#7541)
- Add storage-id flag to proving check (filecoin-project/lotus#7479)
- FilecoinEC: Improve a log message (filecoin-project/lotus#7499)
- itests: retry deal when control addr is out of funds (filecoin-project/lotus#7454)
- Normlize selector use within lotus (filecoin-project/lotus#7467)
- sealing: Improve scheduling of ready work (filecoin-project/lotus#7335)
- Remove dead example code + dep (filecoin-project/lotus#7466)
- fix the withdrawn amount unit (filecoin-project/lotus#7563)
- rename vm#make{=>Account}Actor(). (filecoin-project/lotus#7562)
- Fix used sector space accounting after AddPieceFailed (filecoin-project/lotus#7530)
- Don't remove sector data when moving data into a shared path (filecoin-project/lotus#7494)
- fix: support node instantiation in external packages (filecoin-project/lotus#7511)
- Stop adding Jennifer's $HOME to lotus docs (filecoin-project/lotus#7477)
- Bugfix: Use correct startup network versions (filecoin-project/lotus#7486)
- Dep upgrade pass (filecoin-project/lotus#7478)
- Remove obsolete GS testplan - it now lives in go-graphsync (filecoin-project/lotus#7469)
- sealing: Recover sectors after failed AddPiece (filecoin-project/lotus#7444)
- Update go-graphsync v0.10.1 (filecoin-project/lotus#7457)
- update to proof v10.1.0 (filecoin-project/lotus#7564)
- github.com/filecoin-project/specs-actors/v6 (v6.0.0 -> v6.0.1):
- github.com/filecoin-project/go-jsonrpc (v0.1.4-0.20210217175800-45ea43ac2bec -> v0.1.5):
- github.com/filecoin-project/go-fil-markets (v1.13.1 -> v1.13.3):
- github.com/filecoin-project/go-data-transfer (v1.11.1 -> v1.11.4):
- github.com/filecoin-project/go-crypto (v0.0.0-20191218222705-effae4ea9f03 -> v0.0.1):
- github.com/filecoin-project/go-commp-utils (v0.1.1-0.20210427191551-70bf140d31c7 -> v0.1.2):
- github.com/filecoin-project/go-cbor-util (v0.0.0-20191219014500-08c40a1e63a2 -> v0.0.1):
- github.com/filecoin-project/go-address (v0.0.5 -> v0.0.6):
- unpin the yamux dependency (filecoin-project/lotus#7532
- [email protected] was withdrawn, let's not depend on it directly (filecoin-project/lotus#7481)
- chore(deps): use tagged github.com/ipld/go-ipld-selector-text-lite (filecoin-project/lotus#7464)
- Stop indirectly depending on deprecated github.com/prometheus/common (filecoin-project/lotus#7473)
- fix the changelog (filecoin-project/lotus#7594)
- v1.13.1-rc2 prep (filecoin-project/lotus#7593)
- lotus v1.13.1-rc1 (filecoin-project/lotus#7569)
- misc: back-port v1.13.0 back to master (filecoin-project/lotus#7537)
- Inline codegen (filecoin-project/lotus#7495)
- releases -> master (filecoin-project/lotus#7507)
- Make chocolate back to master (filecoin-project/lotus#7493)
- restore filters for the build-macos job (filecoin-project/lotus#7455)
- bump master to v1.13.1-dev (filecoin-project/lotus#7451)
Contributors
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 27 | +1285/-531 | 76 |
@ribasushi | 7 | +265/-1635 | 21 |
@raulk | 2 | +2/-737 | 13 |
@nonsens | 4 | +391/-21 | 19 |
@arajasek | 6 | +216/-23 | 14 |
@jennijuju | 8 | +102/-37 | 29 |
Steven Allen | 2 | +77/-29 | 6 |
@jennijuju | 4 | +19/-18 | 11 |
@dirkmc | 2 | +9/-9 | 4 |
@@coryschwartz | 1 | +16/-2 | 2 |
@frrist | 1 | +12/-0 | 2 |
@Kubuxu | 5 | +5/-5 | 5 |
@hunjixin | 2 | +6/-3 | 2 |
@vyzo | 1 | +3/-3 | 2 |
@@rvagg | 1 | +3/-3 | 2 |
@hannahhoward | 1 | +3/-2 | 2 |
Marten Seemann | 1 | +3/-0 | 1 |
@ZenGround0 | 1 | +1/-1 | 1 |
Lotus v1.13.0 is a highly recommended feature release for all lotus users(i.e: storage providers, data brokers, application developers and so on) that supports the upcoming Network v14 Chocolate upgrade. This feature release includes the latest functionalities and improvements, like data transfer rate-limiting for both storage and retrieval deals, proof v10 with CUDA support, etc. You can find more details in the Changelog below.
- Enable separate storage and retrieval transfer limits (filecoin-project/lotus#7405)
SimultaneousTransfer
is now replaced bySimultaneousTransfersForStorage
andSimultaneousTransfersForRetrieval
, where users may set the amount of ongoing data transfer for storage and retrieval deals in parallel separately. The default value for both is set to 20.- If you are using the lotus client, these two configuration variables are under the
Client
section in./lotus/config.toml
. - If you are a service provider, these two configuration variables should be set under the
Dealmaking
section in/.lotusminer/config.toml
.
- Update proofs to v10.0.0 (filecoin-project/lotus#7420)
- This version supports CUDA. To enable CUDA instead of openCL, build lotus with
FFI_USE_CUDA=1 FFI_BUILD_FROM_SOURCE=1 ...
. - You can find additional Nvidia driver installation instructions written by MinerX fellows here and perf improvements result on PC2/C2/WindowPoSt computation on different profiles here, most people observe a 30-50% decrease in computation time.
- This version supports CUDA. To enable CUDA instead of openCL, build lotus with
- Feat/datamodel selector retrieval (filecoin-project/lotus#6393)
- This introduces a new RetrievalOrder-struct field and a CLI option that takes a string representation as understood by https://pkg.go.dev/github.com/ipld/go-ipld-selector-text-lite#SelectorSpecFromPath. This allows for partial retrieval of any sub-DAG of a deal provided the user knows the exact low-level shape of the deal contents.
- For example, to retrieve the first entry of a UnixFS directory by executing, run
lotus client retrieve --miner f0XXXXX --datamodel-path-selector 'Links/0/Hash' bafyROOTCID ~/output
- For example, to retrieve the first entry of a UnixFS directory by executing, run
- This introduces a new RetrievalOrder-struct field and a CLI option that takes a string representation as understood by https://pkg.go.dev/github.com/ipld/go-ipld-selector-text-lite#SelectorSpecFromPath. This allows for partial retrieval of any sub-DAG of a deal provided the user knows the exact low-level shape of the deal contents.
- Expose storage stats on the metrics endpoint (filecoin-project/lotus#7418)
- feat: Catch panic to generate report and reraise (filecoin-project/lotus#7341)
- Set
LOTUS_PANIC_REPORT_PATH
andLOTUS_PANIC_JOURNAL_LOOKBACK
to get reports generated when a panic occurs on your daemon miner or workers.
- Set
- Add envconfig docs to the config (filecoin-project/lotus#7412)
- You can now find supported env vars in default-lotus-miner-config.toml.
- lotus shed: fr32 utils (filecoin-project/lotus#7355)
- Miner CLI: Allow trying to change owners of any miner actor (filecoin-project/lotus#7328)
- Add --unproven flag to the sectors list command (filecoin-project/lotus#7308)
- check for deal start epoch on SectorAddPieceToAny (filecoin-project/lotus#7407)
- Verify Voucher locks in VoucherValidUnlocked (filecoin-project/lotus#5609)
- Add more info to miner allinfo command (filecoin-project/lotus#7384)
- add
lotus-miner storage-deals list --format=json
with transfers (filecoin-project/lotus#7312) - Fix formatting (filecoin-project/lotus#7383)
- GetCurrentDealInfo err: handle correctly err case (filecoin-project/lotus#7346)
- fix: Enforce verification key integrity check regardless of TRUST_PARAMS=1 (filecoin-project/lotus#7327)
- Show more deal states in miner info (filecoin-project/lotus#7311)
- Prep retrieval for selectors: no functional changes (filecoin-project/lotus#7306)
- Seed: improve helptext (filecoin-project/lotus#7304)
- Mempool: reduce size of sigValCache (filecoin-project/lotus#7305)
- Stop indirectly depending on deprecated github.com/prometheus/common (filecoin-project/lotus#7474)
- StateSearchMsg: Correct usage of the allowReplaced flag (filecoin-project/lotus#7450)
- fix staging area path buildup (filecoin-project/lotus#7363)
- storagemgr: Cleanup workerLk around worker resources (filecoin-project/lotus#7334)
- fix: check padSector Cid (filecoin-project/lotus#7310)
- sealing: Recover sectors after failed AddPiece (filecoin-project/lotus#7492)
- fix: support node instantiation in external packages (filecoin-project/lotus#7511)
- Chore/backport cleanup withdrawn dependency (filecoin-project/lotus#7482)
- github.com/filecoin-project/go-data-transfer (v1.10.1 -> v1.11.1):
- github.com/filecoin-project/go-fil-markets (v1.12.0 -> v1.13.1):
- github.com/filecoin-project/go-paramfetch (v0.0.2-0.20210614165157-25a6c7769498 -> v0.0.2):
- update go-libp2p to v0.15.0 (filecoin-project/lotus#7362)
- update to go-graphsync v0.10.1 (filecoin-project/lotus#7359)
- Chocolate to master (filecoin-project/lotus#7440)
- releases -> master (filecoin-project/lotus#7403)
- remove nerpanet related code (filecoin-project/lotus#7373)
- sync branch main with master on updates (filecoin-project/lotus#7366)
- remove job to install jq (filecoin-project/lotus#7309)
- restore filters for the build-macos job (filecoin-project/lotus#7455)
- v1.13.0-rc2 (filecoin-project/lotus#7458)
- v1.13.0-rc1 (filecoin-project/lotus#7452)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@dirkmc | 8 | +845/-375 | 55 |
@magik6k | 10 | +1056/-60 | 26 |
@aarshkshah1992 | 6 | +813/-259 | 16 |
@arajasek | 10 | +552/-251 | 43 |
@ribasushi | 6 | +505/-78 | 22 |
@jennijuju | 7 | +212/-323 | 34 |
@nonsense | 10 | +335/-139 | 19 |
@dirkmc | 8 | +149/-55 | 16 |
@hannahhoward | 4 | +56/-32 | 17 |
@rvagg | 4 | +61/-13 | 9 |
@jennijuju | 2 | +0/-57 | 2 |
@hannahhoward | 1 | +33/-18 | 7 |
@Kubuxu | 8 | +27/-16 | 9 |
@coryschwartz | 1 | +16/-2 | 2 |
@travisperson | 1 | +14/-0 | 1 |
@frrist | 1 | +12/-0 | 2 |
@ognots | 1 | +0/-10 | 2 |
@lanzafame | 1 | +3/-3 | 1 |
@jennijuju | 1 | +2/-2 | 1 |
@swift-mx | 1 | +1/-1 | 1 |
This is a mandatory release of Lotus that introduces Filecoin Network v14, codenamed the Chocolate upgrade. The Filecoin mainnet will upgrade at epoch 1231620, on 2021-10-26T13:30:00Z.
The Chocolate upgrade introduces the following FIPs, delivered in v6 actors
- FIP-0020: Add return value to
WithdrawBalance
- FIP-0021: Correct quality calculation on expiration
- FIP-0022: Bad deals don't fail PublishStorageDeals
- FIP-0023: Break ties between tipsets of equal weight
- FIP-0024: BatchBalancer & BatchDiscount Post-HyperDrive Adjustment
- FIP-0026: Extend sector faulty period from 2 weeks to 6 weeks
Note that this release is built on top of lotus v1.11.3. Enterprising users like storage providers, data brokers and others are recommended to use lotus v1.13.0 for latest new features, improvements and bug fixes.
- Implement and support FIP-0024 BatchBalancer & BatchDiscount Post-HyperDrive Adjustment:
- Precommit batch balancer support/config (filecoin-project/lotus#7410)
- Set
BatchPreCommitAboveBaseFee
to decide whether sending out a PreCommits in individual messages or in a batch. - The default value of
BatchPreCommitAboveBaseFee
andAggregateAboveBaseFee
are now updated to 0.32nanoFIL.
- Set
- Precommit batch balancer support/config (filecoin-project/lotus#7410)
- The amount of FIL withdrawn from
WithdrawBalance
from miner or market via lotus CLI is now printed out upon message landing on the chain.
- Implement FIP-0023 (Break ties between tipsets of equal weight)
- ChainStore: Add a tiebreaker rule for tipsets of equal weight (filecoin-project/lotus#7378)
- Randomness: Move getters from ChainAPI to StateAPI (filecoin-project/lotus#7322)
- Fix Drand fetching around null tipsets (filecoin-project/lotus#7376)
- Add v6 actors
- Protocol changes
- Multisig Approve only hashes when hash in params
- FIP 0020 WithdrawBalance methods return withdrawn value
- FIP 0021 Fix bug in power calculation when extending verified deals sectors
- FIP 0022 PublishStorageDeals drops errors in batch
- FIP 0024 BatchBalancer update and burn added to PreCommitBatch
- FIP 0026 Add FaultMaxAge extension
- Reduce calls to power and reward actors by passing values from power cron
- Defensive programming hardening power cron against programmer error
- Implementation changes
- Move to xerrors
- Improved logging: burn events are not logged with reasons and burned value.
- Protocol changes
- github.com/filecoin-project/go-state-types (v0.1.1-0.20210810190654-139e0e79e69e -> v0.1.1-0.20210915140513-d354ccf10379):
- v1.12.0-rc1 prep (filecoin-project/lotus#7426
- Extend FaultMaxAge to 6 weeks for actors v6 on test networks only (filecoin-project/lotus#7421)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@ZenGround0 | 12 | +4202/-2752 | 187 |
@arajasek | 25 | +4567/-854 | 190 |
@laudiacay | 4 | +1276/-435 | 37 |
@laudiacay | 12 | +1350/-209 | 43 |
@magik6k | 1 | +171/-13 | 8 |
@Stebalien | 2 | +115/-12 | 6 |
@jennijuju | 7 | +73/-34 | 26 |
@travisperson | 2 | +19/-19 | 7 |
@coryschwartz | 1 | +16/-2 | 2 |
@Kubuxu | 5 | +5/-5 | 5 |
@ribasushi | 1 | +5/-3 | 1 |
lotus v1.11.3 is a feature release that's highly recommended to ALL lotus users to upgrade, including node operators, storage providers and clients. It includes many improvements and bug fixes that result in perf improvements in different area, like deal making, sealing and so on.
- 🌟🌟Introduce `MaxStagingDealsBytes - reject new deals if our staging deals area is full (filecoin-project/lotus#7276)
- Set
MaxStagingDealsBytes
under the [Dealmaking] section of the markets' subsystem'sconfig.toml
to reject new incoming deals when thedeal-staging
directory of market subsystem's repo gets too large.
- Set
- 🌟🌟miner: Command to list/remove expired sectors locally (filecoin-project/lotus#7140)
- run
./lotus-miner sectors expired -h
for more details.
- run
- 🚀update to ffi to update-bellperson-proofs-v9-0-2 (filecoin-project/lotus#7369)
- MinerX fellows(early testers of lotus releases) have reported faster WindowPoSt computation!
- 🌟dealpublisher: Fully validate deals before publishing (filecoin-project/lotus#7234)
- This excludes the expired deals before sending out a PSD message which reduces the chances of PSD message failure due to invalid deals.
- 🌟Simple alert system; FD limit alerts (filecoin-project/lotus#7108)
- feat(ci): include version/cli checks in tagged releases (filecoin-project/lotus#7331)
- Show deal sizes is sealing sectors (filecoin-project/lotus#7261)
- config for disabling NAT port mapping (filecoin-project/lotus#7204)
- Add optional mined block list to miner info (filecoin-project/lotus#7202)
- Shed: Create a verifreg command for when VRK isn't a multisig (filecoin-project/lotus#7099)
- build macOS CI (filecoin-project/lotus#7307)
- itests: remove cid equality comparison (filecoin-project/lotus#7292)
- Add partition info to the 'sectors status' command (filecoin-project/lotus#7246)
- chain: Cleanup consensus logic (filecoin-project/lotus#7255)
- builder: Handle chainstore config in ConfigFullNode (filecoin-project/lotus#7232)
- gateway: check tipsets in ChainGetPath (filecoin-project/lotus#7230)
- Refactor events subsystem (filecoin-project/lotus#7000)
- test: re-enable disabled tests (filecoin-project/lotus#7211)
- Reduce lotus-miner startup spam (filecoin-project/lotus#7205)
- Catch deal slashed because sector was terminated (filecoin-project/lotus#7201)
- Insert miner and network power data as gibibytes to avoid int64 overflows (filecoin-project/lotus#7194)
- sealing: Check piece CIDs after AddPiece (filecoin-project/lotus#7185)
- markets: OnDealExpiredOrSlashed - get deal by proposal instead of deal ID (filecoin-project/lotus#5431)
- Incoming: improve a log message (filecoin-project/lotus#7181)
- journal: make current log file have a fixed named (#7112) (filecoin-project/lotus#7112)
- call string.Repeat always with positive int ([filecoin-project#7104](https://github. com/filecoin-project/pull/7104))
- itests: support larger sector sizes; add large deal test. (filecoin-project/lotus#7148)
- Ignore nil throttler (filecoin-project/lotus#7169)
- fix: escape periods to match actual periods in version
- fix bug for CommittedCapacitySectorLifetime (filecoin-project/lotus#7337)
- fix a panic in HandleRecoverDealIDs (filecoin-project/lotus#7336)
- fix index out of range (filecoin-project/lotus#7273)
- fix: correctly handle null blocks when detecting an expensive fork (filecoin-project/lotus#7210)
- fix: make lotus soup use the correct dependencies (filecoin-project/lotus#7221)
- fix: init restore adds empty storage.json (filecoin-project/lotus#7025)
- fix: disable broken testground integration test (filecoin-project/lotus#7187)
- fix TestDealPublisher (filecoin-project/lotus#7173)
- fix: make TestTimedCacheBlockstoreSimple pass reliably (filecoin-project/lotus#7174)
- Fix throttling bug (filecoin-project/lotus#7177)
- sealing: Fix sector state accounting with FinalizeEarly (filecoin-project/lotus#7256)
- docker entrypoint.sh missing variable escape character (filecoin-project/lotus#7291)
- sealing: Fix retry loop in SubmitCommitAggregate (filecoin-project/lotus#7245)
- sectors expired: Handle precomitted and unproven sectors correctly (filecoin-project/lotus#7236)
- stores: Fix reserved disk usage log spam (filecoin-project/lotus#7233)
- github.com/filecoin-project/go-fil-markets (v1.8.1 -> v1.12.0):
- github.com/filecoin-project/go-data-transfer (v1.7.8 -> v1.10.1):
- update to ffi to update-bellperson-proofs-v9-0-2 (filecoin-project/lotus#7369)
- fix(deps): use go-graphsync v0.9.3 with hotfix
- Update to unified go-graphsync v0.9.0 (filecoin-project/lotus#7197)
- v1.11.3-rc2 (filecoin-project/lotus#7371)
- v1.11.3-rc1 (filecoin-project/lotus#7299)
- Increase threshold from 0.5% to 1% (filecoin-project/lotus#7262)
- ci: exclude cruft from code coverage (filecoin-project/lotus#7189)
- Bump version to v1.11.3-dev (filecoin-project/lotus#7180)
- test: disable flaky TestBatchDealInput (filecoin-project/lotus#7176)
- Turn off patch (filecoin-project/lotus#7172)
- test: disable flaky TestSimultaneousTransferLimit (filecoin-project/lotus#7153)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 39 | +3311/-1825 | 179 |
@Stebalien | 23 | +1935/-1417 | 84 |
@dirkmc | 12 | +921/-732 | 111 |
@dirkmc | 12 | +663/-790 | 30 |
@hannahhoward | 3 | +482/-275 | 46 |
@travisperson | 1 | +317/-65 | 5 |
@jennijuju | 11 | +223/-126 | 24 |
@hannahhoward | 7 | +257/-55 | 16 |
@nonsense | 9 | +258/-37 | 19 |
@raulk | 4 | +127/-36 | 13 |
@raulk | 1 | +43/-60 | 15 |
@arajasek | 4 | +74/-8 | 10 |
@Frank | 2 | +68/-8 | 3 |
@placer14 | 2 | +52/-1 | 4 |
@ldoublewood | 2 | +15/-13 | 3 |
@lanzafame | 1 | +16/-2 | 1 |
@aarshkshah1992 | 2 | +11/-6 | 2 |
@ZenGround0 | 2 | +7/-6 | 2 |
@ognots | 1 | +0/-10 | 2 |
@KAYUII | 2 | +4/-4 | 2 |
@lanzafame | 1 | +6/-0 | 1 |
@jacobheun | 1 | +3/-3 | 1 |
@frank | 1 | +4/-0 | 1 |
lotus v1.11.2 is a feature release that's highly recommended ALL lotus users to upgrade, including node operators, storage providers and clients.
- 🌟🌟🌟 Introduce Dagstore and CARv2 for deal-making (#6671) (filecoin-project/lotus#6671)
- lotus miner markets' Dagstore is a
component of the
markets
subsystem in lotus-miner. It is a sharded store to hold large IPLD graphs efficiently, packaged as location-transparent attachable CAR files and it replaces the former Badger staging blockstore. It is designed to provide high efficiency and throughput, and minimize resource utilization during deal-making operations.
The dagstore also leverages the indexing features of CARv2 to enable plan CAR files to act as read and write blockstores, which are served as the direct medium for data exchanges in markets for both storage and retrieval deal making without requiring intermediate buffers. - In the future, lotus will leverage and interact with Dagstore a lot for new features and improvements for deal making, therefore, it's highly recommended to lotus users to go through Lotus Miner: About the markets dagstore thoroughly to learn more about Dagstore's conceptual overview, terminology, directory structure, configuration and so on.
- Note:
- When you first start your lotus-miner or market subsystem with this release, a one-time/first-time dagstore migration will be triggered which replaces the former Badger staging blockstore with dagstore. We highly recommend storage providers to read this section to learn more about what the process does, what to expect and how monitor it.
- It is highly recommended to wait all ongoing data transfer to finish or cancel inbound storage deals that
are still transferring, using the
lotus-miner data-transfers cancel
command before upgrade your market nodes. Reason being that the new dagstore changes attributes in the internal deal state objects, and the paths to the staging CARs where the deal data was being placed will be lost. ‼️ Having your dags initialized will become important in the near feature for you to provide a better storage and retrieval service. We'd suggest you to start [forced bulk initialization] soon if possible as this process places relatively high IP workload on your storage system and is better to be carried out gradually and over a longer timeframe. Read how to do properly perform a force bulk initialization here.- ⏮ Rollback Alert(from v1.11.2-rcX to any version lower): If a storages deal is initiated with M1/v1.11.2(-rcX)
release, it needs to get to the
StorageDealAwaitingPrecommit
state before you can do a version rollback or the markets process may panic.
- 💙 Special thanks to MinerX fellows for testing and providing valuable feedbacks for Dagstore in the past month!
- lotus miner markets' Dagstore is a
component of the
- 🌟🌟 rpcenc: Support reader redirect (filecoin-project/lotus#6952)
- This allows market processes to send piece bytes directly to workers involved on
AddPiece
.
- This allows market processes to send piece bytes directly to workers involved on
- Extending sectors: more practical and flexible tools (filecoin-project/lotus#6097)
lotus-miner sectors check-expire
to inspect expiring sectors.lotus-miner sectors renew
for renewing expiring sectors, see the command help menu for customizable option likeextension
,new-expiration
and so on.
‼️ MpoolReplaceCmd ( lotus mpool replace`) now takes FIL for fee-limit (filecoin-project/lotus#6927)- Drop townhall/chainwatch (filecoin-project/lotus#6912)
- ChainWatch is no longer supported by lotus.
- Configurable CC Sector Expiration (filecoin-project/lotus#6803)
- Set
CommittedCapacitySectorLifetime
in lotus-miner/config.toml to specify the default expiration for a new CC sector, value must be between 180-540 days inclusive.
- Set
- api/command for encoding actor params (filecoin-project/lotus#7150)
- shed: Support raw encoding in cid id (filecoin-project/lotus#7149)
- feat(miner deals): create subdir to miner repo for staged deals (filecoin-project/lotus#6853)
- Support --actor in miner actor control list (filecoin-project/lotus#7027)
- Shed: Include network name in genesis-verify (filecoin-project/lotus#7019)
- feat: add ChainGetTipSetAfterHeight (filecoin-project/lotus#6990)
- lotus-shed splitstore clear command (filecoin-project/lotus#6967)
- improve get api error messages (filecoin-project/lotus#7088)
- Strict major minor version checking on v0 and v1 apis (filecoin-project/lotus#7038)
- make lotus-miner net commands hit markets subsystem. (filecoin-project/lotus#7042)
- Test with latest actors version (filecoin-project/lotus#6998)
- Reduce splitstore memory usage during chain walks (filecoin-project/lotus#6949)
- Remove forgotten non-functioning config from the pre-mainnet days (filecoin-project/lotus#6970)
- add explicit error msg if repo dir does not exist (filecoin-project/lotus#6909)
- Test/pledge batching msg prop (filecoin-project/lotus#6537)
- reasonable max value for initial sector expiration (filecoin-project/lotus#6099)
- support MARKETS_API_INFO env var, and markets-repo, markets-api-url CLI flags. (filecoin-project/lotus#6936)
- Improve formatting of workers CLI (filecoin-project/lotus#6942)
- make: set default GOCC earlier (filecoin-project/lotus#6932)
- Moving GC Followup (filecoin-project/lotus#6905)
- Log more call context during errors (filecoin-project/lotus#6918)
- polish(errors): better state tree errors (filecoin-project/lotus#6923)
- adding an RuntimeSubsystems API to storage miner; fix
lotus-miner info
(filecoin-project/lotus#6906) - Reduce entropy in the chain package (filecoin-project/lotus#6889)
- make: Allow setting Go compiler with GOCC (filecoin-project/lotus#6911)
- sealing: Fix RecoverDealIDs loop with changed PieceCID (filecoin-project/lotus#7117)
- Fix error handling in SectorAddPieceToAny api impl (filecoin-project/lotus#7135)
- add rice box to required binaries (filecoin-project/lotus#7125)
- fix(miner): always create miner deal staging directory (#7098) (filecoin-project/lotus#7098)
- fix build after merging #6097. (#7096) (filecoin-project/lotus#7096)
- fix: don't check for t_aux when proving (filecoin-project/lotus#7011)
- fix: vet actors shims (filecoin-project/lotus#6999)
- fix: more logging in maybeStartBatch error (filecoin-project/lotus#6996)
- fix flaky TestDealPublisher and re-enable (filecoin-project/lotus#6991)
- fix skipCount (filecoin-project/lotus#6940)
- fix bug in MpoolPending message exclusion (filecoin-project/lotus#6945)
- PreCommitPolicy: Don't try to align expirations on proving period boundaries (filecoin-project/lotus#7018)
- make: fix version check when using gotip (filecoin-project/lotus#6916)
- fix ticket check (filecoin-project/lotus#6882)
- github.com/filecoin-project/go-data-transfer (v1.7.2 -> v1.7.8):
- github.com/filecoin-project/go-fil-markets (v1.6.2 -> v1.8.1):
- update go-libp2p-pubsub to v0.5.4 (filecoin-project/lotus#6958)
- integrate the proof patch: tag proofs-v9-revert-deps-hotfix
- Update markets, dt and graphsync (filecoin-project/lotus#7160)
- Remove replace directive for multihash dep (#7113) (filecoin-project/lotus#7113)
- upgrade upstream dependencies. (filecoin-project/lotus#7115)
- Update to latest FFI (filecoin-project/lotus#7110)
- Update state machine deps for logging (filecoin-project/lotus#6941)
- Update deps for more logging in data transfer and markets (filecoin-project/lotus#6937)
- Update to branches with improved logging (filecoin-project/lotus#6919)
- update go-libp2p-pubsub to v0.5.3 (filecoin-project/lotus#6907)
- Fix nits and see if codecov works now with auto (filecoin-project/lotus#7151)
- Codecov Projects (filecoin-project/lotus#7147)
- remove m1 templates and make area selection multi-optionable (filecoin-project/lotus#7121)
- release -> master (filecoin-project/lotus#7105)
- Lotus release process - how we make releases (filecoin-project/lotus#6944)
- codecov: fix mock name (filecoin-project/lotus#7039)
- codecov: fix regexes (filecoin-project/lotus#7037)
- chore: disable flaky test (filecoin-project/lotus#6957)
- set buildtype in nerpa and butterfly (filecoin-project/lotus#6085)
- release v1.11.1 backport -> master (filecoin-project/lotus#6929)
- chore: fixup issue templates (filecoin-project/lotus#6899)
- bump master version to v1.11.2-dev (filecoin-project/lotus#6903)
- releases -> master for v1.11.0 (filecoin-project/lotus#6894)
Contributors
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 23 | +5040/-8389 | 114 |
@aarshkshah1992 | 11 | +4859/-1078 | 101 |
@raulk | 5 | +4170/-1662 | 104 |
@vyzo | 30 | +1092/-702 | 49 |
@nonsense | 6 | +630/-472 | 19 |
@ZenGround0 | 31 | +556/-274 | 74 |
@He Weidong | 16 | +680/-128 | 16 |
@raulk | 16 | +444/-277 | 49 |
@Stebalien | 11 | +403/-259 | 48 |
@jennijuju | 17 | +276/-281 | 42 |
@dirkmc | 5 | +204/-138 | 20 |
@placer14 | 7 | +178/-77 | 17 |
@BlocksOnAChain | 1 | +138/-0 | 1 |
@Frrist | 1 | +63/-56 | 2 |
@arajasek | 7 | +74/-42 | 13 |
@frrist | 2 | +67/-6 | 6 |
@hannahhoward | 2 | +13/-11 | 3 |
@coryschwartz | 1 | +16/-6 | 3 |
@whyrusleeping | 1 | +7/-7 | 1 |
@hunjixin | 1 | +8/-6 | 1 |
@aarshkshah1992 | 1 | +6/-6 | 2 |
@dirkmc | 2 | +8/-0 | 2 |
@mx | 2 | +6/-1 | 2 |
@travisperson | 1 | +3/-2 | 1 |
@jennijuju | 2 | +2/-2 | 2 |
@ribasushi | 1 | +1/-2 | 2 |
Note: for discussion about this release, please comment here
This is a highly recommended but optional Lotus v1.11.1 release that introduces many deal making and datastore improvements and new features along with other bug fixes.
- ⭐️⭐️⭐️lotus-miner market subsystem is introduced in this release! It is highly recommended for storage providers to run markets processes on a separate machine! Doing so, only this machine needs to exposes public ports for deal making. This also means that the other miner operations can now be completely isolated by from the deal making processes and storage providers can stop and restarts the markets process without affecting an ongoing Winning/Window PoSt!
- More details on the concepts, architecture and how to split the market process can be found here.
- Base on your system setup(running on separate machines, same machine and so on), please see the suggested practice by community members here.
- Note: if you are running lotus-worker on a different machine, you will need to set
MARKETS_API_INFO
for certain CLI to work properly. This will be improved by #7072.
- Note: if you are running lotus-worker on a different machine, you will need to set
- Huge thanks to MinerX fellows for helping testing the implementation, reporting the issues so they were fixed by now and providing feedbacks to user docs in the past three weeks!
- Config for collateral from miner available balance (filecoin-project/lotus#6629)
- Better control your sector collateral payment by setting
CollateralFromMinerBalance
,AvailableBalanceBuffer
andDisableCollateralFallback
.CollateralFromMinerBalance
: whether to use available miner balance for sector collateral instead of sending it with each message, default isfalse
.AvailableBalanceBuffer
: minimum available balance to keep in the miner actor before sending it with messages, default is 0FIL.DisableCollateralFallback
: whether to send collateral with messages even if there is no available balance in the miner actor, default isfalse
.
- Better control your sector collateral payment by setting
- Config for deal publishing control addresses (filecoin-project/lotus#6697)
- Set
DealPublishControl
to set the wallet used for sendingPublishStorageDeals
messages, instructions here.
- Set
- Config UX improvements (filecoin-project/lotus#6848)
- You can now preview the the default and updated node config by running
lotus/lotus-miner config default/updated
- You can now preview the the default and updated node config by running
- ⭐️⭐️⭐️ Support standalone miner-market process (filecoin-project/lotus#6356)
- ⭐️⭐️ Experimental Splitstore (more details coming in v1.11.2! Stay tuned! Join the discussion here if you have questions!) :
- Improve splitstore warmup (filecoin-project/lotus#6867)
- Moving GC for badger (filecoin-project/lotus#6854)
- splitstore shed utils (filecoin-project/lotus#6811)
- fix warmup by decoupling state from message receipt walk (filecoin-project/lotus#6841)
- Splitstore: support on-disk marksets using badger (filecoin-project/lotus#6833)
- cache loaded block messages (filecoin-project/lotus#6760)
- Splitstore: add retention policy option for keeping messages in the hotstore (filecoin-project/lotus#6775)
- Introduce the LOTUS_CHAIN_BADGERSTORE_DISABLE_FSYNC envvar (filecoin-project/lotus#6817)
- Splitstore: add support for protecting out of chain references in the blockstore (filecoin-project/lotus#6777)
- Implement exposed splitstore (filecoin-project/lotus#6762)
- Splitstore code reorg (filecoin-project/lotus#6756)
- Splitstore: Some small fixes (filecoin-project/lotus#6754)
- Splitstore Enhanchements (filecoin-project/lotus#6474)
- lotus-shed: initial export cmd for markets related metadata (filecoin-project/lotus#6840)
- add a very verbose -vv flag to lotus and lotus-miner. (filecoin-project/lotus#6888)
- Add allocated sectorid vis (filecoin-project/lotus#4638)
- add a command for compacting sector numbers bitfield (filecoin-project/lotus#4640)
- Run
lotus-miner actor compact-allocated
to compact sector number allocations to reduce the size of the allocated sector number bitfield.
- Run
- Add ChainGetMessagesInTipset API (filecoin-project/lotus#6642)
- Handle the --color flag via proper global state (filecoin-project/lotus#6743)
- Enable color by default only if os.Stdout is a TTY (filecoin-project/lotus#6696)
- Stop outputing ANSI color on non-TTY (filecoin-project/lotus#6694)
- Envvar to disable slash filter (filecoin-project/lotus#6620)
- commit batch: AggregateAboveBaseFee config (filecoin-project/lotus#6650)
- shed tool to estimate aggregate network fees (filecoin-project/lotus#6631)
- Fix padding of deals, which only partially shipped in #5988 (filecoin-project/lotus#6683)
- fix deal concurrency test failures by upgrading graphsync and others (filecoin-project/lotus#6724)
- fix: on randomness change, use new rand (filecoin-project/lotus#6805) - fix: always check if StateSearchMessage returns nil (filecoin-project/lotus#6802)
- test: fix flaky window post tests (filecoin-project/lotus#6804)
- wrap close(wait) with sync.Once to avoid panic (filecoin-project/lotus#6800)
- fixes #6786 segfault (filecoin-project/lotus#6787)
- ClientRetrieve stops on cancel(filecoin-project/lotus#6739)
- Fix bugs in sectors extend --v1-sectors (filecoin-project/lotus#6066)
- fix "lotus-seed genesis car" error "merkledag: not found" (filecoin-project/lotus#6688)
- Get retrieval pricing input should not error out on a deal state fetch (filecoin-project/lotus#6679)
- Fix more CID double-encoding as hex (filecoin-project/lotus#6680)
- storage: Fix FinalizeSector with sectors in stoage paths (filecoin-project/lotus#6653)
- Fix tiny error in check-client-datacap (filecoin-project/lotus#6664)
- Fix: precommit_batch method used the wrong cfg.CommitBatchWait (filecoin-project/lotus#6658)
- fix ticket expiration check (filecoin-project/lotus#6635)
- remove precommit check in handleCommitFailed (filecoin-project/lotus#6634)
- fix prove commit aggregate send token amount (filecoin-project/lotus#6625)
- Eliminate inefficiency in markets logging (filecoin-project/lotus#6895)
- rename
cmd/lotus{-storage=>}-miner
to match binary. (filecoin-project/lotus#6886) - fix racy TestSimultanenousTransferLimit. (filecoin-project/lotus#6862)
- ValidateBlock: Assert that block header height's are greater than parents (filecoin-project/lotus#6872)
- feat: Don't panic when api impl is nil (filecoin-project/lotus#6857)
- add docker-compose file (filecoin-project/lotus#6544)
- easy way to make install app (filecoin-project/lotus#5183)
- api: Separate the Net interface from Common (filecoin-project/lotus#6627) - add StateReadState to gateway api (filecoin-project/lotus#6818)
- add SealProof in SectorBuilder (filecoin-project/lotus#6815)
- sealing: Handle preCommitParams errors more correctly (filecoin-project/lotus#6763)
- ClientFindData: always fetch peer id from chain (filecoin-project/lotus#6807)
- test: handle null blocks in TestForkRefuseCall (filecoin-project/lotus#6758)
- Add more deal details to lotus-miner info (filecoin-project/lotus#6708)
- add election backtest (filecoin-project/lotus#5950)
- add dollar sign (filecoin-project/lotus#6690)
- get-actor cli spelling fix (filecoin-project/lotus#6681)
- polish(statetree): accept a context in statetree diff for timeouts (filecoin-project/lotus#6639)
- Add helptext to lotus chain export (filecoin-project/lotus#6672)
- add an incremental nonce itest. (filecoin-project/lotus#6663)
- commit batch: Initialize the FailedSectors map (filecoin-project/lotus#6647)
- Fast-path retry submitting commit aggregate if commit is still valid (filecoin-project/lotus#6638)
- Reuse timers in sealing batch logic (filecoin-project/lotus#6636)
- Update to proof v8.0.3 (filecoin-project/lotus#6890)
- update to go-fil-market v1.6.0 (filecoin-project/lotus#6885)
- Bump go-multihash, adjust test for supported version (filecoin-project/lotus#6674)
- github.com/filecoin-project/go-data-transfer (v1.6.0 -> v1.7.2):
- github.com/filecoin-project/go-fil-markets (v1.5.0 -> v1.6.2):
- github.com/filecoin-project/go-padreader (v0.0.0-20200903213702-ed5fae088b20 -> v0.0.0-20210723183308-812a16dc01b1)
- github.com/filecoin-project/go-state-types (v0.1.1-0.20210506134452-99b279731c48 -> v0.1.1-0.20210810190654-139e0e79e69e)
- github.com/filecoin-project/go-statemachine (v0.0.0-20200925024713-05bd7c71fbfe -> v1.0.1)
- update go-libp2p-pubsub to v0.5.0 (filecoin-project/lotus#6764)
- Master->v1.11.1 (filecoin-project/lotus#7051)
- v1.11.1-rc2 (filecoin-project/lotus#6966)
- Backport master -> v1.11.1 (filecoin-project/lotus#6965)
- Fixes in master -> release (filecoin-project/lotus#6933)
- Add changelog for v1.11.1-rc1 and bump the version (filecoin-project/lotus#6900)
- Fix merge release -> v1.11.1 (filecoin-project/lotus#6897)
- Update RELEASE_ISSUE_TEMPLATE.md (filecoin-project/lotus#6880)
- Add github actions for staled pr (filecoin-project/lotus#6879)
- Update issue templates and add templates for M1 (filecoin-project/lotus#6856)
- Fix links in issue templates
- Update issue templates to forms (filecoin-project/lotus#6798
- Nerpa v13 upgrade (filecoin-project/lotus#6837)
- add docker-compose file (filecoin-project/lotus#6544)
- release -> master (filecoin-project/lotus#6828)
- Resurrect CODEOWNERS, but for maintainers group (filecoin-project/lotus#6773)
- Master disclaimer (filecoin-project/lotus#6757)
- Create stale.yml (filecoin-project/lotus#6747)
- Release template: Update all testnet infra at once (filecoin-project/lotus#6710)
- Release Template: remove binary validation step (filecoin-project/lotus#6709)
- Reset of the interop network (filecoin-project/lotus#6689)
- Update version.go to 1.11.1 (filecoin-project/lotus#6621)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@vyzo | 313 | +8928/-6010 | 415 |
@nonsense | 103 | +6041/-4041 | 304 |
@magik6k | 37 | +3851/-1611 | 146 |
@ZenGround0 | 24 | +1693/-1394 | 95 |
@placer14 | 1 | +2310/-578 | 8 |
@dirkmc | 7 | +1154/-726 | 29 |
@raulk | 44 | +969/-616 | 141 |
@jennijuju | 15 | +682/-354 | 47 |
@ribasushi | 18 | +469/-273 | 64 |
@coryschwartz | 5 | +576/-135 | 14 |
@hunjixin | 7 | +404/-82 | 19 |
@dirkmc | 17 | +348/-47 | 17 |
@tchardin | 2 | +262/-34 | 5 |
@aarshkshah1992 | 9 | +233/-63 | 44 |
@Kubuxu | 4 | +254/-16 | 4 |
@hannahhoward | 6 | +163/-75 | 8 |
@whyrusleeping | 4 | +157/-16 | 9 |
@Whyrusleeping | 2 | +87/-66 | 10 |
@arajasek | 10 | +81/-53 | 13 |
@zgfzgf | 2 | +104/-4 | 2 |
@aarshkshah1992 | 6 | +85/-19 | 10 |
@llifezou | 4 | +59/-20 | 4 |
@Stebalien | 7 | +47/-17 | 9 |
@johnli-helloworld | 3 | +46/-15 | 5 |
@frrist | 1 | +28/-23 | 2 |
@hannahhoward | 4 | +46/-5 | 11 |
@Jennifer | 4 | +31/-2 | 4 |
@wangchao | 1 | +1/-27 | 1 |
@jennijuju | 2 | +7/-21 | 2 |
@chadwick2143 | 1 | +15/-1 | 1 |
@Jerry | 2 | +9/-4 | 2 |
Steve Loeppky | 2 | +12/-0 | 2 |
David Dias | 1 | +9/-0 | 1 |
dependabot[bot] | 1 | +3/-3 | 1 |
zhoutian527 | 1 | +2/-2 | 1 |
xloem | 1 | +4/-0 | 1 |
@travisperson | 2 | +2/-2 | 3 |
Liviu Damian | 2 | +2/-2 | 2 |
@jimpick | 2 | +2/-2 | 2 |
Frank | 1 | +3/-0 | 1 |
turuslan | 1 | +1/-1 | 1 |
Kirk Baird | 1 | +0/-0 | 1 |
This is a highly recommended release of Lotus that have many bug fixes, improvements and new features.
- Miner SimultaneousTransfers config (filecoin-project/lotus#6612)
- Set
SimultaneousTransfers
in lotus miner config to configure the maximum number of parallel online data transfers, including both storage and retrieval deals.
- Set
- Dynamic Retrieval pricing (filecoin-project/lotus#6175)
- Customize your retrieval ask price, see a quick tutorial here.
- Robust message management (filecoin-project/lotus#5822)
- run `lotus mpool manage and follow the instructions!
- Demo available at https://www.youtube.com/watch?v=QDocpLQjZgQ.
- Add utils to use multisigs as miner owners (filecoin-project/lotus#6490)
- feat: implement lotus-sim (filecoin-project/lotus#6406)
- implement a command to export a car (filecoin-project/lotus#6405)
- Add a command to get the fees of a deal (filecoin-project/lotus#5307)
- run
lotus-shed market get-deal-fees
- run
- Add a command to list retrievals (filecoin-project/lotus#6337)
- run
lotus client list-retrievals
- run
- lotus-gateway: add check command (filecoin-project/lotus#6373)
- lotus-wallet: JWT Support (filecoin-project/lotus#6360)
- Allow starting networks from arbitrary actor versions (filecoin-project/lotus#6305)
- oh, snap! (filecoin-project/lotus#6202)
- Add a shed util to count 64 GiB miner stats (filecoin-project/lotus#6290)
- Introduce stateless offline dealflow, bypassing the FSM/deallists (filecoin-project/lotus#5961)
- Transplant some useful commands to lotus-shed actor (filecoin-project/lotus#5913)
- run
lotus-shed actor
- run
- actor wrapper codegen (filecoin-project/lotus#6108)
- Add a shed util to count miners by post type (filecoin-project/lotus#6169)
- shed: command to list duplicate messages in tipsets (steb) (filecoin-project/lotus#5847)
- feat: allow checkpointing to forks (filecoin-project/lotus#6107)
- Add a CLI tool for miner proving deadline (filecoin-project/lotus#6132)
- run
lotus state miner-proving-deadline
- run
- Fix wallet error messages (filecoin-project/lotus#6594)
- Fix CircleCI gen (filecoin-project/lotus#6589)
- Make query-ask CLI more graceful (filecoin-project/lotus#6590)
- scale up sector expiration to avoid sector expire in batch-pre-commit waitting (filecoin-project/lotus#6566)
- Fix an error in msigLockCancel (filecoin-project/lotus#6582
- fix circleci being out of sync. (filecoin-project/lotus#6573)
- Fix helptext for ask price(filecoin-project/lotus#6560)
- fix commit finalize failed (filecoin-project/lotus#6521)
- Fix soup (filecoin-project/lotus#6501)
- fix: pick the correct partitions-per-post limit (filecoin-project/lotus#6502)
- sealing: Fix restartSectors race (filecoin-project/lotus#6495)
- Fix: correct the change of message size limit (filecoin-project/lotus#6430)
- Fix logging of stringified CIDs double-encoded in hex (filecoin-project/lotus#6413)
- Fix success handling in Retreival (filecoin-project/lotus#5921)
- storagefsm: Fix batch deal packing behavior (filecoin-project/lotus#6041)
- events: Fix handling of multiple matched events per epoch (filecoin-project/lotus#6355)
- Fix logging around mineOne (filecoin-project/lotus#6310)
- Fix shell completions (filecoin-project/lotus#6316)
- Allow 8MB sectors in devnet (filecoin-project/lotus#6312)
- fix ticket expired (filecoin-project/lotus#6304)
- Revert "chore: update go-libp2p" (filecoin-project/lotus#6306)
- fix: wait-api should use GetAPI to acquire binary specific API (filecoin-project/lotus#6246)
- fix(ci): Updates to lotus CI build process (filecoin-project/lotus#6256)
- fix: use a consistent tipset in commands (filecoin-project/lotus#6142)
- go mod tidy for lotus-soup testplans (filecoin-project/lotus#6124)
- fix testground payment channel tests: use 1 miner (filecoin-project/lotus#6126)
- fix: use the parent state when listing actors (filecoin-project/lotus#6143)
- Speed up StateListMessages in some cases (filecoin-project/lotus#6007)
- fix(splitstore): fix a panic on revert-only head changes (filecoin-project/lotus#6133)
- drand: fix beacon cache (filecoin-project/lotus#6164)
- gateway: Add support for Version method (filecoin-project/lotus#6618)
- revamped integration test kit (aka. Operation Sparks Joy) (filecoin-project/lotus#6329)
- move with changed name (filecoin-project/lotus#6587)
- dynamic circleci config for streamlining test execution (filecoin-project/lotus#6561)
- extern/storage: add ability to ignore worker resources when scheduling. (filecoin-project/lotus#6542)
- Adjust various CLI display ratios to arbitrary precision (filecoin-project/lotus#6309)
- Test multicore SDR support (filecoin-project/lotus#6479)
- Unit tests for sector batchers (filecoin-project/lotus#6432)
- Update chain list with correct help instructions (filecoin-project/lotus#6465)
- clean failed sectors in batch commit (filecoin-project/lotus#6451)
- itests/kit: add guard to ensure imports from tests only. (filecoin-project/lotus#6445)
- consolidate integration tests into
itests
package; create test kit; cleanup (filecoin-project/lotus#6311) - Fee config for sector batching (filecoin-project/lotus#6420)
- UX: lotus state power CLI should fail if called with a not-miner (filecoin-project/lotus#6425)
- Increase message size limit (filecoin-project/lotus#6419)
- polish(stmgr): define ExecMonitor for message application callback (filecoin-project/lotus#6389)
- upgrade testground action version (filecoin-project/lotus#6403)
- Bypass task scheduler for reading unsealed pieces (filecoin-project/lotus#6280)
- testplans: lotus-soup: use default WPoStChallengeWindow (filecoin-project/lotus#6400)
- Integration tests for offline deals (filecoin-project/lotus#6081)
- Fix some flaky tests (filecoin-project/lotus#6397)
- build appimage in CI (filecoin-project/lotus#6384)
- Generate AppImage (filecoin-project/lotus#6208)
- Add test for AddVerifiedClient (filecoin-project/lotus#6317)
- Typo fix in error message: "pubusb" -> "pubsub" (filecoin-project/lotus#6365)
- Improve the cli state call command (filecoin-project/lotus#6226)
- Upscale mineOne message to a WARN on unexpected ineligibility (filecoin-project/lotus#6358)
- Remove few useless variable assignments (filecoin-project/lotus#6359)
- Reduce noise from 'peer has different genesis' messages (filecoin-project/lotus#6357)
- Get current seal proof when necessary (filecoin-project/lotus#6339)
- Remove log line when tracing is not configured (filecoin-project/lotus#6334)
- separate tracing environment variables (filecoin-project/lotus#6323)
- feat: log dispute rate (filecoin-project/lotus#6322)
- Move verifreg shed utils to CLI (filecoin-project/lotus#6135)
- consider storiface.PathStorage when calculating storage requirements (filecoin-project/lotus#6233)
storage
module: add go docs and minor code quality refactors (filecoin-project/lotus#6259)- Increase data transfer timeouts (filecoin-project/lotus#6300)
- gateway: spin off from cmd to package (filecoin-project/lotus#6294)
- Return total power when GetPowerRaw doesn't find miner claim (filecoin-project/lotus#4938)
- add flags to control gateway lookback parameters (filecoin-project/lotus#6247)
- chore(ci): Enable build on RC tags (filecoin-project/lotus#6238)
- cron-wc (filecoin-project/lotus#6178)
- Allow creation of state tree v3s (filecoin-project/lotus#6167)
- mpool: Cleanup pre-nv12 selection logic (filecoin-project/lotus#6148)
- attempt to do better padding on pieces being written into sectors (filecoin-project/lotus#5988)
- remove duplicate ask and calculate ping before lock (filecoin-project/lotus#5968)
- flaky tests improvement: separate TestBatchDealInput from TestAPIDealFlow (filecoin-project/lotus#6141)
- Testground checks on push (filecoin-project/lotus#5887)
- Use EmptyTSK where appropriate (filecoin-project/lotus#6134)
- upgrade
lotus-soup
testplans and reduce deals concurrency to a single miner (filecoin-project/lotus#6122
- downgrade libp2p/go-libp2p-yamux to v0.5.1. (filecoin-project/lotus#6605)
- Update libp2p to 0.14.2 (filecoin-project/lotus#6404)
- update to markets-v1.4.0 (filecoin-project/lotus#6369)
- Use new actor tags (filecoin-project/lotus#6291)
- chore: update go-libp2p (filecoin-project/lotus#6231)
- Update ffi to proofs v7 (filecoin-project/lotus#6150)
- Initial draft: basic build instructions on Readme (filecoin-project/lotus#6498)
- Remove rc changelog, compile the new changelog for final release only (filecoin-project/lotus#6444)
- updated configuration comments for docs (filecoin-project/lotus#6440)
- Set ntwk v13 HyperDrive Calibration upgrade epoch (filecoin-project/lotus#6441)
- build snapcraft (filecoin-project/lotus#6388)
- Fix the doc errors of the sealing config funcs (filecoin-project/lotus#6399)
- Add doc on gas balancing (filecoin-project/lotus#6392)
- Add interop network (filecoin-project/lotus#6387)
- Network version 13 (v1.11) (filecoin-project/lotus#6342)
- Add a warning to the release issue template (filecoin-project/lotus#6374)
- Update RELEASE_ISSUE_TEMPLATE.md (filecoin-project/lotus#6236)
- Delete CODEOWNERS (filecoin-project/lotus#6289)
- Feat/nerpa v4 (filecoin-project/lotus#6248)
- Introduce a release issue template (filecoin-project/lotus#5826)
- This is a 1:1 forward-port of PR#6183 from 1.9.x to master (filecoin-project/lotus#6196)
- Update cli gen (filecoin-project/lotus#6155)
- Generate CLI docs (filecoin-project/lotus#6145)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@raulk | 118 | +11972/-10860 | 472 |
@magik6k | 65 | +10824/-4158 | 353 |
@aarshkshah1992 | 59 | +8057/-3355 | 224 |
@arajasek | 41 | +8786/-1691 | 331 |
@Stebalien | 106 | +7653/-2718 | 273 |
dirkmc | 11 | +2580/-1371 | 77 |
@dirkmc | 39 | +1865/-1194 | 79 |
@Kubuxu | 19 | +1973/-485 | 81 |
@vyzo | 4 | +1748/-330 | 50 |
@aarshkshah1992 | 5 | +1462/-213 | 27 |
@coryschwartz | 35 | +568/-206 | 59 |
@chadwick2143 | 3 | +739/-1 | 4 |
@ribasushi | 21 | +487/-164 | 36 |
@hannahhoward | 5 | +544/-5 | 19 |
@jennijuju | 9 | +241/-174 | 19 |
@frrist | 1 | +137/-88 | 7 |
@travisperson | 3 | +175/-6 | 7 |
@wadeAlexC | 1 | +48/-129 | 1 |
@whyrusleeping | 8 | +161/-13 | 11 |
lotus | 1 | +114/-46 | 1 |
@nonsense | 8 | +107/-53 | 20 |
@rjan90 | 4 | +115/-33 | 4 |
@ZenGround0 | 3 | +114/-1 | 4 |
@Aloxaf | 1 | +43/-61 | 7 |
@yaohcn | 4 | +89/-9 | 5 |
@mitchellsoo | 1 | +51/-0 | 1 |
@placer14 | 3 | +28/-18 | 4 |
@jennijuju | 6 | +9/-14 | 6 |
@Frank | 2 | +11/-10 | 2 |
@wangchao | 3 | +5/-4 | 4 |
@Steve Loeppky | 1 | +7/-1 | 1 |
@Lion | 1 | +4/-2 | 1 |
@Mimir | 1 | +2/-2 | 1 |
@raulk | 1 | +1/-1 | 1 |
@Jack Yao | 1 | +1/-1 | 1 |
@IPFSUnion | 1 | +1/-1 | 1 |
This is an optional but highly recommended release of Lotus for lotus miners that has many bug fixes and improvements based on the feedback we got from the community since HyperDrive.
- commit batch: AggregateAboveBaseFee config #6650
AggregateAboveBaseFee
is added to miner sealing configuration for setting the network base fee to start aggregating proofs. When the network base fee is lower than this value, the prove commits will be submitted individually viaProveCommitSector
. According to the Batch Incentive Alignment introduced in FIP-0013, we recommend miners to set this value to 0.15 nanoFIL(which is the default value) to avoid unexpected aggregation fee in burn and enjoy the most benefits of aggregation!
- storage: Fix FinalizeSector with sectors in storage paths #6652
- Fix tiny error in check-client-datacap #6664
- Fix: precommit_batch method used the wrong cfg.PreCommitBatchWait #6658
- to optimize the batchwait #6636
- fix getTicket: sector precommitted but expired case #6635
- handleSubmitCommitAggregate() exception handling #6595
- remove precommit check in handleCommitFailed #6634
- ensure agg fee is adequate
- fix: miner balance is not enough, so that ProveCommitAggregate msg exec failed #6623
- commit batch: Initialize the FailedSectors map #6647
Contributors
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 7 | +151/-56 | 21 |
@llifezou | 4 | +59/-20 | 4 |
@johnli-helloworld | 2 | +45/-14 | 4 |
@wangchao | 1 | +1/-27 | 1 |
Jerry | 2 | +9/-4 | 2 |
@zhoutian527 | 1 | +2/-2 | 1 |
@ribasushi | 1 | +1/-1 | 1 |
This is an optional but highly recommended release of Lotus for lotus miners that has many bug fixes and improvements based on the feedback we got from the community since HyperDrive.
- commit batch: AggregateAboveBaseFee config #6650
AggregateAboveBaseFee
is added to miner sealing configuration for setting the network base fee to start aggregating proofs. When the network base fee is lower than this value, the prove commits will be submitted individually viaProveCommitSector
. According to the Batch Incentive Alignment introduced in FIP-0013, we recommend miners to set this value to 0.15 nanoFIL(which is the default value) to avoid unexpected aggregation fee in burn and enjoy the most benefits of aggregation!
- storage: Fix FinalizeSector with sectors in storage paths #6652
- Fix tiny error in check-client-datacap #6664
- Fix: precommit_batch method used the wrong cfg.PreCommitBatchWait #6658
- to optimize the batchwait #6636
- fix getTicket: sector precommitted but expired case #6635
- handleSubmitCommitAggregate() exception handling #6595
- remove precommit check in handleCommitFailed #6634
- ensure agg fee is adequate
- fix: miner balance is not enough, so that ProveCommitAggregate msg exec failed #6623
- commit batch: Initialize the FailedSectors map #6647
Contributors
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 7 | +151/-56 | 21 |
@llifezou | 4 | +59/-20 | 4 |
@johnli-helloworld | 2 | +45/-14 | 4 |
@wangchao | 1 | +1/-27 | 1 |
Jerry | 2 | +9/-4 | 2 |
@zhoutian527 | 1 | +2/-2 | 1 |
@ribasushi | 1 | +1/-1 | 1 |
This is a mandatory release of Lotus that introduces Filecoin network v13, codenamed the HyperDrive upgrade. The Filecoin mainnet will upgrade, which is epoch 892800, on 2021-06-30T22:00:00Z. The network upgrade introduces the following FIPs:
- FIP-0008: Add miner batched sector pre-commit method
- FIP-0011: Remove reward auction from reporting consensus faults
- FIP-0012: DataCap Top up for FIL+ Client Addresses
- FIP-0013: Add ProveCommitSectorAggregated method to reduce on-chain congestion
- FIP-0015: Revert FIP-0009(Exempt Window PoSts from BaseFee burn)
Note that this release is built on top of Lotus v1.9.0. Enterprising users can use the master
branch of Lotus to get the latest functionality, including all changes in this release candidate.
FIPs 0008 and 0013 combine to allow for a significant increase in the rate of onboarding storage on the Filecoin network. This aims to lead to more useful data being stored on the network, reduced network congestion, and lower network base fee.
Check out the documentation here for details on the new Lotus miner sealing config options, here for fee config options, and explanations of the new features.
Note:
- We recommend to keep
PreCommitSectorsBatch
as 1. - We recommend miners to set
PreCommitBatchWait
lower than 30 hours. - We recommend miners to set a longer
CommitBatchSlack
andPreCommitBatchSlack
to prevent message failures due to expirations.
In order to validate the Hyperdrive changes, we wrote a simulation to seal as many sectors as quickly as possible, assuming the same number and mix of 32GiB and 64GiB miners as the current network.
Given these assumptions:
- We'd expect a network storage growth rate of around 530PiB per day. 😳 🎉 🥳 😅
- We'd expect network bandwidth dedicated to
SubmitWindowedPoSt
to grow by about 0.02% per day. - We'd expect the state-tree (and therefore snapshot) size to grow by 1.16GiB per day.
- Nearly all of the state-tree growth is expected to come from new sector metadata.
- We'd expect the daily lotus datastore growth rate to increase by about 10-15% (from current ~21GiB/day).
- Most "growth" of the lotus datastore is due to "churn", historical data that's no longer referenced by the latest state-tree.
Various Lotus improvements are planned moving forward to mitigate the effects of the growing state tree size. The primary improvement is the Lotus splitstore, which will soon be enabled by default. The feature allows for online garbage collection for nodes that do not seek to maintain full chain and state history, thus eliminating the need for users to delete their datastores and sync from snapshots.
Other improvements including better compressed snapshots, faster pre-migrations, and improved chain exports are in the roadmap.
Included in the HyperDrive upgrade is FIP-0015 which eliminates the special-case gas treatment of SubmitWindowedPoSt
messages that was introduced in FIP-0009. Although SubmitWindowedPoSt
messages will be relatively cheap, thanks to the introduction of optimistic acceptance of these proofs in FIP-0010, storage providers should pay attention to their MaxWindowPoStGasFee
config option: too low and PoSts may not land on chain; too high and they may cost an exorbitant amount!
- Implement FIP-0015 (filecoin-project/lotus#6361)
- Integrate FIP0013 and FIP0008 (filecoin-project/lotus#6235)
- Configuration docs and cli examples
- cli docs
- Introduce gas prices for aggregate verifications (filecoin-project/lotus#6347)
- Introduce v5 actors (filecoin-project/lotus#6195)
- Robustify commit batcher (filecoin-project/lotus#6367)
- Always flush when timer goes off (filecoin-project/lotus#6563)
- Update default fees for aggregates (filecoin-project/lotus#6548)
- sealing: Early finalization option (filecoin-project/lotus#6452)
./lotus-miner/config.toml/[Sealing.FinalizeEarly]
: default to false. Enable if you want to FinalizeSector before commiting
- Add filplus utils to CLI (filecoin-project/lotus#6351)
- cli doc can be found here
- Add miner-side MaxDealStartDelay config (filecoin-project/lotus#6576)
- chainstore: Don't take heaviestLk with backlogged reorgCh (filecoin-project/lotus#6526)
- Backport #6041 - storagefsm: Fix batch deal packing behavior (filecoin-project/lotus#6519)
- backport: pick the correct partitions-per-post limit (filecoin-project/lotus#6503)
- failed sectors should be added into res correctly (filecoin-project/lotus#6472)
- sealing: Fix restartSectors race (filecoin-project/lotus#6491)
- Fund miners with the aggregate fee when ProveCommitting (filecoin-project/lotus#6428)
- Commit and Precommit batcher cannot share a getSectorDeadline method (filecoin-project/lotus#6416)
- Fix supported proof type manipulations for v5 actors (filecoin-project/lotus#6366)
- events: Fix handling of multiple matched events per epoch (filecoin-project/lotus#6362)
- Fix randomness fetching around null blocks (filecoin-project/lotus#6240)
- Appimage v1.10.0 rc3 (filecoin-project/lotus#6492)
- Expand on Drand change testing (filecoin-project/lotus#6500)
- Backport Fix logging around mineOne (filecoin-project/lotus#6499)
- mpool: Add more metrics (filecoin-project/lotus#6453)
- Merge backported PRs into v1.10 release branch (filecoin-project/lotus#6436)
- Fix tests (filecoin-project/lotus#6371)
- Extend the default deal start epoch delay (filecoin-project/lotus#6350)
- sealing: Wire up context to batchers (filecoin-project/lotus#6497)
- Improve address resolution for messages (filecoin-project/lotus#6364)
- Proofs v8.0.2 (filecoin-project/lotus#6524)
- Update to fixed Bellperson (filecoin-project/lotus#6480)
- Update to go-praamfetch with fslocks (filecoin-project/lotus#6473)
- Update ffi with fixed multicore sdr support (filecoin-project/lotus#6471)
- github.com/filecoin-project/go-paramfetch (v0.0.2-0.20200701152213-3e0f0afdc261 -> v0.0.2-0.20210614165157-25a6c7769498)
- github.com/filecoin-project/specs-actors/v5 (v5.0.0-20210512015452-4fe3889fff57 -> v5.0.0)
- github.com/filecoin-project/go-hamt-ipld/v3 (v3.0.1 -> v3.1.0)
- github.com/ipfs/go-log/v2 (v2.1.2-0.20200626104915-0016c0b4b3e4 -> v2.1.3)
- github.com/filecoin-project/go-amt-ipld/v3 (v3.0.0 -> v3.1.0)
- Set HyperDrive upgrade epoch (filecoin-project/lotus#6565)
- version bump to lotus v1.10.0-rc6 (filecoin-project/lotus#6529)
- Upgrade epochs for calibration reset (filecoin-project/lotus#6528)
- Lotus version 1.10.0-rc5 (filecoin-project/lotus#6504)
- Merge releases into v1.10 release (filecoin-project/lotus#6494)
- update lotus to v1.10.0-rc3 (filecoin-project/lotus#6481)
- updated configuration comments for docs
- Lotus version 1.10.0-rc2 (filecoin-project/lotus#6443)
- Set ntwk v13 HyperDrive Calibration upgrade epoch (filecoin-project/lotus#6442)
💙Thank you to all the contributors!
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
@magik6k | 81 | +9606/-1536 | 361 |
@arajasek | 41 | +6543/-679 | 189 |
@ZenGround0 | 11 | +4074/-727 | 110 |
@anorth | 10 | +2035/-1177 | 55 |
@iand | 1 | +779/-12 | 5 |
@frrist | 2 | +722/-6 | 6 |
@Stebalien | 6 | +368/-24 | 15 |
@jennijuju | 11 | +204/-111 | 19 |
@vyzo | 6 | +155/-66 | 13 |
@coryschwartz | 10 | +171/-27 | 14 |
@Kubuxu | 4 | +177/-13 | 7 |
@ribasushi | 4 | +65/-42 | 5 |
@travisperson | 2 | +11/-11 | 4 |
@kirk-baird | 1 | +1/-5 | 1 |
@wangchao | 2 | +3/-2 | 2 |
This is an optional Lotus release that introduces various improvements to the sealing, mining, and deal-making processes.
- OpenRPC Support (filecoin-project#5843)
- Take latency into account when making interactive deals (filecoin-project#5876)
- Update go-commp-utils for >10x faster client commp calculation (filecoin-project#5892)
- add
lotus client cancel-retrieval
cmd to lotus CLI (filecoin-project#5871) - add
inspect-deal
command tolotus client
(filecoin-project#5833) - Local retrieval support (filecoin-project#5917)
- go-fil-markets v1.1.9 -> v1.2.5
- For a detailed changelog see https://github.com/filecoin-project/go-fil-markets/blob/master/CHANGELOG.md
- rust-fil-proofs v5.4.1 -> v7.0.1
- For a detailed changelog see https://github.com/filecoin-project/rust-fil-proofs/blob/master/CHANGELOG.md
- storagefsm: Apply global events even in broken states (filecoin-project#5962)
- Default the AlwaysKeepUnsealedCopy flag to true (filecoin-project#5743)
- splitstore: compact hotstore prior to garbage collection (filecoin-project#5778)
- ipfs-force bootstrapper update (filecoin-project#5799)
- better logging when unsealing fails (filecoin-project#5851)
- perf: add cache for gas permium estimation (filecoin-project#5709)
- backupds: Compact log on restart (filecoin-project#5875)
- backupds: Improve truncated log handling (filecoin-project#5891)
- State CLI improvements (State CLI improvements)
- API proxy struct codegen (filecoin-project#5854)
- move DI stuff for paychmgr into modules (filecoin-project#5791)
- Implement Event observer and Settings for 3rd party dep injection (filecoin-project#5693)
- Export developer and network commands for consumption by derivatives of Lotus (filecoin-project#5864)
- mock sealer: Simulate randomness sideeffects (filecoin-project#5805)
- localstorage: Demote reservation stat error to debug (filecoin-project#5976)
- shed command to unpack miner info dumps (filecoin-project#5800)
- Add two utils to Lotus-shed (filecoin-project#5867)
- add shed election estimate command (filecoin-project#5092)
- Add --actor flag in lotus-shed sectors terminate (filecoin-project#5819)
- Move lotus mpool clear to lotus-shed (filecoin-project#5900)
- Centralize everything on ipfs/go-log/v2 (filecoin-project#5974)
- expose NextID from nice market actor interface (filecoin-project#5850)
- add available options for perm on error (filecoin-project#5814)
- API docs clarification: Document StateSearchMsg replaced message behavior (filecoin-project#5838)
- api: Document StateReplay replaced message behavior (filecoin-project#5840)
- add godocs to miner objects (filecoin-project#2184)
- Add description to the client deal CLI command (filecoin-project#5999)
- lint: don't skip builtin (filecoin-project#5881)
- use deal duration from actors (filecoin-project#5270)
- remote calc winningpost proof (filecoin-project#5884)
- packer: other network images (filecoin-project#5930)
- Convert the chainstore lock to RW (filecoin-project#5971)
- Remove CachedBlockstore (filecoin-project#5972)
- remove messagepool CapGasFee duplicate code (filecoin-project#5992)
- Add a mining-heartbeat INFO line at every epoch (filecoin-project#6183)
- chore(ci): Enable build on RC tags (filecoin-project#6245)
- Upgrade nerpa to actor v4 and bump the version to rc4 (filecoin-project#6249)
- return buffers after canceling badger operation (filecoin-project#5796)
- avoid holding a lock while calling the View callback (filecoin-project#5792)
- storagefsm: Trigger input processing when below limits (filecoin-project#5801)
- After importing a previously deleted key, be able to delete it again (filecoin-project#4653)
- fix StateManager.Replay on reward actor (filecoin-project#5804)
- make sure atomic 64bit fields are 64bit aligned (filecoin-project#5794)
- Import secp sigs in paych tests (filecoin-project#5879)
- fix ci build-macos (filecoin-project#5934)
- Fix creation of remainder account when it's not a multisig (filecoin-project#5807)
- Fix fallback chainstore (filecoin-project#6003)
- fix 4857: show help for set-addrs (filecoin-project#5943)
- fix health report (filecoin-project#6011)
- fix(ci): Use recent ubuntu LTS release; Update release params ((filecoin-project#6011))
This is a mandatory release of Lotus that upgrades the network to version 12, which introduces various performance improvements to the cron processing of the power actor. The network will upgrade at height 712320, which is 2021-04-29T06:00:00Z.
- v4 specs-actors integration, nv12 migration (filecoin-project#6116)
This is a mandatory release of Lotus that upgrades the network to version 11, which implements FIP-0014. The network will upgrade at height 665280, which is 2021-04-12T22:00:00Z.
This release also expands the lotus-miner sectors extend
CLI, with a new option that automatically extends all extensible v1 sectors. The option can be run using lotus-miner sectors extend --v1-sectors
.
-
The
tolerance
flag can be passed to indicate what durations aren't "worth" extending. It defaults to one week, which means that sectors whose current lifetime's are within one week of the maximum possible lifetime will not be extended. -
The
expiration-cutoff
flag can be passed to skip sectors whose expiration is past a certain point from the current head. It defaults to infinity (no cutoff), but if, say, 28800 was specified, then only sectors expiring in the next 10 days would be extended (2880 epochs in 1 day).
- Util for miners to extend all v1 sectors (filecoin-project#5924)
- Upgrade the butterfly network (filecoin-project#5929)
- Introduce the v11 network upgrade (filecoin-project#5904)
- Debug mode: Make upgrade heights controllable by an envvar (filecoin-project#5919)
This is a patch release of Lotus that introduces small fixes to the Storage FSM.
- storagefsm: Fix double unlock with ready WaitDeals sectors (filecoin-project#5783)
- backupds: Allow larger values in write log (filecoin-project#5776)
- storagefsm: Don't log the SectorRestart event (filecoin-project#5779)
This is an hotfix release of Lotus that fixes a critical bug introduced in v1.5.1 in the miner windowPoSt logic. This upgrade is only affecting miner nodes.
- fix window post rand check (filecoin-project#5773)
- wdpost: Always use head tipset to get randomness (filecoin-project#5774)
This is an optional release of Lotus that introduces an important fix to the WindowPoSt computation process. The change is to wait for some confidence before drawing beacon randomness for the proof. Without this, invalid proofs might be generated as the result of a null tipset.
This release also introduces the splitstore, a new optional blockstore that segregates the monolithic blockstore into cold and hot regions. The hot region contains objects from the last 4-5 finalities plus all reachable objects from two finalities away. All other objects are moved to the cold region using a compaction process that executes every finality, once 5 finalities have elapsed.
The splitstore allows us to separate the two regions quite effectively, using two separate badger blockstores. The separation means that the live working set is much smaller, which results in potentially significant performance improvements. In addition, it means that the coldstore can be moved to a separate (bigger, slower, cheaper) disk without loss of performance.
The design also allows us to use different implementations for the two blockstores; for example, an append-only blockstore could be used for coldstore and a faster memory mapped blockstore could be used for the hotstore (eg LMDB). We plan to experiment with these options in the future.
Once the splitstore has been enabled, the existing monolithic blockstore becomes the coldstore. On the first head change notification, the splitstore will warm up the hotstore by copying all reachable objects from the current tipset into the hotstore. All new writes go into the hotstore, with the splitstore tracking the write epoch. Once 5 finalities have elapsed, and every finality thereafter, the splitstore compacts by moving cold objects into the coldstore. There is also experimental support for garbage collection, whereby nunreachable objects are simply discarded.
To enable the splitstore, add the following to config.toml:
[Chainstore]
EnableSplitstore = true
Other highlights include:
- Improved deal data handling - now multiple deals can be adding to sectors in parallel
- Rewriten sector pledging - it now actually cares about max sealing sector limits
- Better handling for sectors stuck in the RecoverDealIDs state
- lotus-miner sectors extend command
- Optional configurable storage path size limit
- Config to disable owner/worker fallback from control addresses (useful when owner is a key on a hardware wallet)
- A write log for node metadata, which can be restored as a backup when the metadata leveldb becomes corrupted (e.g. when you run out of disk space / system crashes in some bad way)
- avoid use mp.cfg directly to avoid race (filecoin-project#5350)
- Show replacing message CID is state search-msg cli (filecoin-project#5656)
- Fix riceing by importing the main package (filecoin-project#5675)
- Remove sectors with all deals expired in RecoverDealIDs (filecoin-project#5658)
- storagefsm: Rewrite input handling (filecoin-project#5375)
- reintroduce Refactor send command for better testability (filecoin-project#5668)
- Improve error message with importing a chain (filecoin-project#5669)
- storagefsm: Cleanup CC sector creation (filecoin-project#5612)
- chain list --gas-stats display capacity (filecoin-project#5676)
- Correct some logs (filecoin-project#5694)
- refactor blockstores (filecoin-project#5484)
- Add idle to sync stage's String() (filecoin-project#5702)
- packer provisioner (filecoin-project#5604)
- add DeleteMany to Blockstore interface (filecoin-project#5703)
- segregate chain and state blockstores (filecoin-project#5695)
- fix(multisig): The format of the amount is not correct in msigLockApp (filecoin-project#5718)
- Update butterfly network (filecoin-project#5627)
- Collect worker task metrics (filecoin-project#5648)
- Correctly format disputer log (filecoin-project#5716)
- Log block CID in the large delay warning (filecoin-project#5704)
- Move api client builders to a cliutil package (filecoin-project#5728)
- Implement net peers --extended (filecoin-project#5734)
- Command to extend sector expiration (filecoin-project#5666)
- garbage collect hotstore after compaction (filecoin-project#5744)
- tune badger gc to repeatedly gc the value log until there is no rewrite (filecoin-project#5745)
- Add configuration option for pubsub IPColocationWhitelist subnets (filecoin-project#5735)
- hot/cold blockstore segregation (aka. splitstore) (filecoin-project#4992)
- Customize verifreg root key and remainder account when making genesis (filecoin-project#5730)
- chore: update go-graphsync to 0.6.0 (filecoin-project#5746)
- Add connmgr metadata to NetPeerInfo (filecoin-project#5749)
- test: attempt to make the splitstore test deterministic (filecoin-project#5750)
- Feat/api no dep build (filecoin-project#5729)
- Fix bootstrapper profile setting (filecoin-project#5756)
- Check liveness of sectors when processing termination batches (filecoin-project#5759)
- Configurable storage path storage limit (filecoin-project#5624)
- miner: Config to disable owner/worker address fallback (filecoin-project#5620)
- Fix TestUnpadReader on Go 1.16 (filecoin-project#5761)
- Metadata datastore log (filecoin-project#5755)
- Remove the SR2 stats, leave just the network totals (filecoin-project#5757)
- fix: wait a bit before starting to compute window post proofs (filecoin-project#5764)
- fix: retry proof when randomness changes (filecoin-project#5768)
This is a mandatory release of Lotus that introduces the fifth upgrade to the Filecoin network. The network upgrade occurs at height 550321, before which time all nodes must have updated to this release (or later). At this height, v3 specs-actors will take effect, which in turn implements the following two FIPs:
- FIP-0007 h/amt-v3 which improves the performance of the Filecoin HAMT and AMT.
- FIP-0010 off-chain Window PoSt Verification which reduces the gas consumption of
SubmitWindowedPoSt
messages significantly by optimistically accepting Window PoSt proofs without verification, and allowing them to be disputed later by off-chain verifiers.
Note that the integration of v3 actors was already completed in 1.4.2, this upgrade simply sets the epoch for the upgrade to occur.
FIP-0010 introduces the ability to dispute bad Window PoSts. Node operators are encouraged to run the new Lotus disputer alongside their Lotus daemons. For more information, see the announcement here.
- #5341 Add a
LOTUS_DISABLE_V3_ACTOR_MIGRATION
envvar- Setting this envvar to 1 disables the v3 actor migration, should only be used in the event of a failed migration
This is a large, and highly recommended, optional release with new features and improvements for lotus miner and deal-making UX. The release also integrates v3 specs-actors, which implements two FIPs:
- FIP-0007 h/amt-v3 which improves the performance of the Filecoin HAMT and AMT.
- FIP-0010 off-chain Window PoSt Verification which reduces the gas consumption of
SubmitWindowedPoSt
messages significantly by optimistically accepting Window PoSt proofs without verification, and allowing them to be disputed later by off-chain verifiers.
Note that this release does NOT set an upgrade epoch for v3 actors to take effect. That will be done in the upcoming 1.5.0 release.
- #5341 Added sector termination API and CLI
- Run
lotus-miner sectors terminate
- Run
- #5342 Added CLI for using a multisig wallet as miner's owner address
- See how to set it up here
- #5363, #5418, #5476, #5459 Integrated spec-actor v3
- #5472 Generate actor v3 methods for pond
- #5379 Added WindowPoSt disputer
- This is to support FIP-0010 off-chian Window PoSt verification
- See how to run a disputer here
- #5309 Batch multiple deals in one
PublishStorageMessages
- #5411 Handle batch
PublishStorageDeals
message in sealing recovery - #5505 Exclude expired deals from batching in
PublishStorageDeals
messages - Added
PublishMsgPeriod
andMaxDealsPerPublishMsg
to minerDealmaking
configuration. See how they work here. - #5538, #5549 Added a command to list pending deals and force publish messages.
- Run
lotus-miner market pending-publish
- Run
- #5428 Moved waiting for
PublishStorageDeals
messages' receipt from markets to lotus
- #5411 Handle batch
- #5510 Added
nerpanet
build option- To build
nerpanet
, runmake nerpanet
- To build
- #5433 Added
AlwaysKeepUnsealedCopy
option to the miner configuration - #5520 Added
MsigGetPending
to get pending transactions for multisig wallets - #5219 Added interactive mode for lotus-wallet
- 5529 Added support for minder nodes in
lotus-shed rpc
util
- #5210 Miner should not dial client on restart
- #5403 When estimating GasLimit only apply prior messages up to the nonce
- #5410 Fix the calibnet build option
- #5492 Fixed
has
for ipfsbstore for non-existing blocks - #5361 Fixed retrieval hangs when using
IpfsOnlineMode=true
- #5493 Fixed retrieval failure when price-per-byte is zero
- #5506 Fixed contexts in the storage adpater
- #5515 Properly wire up
StateReadState
on gateway API - #5582 Fixed error logging format strings
- #5614 Fixed websocket reconnecting handling
- #5389 Show verified indicator for
./lotus-miner storage-deals list
- #5229 Show power for verified deals in
./lotus-miner setocr list
- #5407 Added explicit check of the miner address protocol
- #5399 watchdog: increase heapprof capture threshold to 90%
- #5398 storageadapter: Look at precommits on-chain since deal publish msg
- #5470 Added
--no-timing
option for./lotus state compute-state --html
- #5417 Storage Manager: Always unseal full sectors
- #5393 Switched to filecoin-ffi bls api for bls signatures
- #5380 Refactor deals API tests
- #5397 Fixed a flake in the sync manager edge case test
- #5406 Added a test to ensure a correct window post cannot be disputed
- #5294 Added jobs to build Lotus docker image and push it to AWS ECR
- #5387 Added network info(mainnet|calibnet) in version
- #5497 Export metric for lotus-gateaway
- #4950 Removed bench policy
- #5047 Improved the UX for
./lotus-shed bitfield enc
- #5282 Snake a context through the chian blockstore creation
- #5350 Avoid using
mp.cfg
directrly to prevent race condition - #5449 Documented the block-header better
- #5404 Added retrying proofs if an incorrect one is generated
- #4545 Made state tipset usage consistent in the API
- #5540 Removed unnecessary database reads in validation check
- #5554 Fixed
build lotus-soup
CI job - #5552 Updated CircleCI to halt gracefully
- #5555 Cleanup and add docstrings of node builder
- #5564 Stopped depending on gocheck with gomod
- #5574 Updated CLI UI
- #5570 Added code CID to
StateReadState
return object - #5565 Added storageadapter.PublishMsgConfig to miner in testkit for lotus-soup testplan
- #5571 Added
lotus-seed gensis car
to generate lotus block for devnets - #5613 Check format in client commP util
- #5507 Refactored coalescing logic into its own function and take both cancellation sets into account
- #5592 Verify FFI version before building
- #5296 Upgraded to raulk/[email protected]
- #5450 Dependency updates
- #5425 Fixed stale imports in testplans/lotus-soup
- #5535 Updated to [email protected]
- #5616 Updated to filecoin-ffi@b6e0b35fb49ed0fe
- #5599 Updated to [email protected]
- #5614, , #5621 Updated to [email protected]
- #5459 Updated to [email protected]
- #5473 Merged staging branch for v1.5.0
- #5603 Set nerpanet's upgrade epochs up to v3 actors
- #5471, #5456 Set calibration net actor v3 migration epochs for testing
- #5434 Implemented pre-migration framework
- #5476 Tune migration
This is an optional Lotus release that introduces various improvements to the sealing, mining, and deal-making processes. In particular, #5341 introduces the ability for Lotus miners to terminate sectors.
- fix(sync): enforce ForkLengthThreshold for synced chain (filecoin-project#5182)
- introduce memory watchdog; LOTUS_MAX_HEAP (filecoin-project#5101)
- Skip bootstrapping if no peers specified (filecoin-project#5301)
- Chainxchg write response timeout (filecoin-project#5254)
- update NewestNetworkVersion (filecoin-project#5277)
- fix(sync): remove checks bypass when we submit the block (filecoin-project#4192)
- chore: export vm.ShouldBurn (filecoin-project#5355)
- fix(sync): enforce fork len when changing head (filecoin-project#5244)
- Use 55th percentile instead of median for gas-price (filecoin-project#5369)
- update go-libp2p-pubsub to v0.4.1 (filecoin-project#5329)
- Sector termination support (filecoin-project#5341)
- update weight canSeal and canStore when attach (https://github.com/filecoin-project/lotus/pull/5242/files)
- sector-storage/mock: improve mocked readpiece (filecoin-project#5208)
- Fix deadlock in runWorker in sched_worker.go (filecoin-project#5251)
- Skip checking terminated sectors provable (filecoin-project#5217)
- storagefsm: Fix unsealedInfoMap.lk init race (filecoin-project#5319)
- Multicore AddPiece CommP (filecoin-project#5320)
- storagefsm: Send correct event on ErrExpiredTicket in CommitFailed (filecoin-project#5366)
- expose StateSearchMessage on gateway (filecoin-project#5382)
- fix FileSize to return correct disk usage recursively (filecoin-project#5384)
- Better error message when withdrawing funds (filecoin-project#5293)
- add verbose for list transfers (filecoin-project#5259)
- cli - rename
client info
toclient balances
(filecoin-project#5304) - Better CLI for wallet market withdraw and client info (filecoin-project#5303)
- correct flag usages for replace cmd (filecoin-project#5255)
- lotus state call will panic (filecoin-project#5275)
- fix get sector bug (filecoin-project#4976)
- feat: lotus wallet market add (adds funds to storage market actor) (filecoin-project#5300)
- Fix client flag parsing in client balances cli (filecoin-project#5312)
- delete slash-consensus miner (filecoin-project#4577)
- add fund sufficient check in send (filecoin-project#5252)
- enable parse and shorten negative FIL values (filecoin-project#5315)
- add limit and rate for chain noise (filecoin-project#5223)
- add bench env print (filecoin-project#5222)
- Implement full-node restore option (filecoin-project#5362)
- add color for token amount (filecoin-project#5352)
- correct log in maybeUseAddress (filecoin-project#5359)
- add slash-consensus from flag (filecoin-project#5378)
- tvx extract: more tipset extraction goodness (filecoin-project#5258)
- Fix race in blockstore test suite (filecoin-project#5297)
- Remove LOTUS_DISABLE_V2_ACTOR_MIGRATION envvar (filecoin-project#5289)
- Create a calibnet build option (filecoin-project#5288)
- Calibnet: Set Orange epoch (filecoin-project#5325)
- Update SECURITY.md (filecoin-project#5246)
- README: Contribute section (filecoin-project#5330)
- README: refine Contribute section (filecoin-project#5331)
- Add misc tooling to codecov ignore list (filecoin-project#5347)
This is a MANDATORY hotfix release of Lotus that resolves a chain halt at height 336,459 caused by nondeterminism in specs-actors. The fix is to update actors to 2.3.3 in order to incorporate this fix filecoin-project/specs-actors#1334.
This is a mandatory release of Lotus that introduces the third post-liftoff upgrade to the Filecoin network. The network upgrade occurs at height 343200, before which time all nodes must have updated to this release (or later). The change that breaks consensus is an implementation of FIP-0009(https://github.com/filecoin-project/FIPs/blob/master/FIPS/fip-0009.md).
- Disable gas burning for window post messages (filecoin-project#5200)
- fix lock propose (filecoin-project#5197)
This is an optional Lotus release that introduces many performance improvements, bugfixes, and UX improvements.
- When waiting for deal commit messages, ignore unsuccessful messages (filecoin-project#5189)
- Bigger copy buffer size for stores (filecoin-project#5177)
- Print MinPieceSize when querying ask (filecoin-project#5178)
- Optimize miner info & sectors list loading (filecoin-project#5176)
- Allow miners to filter (un)verified deals (filecoin-project#5094)
- Fix curSealing out of MaxSealingSectors limit (filecoin-project#5166)
- Add mpool pending from / to filter (filecoin-project#5169)
- Add metrics for delayed blocks (filecoin-project#5171)
- Fix PushUntrusted publishing -- the message is local (filecoin-project#5173)
- Avoid potential hang in events API when starting event listener (filecoin-project#5159)
- Show data transfer ID in list-deals (filecoin-project#5150)
- Fix events API mutex locking (filecoin-project#5160)
- Message pool refactors (filecoin-project#5162)
- Fix lotus-shed cid output (filecoin-project#5072)
- Use FundManager to withdraw funds, add MarketWithdraw API (filecoin-project#5112)
- Add keygen outfile (filecoin-project#5118)
- Update sr2 stat aggregation (filecoin-project#5114)
- Fix miner control address lookup (filecoin-project#5119)
- Fix send with declared nonce 0 (filecoin-project#5111)
- Introduce memory watchdog; LOTUS_MAX_HEAP (filecoin-project#5101)
- Miner control address config for (pre)commits (filecoin-project#5103)
- Delete repeated call func (filecoin-project#5099)
- lotus-shed ledger show command (filecoin-project#5098)
- Log a message when there aren't enough peers for sync (filecoin-project#5105)
- Miner code cleanup (filecoin-project#5107)
This is an optional Lotus release that introduces various improvements to the mining logic and deal-making workflow, as well as several new UX features.
- Set lower feecap on PoSt messages with low balance (filecoin-project#4217)
- Add options to set BlockProfileRate and MutexProfileFraction (filecoin-project#4140)
- Shed/post find (filecoin-project#4355)
- tvx extract: make it work with secp messages.(filecoin-project#4583)
- update go from 1.14 to 1.15 (filecoin-project#4909)
- print multiple blocks from miner cid (filecoin-project#4767)
- Connection Gater support (filecoin-project#4849)
- just return storedask.NewStoredAsk to reduce unuseful code (filecoin-project#4902)
- add go main version (filecoin-project#4910)
- Use version0 when pre-sealing (filecoin-project#4911)
- optimize code UpgradeTapeHeight and go fmt (filecoin-project#4913)
- CLI to get network version (filecoin-project#4914)
- Improve error for ActorsVersionPredicate (filecoin-project#4915)
- upgrade to go-fil-markets 1.0.5 (filecoin-project#4916)
- bug:replace with func recordFailure (filecoin-project#4919)
- Remove unused key (filecoin-project#4924)
- change typeV7 make len (filecoin-project#4943)
- emit events for peer disconnections and act upon them in the blocksync tracker (filecoin-project#4754)
- Fix lotus bench error (filecoin-project#4305)
- Reduce badger ValueTreshold to 128 (filecoin-project#4629)
- Downgrade duplicate nonce logs to debug (filecoin-project#4933)
- readme update golang version from 1.14.7 to 1.15.5 (filecoin-project#4974)
- add data transfer logging (filecoin-project#4975)
- Remove all temp file generation for deals (filecoin-project#4929)
- fix get sector bug (filecoin-project#4976)
- fix nil pointer in StateSectorPreCommitInfo (filecoin-project#4082)
- Add logging on data-transfer to miner (filecoin-project#4980)
- bugfix: fixup devnet script (filecoin-project#4956)
- modify for unsafe (filecoin-project#4024)
- move testground/lotus-soup testplan from oni to lotus (filecoin-project#4727)
- Setup remainder msig signers when parsing genesis template (filecoin-project#4904)
- Update JSON RPC server to enforce a maximum request size (filecoin-project#4923)
- New SR-specific lotus-shed cmd (filecoin-project#4971)
- update index to sectorNumber (filecoin-project#4987)
- storagefsm: Fix expired ticket retry loop (filecoin-project#4876)
- add .sec scale to measurements; humanize for metric tags (filecoin-project#4989)
- Support seal proof type switching (filecoin-project#4873)
- fix log format (filecoin-project#4984)
- Format workerID as string (filecoin-project#4973)
- miner: Winning PoSt Warmup (filecoin-project#4824)
- Default StartDealParams's fast retrieval field to true over JSON (filecoin-project#4998)
- Fix actor not found in chain inspect-usage (filecoin-project#5010)
- storagefsm: Improve new deal sector logic (filecoin-project#5007)
- Configure simultaneous requests (filecoin-project#4996)
- miner: log winningPoSt duration separately (filecoin-project#5005)
- fix wallet dead lock (filecoin-project#5002)
- Update go-jsonrpc to v0.1.2 (filecoin-project#5015)
- markets - separate watching for pre-commit from prove-commit (filecoin-project#4945)
- storagefsm: Add missing planners (filecoin-project#5016)
- fix wallet delete address where address is default (filecoin-project#5019)
- worker: More robust remote checks (filecoin-project#5008)
- Add new booststrappers (filecoin-project#4007)
- add a tooling to make filecoin accounting a little easier (filecoin-project#5025)
- fix: start a new line in print miner-info to avoid ambiguous display (filecoin-project#5029)
- Print gas limit sum in mpool stat (filecoin-project#5035)
- Fix chainstore tipset leak (filecoin-project#5037)
- shed rpc: Allow calling with args (filecoin-project#5036)
- Make --gas-limit optional in mpool replace cli (filecoin-project#5059)
- client list-asks --by-ping (filecoin-project#5060)
- Ledger signature verification (filecoin-project#5068)
- Fix helptext for verified-deal default in client deal (filecoin-project#5074)
- worker: Support setting task types at runtime (filecoin-project#5023)
- Enable Callers tracing when GasTracing is enabled (filecoin-project#5080)
- Cancel transfer cancels storage deal (filecoin-project#5032)
- Sector check command (filecoin-project#5041)
- add commp-to-cid base64 decode (filecoin-project#5079)
- miner info cli improvements (filecoin-project#5083)
- miner: Add slow mode to proving check (filecoin-project#5086)
- Error out deals that are not activated by proposed deal start epoch (filecoin-project#5061)
This is a very small release of Lotus that fixes an issue users are experiencing when importing snapshots. There is no need to upgrade unless you experience an issue with creating a new datastore directory in the Lotus repo.
- fix blockstore directory not created automatically (filecoin-project#4922)
- WindowPoStScheduler.checkSectors() delete useless judgment (filecoin-project#4918)
This is a mandatory release of Lotus that introduces the second post-liftoff upgrade to the Filecoin network. The network upgrade occurs at height 265200, before which time all nodes must have updated to this release (or later). This release also bumps the required version of Go to 1.15.
The changes that break consensus are:
- Upgrading to sepcs-actors 2.3.2 (https://github.com/filecoin-project/specs-actors/releases/tag/v2.3.2)
- Introducing proofs v5.4.0 (https://github.com/filecoin-project/rust-fil-proofs/releases/tag/storage-proofs-v5.4.0), and switching between the proof types (filecoin-project#4873)
- Don't use terminated sectors for winning PoSt (filecoin-project#4770)
- Various small VM-level edge-case handling (filecoin-project#4783)
- Correction of the VM circulating supply calculation (filecoin-project#4862)
- Retuning gas costs (filecoin-project#4830)
- Avoid sending messages to the zero BLS address (filecoin-project#4888)
- delayed pubsub subscribe for messages topic (filecoin-project#3646)
- add chain base64 decode params (filecoin-project#4748)
- chore(dep): update bitswap to fix an initialization race that could panic (filecoin-project#4855)
- Chore/blockstore nits (filecoin-project#4813)
- Print Consensus Faults in miner info (filecoin-project#4853)
- Truncate genesis file before generating (filecoin-project#4851)
- miner: Winning PoSt Warmup (filecoin-project#4824)
- Fix init actor address map diffing (filecoin-project#4875)
- Bump API versions to 1.0.0 (filecoin-project#4884)
- Fix cid recording issue (filecoin-project#4874)
- Speed up worker key retrieval (filecoin-project#4885)
- Add error codes to worker return (filecoin-project#4890)
- Update go to 1.15.5 (filecoin-project#4896)
- Fix MaxSealingSectrosForDeals getting reset to 0 (filecoin-project#4879)
- add sanity check for maximum block size (filecoin-project#3171)
- Check (pre)commit receipt before other checks in failed states (filecoin-project#4712)
- fix badger double open on daemon --import-snapshot; chainstore lifecycle (filecoin-project#4872)
- Update to ipfs-blockstore 1.0.3 (filecoin-project#4897)
- break loop when found warm up sector (filecoin-project#4869)
- Tweak handling of bad beneficaries in DeleteActor (filecoin-project#4903)
- cap maximum number of messages per block in selection (filecoin-project#4905)
- Set Calico epoch (filecoin-project#4889)
This is an optional release of Lotus that upgrades Lotus dependencies, and includes many performance enhancements, bugfixes, and UX improvements.
- Refactored much of the miner code (filecoin-project#3618), improving its recovery from restarts and overall sector success rate
- Updated proofs to v5.3.0, which brings significant performance improvements
- Updated markets to v1.0.4, which reduces failures due to reorgs (filecoin-project#4730) and uses the newly refactored fund manager (filecoin-project#4736)
- polish: add Equals method to MinerInfo shim (filecoin-project#4604)
- Fix messagepool accounting (filecoin-project#4668)
- Prep for gas balancing (filecoin-project#4651)
- Reduce badger ValueThreshold to 128 (filecoin-project#4629)
- Config for default max gas fee (filecoin-project#4652)
- bootstrap: don't return early when one drand resolution fails (filecoin-project#4626)
- polish: add ClaimsChanged and DiffClaims method to power shim (filecoin-project#4628)
- Simplify chain event Called API (filecoin-project#4664)
- Cache deal states for most recent old/new tipset (filecoin-project#4623)
- Add miner available balance and power info to state miner info (filecoin-project#4618)
- Call GetHeaviestTipSet() only once when syncing (filecoin-project#4696)
- modify runtime gasUsed printf (filecoin-project#4704)
- Rename builtin actor generators (filecoin-project#4697)
- Move gas multiplier as property of pricelist (filecoin-project#4728)
- polish: add msig pendingtxn diffing and comp (filecoin-project#4719)
- Optional chain Bitswap (filecoin-project#4717)
- rewrite sync manager (filecoin-project#4599)
- async connect to bootstrappers (filecoin-project#4785)
- head change coalescer (filecoin-project#4688)
- move to native badger blockstore; leverage zero-copy View() to deserialize in-place (filecoin-project#4681)
- badger blockstore: minor improvements (filecoin-project#4811)
- Do not fail wallet delete because of pre-existing trashed key (filecoin-project#4589)
- Correctly delete the default wallet address (filecoin-project#4705)
- Reduce badger ValueTreshold to 128 (filecoin-project#4629)
- predicates: Fast StateGetActor wrapper (filecoin-project#4835)
- worker key should change when set sender found key not equal with the value on chain (filecoin-project#4595)
- extern/sector-storage: fix GPU usage overwrite bug (filecoin-project#4627)
- sectorstorage: Fix manager restart edge-case (filecoin-project#4645)
- storagefsm: Fix GetTicket loop when the sector is already precommitted (filecoin-project#4643)
- Debug flag to force running sealing scheduler (filecoin-project#4662)
- Fix worker reenabling, handle multiple restarts in worker (filecoin-project#4666)
- keep retrying the proof until we run out of sectors to skip (filecoin-project#4633)
- worker: Commands to pause/resume task processing (filecoin-project#4615)
- struct name incorrect (filecoin-project#4699)
- optimize code replace strings with constants (filecoin-project#4769)
- optimize pledge sector (filecoin-project#4765)
- Track sealing processes across lotus-miner restarts (filecoin-project#3618)
- Fix scheduler lockups after storage is freed (filecoin-project#4778)
- storage: Track worker hostnames with work (filecoin-project#4779)
- Expand sched-diag; Command to abort sealing calls (filecoin-project#4804)
- miner: Winning PoSt Warmup (filecoin-project#4824)
- docsgen: Support miner/worker (filecoin-project#4817)
- miner: Basic storage cleanup command (filecoin-project#4834)
- Flesh out data transfer features (filecoin-project#4572)
- Fix memory leaks in data transfer (filecoin-project#4619)
- Handle deal id changes in OnDealSectorCommitted (filecoin-project#4730)
- Refactor FundManager (filecoin-project#4736)
- refactor: integrate new FundManager (filecoin-project#4787)
- Fix race in paych manager when req context is cancelled (filecoin-project#4803)
- fix race in paych manager add funds (filecoin-project#4597)
- Fix panic in FundManager (filecoin-project#4808)
- Fix: dont crash on startup if funds migration fails (filecoin-project#4827)
- Make EarlyExpiration in sectors list less scary (filecoin-project#4600)
- Add commands to change the worker key (filecoin-project#4513)
- Expose ClientDealSize via CLI (filecoin-project#4569)
- client deal: Cache CommD when creating multiple deals (filecoin-project#4535)
- miner sectors list: flags for events/seal time (filecoin-project#4649)
- make IPFS online mode configurable (filecoin-project#4650)
- Add sync status to miner info command (filecoin-project#4669)
- Add a StateDecodeParams method (filecoin-project#4105)
- sched: Interactive RPC Shell (filecoin-project#4692)
- Add api for getting status given a code (filecoin-project#4210)
- Update lotus-stats with a richer cli (filecoin-project#4718)
- Use TSK passed to GasEstimateGasLimit (filecoin-project#4739)
- match data type for reward state api (filecoin-project#4745)
- Add
termination-estimate
to get an estimation for how much a termination penalty will be (filecoin-project#4617) - Restrict
ParseFIL
input length (filecoin-project#4780) - cmd sectors commitIDs len debug (filecoin-project#4786)
- Add client deal-stats CLI (filecoin-project#4788)
- Modify printf format (filecoin-project#4795)
- Updated msig inspect (filecoin-project#4533)
- Delete the duplicate output (filecoin-project#4819)
- miner: Storage list sectors command (filecoin-project#4831)
- drop a few logs down to debug (filecoin-project#4832)
- refactor: share code between CLI tests (filecoin-project#4598)
- Fix flaky TestCLIDealFlow (filecoin-project#4608)
- Fix flaky testMiningReal (filecoin-project#4609)
- Add election run-dummy command (filecoin-project#4498)
- Fix .gitmodules (filecoin-project#4713)
- fix metrics wiring.(filecoin-project#4691)
- shed: Util for creating ID CIDs (filecoin-project#4726)
- Run kumquat upgrade on devnets (filecoin-project#4734)
- Make pond work again (filecoin-project#4775)
- lotus-stats: fix influx flags (filecoin-project#4810)
- 2k sync BootstrapPeerThreshold (filecoin-project#4797)
- test for FundManager panic to ensure it is fixed (filecoin-project#4825)
- Stop mining at the end of tests (filecoin-project#4826)
- Make some logs quieter (filecoin-project#4709)
- update filecoin-ffi in go mod (filecoin-project#4584)
- Update FFI (filecoin-project#4613)
- feat: integrate new optional blst backend and verification optimizations from proofs (filecoin-project#4630)
- Use https for blst submodule (filecoin-project#4710)
- Update go-bitfield (filecoin-project#4756)
- Update Yamux (filecoin-project#4758)
- Update to latest go-bitfield (filecoin-project#4793)
- Update to latest go-address (filecoin-project#4798)
- update libp2p for stream interface changes (filecoin-project#4814)
This is a patch release of Lotus that builds on the fixes involving worker keys that was introduced in v1.1.1. Miners and node operators should update to this release as soon as possible in order to ensure their blocks are propagated and validated.
- Handle worker key changes correctly in runtime (filecoin-project#4579)
This is a patch release of Lotus that addresses some issues caused by when miners change their worker keys. Miners and node operators should update to this release as soon as possible, especially any miner who has changed their worker key recently.
- Miner finder for interactive client deal CLI (filecoin-project#4504)
- Disable blockstore bloom filter (filecoin-project#4512)
- Add api for getting status given a code (filecoin-project#4210)
- add batch api for push messages (filecoin-project#4236)
- add measure datastore wrapper around bench chain datastore (filecoin-project#4302)
- Look at block base fee for PCR (filecoin-project#4313)
- Add a shed util to determine % of power that has won a block (filecoin-project#4318)
- Shed/borked cmd (filecoin-project#4339)
- optimize mining code (filecoin-project#4379)
- heaviestTipSet reurning nil is a ok (filecoin-project#4523)
- Remove most v0 actor imports (filecoin-project#4383)
- Small chain export optimization (filecoin-project#4536)
- Add block list to pcr (filecoin-project#4314)
- Fix circ supply default in conformance (filecoin-project#4449)
- miner: fix init --create-worker-key (filecoin-project#4475)
- make push and addLocal atomic (filecoin-project#4500)
- add some methods that oni needs (filecoin-project#4501)
- MinerGetBaseInfo: if miner is not found in lookback, check current (filecoin-project#4508)
- Delete wallet from local wallet cache (filecoin-project#4526)
- Fix lotus-shed ledger list (filecoin-project#4521)
- Manage sectors by size instead of proof type (filecoin-project#4511)
- Feat/api request metrics wrapper (filecoin-project#4516)
- Fix chain sync stopping to sync (filecoin-project#4541)
- Use the correct lookback for the worker key when creating blocks (filecoin-project#4539)
- Cleanup test initialization and always validate VRFs in tests (filecoin-project#4538)
- Add a market WithdrawBalance CLI (filecoin-project#4524)
- wallet list: Add market balance and ID address flags (filecoin-project#4555)
- tvx simulate command; tvx extract --ignore-sanity-checks (filecoin-project#4554)
- lotus-lite: CLI tests for
lotus client
commands (filecoin-project#4497) - lite-mode - market storage and retrieval clients (filecoin-project#4263)
- Chore: update drand to v1.2.0 (filecoin-project#4420)
- Fix random test failures (filecoin-project#4559)
- Fix flaky TestTimedBSSimple (filecoin-project#4561)
- Make wallet market withdraw usable with miner addresses (filecoin-project#4556)
- Fix flaky TestChainExportImportFull (filecoin-project#4564)
- Use older randomness for the PoSt commit on specs-actors version 2 (filecoin-project#4563)
- shed: Commad to decode messages (filecoin-project#4565)
- Fetch worker key from correct block on sync (filecoin-project#4573)
This is a mandatory release that introduces the first post-liftoff upgrade to the Filecoin network. The changes that break consensus are an upgrade to specs-actors v2.2.0 at epoch 170000.
- Introduce Network version 6 (filecoin-project#4506)
- Update markets v1.0.0 (filecoin-project#4505)
- Add some extra logging to try and debug sync issues (filecoin-project#4486)
- Circle: Run tests for some subsystems separately (filecoin-project#4496)
- Add a terminate sectors command to lotus-shed (filecoin-project#4507)
- Add a comment to BlockMessages to address #4446 (filecoin-project#4491)
It's 1.0.0! This is an optional release of Lotus that introduces some UX improvements to the 0.10 series.
This very small release is largely cosmetic, and intended to flag the code that the Filecoin mainnet was launched with.
StateMsgGasCost
has been removed. The equivalent information can be gained by callingStateReplay
.- A
GasCost
field has been added to theInvocResult
type, meaning detailed gas costs will be returned when callingStateReplay
,StateCompute
, andStateCall
. - The behaviour of
StateReplay
in response to an empty tipset key has been changed. Instead of simply using the heaviest tipset (which is almost guaranteed to be an unsuccessful replay), we search now search the chain for the tipset that included the message, and replay the message in that tipset (we fail if no such tipset is found).
- Increase code coverage! (filecoin-project#4410)
- Mpool: Don't block node startup loading messages (filecoin-project#4411)
- Improve the UX of multisig approves (filecoin-project#4398)
- Use build.BlockDelaySecs for deal start buffer (filecoin-project#4415)
- Conformance: support multiple protocol versions (filecoin-project#4393)
- Ensure msig inspect cli works with lotus-lite (filecoin-project#4421)
- Add command to (slowly) prune lotus chain datastore (filecoin-project#3876)
- Add WalletVerify to lotus-gateway (filecoin-project#4373)
- Improve StateMsg APIs (filecoin-project#4429)
- Add endpoints needed by spacegap (filecoin-project#4426)
- Make audit balances capable of printing robust addresses (filecoin-project#4423)
- Custom filters for retrieval deals (filecoin-project#4424)
- Fix message list api (filecoin-project#4422)
- Replace bootstrap peers (filecoin-project#4447)
- Don't overwrite previously-configured maxPieceSize for a persisted ask (filecoin-project#4480)
- State: optimize state snapshot address cache (filecoin-project#4481)
This is an optional release of Lotus that updates markets to 0.9.1, which fixes an issue affecting deals that were mid-transfer when the node was upgraded to 0.9.0. This release also includes some tweaks to default gas values and minor performance improvements.
- Use updated stored ask API (filecoin-project#4384)
- tvx: trace puts to blockstore for inclusion in CAR. (filecoin-project#4278)
- Add propose remove (filecoin-project#4311)
- Update to 0.9.1 bugfix release (filecoin-project#4402)
- Update drand endpoints (filecoin-project#4125)
- fix: return true when deadlines changed (filecoin-project#4403)
- sync wait --watch (filecoin-project#4396)
- reduce garbage in blockstore (filecoin-project#4406)
- give the TimeCacheBS tests a bit more time (filecoin-project#4407)
- Improve gas defaults (filecoin-project#4408)
- Change default gas premium to for 10 block inclusion (filecoin-project#4222)
This is an optional release of Lotus that updates markets to 0.9.0, which adds the ability to restart data transfers. This release also introduces Ledger support, and various UX improvements.
- Test the tape upgrade (filecoin-project#4328)
- Adding in Ledger support (filecoin-project#4290)
- Improve the UX for lotus-miner sealing workers (filecoin-project#4329)
- Add a CLI tool for miner's to repay debt (filecoin-project#4319)
- Rename params_testnet to params_mainnet (filecoin-project#4336)
- Use seal-duration in calculating the earliest StartEpoch (filecoin-project#4337)
- Reject deals that are > 7 days in the future in the BasicDealFilter (filecoin-project#4173)
- Add an API endpoint to calculate the exact circulating supply (filecoin-project#4148)
- lotus-pcr: ignore all other market messages (filecoin-project#4341)
- Add message CID to InvocResult (filecoin-project#4382)
- types: Add CID fields to messages in json marshalers (filecoin-project#4338)
- fix(sync state): set state height to actual tipset height (filecoin-project#4347)
- Fix off by one tipset in searchBackForMsg (filecoin-project#4367)
- fix a panic on startup when we fail to load the tipset (filecoin-project#4376)
- Avoid having the same message CID show up in execution traces (filecoin-project#4350)
- feat(markets): update markets 0.9.0 and add data transfer restart (filecoin-project#4363)
This is a consensus-breaking hotfix that addresses an issue in specs-actors v2.0.3 that made it impossible to pledge new 32GiB sectors. The change in Lotus is to update to actors v2.1.0, behind the new network version 5.
- make pledge test pass with the race detector (filecoin-project#4291)
- fix a race in tipset cache usage (filecoin-project#4282)
- add an api for removing multisig signers (filecoin-project#4274)
- cli: Don't output errors to stdout (filecoin-project#4298)
- Fix panic in wallet export when key is not found (filecoin-project#4299)
- Dump the block validation cache whenever we perform an import (filecoin-project#4287)
- Fix two races (filecoin-project#4301)
- sync unmark-bad --all (filecoin-project#4296)
- decode parameters for multisig transactions in inspect (filecoin-project#4312)
- Chain is love (filecoin-project#4321)
- lotus-stats: optmize getting miner power (filecoin-project#4315)
- implement tape upgrade (filecoin-project#4322)
This release fixes an issue which may cause the actors v2 migration to compute the state incorrectly when more than one migration is running in parallel.
- Make concurrent actor migrations safe (filecoin-project#4293)
- Remote wallet backends (filecoin-project#3583)
- Track funds in FundMgr correctly in case of AddFunds failing (filecoin-project#4273)
- Partial lite-node mode (filecoin-project#4095)
- Fix potential infinite loop in GetBestMiningCandidate (filecoin-project#3444)
- sync wait: Handle processed message offset (filecoin-project#4253)
- Add some new endpoints for querying Msig info (filecoin-project#4250)
- Update markets v0.7.1 (filecoin-project#4254)
- Optimize SearchForMessage and GetReceipt (filecoin-project#4246)
- Use FIL instead of attoFIL in CLI more consistently (filecoin-project#4249)
- fix: clash between daemon --api flag and cli tests (filecoin-project#4241)
- add more info to chain sync lookback failure (filecoin-project#4245)
- Add message counts to inspect chain output (filecoin-project#4230)
This consensus-breaking release of Lotus upgrades the actors version to v2.0.0. This requires migrating actor state from v0 to v2. The changes that break consensus are:
- Introducing v2 actors and its migration (filecoin-project#3936)
- Runtime's Receiver() should only return ID addresses (filecoin-project#3589)
- Update miner eligibility checks for v2 actors (filecoin-project#4188)
- Add funds that have left FilReserve to circ supply (filecoin-project#4160)
- Set WinningPoStSectorSetLookback to finality post-v2 actors (filecoin-project#4190)
- fix: error when actor panics directly (filecoin-project#3697)
- Update go-bitfield (filecoin-project#4171)
- update the AMT implementation (filecoin-project#4194)
- Update to actors v0.2.1 (filecoin-project#4199)
- Paych: fix voucher amount verification (filecoin-project#3821)
- Cap market provider messages (filecoin-project#4141)
- Run fork function after cron for null block safety (filecoin-project#4114)
- use bitswap sessions when fetching messages, and cancel them (filecoin-project#4142)
- relax pubsub IPColocationFactorThreshold to 5 (filecoin-project#4183)
- Support addresses with mainnet prefixes (filecoin-project#4186)
- fix: make message signer nonce generation transactional (filecoin-project#4165)
- build: Env var to keep test address output (filecoin-project#4213)
- make vm.EnableGasTracing public (filecoin-project#4214)
- introduce separate state-tree versions (filecoin-project#4197)
- reject explicit "calls" at the upgrade height (filecoin-project#4231)
- return an illegal actor error when we see an unsupported actor version (filecoin-project#4232)
- Set head should unmark blocks as valid (https://gist.github.com/travisperson/3c7cddd77a33979a519ccef4e6515f20)
- Increased ExpectedSealDuration and and WaitDealsDelay (filecoin-project#3743)
- Miner backup/restore commands (filecoin-project#4133)
- lotus-miner: add more help text to storage / attach (filecoin-project#3961)
- Reject deals that are > 7 days in the future in the BasicDealFilter (filecoin-project#4173)
- feat(miner): add miner deadline diffing logic (filecoin-project#4178)
- Improve the UX for replacing messages (filecoin-project#4134)
- Add verified flag to interactive deal creation (filecoin-project#4145)
- Add command to (slowly) prune lotus chain datastore (filecoin-project#3876)
- Some helpers for verifreg work (filecoin-project#4124)
- Always use default 720h for setask duration and hide the duration param option (filecoin-project#4077)
- Convert ID addresses to key addresses before checking wallet (filecoin-project#4122)
- add a command to view block space utilization (filecoin-project#4176)
- allow usage inspection on a chain segment (filecoin-project#4177)
- Add mpool stats for base fee (filecoin-project#4170)
- Add verified status to api.DealInfo (filecoin-project#4153)
- Add a CLI command to set a miner's owner address (filecoin-project#4189)
- Lotus-pcr: add recover-miners command (filecoin-project#3714)
- MpoolPushUntrusted API for gateway (filecoin-project#3915)
- Test lotus-miner info all (filecoin-project#4166)
- chain export: Error with unfinished exports (filecoin-project#4179)
- add printf in TestWindowPost (filecoin-project#4043)
- add trace wdpost (filecoin-project#4020)
- Fix noncefix (filecoin-project#4202)
- Lotus-pcr: Limit the fee cap of messages we will process, refund gas fees for windowed post and storage deals (filecoin-project#4198)
- Fix pond (filecoin-project#4203)
- allow manual setting of noncefix fee cap (filecoin-project#4205)
- implement command to get execution traces of any message (filecoin-project#4200)
- conformance: minor driver refactors (filecoin-project#4211)
- lotus-pcr: ignore all other messages (filecoin-project#4218)
- lotus-pcr: zero refund (filecoin-project#4229)
The following contributors had 5 or more commits go into this release. We are grateful for every contribution!
Contributor | Commits | Lines ± |
---|---|---|
Stebalien | 84 | +3425/-2287 |
magik6k | 41 | +2121/-506 |
arajasek | 39 | +2467/-424 |
Kubuxu | 25 | +2344/-775 |
raulk | 21 | +287/-196 |
whyrusleeping | 13 | +727/-71 |
hsanjuan | 13 | +5886/-7956 |
dirkmc | 11 | +2634/-576 |
travisperson | 8 | +923/-202 |
ribasushi | 6 | +188/-128 |
zgfzgf | 5 | +21/-17 |
This optional release of Lotus introduces a new version of markets which switches to CBOR-map encodings, and allows datastore migrations. The release also introduces several improvements to the mining process, a few performance optimizations, and a battery of UX additions and enhancements.
- Markets 0.7.0 with updated data stores (filecoin-project#4089)
- Update ffi to code with blst fixes (filecoin-project#3998)
- Fix GetPower with no miner address (filecoin-project#4049)
- Refactor: Move nonce generation out of mpool (filecoin-project#3970)
- Implement caching syscalls for import-bench (filecoin-project#3888)
- Fetch tipset blocks in parallel (filecoin-project#4074)
- Optimize Tipset equals() (filecoin-project#4056)
- Make state transition in validation async (filecoin-project#3868)
- Add trace window post (filecoin-project#4020)
- Use abstract types for Dont recompute post on revert (filecoin-project#4022)
- Fix injectNulls logic in test miner (filecoin-project#4058)
- Fix potential panic in FinalizeSector (filecoin-project#4092)
- Don't recompute post on revert (filecoin-project#3924)
- Fix some failed precommit handling (filecoin-project#3445)
- Add --no-swap flag for worker (filecoin-project#4107)
- Allow some single-thread tasks to run in parallel with PC2/C2 (filecoin-project#4116)
- Add an envvar to set address network version (filecoin-project#4028)
- Add logging to chain export (filecoin-project#4030)
- Add JSON output to state compute (filecoin-project#4038)
- Wallet list CLI: Print balances/nonces (filecoin-project#4088)
- Added an option to show or not show sector info for
lotus-miner info
(filecoin-project#4003) - Add a command to import an ipld object into the chainstore (filecoin-project#3434)
- Improve the lotus-shed dealtracker (filecoin-project#4051)
- Docs review and re-organization (filecoin-project#3431)
- Fix wallet list (filecoin-project#4104)
- Add an endpoint to validate whether a string is a well-formed address (filecoin-project#4106)
- Add an option to set config path (filecoin-project#4103)
- Add printf in TestWindowPost (filecoin-project#4043)
- Improve miner sectors list UX (filecoin-project#4108)
- Move policy change to seal bench (filecoin-project#4032)
- Add back network power to stats (filecoin-project#4050)
- Conformance: Record and feed circulating supply (filecoin-project#4078)
- Snapshot import progress bar, add HTTP support (filecoin-project#4070)
- Add lotus shed util to validate a tipset (filecoin-project#4065)
- tvx: a test vector extraction and execution tool (filecoin-project#4064)
- Add new bootstrappers (filecoin-project#4007)
- Add Glif node to bootstrap peers (filecoin-project#4004)
- Add one more node located in China (filecoin-project#4041)
- Add ipfsmain bootstrapper (filecoin-project#4067)
This consensus-breaking release of Lotus introduces an upgrade to the network. The changes that break consensus are:
- Upgrading to specs-actors v0.9.11, which reduces WindowPoSt faults per FIP 0002 to reduce cost for honest miners with occasional faults (see filecoin-project/specs-actors#1181)
- Revisions to some cryptoeconomics and network params
This release also updates go-fil-markets to fix an incompatibility issue between v0.7.2 and earlier versions.
- Update spec actors to 0.9.11 (filecoin-project#4039)
- Update markets to 0.6.3 (filecoin-project#4013)
- Network upgrade (filecoin-project#4039)
- Fix AddSupportedProofTypes (filecoin-project#4033)
- Return an error when we fail to find a sector when checking sector expiration (filecoin-project#4026)
- Batch blockstore copies after block validation (filecoin-project#3980)
- Remove a misleading miner actor abstraction (filecoin-project#3977)
- Fix out-of-bounds when loading all sector infos (filecoin-project#3976)
- Fix break condition in the miner (filecoin-project#3953)
- Correct helptext around miners setting ask (filecoin-project#4009)
- Make sync wait nicer (filecoin-project#3991)
- Small adjustments following network upgradability changes (filecoin-project#3996)
- Add some more big pictures stats to stateroot stat (filecoin-project#3995)
- Add some actors policy setters for testing (filecoin-project#3975)
The following contributors had 5 or more commits go into this release. We are grateful for every contribution!
Contributor | Commits | Lines ± |
---|---|---|
arajasek | 66 | +3140/-1261 |
Stebalien | 64 | +3797/-3434 |
magik6k | 48 | +1892/-976 |
raulk | 40 | +2412/-1549 |
vyzo | 22 | +287/-196 |
alanshaw | 15 | +761/-146 |
whyrusleeping | 15 | +736/-52 |
hannahhoward | 14 | +1237/-837 |
anton | 6 | +32/-8 |
travisperson | 5 | +502/-6 |
Frank | 5 | +78/-39 |
Jennifer | 5 | +148/-41 |
This optional release of Lotus introduces a major refactor around how a Lotus node interacts with code from the specs-actors repo. We now use interfaces to read the state of actors, which is required to be able to reason about different versions of actors code at the same time.
Additionally, this release introduces various improvements to the sync process, as well as changes to better the overall UX experience.
- Network upgrade support (filecoin-project#3781)
- Upgrade markets to
v0.6.2
(filecoin-project#3974) - Validate chain sync response indices when fetching messages (filecoin-project#3939)
- Add height diff to sync wait (filecoin-project#3926)
- Replace Requires with Wants (filecoin-project#3898)
- Update state diffing for market actor (filecoin-project#3889)
- Parallel fetch for sync (filecoin-project#3887)
- Fix SectorState (filecoin-project#3881)
- Add basic deal stats api server for spacerace slingshot (filecoin-project#3963)
- When doing
sectors update-state
, show a list of existing states if user inputs an invalid one (filecoin-project#3944) - Fix
lotus-miner storage find
error (filecoin-project#3927) - Log shutdown method for lotus daemon and miner (filecoin-project#3925)
- Update build and setup instruction link (filecoin-project#3919)
- Add an option to hide removed sectors from
sectors list
output (filecoin-project#3903)
- Add init.State#Remove() for testing (filecoin-project#3971)
- lotus-shed: add consensus check command (filecoin-project#3933)
- Add keyinfo verify and jwt token command to lotus-shed (filecoin-project#3914)
- Fix conformance gen (filecoin-project#3892)
This optional release of Lotus introduces some critical fixes to the window PoSt process. It also upgrades some core dependencies, and introduces many improvements to the mining process, deal-making cycle, and overall User Experience.
- Correctly construct params for
SubmitWindowedPoSt
messages (filecoin-project#3909) - Skip sectors correctly for Window PoSt (filecoin-project#3839)
- Split window PoST submission into multiple messages (filecoin-project#3689)
- Improve journal coverage (filecoin-project#2455)
- Allow retrievals while sealing (filecoin-project#3778)
- Don't prune locally published messages (filecoin-project#3772)
- Add get-ask, set-ask retrieval commands (filecoin-project#3886)
- Consistently name winning and window post in logs (filecoin-project#3873))
- Add auto flag to mpool replace (filecoin-project#3752))
- Upgrade markets to
v0.6.1
(filecoin-project#3906) - Upgrade specs-actors to
v0.9.10
(filecoin-project#3846) - Upgrade badger (filecoin-project#3739)
This consensus-breaking release of Lotus is designed to test a network upgrade on the space race testnet. The changes that break consensus are:
- Upgrading the Drand network used from the test Drand network to the League of Entropy main drand network. This is the same Drand network that will be used in the Filecoin mainnet.
- Upgrading to specs-actors v0.9.8, which adds a new method to the Multisig actor.
- Fix IsAncestorOf (filecoin-project#3717)
- Update to specs-actors v0.9.8 (filecoin-project#3725)
- Increase chain throughput by 20% (filecoin-project#3732)
- Updare to go-libp2p-pubsub
master
(filecoin-project#3735) - Drand upgrade (filecoin-project#3670)
- Multisig API additions (filecoin-project#3590)
- Increase the number of times precommit2 is attempted before moving back to precommit1 (filecoin-project#3720)
- Relax mpool add strictness checks for local pushes (filecoin-project#3724)
- Fix devnets (filecoin-project#3712)
- Fix(chainwatch): compare prev miner with cur miner (filecoin-project#3715)
- CI: fix statediff build; make optional (filecoin-project#3729)
- Feat: Chaos abort (filecoin-project#3733)
The following contributors had commits go into this release. We are grateful for every contribution!
Contributor | Commits | Lines ± |
---|---|---|
arajasek | 28 | +1144/-239 |
Kubuxu | 19 | +452/-261 |
whyrusleeping | 13 | +456/-87 |
vyzo | 11 | +318/-20 |
raulk | 10 | +1289/-350 |
magik6k | 6 | +188/-55 |
dirkmc | 3 | +31/-8 |
alanshaw | 3 | +176/-37 |
Stebalien | 2 | +9/-12 |
lanzafame | 1 | +1/-1 |
frrist | 1 | +1/-1 |
mishmosh | 1 | +1/-1 |
nonsense | 1 | +1/-0 |
This release introduces some critical fixes to message selection and gas estimation logic. It also adds the ability for nodes to mark a certain tipset as checkpointed, as well as various minor improvements and bugfixes.
- Warn when optimal selection fails to pack a block and we fall back to random selection (filecoin-project#3708)
- Add basic command for printing gas performance of messages in the mpool (filecoin-project#3701)
- Adjust optimal selection to always try to fill blocks (filecoin-project#3685)
- Fix very minor bug in repub baseFeeLowerBound (filecoin-project#3663)
- Add an auto flag to mpool replace (filecoin-project#3676)
- Fix mpool optimal selection packing failure (filecoin-project#3698)
- Don't use latency as initital estimate for blocksync (filecoin-project#3648)
- Add niceSleep 1 second when drand errors (filecoin-project#3664)
- Fix isChainNearSync check in block validator (filecoin-project#3650)
- Add peer to peer manager before fetching the tipset (filecoin-project#3667)
- Add StageFetchingMessages to sync status (filecoin-project#3668)
- Pass tipset through upgrade logic (filecoin-project#3673)
- Allow nodes to mark tipsets as checkpointed (filecoin-project#3680)
- Remove hard-coded late-fee in window PoSt (filecoin-project#3702)
- Gas: Fix median calc (filecoin-project#3686)
- Storage manager: bail out with an error if unsealed cid is undefined (filecoin-project#3655)
- Storage: return true from Sealer.ReadPiece() on success (filecoin-project#3657)
- Resolve lotus, test-vectors, statediff dependency cycle (filecoin-project#3688)
- Paych: add docs on how to use paych status (filecoin-project#3690)
- Initial CODEOWNERS (filecoin-project#3691)
This optional release introduces a minor improvement to the sync process, ensuring nodes don't fall behind and then resync.
- Update
test-vectors
(filecoin-project#3645) - Revert "only subscribe to pubsub topics once we are synced" (filecoin-project#3643)
This consensus-breaking release of Lotus is designed to test a network upgrade on the space race testnet. The changes that break consensus are:
- Tweaking of some cryptoecon parameters in specs-actors 0.9.7 (https://github.com/filecoin-project/specs-actors/releases/tag/v0.9.7)
- Rebalancing FIL distribution to make testnet FIL scarce, which prevents base fee spikes and sets better expectations for mainnet
This release also introduces many improvements to Lotus! Among them are a new version of go-fil-markets that supports non-blocking retrieval, various spam reduction measures in the messagepool and p2p logic, and UX improvements to payment channels, dealmaking, and state inspection.
- Implement faucet funds reallocation logic (filecoin-project#3632)
- Network upgrade: Upgrade to correct fork threshold (filecoin-project#3628)
- Update to specs 0.9.7 and markets 0.6.0 (filecoin-project#3627)
- Network upgrade: Perform base fee tamping (filecoin-project#3623)
- Chain events: if cache best() is nil, return chain head (filecoin-project#3611)
- Update to specs actors v0.9.6 (filecoin-project#3603)
- Temporarily allow negative chains (filecoin-project#3625)
- Improve publish/republish logic (filecoin-project#3592)
- Fix selection bug; priority messages were not included if other chains were negative (filecoin-project#3580)
- Add defensive check for minimum GasFeeCap for inclusion within the next 20 blocks (filecoin-project#3579)
- Add additional info about gas premium (filecoin-project#3578)
- Fix GasPremium capping logic (filecoin-project#3552)
- Get available funds by address or by from/to (filecoin-project#3547)
- Create
lotus paych status
command (filecoin-project#3523) - Rename CLI command from "paych get" to "paych add-funds" (filecoin-project#3520)
- Only subscribe to pubsub topics once we are synced (filecoin-project#3602)
- Reduce mpool add failure log spam (filecoin-project#3562)
- Republish messages even if the chains have negative performance(filecoin-project#3557)
- Adjust gossipsub gossip factor (filecoin-project#3556)
- Integrate pubsub Random Early Drop (filecoin-project#3518)
- Fix panic in OnDealExpiredSlashed (filecoin-project#3553)
- Robustify state manager against holes in actor method numbers (filecoin-project#3538)
- VM: Fix an error message (filecoin-project#3608)
- Documentation: Batch replacement,update lotus-storage-miner to lotus-miner (filecoin-project#3571)
- CLI: Robust actor lookup (filecoin-project#3535)
- Add agent flag to net peers (filecoin-project#3534)
- Add watch option to storage-deals list (filecoin-project#3527)
- Decommission chain-validation (filecoin-project#3606)
- Metrics: add expected height metric (filecoin-project#3586)
- PCR: Use current tipset during refund (filecoin-project#3570)
- Lotus-shed: Add math command (filecoin-project#3568)
- PCR: Add tipset aggergation (filecoin-project#3565 Fix broken paych tests (filecoin-project#3551)
- Make chain export ~1000x times faster (filecoin-project#3533)
- Chainwatch: Stop SyncIncomingBlocks from leaking into chainwatch processing; No panics during processing (filecoin-project#3526)
- Conformance: various changes (filecoin-project#3521)
This patch includes a crucial fix to the message pool selection logic, strongly disfavouring messages that might cause a miner penalty.
- Fix calculation of GasReward in messagepool (filecoin-project#3528)
This patch includes a hotfix to the GasEstimateFeeCap
method, capping the estimated fee to a reasonable level by default.
- Added target height to sync wait (filecoin-project#3502)
- Disable codecov annotations (filecoin-project#3514)
- Cap fees to reasonable level by default (filecoin-project#3516)
- Add APIs and command to inspect bandwidth usage (filecoin-project#3497)
- Track expected nonce in mpool, ignore messages with large nonce gaps (filecoin-project#3450)
This patch includes some bugfixes to the sector sealing process, and updates go-fil-markets. It also improves the performance of blocksync, adds a method to export chain state trees, and improves chainwatch.
- Upgrade markets to v0.5.9 (filecoin-project#3496)
- Improve blocksync to load fewer messages: (filecoin-project#3494)
- Fix a panic in the ffi-wrapper's
ReadPiece
(https://github.com/filecoin-project/lotus/pull/3492/files) - Fix a deadlock in the sealing scheduler (filecoin-project#3489)
- Add test vectors for tipset tests (https://github.com/filecoin-project/lotus/pull/3485/files)
- Improve the advance-block debug command (filecoin-project#3476)
- Add toggle for message processing to Lotus PCR (filecoin-project#3470)
- Allow exporting recent chain state trees (filecoin-project#3463)
- Remove height from chain rand (filecoin-project#3458)
- Disable GC on chain badger datastore (filecoin-project#3457)
- Account for
GasPremium
inGasEstimateFeeCap
(filecoin-project#3456) - Update go-libp2p-pubsub to
master
(filecoin-project#3455) - Chainwatch improvements (filecoin-project#3442)
This patch release includes some bugfixes and enhancements to the sector lifecycle and message pool logic.
- Rebuild unsealed infos on miner restart (filecoin-project#3401)
- CLI to attach storage paths to workers (filecoin-project#3405)
- Do not select negative performing message chains for inclusion (filecoin-project#3392)
- Remove a redundant error-check (filecoin-project#3421)
- Correctly move unsealed sectors in
FinalizeSectors
(filecoin-project#3424) - Improve worker selection logic (filecoin-project#3425)
- Don't use context to close bitswap (filecoin-project#3430)
- Correctly estimate gas premium when there is only one message on chain (filecoin-project#3428)
Hotfix release that fixes a panic in the sealing scheduler (filecoin-project#3389).
This patch release introduces a large number of improvements to the sealing process. It also updates go-fil-markets to version 0.5.8, and go-libp2p-pubsub to v0.3.5.
- Upgrades markets to v0.5.8 (filecoin-project#3384)
- Upgrades go-libp2p-pubsub to v0.3.5 (filecoin-project#3305)
-
The following improvements were introduced in filecoin-project#3350.
- Allow
lotus-miner sectors remove
to remove a sector in any state. - Create a separate state in the storage FSM dedicated to submitting the Commit message.
- Recovery for when the Deal IDs of deals in a sector get changed in a reorg.
- Auto-retry sending Precommit and Commit messages if they run out of gas
- Auto-retry sector remove tasks when they fail
- Compact worker windows, and allow their tasks to be executed in any order
- Allow
-
Don't simply skip PoSt for bad sectors (filecoin-project#3323)
- Spam Protection: Track required funds for pending messages (filecoin-project#3313)
- Add more power and reward metrics (filecoin-project#3367)
- Fix raciness in sector deal table (filecoin-project#3275)
- Parallelize miner processing (filecoin-project#3380)
- Accept Lotus API and token (filecoin-project#3337)
A patch release, containing a few nice bugfixes and improvements:
- Fix parsing of peer ID in
lotus-miner actor set-peer-id
(@whyrusleeping) - Update dependencies, fixing several bugs (@Stebalien)
- Fix remaining linter warnings (@Stebalien)
- Use safe string truncation (@Ingar)
- Allow tweaking of blocksync message window size (@whyrusleeping)
- Add some additional gas stats to metrics (@Kubuxu)
- Fix an edge case bug in message selection, add many tests (@vyzo)
Yet another hotfix release. A lesson for readers, having people who have been awake for 12+ hours review your hotfix PR is not a good idea. Find someone who has enough slept recently enough to give you good code review, otherwise you'll end up quickly bumping versions again.
- Fixed a bug in the mempool that was introduced in v0.5.2
This is a hotfix release.
- Fix message selection to not include messages that are invalid for block inclusion.
- Improve SelectMessage handling of the case where the message pools tipset differs from our mining base.
The Space Race release! This release contains the genesis car file and bootstrap peers for the space race network.
Additionally, we included two small fixes to genesis creation:
- Randomize ticket value in genesis generation
- Correctly set t099 (burnt funds actor) to have valid account actor state
This version of Lotus will be used for the incentivized testnet Space Race competition, and can be considered mainnet-ready code. It includes some protocol changes, upgrades of core dependencies, and various bugfixes and UX/performance improvements.
Among the highlights included in this release are:
- Gas changes: We implemented EIP-1559 and introduced real gas values.
- Deal-making: We now support "Committed Capacity" sectors, "fast-retrieval" deals, and the packing of multiple deals into a single sector.
- Renamed features: We renamed some of the binaries, environment variables, and default paths associated with a Lotus node.
We made some significant changes to the mechanics of gas in this release.
We implemented something similar to
Ethereum's EIP-1559.
The Message
structure had three changes:
- The
GasPrice
field has been removed - A new
GasFeeCap
field has been added, which controls the maximum cost the sender incurs for the message - A new
GasPremium
field has been added, which controls the reward a miner earns for including the message
A sender will never be charged more than GasFeeCap * GasLimit
.
A miner will typically earn GasPremium * GasLimit
as a reward.
The Blockheader
structure has one new field, called ParentBaseFee
.
Informally speaking,the ParentBaseFee
is increased when blocks are densely packed with messages, and decreased otherwise.
The ParentBaseFee
is used when calculating how much a sender burns when executing a message. Burning simply refers to sending attoFIL to a dedicated, unreachable account.
A message causes ParentBaseFee * GasUsed
attoFIL to be burnt.
This release also includes our first "real" gas costs for primitive operations. The costs were designed to account for both the time that message execution takes, as well as the space a message adds to the state tree.
There are three key changes to the deal-making process.
Miners can now pledge "Committed Capacity" (CC) sectors, which are explicitly stated as containing junk data, and must not include any deals. Miners can do this to increase their storage power, and win block rewards from this pledged storage.
They can mark these sectors as "upgradable" with lotus-miner sectors mark-for-upgrade
.
If the miner receives and accepts one or more storage deals, the sector that includes
those deals will replace the CC sector. This is intended to maximize the amount of useful
storage on the Filecoin network.
Clients can now include a fast-retrieval
flag when proposing deals with storage miners.
If set to true, the miner will include an extra copy of the deal data. This
data can be quickly served in a retrieval deal, since it will not need to be unsealed.
Miners can now pack multiple deals into a single sector, so long as all the deals fit into the sector capacity. This should increase the packing efficiency of miners.
To improve the user experience, we updated several names to mainatin standard prefixing, and to better reflect the meaning of the features being referenced.
In particular, the Lotus miner binary is now called lotus-miner
, the default
path for miner data is now ~/.lotusminer
, and the environment variable
that sets the path for miner data is now $LOTUS_MINER_PATH
. A full list of renamed
features can be found here.
- Upgrades markets to v0.5.6 (filecoin-project#3058)
- Upgrades specs-actors to v0.9.3 (filecoin-project#3151)
- Introduces gas values, replacing placeholders (filecoin-project#2343)
- Implements EIP-1559, introducing a network base fee, message gas fee cap, and message gas fee premium (filecoin-project#2874)
- Implements Poisson Sortition for elections (filecoin-project#2084)
- Introduces "Committed Capacity" sectors (filecoin-project#2220)
- Introduces "fast-retrieval" flag for deals (filecoin-project#2323
- Supports packing multiple deals into one sector (filecoin-project/storage-fsm#38)
- Optimized message pool selection logic (filecoin-project#2838)
- Window-based scheduling of sealing tasks (filecoin-project/sector-storage#67)
- Faster window PoSt (https://github.com/filecoin-project/lotus/pull/2209/files)
- Refactors the payment channel manager (filecoin-project#2640)
- Refactors blocksync (https://github.com/filecoin-project/lotus/pull/2715/files)
- Provide status updates for data-transfer (filecoin-project#3162, filecoin-project#3191)
- Miners can customise asks (filecoin-project#2046)
- Miners can toggle auto-acceptance of deals (filecoin-project#1994)
- Miners can maintain a blocklist of piece CIDs (filecoin-project#2069)
The following contributors had 10 or more commits go into this release. We are grateful for every contribution!
Contributor | Commits | Lines ± |
---|---|---|
magik6k | 361 | +13197/-6136 |
Kubuxu | 227 | +5670/-2587 |
arajasek | 120 | +2916/-1264 |
whyrusleeping | 112 | +3979/-1089 |
vyzo | 99 | +3343/-1305 |
dirkmc | 68 | +8732/-3621 |
laser | 45 | +1489/-501 |
hannahhoward | 43 | +2654/-990 |
frrist | 37 | +6630/-4338 |
schomatis | 28 | +3016/-1368 |
placer14 | 27 | +824/-350 |
raulk | 25 | +28718/-29849 |
mrsmkl | 22 | +560/-368 |
travisperson | 18 | +1354/-314 |
nonsense | 16 | +2956/-2842 |
ingar | 13 | +331/-123 |
daviddias | 11 | +311/-11 |
Stebalien | 11 | +1204/-980 |
RobQuistNL | 10 | +69/-74 |
We are very excited to release lotus 0.1.0. This is our testnet release. To install lotus and join the testnet, please visit lotu.sh. Please file bug reports as issues.
A huge thank you to all contributors for this testnet release!