CHANGELOG.md

Lotus changelog

1.1.2 / 2020-10-24

This is a patch release of Lotus that builds on the fixes involving worker keys that was introduced in v1.1.1. Miners and node operators should update to this release as soon as possible in order to ensure their blocks are propagated and validated.

Changes

• Handle worker key changes correctly in runtime (filecoin-project#4579)

1.1.1 / 2020-10-24

This is a patch release of Lotus that addresses some issues caused by when miners change their worker keys. Miners and node operators should update to this release as soon as possible, especially any miner who has changed their worker key recently.

Changes

• Miner finder for interactive client deal CLI (filecoin-project#4504)
• Disable blockstore bloom filter (filecoin-project#4512)
• Add api for getting status given a code (filecoin-project#4210)
• add batch api for push messages (filecoin-project#4236)
• add measure datastore wrapper around bench chain datastore (filecoin-project#4302)
• Look at block base fee for PCR (filecoin-project#4313)
• Add a shed util to determine % of power that has won a block (filecoin-project#4318)
• Shed/borked cmd (filecoin-project#4339)
• optimize mining code (filecoin-project#4379)
• heaviestTipSet reurning nil is a ok (filecoin-project#4523)
• Remove most v0 actor imports (filecoin-project#4383)
• Small chain export optimization (filecoin-project#4536)
• Add block list to pcr (filecoin-project#4314)
• Fix circ supply default in conformance (filecoin-project#4449)
• miner: fix init --create-worker-key (filecoin-project#4475)
• make push and addLocal atomic (filecoin-project#4500)
• add some methods that oni needs (filecoin-project#4501)
• MinerGetBaseInfo: if miner is not found in lookback, check current (filecoin-project#4508)
• Delete wallet from local wallet cache (filecoin-project#4526)
• Fix lotus-shed ledger list (filecoin-project#4521)
• Manage sectors by size instead of proof type (filecoin-project#4511)
• Feat/api request metrics wrapper (filecoin-project#4516)
• Fix chain sync stopping to sync (filecoin-project#4541)
• Use the correct lookback for the worker key when creating blocks (filecoin-project#4539)
• Cleanup test initialization and always validate VRFs in tests (filecoin-project#4538)
• Add a market WithdrawBalance CLI (filecoin-project#4524)
• wallet list: Add market balance and ID address flags (filecoin-project#4555)
• tvx simulate command; tvx extract --ignore-sanity-checks (filecoin-project#4554)
• lotus-lite: CLI tests for lotus client commands (filecoin-project#4497)
• lite-mode - market storage and retrieval clients (filecoin-project#4263)
• Chore: update drand to v1.2.0 (filecoin-project#4420)
• Fix random test failures (filecoin-project#4559)
• Fix flaky TestTimedBSSimple (filecoin-project#4561)
• Make wallet market withdraw usable with miner addresses (filecoin-project#4556)
• Fix flaky TestChainExportImportFull (filecoin-project#4564)
• Use older randomness for the PoSt commit on specs-actors version 2 (filecoin-project#4563)
• shed: Commad to decode messages (filecoin-project#4565)
• Fetch worker key from correct block on sync (filecoin-project#4573)

1.1.0 / 2020-10-20

This is a mandatory release that introduces the first post-liftoff upgrade to the Filecoin network. The changes that break consensus are an upgrade to specs-actors v2.2.0 at epoch 170000.

Changes

• Introduce Network version 6 (filecoin-project#4506)
• Update markets v1.0.0 (filecoin-project#4505)
• Add some extra logging to try and debug sync issues (filecoin-project#4486)
• Circle: Run tests for some subsystems separately (filecoin-project#4496)
• Add a terminate sectors command to lotus-shed (filecoin-project#4507)
• Add a comment to BlockMessages to address #4446 (filecoin-project#4491)

1.0.0 / 2020-10-19

It's 1.0.0! This is an optional release of Lotus that introduces some UX improvements to the 0.10 series.

This very small release is largely cosmetic, and intended to flag the code that the Filecoin mainnet was launched with.

API changes

• StateMsgGasCost has been removed. The equivalent information can be gained by calling StateReplay.
• A GasCost field has been added to the InvocResult type, meaning detailed gas costs will be returned when calling StateReplay, StateCompute, and StateCall.
• The behaviour of StateReplay in response to an empty tipset key has been changed. Instead of simply using the heaviest tipset (which is almost guaranteed to be an unsuccessful replay), we search now search the chain for the tipset that included the message, and replay the message in that tipset (we fail if no such tipset is found).

Changes

• Increase code coverage! (filecoin-project#4410)
• Mpool: Don't block node startup loading messages (filecoin-project#4411)
• Improve the UX of multisig approves (filecoin-project#4398)
• Use build.BlockDelaySecs for deal start buffer (filecoin-project#4415)
• Conformance: support multiple protocol versions (filecoin-project#4393)
• Ensure msig inspect cli works with lotus-lite (filecoin-project#4421)
• Add command to (slowly) prune lotus chain datastore (filecoin-project#3876)
• Add WalletVerify to lotus-gateway (filecoin-project#4373)
• Improve StateMsg APIs (filecoin-project#4429)
• Add endpoints needed by spacegap (filecoin-project#4426)
• Make audit balances capable of printing robust addresses (filecoin-project#4423)
• Custom filters for retrieval deals (filecoin-project#4424)
• Fix message list api (filecoin-project#4422)
• Replace bootstrap peers (filecoin-project#4447)
• Don't overwrite previously-configured maxPieceSize for a persisted ask (filecoin-project#4480)
• State: optimize state snapshot address cache (filecoin-project#4481)

0.10.2 / 2020-10-14

This is an optional release of Lotus that updates markets to 0.9.1, which fixes an issue affecting deals that were mid-transfer when the node was upgraded to 0.9.0. This release also includes some tweaks to default gas values and minor performance improvements.

Changes

• Use updated stored ask API (filecoin-project#4384)
• tvx: trace puts to blockstore for inclusion in CAR. (filecoin-project#4278)
• Add propose remove (filecoin-project#4311)
• Update to 0.9.1 bugfix release (filecoin-project#4402)
• Update drand endpoints (filecoin-project#4125)
• fix: return true when deadlines changed (filecoin-project#4403)
• sync wait --watch (filecoin-project#4396)
• reduce garbage in blockstore (filecoin-project#4406)
• give the TimeCacheBS tests a bit more time (filecoin-project#4407)
• Improve gas defaults (filecoin-project#4408)
• Change default gas premium to for 10 block inclusion (filecoin-project#4222)

0.10.1 / 2020-10-14

This is an optional release of Lotus that updates markets to 0.9.0, which adds the ability to restart data transfers. This release also introduces Ledger support, and various UX improvements.

Changes

• Test the tape upgrade (filecoin-project#4328)
• Adding in Ledger support (filecoin-project#4290)
• Improve the UX for lotus-miner sealing workers (filecoin-project#4329)
• Add a CLI tool for miner's to repay debt (filecoin-project#4319)
• Rename params_testnet to params_mainnet (filecoin-project#4336)
• Use seal-duration in calculating the earliest StartEpoch (filecoin-project#4337)
• Reject deals that are > 7 days in the future in the BasicDealFilter (filecoin-project#4173)
• Add an API endpoint to calculate the exact circulating supply (filecoin-project#4148)
• lotus-pcr: ignore all other market messages (filecoin-project#4341)
• Add message CID to InvocResult (filecoin-project#4382)
• types: Add CID fields to messages in json marshalers (filecoin-project#4338)
• fix(sync state): set state height to actual tipset height (filecoin-project#4347)
• Fix off by one tipset in searchBackForMsg (filecoin-project#4367)
• fix a panic on startup when we fail to load the tipset (filecoin-project#4376)
• Avoid having the same message CID show up in execution traces (filecoin-project#4350)
• feat(markets): update markets 0.9.0 and add data transfer restart (filecoin-project#4363)

0.10.0 / 2020-10-12

This is a consensus-breaking hotfix that addresses an issue in specs-actors v2.0.3 that made it impossible to pledge new 32GiB sectors. The change in Lotus is to update to actors v2.1.0, behind the new network version 5.

Changes

• make pledge test pass with the race detector (filecoin-project#4291)
• fix a race in tipset cache usage (filecoin-project#4282)
• add an api for removing multisig signers (filecoin-project#4274)
• cli: Don't output errors to stdout (filecoin-project#4298)
• Fix panic in wallet export when key is not found (filecoin-project#4299)
• Dump the block validation cache whenever we perform an import (filecoin-project#4287)
• Fix two races (filecoin-project#4301)
• sync unmark-bad --all (filecoin-project#4296)
• decode parameters for multisig transactions in inspect (filecoin-project#4312)
• Chain is love (filecoin-project#4321)
• lotus-stats: optmize getting miner power (filecoin-project#4315)
• implement tape upgrade (filecoin-project#4322)

0.9.1 / 2020-10-10

This release fixes an issue which may cause the actors v2 migration to compute the state incorrectly when more than one migration is running in parallel.

Changes

• Make concurrent actor migrations safe (filecoin-project#4293)
• Remote wallet backends (filecoin-project#3583)
• Track funds in FundMgr correctly in case of AddFunds failing (filecoin-project#4273)
• Partial lite-node mode (filecoin-project#4095)
• Fix potential infinite loop in GetBestMiningCandidate (filecoin-project#3444)
• sync wait: Handle processed message offset (filecoin-project#4253)
• Add some new endpoints for querying Msig info (filecoin-project#4250)
• Update markets v0.7.1 (filecoin-project#4254)
• Optimize SearchForMessage and GetReceipt (filecoin-project#4246)
• Use FIL instead of attoFIL in CLI more consistently (filecoin-project#4249)
• fix: clash between daemon --api flag and cli tests (filecoin-project#4241)
• add more info to chain sync lookback failure (filecoin-project#4245)
• Add message counts to inspect chain output (filecoin-project#4230)

0.9.0 / 2020-10-07

This consensus-breaking release of Lotus upgrades the actors version to v2.0.0. This requires migrating actor state from v0 to v2. The changes that break consensus are:

• Introducing v2 actors and its migration (filecoin-project#3936)
• Runtime's Receiver() should only return ID addresses (filecoin-project#3589)
• Update miner eligibility checks for v2 actors (filecoin-project#4188)
• Add funds that have left FilReserve to circ supply (filecoin-project#4160)
• Set WinningPoStSectorSetLookback to finality post-v2 actors (filecoin-project#4190)
• fix: error when actor panics directly (filecoin-project#3697)

Changes

Dependencies

• Update go-bitfield (filecoin-project#4171)
• update the AMT implementation (filecoin-project#4194)
• Update to actors v0.2.1 (filecoin-project#4199)

Core Lotus

• Paych: fix voucher amount verification (filecoin-project#3821)
• Cap market provider messages (filecoin-project#4141)
• Run fork function after cron for null block safety (filecoin-project#4114)
• use bitswap sessions when fetching messages, and cancel them (filecoin-project#4142)
• relax pubsub IPColocationFactorThreshold to 5 (filecoin-project#4183)
• Support addresses with mainnet prefixes (filecoin-project#4186)
• fix: make message signer nonce generation transactional (filecoin-project#4165)
• build: Env var to keep test address output (filecoin-project#4213)
• make vm.EnableGasTracing public (filecoin-project#4214)
• introduce separate state-tree versions (filecoin-project#4197)
• reject explicit "calls" at the upgrade height (filecoin-project#4231)
• return an illegal actor error when we see an unsupported actor version (filecoin-project#4232)
• Set head should unmark blocks as valid (https://gist.github.com/travisperson/3c7cddd77a33979a519ccef4e6515f20)

Mining

• Increased ExpectedSealDuration and and WaitDealsDelay (filecoin-project#3743)
• Miner backup/restore commands (filecoin-project#4133)
• lotus-miner: add more help text to storage / attach (filecoin-project#3961)
• Reject deals that are > 7 days in the future in the BasicDealFilter (filecoin-project#4173)
• feat(miner): add miner deadline diffing logic (filecoin-project#4178)

UX

• Improve the UX for replacing messages (filecoin-project#4134)
• Add verified flag to interactive deal creation (filecoin-project#4145)
• Add command to (slowly) prune lotus chain datastore (filecoin-project#3876)
• Some helpers for verifreg work (filecoin-project#4124)
• Always use default 720h for setask duration and hide the duration param option (filecoin-project#4077)
• Convert ID addresses to key addresses before checking wallet (filecoin-project#4122)
• add a command to view block space utilization (filecoin-project#4176)
• allow usage inspection on a chain segment (filecoin-project#4177)
• Add mpool stats for base fee (filecoin-project#4170)
• Add verified status to api.DealInfo (filecoin-project#4153)
• Add a CLI command to set a miner's owner address (filecoin-project#4189)

Tooling and validation

• Lotus-pcr: add recover-miners command (filecoin-project#3714)
• MpoolPushUntrusted API for gateway (filecoin-project#3915)
• Test lotus-miner info all (filecoin-project#4166)
• chain export: Error with unfinished exports (filecoin-project#4179)
• add printf in TestWindowPost (filecoin-project#4043)
• add trace wdpost (filecoin-project#4020)
• Fix noncefix (filecoin-project#4202)
• Lotus-pcr: Limit the fee cap of messages we will process, refund gas fees for windowed post and storage deals (filecoin-project#4198)
• Fix pond (filecoin-project#4203)
• allow manual setting of noncefix fee cap (filecoin-project#4205)
• implement command to get execution traces of any message (filecoin-project#4200)
• conformance: minor driver refactors (filecoin-project#4211)
• lotus-pcr: ignore all other messages (filecoin-project#4218)
• lotus-pcr: zero refund (filecoin-project#4229)

Contributors

The following contributors had 5 or more commits go into this release. We are grateful for every contribution!

Contributor	Commits	Lines ±
Stebalien	84	+3425/-2287
magik6k	41	+2121/-506
arajasek	39	+2467/-424
Kubuxu	25	+2344/-775
raulk	21	+287/-196
whyrusleeping	13	+727/-71
hsanjuan	13	+5886/-7956
dirkmc	11	+2634/-576
travisperson	8	+923/-202
ribasushi	6	+188/-128
zgfzgf	5	+21/-17

0.8.1 / 2020-09-30

This optional release of Lotus introduces a new version of markets which switches to CBOR-map encodings, and allows datastore migrations. The release also introduces several improvements to the mining process, a few performance optimizations, and a battery of UX additions and enhancements.

Changes

Dependencies

• Markets 0.7.0 with updated data stores (filecoin-project#4089)
• Update ffi to code with blst fixes (filecoin-project#3998)

Core Lotus

• Fix GetPower with no miner address (filecoin-project#4049)
• Refactor: Move nonce generation out of mpool (filecoin-project#3970)

Performance

• Implement caching syscalls for import-bench (filecoin-project#3888)
• Fetch tipset blocks in parallel (filecoin-project#4074)
• Optimize Tipset equals() (filecoin-project#4056)
• Make state transition in validation async (filecoin-project#3868)

Mining

• Add trace window post (filecoin-project#4020)
• Use abstract types for Dont recompute post on revert (filecoin-project#4022)
• Fix injectNulls logic in test miner (filecoin-project#4058)
• Fix potential panic in FinalizeSector (filecoin-project#4092)
• Don't recompute post on revert (filecoin-project#3924)
• Fix some failed precommit handling (filecoin-project#3445)
• Add --no-swap flag for worker (filecoin-project#4107)
• Allow some single-thread tasks to run in parallel with PC2/C2 (filecoin-project#4116)

UX

• Add an envvar to set address network version (filecoin-project#4028)
• Add logging to chain export (filecoin-project#4030)
• Add JSON output to state compute (filecoin-project#4038)
• Wallet list CLI: Print balances/nonces (filecoin-project#4088)
• Added an option to show or not show sector info for lotus-miner info (filecoin-project#4003)
• Add a command to import an ipld object into the chainstore (filecoin-project#3434)
• Improve the lotus-shed dealtracker (filecoin-project#4051)
• Docs review and re-organization (filecoin-project#3431)
• Fix wallet list (filecoin-project#4104)
• Add an endpoint to validate whether a string is a well-formed address (filecoin-project#4106)
• Add an option to set config path (filecoin-project#4103)
• Add printf in TestWindowPost (filecoin-project#4043)
• Improve miner sectors list UX (filecoin-project#4108)

Tooling

• Move policy change to seal bench (filecoin-project#4032)
• Add back network power to stats (filecoin-project#4050)
• Conformance: Record and feed circulating supply (filecoin-project#4078)
• Snapshot import progress bar, add HTTP support (filecoin-project#4070)
• Add lotus shed util to validate a tipset (filecoin-project#4065)
• tvx: a test vector extraction and execution tool (filecoin-project#4064)

Bootstrap

• Add new bootstrappers (filecoin-project#4007)
• Add Glif node to bootstrap peers (filecoin-project#4004)
• Add one more node located in China (filecoin-project#4041)
• Add ipfsmain bootstrapper (filecoin-project#4067)

0.8.0 / 2020-09-26

This consensus-breaking release of Lotus introduces an upgrade to the network. The changes that break consensus are:

• Upgrading to specs-actors v0.9.11, which reduces WindowPoSt faults per FIP 0002 to reduce cost for honest miners with occasional faults (see filecoin-project/specs-actors#1181)
• Revisions to some cryptoeconomics and network params

This release also updates go-fil-markets to fix an incompatibility issue between v0.7.2 and earlier versions.

Changes

Dependencies

• Update spec actors to 0.9.11 (filecoin-project#4039)
• Update markets to 0.6.3 (filecoin-project#4013)

Core Lotus

• Network upgrade (filecoin-project#4039)
• Fix AddSupportedProofTypes (filecoin-project#4033)
• Return an error when we fail to find a sector when checking sector expiration (filecoin-project#4026)
• Batch blockstore copies after block validation (filecoin-project#3980)
• Remove a misleading miner actor abstraction (filecoin-project#3977)
• Fix out-of-bounds when loading all sector infos (filecoin-project#3976)
• Fix break condition in the miner (filecoin-project#3953)

UX

• Correct helptext around miners setting ask (filecoin-project#4009)
• Make sync wait nicer (filecoin-project#3991)

Tooling and validation

• Small adjustments following network upgradability changes (filecoin-project#3996)
• Add some more big pictures stats to stateroot stat (filecoin-project#3995)
• Add some actors policy setters for testing (filecoin-project#3975)

Contributors

The following contributors had 5 or more commits go into this release. We are grateful for every contribution!

Contributor	Commits	Lines ±
arajasek	66	+3140/-1261
Stebalien	64	+3797/-3434
magik6k	48	+1892/-976
raulk	40	+2412/-1549
vyzo	22	+287/-196
alanshaw	15	+761/-146
whyrusleeping	15	+736/-52
hannahhoward	14	+1237/-837
anton	6	+32/-8
travisperson	5	+502/-6
Frank	5	+78/-39
Jennifer	5	+148/-41

0.7.2 / 2020-09-23

This optional release of Lotus introduces a major refactor around how a Lotus node interacts with code from the specs-actors repo. We now use interfaces to read the state of actors, which is required to be able to reason about different versions of actors code at the same time.

Additionally, this release introduces various improvements to the sync process, as well as changes to better the overall UX experience.

Changes

Core Lotus

• Network upgrade support (filecoin-project#3781)
• Upgrade markets to v0.6.2 (filecoin-project#3974)
• Validate chain sync response indices when fetching messages (filecoin-project#3939)
• Add height diff to sync wait (filecoin-project#3926)
• Replace Requires with Wants (filecoin-project#3898)
• Update state diffing for market actor (filecoin-project#3889)
• Parallel fetch for sync (filecoin-project#3887)
• Fix SectorState (filecoin-project#3881)

User Experience

• Add basic deal stats api server for spacerace slingshot (filecoin-project#3963)
• When doing sectors update-state, show a list of existing states if user inputs an invalid one (filecoin-project#3944)
• Fix lotus-miner storage find error (filecoin-project#3927)
• Log shutdown method for lotus daemon and miner (filecoin-project#3925)
• Update build and setup instruction link (filecoin-project#3919)
• Add an option to hide removed sectors from sectors list output (filecoin-project#3903)

Testing and validation

• Add init.State#Remove() for testing (filecoin-project#3971)
• lotus-shed: add consensus check command (filecoin-project#3933)
• Add keyinfo verify and jwt token command to lotus-shed (filecoin-project#3914)
• Fix conformance gen (filecoin-project#3892)

0.7.1 / 2020-09-17

This optional release of Lotus introduces some critical fixes to the window PoSt process. It also upgrades some core dependencies, and introduces many improvements to the mining process, deal-making cycle, and overall User Experience.

Changes

Some notable improvements:

• Correctly construct params for SubmitWindowedPoSt messages (filecoin-project#3909)
• Skip sectors correctly for Window PoSt (filecoin-project#3839)
• Split window PoST submission into multiple messages (filecoin-project#3689)
• Improve journal coverage (filecoin-project#2455)
• Allow retrievals while sealing (filecoin-project#3778)
• Don't prune locally published messages (filecoin-project#3772)
• Add get-ask, set-ask retrieval commands (filecoin-project#3886)
• Consistently name winning and window post in logs (filecoin-project#3873))
• Add auto flag to mpool replace (filecoin-project#3752))

Dependencies

• Upgrade markets to v0.6.1 (filecoin-project#3906)
• Upgrade specs-actors to v0.9.10 (filecoin-project#3846)
• Upgrade badger (filecoin-project#3739)

0.7.0 / 2020-09-10

This consensus-breaking release of Lotus is designed to test a network upgrade on the space race testnet. The changes that break consensus are:

• Upgrading the Drand network used from the test Drand network to the League of Entropy main drand network. This is the same Drand network that will be used in the Filecoin mainnet.
• Upgrading to specs-actors v0.9.8, which adds a new method to the Multisig actor.

Changes

Core Lotus

• Fix IsAncestorOf (filecoin-project#3717)
• Update to specs-actors v0.9.8 (filecoin-project#3725)
• Increase chain throughput by 20% (filecoin-project#3732)
• Updare to go-libp2p-pubsub master (filecoin-project#3735)
• Drand upgrade (filecoin-project#3670)
• Multisig API additions (filecoin-project#3590)

Storage Miner

• Increase the number of times precommit2 is attempted before moving back to precommit1 (filecoin-project#3720)

Message pool

• Relax mpool add strictness checks for local pushes (filecoin-project#3724)

Maintenance

• Fix devnets (filecoin-project#3712)
• Fix(chainwatch): compare prev miner with cur miner (filecoin-project#3715)
• CI: fix statediff build; make optional (filecoin-project#3729)
• Feat: Chaos abort (filecoin-project#3733)

Contributors

The following contributors had commits go into this release. We are grateful for every contribution!

Contributor	Commits	Lines ±
arajasek	28	+1144/-239
Kubuxu	19	+452/-261
whyrusleeping	13	+456/-87
vyzo	11	+318/-20
raulk	10	+1289/-350
magik6k	6	+188/-55
dirkmc	3	+31/-8
alanshaw	3	+176/-37
Stebalien	2	+9/-12
lanzafame	1	+1/-1
frrist	1	+1/-1
mishmosh	1	+1/-1
nonsense	1	+1/-0

0.6.2 / 2020-09-09

This release introduces some critical fixes to message selection and gas estimation logic. It also adds the ability for nodes to mark a certain tipset as checkpointed, as well as various minor improvements and bugfixes.

Changes

Messagepool

• Warn when optimal selection fails to pack a block and we fall back to random selection (filecoin-project#3708)
• Add basic command for printing gas performance of messages in the mpool (filecoin-project#3701)
• Adjust optimal selection to always try to fill blocks (filecoin-project#3685)
• Fix very minor bug in repub baseFeeLowerBound (filecoin-project#3663)
• Add an auto flag to mpool replace (filecoin-project#3676)
• Fix mpool optimal selection packing failure (filecoin-project#3698)

Core Lotus

• Don't use latency as initital estimate for blocksync (filecoin-project#3648)
• Add niceSleep 1 second when drand errors (filecoin-project#3664)
• Fix isChainNearSync check in block validator (filecoin-project#3650)
• Add peer to peer manager before fetching the tipset (filecoin-project#3667)
• Add StageFetchingMessages to sync status (filecoin-project#3668)
• Pass tipset through upgrade logic (filecoin-project#3673)
• Allow nodes to mark tipsets as checkpointed (filecoin-project#3680)
• Remove hard-coded late-fee in window PoSt (filecoin-project#3702)
• Gas: Fix median calc (filecoin-project#3686)

Storage

• Storage manager: bail out with an error if unsealed cid is undefined (filecoin-project#3655)
• Storage: return true from Sealer.ReadPiece() on success (filecoin-project#3657)

Maintenance

• Resolve lotus, test-vectors, statediff dependency cycle (filecoin-project#3688)
• Paych: add docs on how to use paych status (filecoin-project#3690)
• Initial CODEOWNERS (filecoin-project#3691)

0.6.1 / 2020-09-08

This optional release introduces a minor improvement to the sync process, ensuring nodes don't fall behind and then resync.

Changes

• Update test-vectors (filecoin-project#3645)
• Revert "only subscribe to pubsub topics once we are synced" (filecoin-project#3643)

0.6.0 / 2020-09-07

This consensus-breaking release of Lotus is designed to test a network upgrade on the space race testnet. The changes that break consensus are:

• Tweaking of some cryptoecon parameters in specs-actors 0.9.7 (https://github.com/filecoin-project/specs-actors/releases/tag/v0.9.7)
• Rebalancing FIL distribution to make testnet FIL scarce, which prevents base fee spikes and sets better expectations for mainnet

This release also introduces many improvements to Lotus! Among them are a new version of go-fil-markets that supports non-blocking retrieval, various spam reduction measures in the messagepool and p2p logic, and UX improvements to payment channels, dealmaking, and state inspection.

Changes

Core Lotus and dependencies

• Implement faucet funds reallocation logic (filecoin-project#3632)
• Network upgrade: Upgrade to correct fork threshold (filecoin-project#3628)
• Update to specs 0.9.7 and markets 0.6.0 (filecoin-project#3627)
• Network upgrade: Perform base fee tamping (filecoin-project#3623)
• Chain events: if cache best() is nil, return chain head (filecoin-project#3611)
• Update to specs actors v0.9.6 (filecoin-project#3603)

Messagepool

• Temporarily allow negative chains (filecoin-project#3625)
• Improve publish/republish logic (filecoin-project#3592)
• Fix selection bug; priority messages were not included if other chains were negative (filecoin-project#3580)
• Add defensive check for minimum GasFeeCap for inclusion within the next 20 blocks (filecoin-project#3579)
• Add additional info about gas premium (filecoin-project#3578)
• Fix GasPremium capping logic (filecoin-project#3552)

Payment channels

• Get available funds by address or by from/to (filecoin-project#3547)
• Create lotus paych status command (filecoin-project#3523)
• Rename CLI command from "paych get" to "paych add-funds" (filecoin-project#3520)

Peer-to-peer

• Only subscribe to pubsub topics once we are synced (filecoin-project#3602)
• Reduce mpool add failure log spam (filecoin-project#3562)
• Republish messages even if the chains have negative performance(filecoin-project#3557)
• Adjust gossipsub gossip factor (filecoin-project#3556)
• Integrate pubsub Random Early Drop (filecoin-project#3518)

Miscellaneous

• Fix panic in OnDealExpiredSlashed (filecoin-project#3553)
• Robustify state manager against holes in actor method numbers (filecoin-project#3538)

UX

• VM: Fix an error message (filecoin-project#3608)
• Documentation: Batch replacement,update lotus-storage-miner to lotus-miner (filecoin-project#3571)
• CLI: Robust actor lookup (filecoin-project#3535)
• Add agent flag to net peers (filecoin-project#3534)
• Add watch option to storage-deals list (filecoin-project#3527)

Testing & tooling

• Decommission chain-validation (filecoin-project#3606)
• Metrics: add expected height metric (filecoin-project#3586)
• PCR: Use current tipset during refund (filecoin-project#3570)
• Lotus-shed: Add math command (filecoin-project#3568)
• PCR: Add tipset aggergation (filecoin-project#3565 Fix broken paych tests (filecoin-project#3551)
• Make chain export ~1000x times faster (filecoin-project#3533)
• Chainwatch: Stop SyncIncomingBlocks from leaking into chainwatch processing; No panics during processing (filecoin-project#3526)
• Conformance: various changes (filecoin-project#3521)

0.5.10 / 2020-09-03

This patch includes a crucial fix to the message pool selection logic, strongly disfavouring messages that might cause a miner penalty.

Changes

• Fix calculation of GasReward in messagepool (filecoin-project#3528)

0.5.9 / 2020-09-03

This patch includes a hotfix to the GasEstimateFeeCap method, capping the estimated fee to a reasonable level by default.

Changes

• Added target height to sync wait (filecoin-project#3502)
• Disable codecov annotations (filecoin-project#3514)
• Cap fees to reasonable level by default (filecoin-project#3516)
• Add APIs and command to inspect bandwidth usage (filecoin-project#3497)
• Track expected nonce in mpool, ignore messages with large nonce gaps (filecoin-project#3450)

0.5.8 / 2020-09-02

This patch includes some bugfixes to the sector sealing process, and updates go-fil-markets. It also improves the performance of blocksync, adds a method to export chain state trees, and improves chainwatch.

Changes

• Upgrade markets to v0.5.9 (filecoin-project#3496)
• Improve blocksync to load fewer messages: (filecoin-project#3494)
• Fix a panic in the ffi-wrapper's ReadPiece (https://github.com/filecoin-project/lotus/pull/3492/files)
• Fix a deadlock in the sealing scheduler (filecoin-project#3489)
• Add test vectors for tipset tests (https://github.com/filecoin-project/lotus/pull/3485/files)
• Improve the advance-block debug command (filecoin-project#3476)
• Add toggle for message processing to Lotus PCR (filecoin-project#3470)
• Allow exporting recent chain state trees (filecoin-project#3463)
• Remove height from chain rand (filecoin-project#3458)
• Disable GC on chain badger datastore (filecoin-project#3457)
• Account for GasPremium in GasEstimateFeeCap (filecoin-project#3456)
• Update go-libp2p-pubsub to master (filecoin-project#3455)
• Chainwatch improvements (filecoin-project#3442)

0.5.7 / 2020-08-31

This patch release includes some bugfixes and enhancements to the sector lifecycle and message pool logic.

Changes

• Rebuild unsealed infos on miner restart (filecoin-project#3401)
• CLI to attach storage paths to workers (filecoin-project#3405)
• Do not select negative performing message chains for inclusion (filecoin-project#3392)
• Remove a redundant error-check (filecoin-project#3421)
• Correctly move unsealed sectors in FinalizeSectors (filecoin-project#3424)
• Improve worker selection logic (filecoin-project#3425)
• Don't use context to close bitswap (filecoin-project#3430)
• Correctly estimate gas premium when there is only one message on chain (filecoin-project#3428)

0.5.6 / 2020-08-29

Hotfix release that fixes a panic in the sealing scheduler (filecoin-project#3389).

0.5.5

This patch release introduces a large number of improvements to the sealing process. It also updates go-fil-markets to version 0.5.8, and go-libp2p-pubsub to v0.3.5.

Downstream upgrades

• Upgrades markets to v0.5.8 (filecoin-project#3384)
• Upgrades go-libp2p-pubsub to v0.3.5 (filecoin-project#3305)

Sector sealing

• The following improvements were introduced in filecoin-project#3350.

  • Allow lotus-miner sectors remove to remove a sector in any state.
  • Create a separate state in the storage FSM dedicated to submitting the Commit message.
  • Recovery for when the Deal IDs of deals in a sector get changed in a reorg.
  • Auto-retry sending Precommit and Commit messages if they run out of gas
  • Auto-retry sector remove tasks when they fail
  • Compact worker windows, and allow their tasks to be executed in any order

• Don't simply skip PoSt for bad sectors (filecoin-project#3323)

Message Pool

• Spam Protection: Track required funds for pending messages (filecoin-project#3313)

Chainwatch

• Add more power and reward metrics (filecoin-project#3367)
• Fix raciness in sector deal table (filecoin-project#3275)
• Parallelize miner processing (filecoin-project#3380)
• Accept Lotus API and token (filecoin-project#3337)

0.5.4

A patch release, containing a few nice bugfixes and improvements:

• Fix parsing of peer ID in lotus-miner actor set-peer-id (@whyrusleeping)
• Update dependencies, fixing several bugs (@Stebalien)
• Fix remaining linter warnings (@Stebalien)
• Use safe string truncation (@Ingar)
• Allow tweaking of blocksync message window size (@whyrusleeping)
• Add some additional gas stats to metrics (@Kubuxu)
• Fix an edge case bug in message selection, add many tests (@vyzo)

0.5.3

Yet another hotfix release. A lesson for readers, having people who have been awake for 12+ hours review your hotfix PR is not a good idea. Find someone who has enough slept recently enough to give you good code review, otherwise you'll end up quickly bumping versions again.

• Fixed a bug in the mempool that was introduced in v0.5.2

0.5.2 / 2020-08-24

This is a hotfix release.

• Fix message selection to not include messages that are invalid for block inclusion.
• Improve SelectMessage handling of the case where the message pools tipset differs from our mining base.

0.5.1 / 2020-08-24

The Space Race release! This release contains the genesis car file and bootstrap peers for the space race network.

Additionally, we included two small fixes to genesis creation:

• Randomize ticket value in genesis generation
• Correctly set t099 (burnt funds actor) to have valid account actor state

0.5.0 / 2020-08-20

This version of Lotus will be used for the incentivized testnet Space Race competition, and can be considered mainnet-ready code. It includes some protocol changes, upgrades of core dependencies, and various bugfixes and UX/performance improvements.

Highlights

Among the highlights included in this release are:

• Gas changes: We implemented EIP-1559 and introduced real gas values.
• Deal-making: We now support "Committed Capacity" sectors, "fast-retrieval" deals, and the packing of multiple deals into a single sector.
• Renamed features: We renamed some of the binaries, environment variables, and default paths associated with a Lotus node.

Gas changes

We made some significant changes to the mechanics of gas in this release.

Network fee

We implemented something similar to Ethereum's EIP-1559. The Message structure had three changes:

• The GasPrice field has been removed
• A new GasFeeCap field has been added, which controls the maximum cost the sender incurs for the message
• A new GasPremium field has been added, which controls the reward a miner earns for including the message

A sender will never be charged more than GasFeeCap * GasLimit. A miner will typically earn GasPremium * GasLimit as a reward.

The Blockheader structure has one new field, called ParentBaseFee. Informally speaking,the ParentBaseFee is increased when blocks are densely packed with messages, and decreased otherwise.

The ParentBaseFee is used when calculating how much a sender burns when executing a message. Burning simply refers to sending attoFIL to a dedicated, unreachable account. A message causes ParentBaseFee * GasUsed attoFIL to be burnt.

Real gas values

This release also includes our first "real" gas costs for primitive operations. The costs were designed to account for both the time that message execution takes, as well as the space a message adds to the state tree.

Deal-making changes

There are three key changes to the deal-making process.

Committed Capacity sectors

Miners can now pledge "Committed Capacity" (CC) sectors, which are explicitly stated as containing junk data, and must not include any deals. Miners can do this to increase their storage power, and win block rewards from this pledged storage.

They can mark these sectors as "upgradable" with lotus-miner sectors mark-for-upgrade. If the miner receives and accepts one or more storage deals, the sector that includes those deals will replace the CC sector. This is intended to maximize the amount of useful storage on the Filecoin network.

Fast-retrieval deals

Clients can now include a fast-retrieval flag when proposing deals with storage miners. If set to true, the miner will include an extra copy of the deal data. This data can be quickly served in a retrieval deal, since it will not need to be unsealed.

Multiple deals per sector

Miners can now pack multiple deals into a single sector, so long as all the deals fit into the sector capacity. This should increase the packing efficiency of miners.

Renamed features

To improve the user experience, we updated several names to mainatin standard prefixing, and to better reflect the meaning of the features being referenced.

In particular, the Lotus miner binary is now called lotus-miner, the default path for miner data is now ~/.lotusminer, and the environment variable that sets the path for miner data is now $LOTUS_MINER_PATH. A full list of renamed features can be found here.

Changelog

Downstream upgrades

• Upgrades markets to v0.5.6 (filecoin-project#3058)
• Upgrades specs-actors to v0.9.3 (filecoin-project#3151)

Core protocol

• Introduces gas values, replacing placeholders (filecoin-project#2343)
• Implements EIP-1559, introducing a network base fee, message gas fee cap, and message gas fee premium (filecoin-project#2874)
• Implements Poisson Sortition for elections (filecoin-project#2084)

Deal-making lifecycle

• Introduces "Committed Capacity" sectors (filecoin-project#2220)
• Introduces "fast-retrieval" flag for deals (filecoin-project#2323
• Supports packing multiple deals into one sector (filecoin-project/storage-fsm#38)

Enhancements

• Optimized message pool selection logic (filecoin-project#2838)
• Window-based scheduling of sealing tasks (filecoin-project/sector-storage#67)
• Faster window PoSt (https://github.com/filecoin-project/lotus/pull/2209/files)
• Refactors the payment channel manager (filecoin-project#2640)
• Refactors blocksync (https://github.com/filecoin-project/lotus/pull/2715/files)

UX

• Provide status updates for data-transfer (filecoin-project#3162, filecoin-project#3191)
• Miners can customise asks (filecoin-project#2046)
• Miners can toggle auto-acceptance of deals (filecoin-project#1994)
• Miners can maintain a blocklist of piece CIDs (filecoin-project#2069)

Contributors

The following contributors had 10 or more commits go into this release. We are grateful for every contribution!

Contributor	Commits	Lines ±
magik6k	361	+13197/-6136
Kubuxu	227	+5670/-2587
arajasek	120	+2916/-1264
whyrusleeping	112	+3979/-1089
vyzo	99	+3343/-1305
dirkmc	68	+8732/-3621
laser	45	+1489/-501
hannahhoward	43	+2654/-990
frrist	37	+6630/-4338
schomatis	28	+3016/-1368
placer14	27	+824/-350
raulk	25	+28718/-29849
mrsmkl	22	+560/-368
travisperson	18	+1354/-314
nonsense	16	+2956/-2842
ingar	13	+331/-123
daviddias	11	+311/-11
Stebalien	11	+1204/-980
RobQuistNL	10	+69/-74

0.1.0 / 2019-12-11

We are very excited to release lotus 0.1.0. This is our testnet release. To install lotus and join the testnet, please visit lotu.sh. Please file bug reports as issues.

A huge thank you to all contributors for this testnet release!