Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Increase the number of times precommit2 is attempted before moving back to precommit1 #3720

Merged
merged 1 commit into from
Sep 10, 2020

Conversation

lanzafame
Copy link
Contributor

Because restarting a precommit2 worker twice during sector data transfer has resulted in them being sent back to precommit1.

Ideally, there would be a subset of errors that cause this counter to increment and not things like the user restarting a worker.

@magik6k magik6k merged commit f64bd55 into master Sep 10, 2020
@magik6k magik6k deleted the fix/increase-precommit2-retry-counter branch September 10, 2020 09:52
@RobQuistNL
Copy link
Contributor

I think this partially fixes #3563 and #3585

This might just make my mining setup about 20% more efficient <3

@RobQuistNL
Copy link
Contributor

Unfortunately it looks like it just retries 3 times and fails instantly (because the files were partially moved?) and then ends up being the same end result :P

Event Log:
0.	2020-09-13 23:44:02 +0000 UTC:	[event;sealing.SectorStart]	{"User":{"ID":214,"SectorType":3}}
1.	2020-09-13 23:44:02 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqe5mrbltsbvek3awsbjh4qygzw4bwnfsgndlxwxjxgfwagzvmlgmq"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceddzac2ozsrxfc2jy23q4kmkbrds3d5bs7rnwmfs24gi4uhq54ec4"},"DealID":133467,"DealSchedule":{"StartEpoch":63554,"EndEpoch":766969},"KeepUnsealed":true}}}}
2.	2020-09-14 00:41:01 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqd2fvj5q5flfvpsc2u34fru3vcp2fbpiblgznivzvisxu3x4mtqoy"}},"DealInfo":{"PublishCid":{"/":"bafy2bzacebnbajm54eu2ufgby7zwk52jaqmszkjiupgnimi72xgka3bqr5fkg"},"DealID":133961,"DealSchedule":{"StartEpoch":63669,"EndEpoch":766969},"KeepUnsealed":true}}}}
3.	2020-09-14 01:44:32 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqg5u5caaflpqrro2bf5kodbfgbfzmowxibokf3w6e4sswbyfy5cai"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceai3nmjdzfpdmkivviikbj3rf26dmfsxktaficc3lz7xat3nnlirq"},"DealID":134339,"DealSchedule":{"StartEpoch":63792,"EndEpoch":766969},"KeepUnsealed":true}}}}
4.	2020-09-14 02:44:02 +0000 UTC:	[event;sealing.SectorStartPacking]	{"User":{}}
5.	2020-09-14 02:53:38 +0000 UTC:	[event;sealing.SectorPacked]	{"User":{"FillerPieces":[{"Size":131072,"PieceCID":{"/":"baga6ea4seaqi5hrea(.....)dt3w7qpbikpa"}}]}}
6.	2020-09-14 06:56:11 +0000 UTC:	[event;sealing.SectorPreCommit1]	{"User":{"PreCommit1Out":"eyJyZWdpc3(...)wxMF19","TicketValue":"MTZgw2ABZTKbHqp1seO6nrDT5gxsntTrUl2M6w6RKrc=","TicketEpoch":57287}}
7.	2020-09-14 07:03:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: failed to acquire sector {2388 214} from remote (tried [{8811b30c-557d-4dec-9ce7-f4c7505643d8 [http://192.168.2.100:2345/remote/cache/s-t02388-214] 10 true false false}]): 1 error occurred:
	* fetch error http://192.168.2.100:2345/remote/cache/s-t02388-214 (storage 8811b30c-557d-4dec-9ce7-f4c7505643d8) -> /home/sealer2/.lotusworker/cache/fetching/s-t02388-214: read tcp 192.168.2.6:54866->192.168.2.100:2345: read: connection timed out


8.	2020-09-14 07:04:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
9.	2020-09-14 07:04:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
10.	2020-09-14 07:05:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
11.	2020-09-14 07:05:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
12.	2020-09-14 07:06:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
13.	2020-09-14 07:06:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
14.	2020-09-14 07:07:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit1]	{"User":{}}
15.	2020-09-14 11:34:23 +0000 UTC:	[event;sealing.SectorSealPreCommit1Failed]	{"User":{}}
	seal pre commit(1) failed: handler: websocket connection closed
16.	2020-09-14 11:35:23 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit1]	{"User":{}}
17.	2020-09-14 21:32:04 +0000 UTC:	[event;sealing.SectorPreCommit1]	{"User":{"PreCommit1Out":"ey(...)EsMTkxLDE0MiwxMF19","TicketValue":"4dYJFFxyz8UKg709Ba5V91E+1aCLk7ezzj542cMDcx8=","TicketEpoch":58330}}
18.	2020-09-14 22:04:51 +0000 UTC:	[event;sealing.SectorPreCommit2]	{"User":{"Sealed":{"/":"bagboea4b5abcbdxrtbv4xqoucshnvhb6rsgnvn3k5pflfigm2odikr4qv7d3ikkf"},"Unsealed":{"/":"baga6ea4seaqdokw4voysy3hntqerrn3xr4hmpmgrniiyzvp5agtknlptd67y4cq"}}}
19.	2020-09-14 22:04:51 +0000 UTC:	[event;sealing.SectorPreCommitted]	{"User":{"Message":{"/":"bafy2bzacedfiz26qdkw2xgfalbrvlvr6cswdv2aaabbpls4dbl6njldrkgv4e"},"PreCommitDeposit":"352567768484325152","PreCommitInfo":{"SealProof":3,"SectorNumber":214,"SealedCID":{"/":"bagboea4b5abcbdxrtbv4xqoucshnvhb6rsgnvn3k5pflfigm2odikr4qv7d3ikkf"},"SealRandEpoch":58330,"DealIDs":[133467,133961,134339],"Expiration":769849,"ReplaceCapacity":false,"ReplaceSectorDeadline":0,"ReplaceSectorPartition":0,"ReplaceSectorNumber":0}}}
20.	2020-09-14 22:08:30 +0000 UTC:	[event;sealing.SectorPreCommitLanded]	{"User":{"TipSet":"AXGg5AIgpehHoznKyobRG/v4ozEhqSzUybVz4ykMr2cXUfFEI0sBcaDkAiB38YYgyNfDju7Y0qUMgZscYxJxF2Tx3Mbw3mULKSiClA=="}}
21.	2020-09-14 23:23:30 +0000 UTC:	[event;sealing.SectorSeedReady]	{"User":{"SeedValue":"EoVi7SXbE5Fd1Sb+KuPNV7JjuEYoa+TeGryAij96j14=","SeedEpoch":60641}}
22.	2020-09-15 01:09:59 +0000 UTC:	[event;sealing.SectorCommitted]	{"User":{"Proof":"mSlg(....)sn+rSWkzN5BvFVS/B"}}
23.	2020-09-15 01:09:59 +0000 UTC:	[event;sealing.SectorCommitSubmitted]	{"User":{"Message":{"/":"bafy2bzacedf5daecchodllqvfgxosxfs2jm7qrzy4p3v2zbmwqkzep2v5zer6"}}}
24.	2020-09-15 01:13:31 +0000 UTC:	[event;sealing.SectorProving]	{"User":{}}
25.	2020-09-15 01:53:51 +0000 UTC:	[event;sealing.SectorFinalized]	{"User":{}}

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants