Erigon 3.0.2: Polygon MainNet Archive: Stuck with 17 Files Left 0/Bs #15574
-
|
Hey I am trying to get a 3.0.2 bor-mainnet archive node synched. At the beginning of Ottersynch I was able to download at ~ 1Gbps. So I got through most of the 8050 files quickly. Once I got to approximately 50 files left, I basically began to stall. [INFO] [06-14|09:10:20.838] [1/1 OtterSync] Downloading progress="(8050/8050 files) 55.71% - 3.1TB/5.6TB" time-left=999hrs:99m total-time=2m4s download-rate=0B/s completion-rate=0B/s alloc=4.7GB sys=5.3GB [INFO] [06-14|09:10:26.231] [snapshots] no progress yet files=17 list=domain/v1-commitment.3392-3424.kv,domain/v1-commitment.3328-3392.kv,history/v1-accounts.3200-3264.v,idx/v1-storage.896-960.ef,idx/v1-storage.1728-1792.ef,... As you can see I am currently on file 17 after three days, so I am slowly getting there. What appears to be happening is I am struggling to find peers that have these files. When I find them though, I appear to be getting traffic shaped. I have tested to make sure this is not my local ISP traffic shaping me. I basically renamed the data directory, to start fresh, and again at the beginning of the manifest I achieve 1 Gbps throughput which tells me I am able to get throughput locally over torrent. So this appears to be that the ISP of the peer I am connected to that has the files I am looking for is rate shaping the connection. I have written a script to pull out of the erigon log when I see any progress on this file list, and you can see here that once I get data, it begins to geometrically hold down the throughput so I stay connected to the peer, but my throughput is nothing. [2025-06-14 08:17:53] [monitor] ✅ Progress detected — rate=102.4KB/s, total-time=14m19s Corresponding real logs: What I have done so far:
Anyone have ideas? BTW.. To note, I am also very concerned by this: progress="(8050/8050 files) 55.71% - 3.1TB/5.6TB". I am not sure how I can have only 17 files left but used only 3.6TB of the 5.6TB required. If I have some BIG files left in this 17 I will clearly never get there this way. Many thanks! |
Beta Was this translation helpful? Give feedback.
Replies: 8 comments 15 replies
-
start erigon also i would advise to upgrade to |
Beta Was this translation helpful? Give feedback.
-
|
Thank you will do.. and report back.. btw this is my current config (running this natively btw, not in docker) ------------------------------------------------------------Start Polygon-PoS Erigon full node (embedded rpcdaemon + trace)------------------------------------------------------------set -euo pipefail ERIGON_BIN="${ERIGON_BIN:-$(dirname "$0")/build/bin/erigon}" ARGS=( RPC--http.addr 0.0.0.0 Performance / limits--torrent.download.rate 100MB exec "$ERIGON_BIN" "${ARGS[@]}" |
Beta Was this translation helpful? Give feedback.
-
|
Remove --downloader.verify |
Beta Was this translation helpful? Give feedback.
-
|
Thanks I have done all of that. It buzzed through the files from 7290 down to 1267 in a couple of hours. Seem to be stuck here now: |
Beta Was this translation helpful? Give feedback.
-
|
I backed down to 3.0.5, and cleared all the directories / files again: Now it looks like I am down to 20 files. While it says this (still 0B/s): It looks like my machine is actually downloading like 320Mbps of something.. I'll continue to let it run, and update. |
Beta Was this translation helpful? Give feedback.
-
|
Just an interesting note, I think some of the CDN servers at Cloudflare may be misconfigured.. some respond fine, but some get this message: |
Beta Was this translation helpful? Give feedback.
-
|
Ok this is all sorted, see #15574 (reply in thread). |
Beta Was this translation helpful? Give feedback.
Seems it was some troubles on our side try restart now