34 Commits

Author SHA1 Message Date
nymkappa
4596394100
[mining] pool updater is now self contained service 2024-08-20 12:07:20 +02:00
nymkappa
ae2ed8fdae
[mining] fix pools updater only running at start 2024-08-20 11:53:48 +02:00
Mononaut
99b8a3cb3e
Rename AUTOMATIC_POOLS_UPDATE, set in prod 2024-07-05 05:58:14 +00:00
nymkappa
ea51ab8d0b
[indexer] show github sha when successufly updated pools json 2023-05-30 10:42:41 -07:00
nymkappa
321161ede9
Cleanup some log 2023-04-01 12:00:54 +09:00
nymkappa
ecfb980e75
Disable pool update when running lightning only 2023-03-13 17:24:23 +09:00
softsimon
fdbcef29e5
Merge pull request #3212 from mempool/nymkappa/bugfix/initial-pool-download
Fix initial pool update when db is empty
2023-03-05 15:44:14 +09:00
nymkappa
ff7c85180d
Fix initial pool update when db is empty 2023-03-05 08:27:30 +09:00
nymkappa
001be82f5a
Move some notice into info 2023-03-05 08:23:05 +09:00
nymkappa
d0d2303513
Document --update-pools - Added some logs 2023-02-26 14:19:10 +09:00
nymkappa
9395a5031e
Log the whole exception in pool parser 2023-02-25 17:12:50 +09:00
nymkappa
2363a397f1
Remove duplicated db transaction 2023-02-25 17:05:58 +09:00
nymkappa
ad9e42db26
Use regexes instead of tags 2023-02-25 16:32:03 +09:00
nymkappa
117aa1375d
Disable mining pools update if AUTOMATIC_BLOCK_REINDEXING is not set - Re-index unknown blocks when a new pool is added 2023-02-25 16:32:03 +09:00
nymkappa
d87fb04a92
Point to the new mining pool files pools-v2.json 2023-02-25 16:32:02 +09:00
nymkappa
d3fdef256c
Rewrite mining pools parser - Re-index blocks table 2023-02-25 16:31:47 +09:00
nymkappa
efb48271f9
Cleanup logs 2022-12-01 15:52:06 +01:00
nymkappa
a64cb4bbad
Make mining pools url configurable 2022-08-09 15:52:24 +02:00
nymkappa
68f72e3074
Implement our own price indexer with historical data 2022-06-23 15:42:42 +02:00
nymkappa
1074d23a90
Cleanup some ops logs 2022-06-13 10:12:27 +02:00
wiz
0b50c17ed0
Merge branch 'master' into nymkappa/bugfix/db-disabled 2022-06-08 01:56:52 +09:00
nymkappa
53bc80e899
Add 'db-less' mining pool tagging support 2022-06-07 11:28:39 +02:00
Ayanami
6ff473ab5d
Add an ability to change circuits 2022-06-07 04:16:37 +09:00
Ayanami
40bfc6bff3
Include SocksProxyAgent inside while loop
To address error Socks5 proxy rejected connection - Failure
2022-06-07 04:16:37 +09:00
Ayanami
e41a08789a
Added configurable user-agent for axios
Will use `mempool/v${backendInfo.getBackendInfo().version}` for default
2022-06-07 04:16:36 +09:00
Ayanami
9d5bbf1f44
Handle Error with basic retry while syncing external assets ( Price Data )
+ Removed unused External Assets value

+ Make static URL dynamic

+ Added config options for syncing pool data

+ Added retry interval & max retry
2022-06-07 04:16:36 +09:00
nymkappa
e590759b7b
Don't try to run pools parser if db is not enabled 2022-05-27 10:31:49 +02:00
Ayanami
0b351b9fcb pools-updater: Support secure Tor connection to sync data with Github
Use Axios instead of native https
2022-05-18 11:20:28 +09:00
softsimon
6919393e6c
Refactored the DB class into a regular singleton class. 2022-04-13 17:38:42 +04:00
nymkappa
6fb0571b06
Refactor database pool use 2022-04-13 21:46:39 +09:00
nymkappa
bee0dbd400
Cleanup mining related backend logs 2022-04-13 16:30:49 +09:00
nymkappa
e451b40084
Catch http request error - Fix 24h retry period 2022-04-07 16:14:43 +09:00
nymkappa
2d29b9ef89
Upon error, re-run the PoolsUpdater within 24h instead of 7d 2022-04-07 14:51:23 +09:00
nymkappa
1969f2a275
Use github api to fetch and update the pools database, once a week 2022-04-07 14:37:16 +09:00