111 Commits

Author SHA1 Message Date
wiz
7c25fd61da
Merge branch 'master' into nymkappa/feature/stop-updating-closed-channels 2022-08-21 22:05:52 +09:00
nymkappa
5b9b717a93
Fix LN stats importer with new data "cleanupTopology" structure 2022-08-19 18:07:26 +02:00
nymkappa
48dcf01199
If a channel is closed, stop updating it 2022-08-19 16:43:37 +02:00
nymkappa
e7d99e9653
Insert channels from historical data 2022-08-19 12:34:38 +02:00
nymkappa
1ef4485a26
Use timestamp instead of date in stats table 2022-08-19 12:09:58 +02:00
nymkappa
0243769a02
Improve error logging in ln import 2022-08-18 11:14:34 +02:00
nymkappa
57e0980134
Import json topology 2022-08-18 11:06:20 +02:00
nymkappa
c37b4cadb1
Wrap LN importer into try/catch 2022-08-18 07:48:58 +02:00
nymkappa
8dc41257ce
Remove xml parser - Read only .topology file and assume json format 2022-08-16 21:47:52 +02:00
nymkappa
a71262f538
Assume topology file are in .json - trim log 2022-08-16 19:29:00 +02:00
nymkappa
264ce1222a
Remove "invalid data skipping fix" from stats importer 2022-08-16 19:00:08 +02:00
nymkappa
3e9543f0b6
Create and populate nodes_socket table 2022-08-13 11:01:46 +02:00
nymkappa
06453edc7c
Fix LN stats node per network count 2022-08-12 12:12:34 +02:00
nymkappa
7e356ef0a0
Fix recursive call in LN network updater 2022-08-11 16:51:09 +02:00
nymkappa
9b974dfbd9
Add nodes.status db field to mark nodes as inactive if needed 2022-08-09 11:17:37 +02:00
nymkappa
61e512b8f7
Refactor the LN backend and add more logs 2022-08-09 11:12:05 +02:00
nymkappa
2a6f48d8c8
Handle core timeout during closed channel scan, using correct config variable 2022-08-09 11:07:13 +02:00
nymkappa
6a52725b63
Make sure we work with integer in the stats importer 2022-08-09 10:28:40 +02:00
nymkappa
abb078f7ee
Convert to short_id before fetching the funding tx 2022-08-09 09:21:31 +02:00
nymkappa
47363b477e
Refactor the LN backend and add more logs 2022-08-09 09:20:25 +02:00
wiz
c0e6b7af58
Merge pull request #2251 from mempool/nymkappa/bugfix/clightning-crash
Don't throw an exception when cln connection is down
2022-08-08 17:28:50 +09:00
wiz
771d21e410
Merge branch 'master' into nymkappa/bugfix/missing-last-data-charts 2022-08-08 15:59:34 +09:00
wiz
78d1ef9b1c
Merge branch 'master' into nymkappa/bugfix/unique-lightning-stats 2022-08-08 15:40:46 +09:00
nymkappa
1d106a9851
Fix CLN channel short_id conversion 2022-08-08 07:50:50 +02:00
nymkappa
c01c610bb3
Don't insert stats in the future 2022-08-05 12:43:26 +02:00
nymkappa
5a50a0d973
Make sure lightning stats are not duplicated in db 2022-08-05 12:32:20 +02:00
nymkappa
54669281de
Run node stats every 10 minutes, only keep the latest entry per day 2022-08-04 18:27:36 +02:00
nymkappa
f6d6ea5d31
Gracefully attempt to reconnect to cln upon error 2022-08-04 13:05:15 +02:00
nymkappa
6be2985b40
Fix daily LN stats crash 2022-08-03 12:13:55 +02:00
nymkappa
a25af16f7c
Fetch funding tx for clightning channels 2022-08-02 18:34:20 +02:00
nymkappa
00cd3ee9bf
Don't run the ln network update if the graph is emtpy 2022-08-02 18:34:19 +02:00
nymkappa
80f1ee45b5
Rebased using the update lightning interfaces 2022-08-02 18:34:19 +02:00
nymkappa
eb90434c28
Delete historical generation code 2022-08-02 18:34:19 +02:00
nymkappa
b6ba3c5781
Ignore channels fee rate > 5000ppm or base fee > 5000 in stats 2022-08-02 18:15:34 +02:00
nymkappa
5b521cfc7c
Don't insert gapped gossip data upon restart 2022-08-02 17:56:46 +02:00
nymkappa
d7f2f4136c
Small cleanup 2022-08-02 16:00:40 +02:00
nymkappa
5d7e42195f
Reduce massive gaps in the imported historical LN data 2022-08-02 16:00:40 +02:00
nymkappa
7fdf95ad34
Remove buggy tx vout value fetching and improve performances 2022-08-02 16:00:40 +02:00
nymkappa
5287490894
Make sure to not count channels twice 2022-08-02 16:00:40 +02:00
nymkappa
b246c6f4c3
We don't need a synced node to import historical data 2022-08-02 16:00:39 +02:00
nymkappa
2daf94f65a
Re-use LN stats importer code to log daily LN stats 2022-08-02 16:00:39 +02:00
nymkappa
91ada9ce75
Integrate LN stats importer into the main process 2022-08-02 16:00:39 +02:00
nymkappa
4ea1e98547
Import LN historical statistics (network wide + per node) 2022-08-02 16:00:38 +02:00
Antoni Spaanderman
887fb13f34
use lnd rest api 2022-07-30 21:52:58 +02:00
wiz
48496abbf4
Merge branch 'master' into nymkappa/bugfix/channels-update-status 2022-07-27 18:53:29 +00:00
nymkappa
f57fa1286c
Don't mark closed channels as inactive 2022-07-27 17:24:31 +02:00
nymkappa
edfa0d6074
Don't set all channels to inactive when the updater runs 2022-07-27 17:21:24 +02:00
nymkappa
d6e9500bee
[LN stats] Ony consider channel stats = 1 for stats calculation 2022-07-27 16:19:47 +02:00
wiz
ad9e989598
Correct maxmind geoip-db GEOLITE2_ISP to GEOIP2_ISP 2022-07-23 23:53:28 +02:00
nymkappa
ffe22399d5
Integrate GeoIP2 ISP database 2022-07-23 23:33:13 +02:00