58 Commits

Author SHA1 Message Date
nymkappa
b9664e1c3e Insert channels from historical data 2022-08-19 12:34:38 +02:00
nymkappa
f6e1ee8017 Use timestamp instead of date in stats table 2022-08-19 12:09:58 +02:00
nymkappa
dcff15c219 Improve error logging in ln import 2022-08-18 11:14:34 +02:00
nymkappa
678bf009ea Import json topology 2022-08-18 11:06:20 +02:00
nymkappa
440683f994 Wrap LN importer into try/catch 2022-08-18 07:48:58 +02:00
nymkappa
51c3d8a5a3 Remove xml parser - Read only .topology file and assume json format 2022-08-16 21:47:52 +02:00
nymkappa
b71d90d749 Assume topology file are in .json - trim log 2022-08-16 19:29:00 +02:00
nymkappa
d61af09b74 Remove "invalid data skipping fix" from stats importer 2022-08-16 19:00:08 +02:00
nymkappa
34bd21aa8f Create and populate nodes_socket table 2022-08-13 11:01:46 +02:00
nymkappa
3e43a6750b Fix LN stats node per network count 2022-08-12 12:12:34 +02:00
nymkappa
6b8a7ef693 Fix recursive call in LN network updater 2022-08-11 16:51:09 +02:00
nymkappa
0576f35ede Add nodes.status db field to mark nodes as inactive if needed 2022-08-09 11:17:37 +02:00
nymkappa
e720f70235 Refactor the LN backend and add more logs 2022-08-09 11:12:05 +02:00
nymkappa
4036573a09 Handle core timeout during closed channel scan, using correct config variable 2022-08-09 11:07:13 +02:00
nymkappa
8a09a94453 Make sure we work with integer in the stats importer 2022-08-09 10:28:40 +02:00
nymkappa
34f581e8eb Convert to short_id before fetching the funding tx 2022-08-09 09:21:31 +02:00
nymkappa
295f0dd8ff Refactor the LN backend and add more logs 2022-08-09 09:20:25 +02:00
wiz
9075651897 Merge pull request #2251 from mempool/nymkappa/bugfix/clightning-crash
Don't throw an exception when cln connection is down
2022-08-08 17:28:50 +09:00
wiz
4bc587a483 Merge branch 'master' into nymkappa/bugfix/missing-last-data-charts 2022-08-08 15:59:34 +09:00
wiz
23b42355f7 Merge branch 'master' into nymkappa/bugfix/unique-lightning-stats 2022-08-08 15:40:46 +09:00
nymkappa
e8c982f815 Fix CLN channel short_id conversion 2022-08-08 07:50:50 +02:00
nymkappa
b0b0beca22 Don't insert stats in the future 2022-08-05 12:43:26 +02:00
nymkappa
bd69cee118 Make sure lightning stats are not duplicated in db 2022-08-05 12:32:20 +02:00
nymkappa
6317d0867a Run node stats every 10 minutes, only keep the latest entry per day 2022-08-04 18:27:36 +02:00
nymkappa
fab4f92027 Gracefully attempt to reconnect to cln upon error 2022-08-04 13:05:15 +02:00
nymkappa
f61a04ec60 Fix daily LN stats crash 2022-08-03 12:13:55 +02:00
nymkappa
d9077412e2 Fetch funding tx for clightning channels 2022-08-02 18:34:20 +02:00
nymkappa
06a404d9ba Don't run the ln network update if the graph is emtpy 2022-08-02 18:34:19 +02:00
nymkappa
918a428237 Rebased using the update lightning interfaces 2022-08-02 18:34:19 +02:00
nymkappa
1871111b4e Delete historical generation code 2022-08-02 18:34:19 +02:00
nymkappa
822a677624 Ignore channels fee rate > 5000ppm or base fee > 5000 in stats 2022-08-02 18:15:34 +02:00
nymkappa
b630816b2e Don't insert gapped gossip data upon restart 2022-08-02 17:56:46 +02:00
nymkappa
71abbae05d Small cleanup 2022-08-02 16:00:40 +02:00
nymkappa
2bddd97e85 Reduce massive gaps in the imported historical LN data 2022-08-02 16:00:40 +02:00
nymkappa
5205d92486 Remove buggy tx vout value fetching and improve performances 2022-08-02 16:00:40 +02:00
nymkappa
2c07b7f4fb Make sure to not count channels twice 2022-08-02 16:00:40 +02:00
nymkappa
8a93a0fcf3 We don't need a synced node to import historical data 2022-08-02 16:00:39 +02:00
nymkappa
5eed515bdb Re-use LN stats importer code to log daily LN stats 2022-08-02 16:00:39 +02:00
nymkappa
6ea171e45a Integrate LN stats importer into the main process 2022-08-02 16:00:39 +02:00
nymkappa
068f7392dd Import LN historical statistics (network wide + per node) 2022-08-02 16:00:38 +02:00
Antoni Spaanderman
5264738e5f use lnd rest api 2022-07-30 21:52:58 +02:00
wiz
0c646b6684 Merge branch 'master' into nymkappa/bugfix/channels-update-status 2022-07-27 18:53:29 +00:00
nymkappa
f69a3beff1 Don't mark closed channels as inactive 2022-07-27 17:24:31 +02:00
nymkappa
54d2d178fc Don't set all channels to inactive when the updater runs 2022-07-27 17:21:24 +02:00
nymkappa
d532ab93ea [LN stats] Ony consider channel stats = 1 for stats calculation 2022-07-27 16:19:47 +02:00
wiz
2878561e52 Correct maxmind geoip-db GEOLITE2_ISP to GEOIP2_ISP 2022-07-23 23:53:28 +02:00
nymkappa
6795f69343 Integrate GeoIP2 ISP database 2022-07-23 23:33:13 +02:00
nymkappa
cfad17d049 Use country iso code in ln nodes per country page url 2022-07-17 09:53:02 +02:00
nymkappa
a496d8d09c Make sure we have initial channel stats to display after fresh run 2022-07-12 19:59:37 +02:00
nymkappa
d5cf4a5c9a Store AS organization in geo_names 2022-07-12 12:12:10 +02:00