ETL app for LND coming along nicely… this is my first attempt at a real application, coming from data wrangling scripts/notebooks.
Support and configs for:
- lndmon endpoints
- timeseries resolution & query range
- data processing
- write to local disk, S3 bucket
- write to csv, json, parquet
- partition by filetype, timestamp
TODO before publishing:
- lndmon, AWS creds
- datatypes / Pydantic
- logging
- basic unit tests
Phase 2 is to do the same for the Mempool API so you can automate extracting all the data from your Bitcoin and LND nodes… possibly bundled into one packag. 🤙
sha2fiddy
npub1sh…xcqyj
2023-03-06 01:11:58
Author Public Key
npub1sha2fddyx7ysjvch0jvfea8gm5dwt7q5sayker3szfdymvq2ckcsrxcqyjPublished at
2023-03-06 01:11:58Event JSON
{
"id": "ae36839d197428ee21932e1864bad0e00c91c917bb0cab342e621aa1328fe04f",
"pubkey": "85faa4b5a437890933177c989cf4e8dd1ae5f81487496c8e30125a4db00ac5b1",
"created_at": 1678065118,
"kind": 1,
"tags": [],
"content": "ETL app for LND coming along nicely… this is my first attempt at a real application, coming from data wrangling scripts/notebooks.\n\nSupport and configs for:\n- lndmon endpoints\n- timeseries resolution \u0026 query range\n- data processing\n- write to local disk, S3 bucket\n- write to csv, json, parquet\n- partition by filetype, timestamp\n\nTODO before publishing:\n- lndmon, AWS creds\n- datatypes / Pydantic\n- logging\n- basic unit tests\n\nPhase 2 is to do the same for the Mempool API so you can automate extracting all the data from your Bitcoin and LND nodes… possibly bundled into one packag. 🤙",
"sig": "9478a0cbd9cc8927a7bbe5a9bf3c3024b818cdbeffa9fae98e9a18ffbd90547377377b7914187585272728ac15d90823bce3bfaec6c2a58af4fb14ed26a43ef1"
}