Mike Harrison on Nostr: Am starting to despise modern API devs. In many cases I need to pull a few thousand ...
Am starting to despise modern API devs. In many cases I need to pull a few thousand records. Their API allows <= 250/256 (depends on API) records at a time, with a page #. With rate limiting, and rapidly changing data I sometimes get a dupe at the end of one page and the start of another. Or miss somthing that existed when I started the query. Easy enough for me to code around, but I miss the database concept of a static set of data for a query. #API #SQL
Published at
2023-10-25 16:39:28Event JSON
{
"id": "3ea2cc5ce6fcef5c12d6d78504bb0b64164730434206a8c86c04bad5eb828d74",
"pubkey": "7726a17f5e9eaf99d85375e62bc4fb486636802f2c5334bf9f4c15932e60b624",
"created_at": 1698251968,
"kind": 1,
"tags": [
[
"t",
"api"
],
[
"t",
"sql"
],
[
"proxy",
"https://fosstodon.org/users/meuon/statuses/111296641003932775",
"activitypub"
]
],
"content": "Am starting to despise modern API devs. In many cases I need to pull a few thousand records. Their API allows \u003c= 250/256 (depends on API) records at a time, with a page #. With rate limiting, and rapidly changing data I sometimes get a dupe at the end of one page and the start of another. Or miss somthing that existed when I started the query. Easy enough for me to code around, but I miss the database concept of a static set of data for a query. #API #SQL",
"sig": "c04b03d57ffce00a9427ea016d51e7b20efd1a57c3edbcdaecf3b5e735d6c1fee35c8468cee9cf39f99fed79458e12e439ffa762022156cf25b85817e2d9d086"
}