kero / is on Nostr

Co-founder & CTO @meilisearch. Rust developer and ex-student from @42born2code.

Last Notes

2023-08-17 18:01:47

My first blog website ever 🤗
https://blog.kerollmops.com/using-rust-and-the-github-ci-for-my-blog

2023-08-14 09:17:19

Hey @npub1y0e…mm9n, we want to, zero-downtime swap an #LMDB environment that comes from an S3 with one that is already on disk (and opened). My first idea was to open the incoming env, open a write txn on the dst one and clear and copy the entries into the existing one but I fear about the MDB_TXN_FULL error. The second idea is to close the env (awaiting running txns) and swap the env files. This can produce a downtime. Do you recommend anything else?

2023-08-06 21:41:59

- reply

@npub1zea…rzh5 @npub15s5…xszk Unfortunately, lmdb-rkv is always above heed on lib.rs, even if it's no more maintained... https://lib.rs/search?q=lmdb

2023-08-06 21:05:15

- reply

@npub1acg…p35c @npub1xts…kk5s Would be better if reproduced from scratch in C but if you know the last operation that corrupts the database maybe do this last one in C if possible. Providing the pre-corrupted database and the last operations breaking it could probably help diagnosis.

2023-08-06 20:36:46

- reply

@npub15s5…xszk Just go with #LMDB. Only a single file, faster than SQLite for key-value storage and zerocopy read. I maintain a Rust wrapper called heed and Meilisearch is running on too of that, works perfectly 🎉
I recently updated the Wikipedia page. https://en.wikipedia.org/wiki/Lightning_Memory-Mapped_Database

2023-08-06 20:22:19

- reply

@npub1acg…p35c @npub1xts…kk5s
If you can repro the LMDB issue you got in C, you can create a new issue on the OpenLDAP ITS. https://bugs.openldap.org/

2023-08-06 20:20:49

- reply

@npub1acg…p35c @npub1xts…kk5s
I worked on bringing the DUPSORT LMDB feature to heed today. I will continue with the DUPFIXED later. I will release a new alpha version later next week, probably 🙂 https://github.com/meilisearch/heed/pull/200

2023-08-03 08:22:07

- reply

@npub1acg…p35c @npub1xts…kk5s If you need anything, tell me, create an issue and I will see if I have time to work on it. I am working on this big v0.20 alpha refactor so let’s break everything 🏺

2023-08-02 21:51:52

- reply

@npub1xts…kk5s @npub1acg…p35c I advise you to use heed that I maintain. We use it in Meilisearch. You should try the latest v0.20-alpha versions. https://lib.rs/crates/heed