Currently, LLMs don't handle long conversations well. They operate on a sliding window of the most recent inputs. More advanced LLMs have some memory storage but it's not really clear when or how to trigger memory updates.
If you try to have a long conversation it will get stuck in a loop because it forgets the stuff you already resolved and starts introducing regressions.
A good strategy is to limit your conversation length. This forces you to chunk up your work into bite size pieces, which is always a good idea. For me, I like to set a goal for each conversation. Maybe I need to decide the best architectural change to accomplish some development goal, or the best library to use, or implement one small feature in isolation.
When I complete a task, if the next task builds on the last (it usually does) I ask the LLM to summarize our convo and I use the summary to kick off the next discussion. Getting a lot of mileage out of this technique.
vnprc
npub16v…umhgd
2025-04-02 16:30:29
Author Public Key
npub16vzjeglr653mrmyqvu0trwaq29az753wr9th3hyrm5p63kz2zu8qzumhgdPublished at
2025-04-02 16:30:29Event JSON
{
"id": "46d02a9d72c4a04680d008a8880ca45adafb7033ec4d25341d961674fc9eb30c",
"pubkey": "d3052ca3e3d523b1ec80671eb1bba0517a2f522e195778dc83dd03a8d84a170e",
"created_at": 1743611429,
"kind": 1,
"tags": [],
"content": "Currently, LLMs don't handle long conversations well. They operate on a sliding window of the most recent inputs. More advanced LLMs have some memory storage but it's not really clear when or how to trigger memory updates.\n\nIf you try to have a long conversation it will get stuck in a loop because it forgets the stuff you already resolved and starts introducing regressions.\n\nA good strategy is to limit your conversation length. This forces you to chunk up your work into bite size pieces, which is always a good idea. For me, I like to set a goal for each conversation. Maybe I need to decide the best architectural change to accomplish some development goal, or the best library to use, or implement one small feature in isolation.\n\nWhen I complete a task, if the next task builds on the last (it usually does) I ask the LLM to summarize our convo and I use the summary to kick off the next discussion. Getting a lot of mileage out of this technique.",
"sig": "ba4e8c9eeaa7269b8cc20cc8ea4358c03bfd451089f2b546ef8cb3305ea9f5141056f59af40fef78cf34bdddb206ed7d3a360550b87d310403f0087675a62b75"
}