MCP is just an API for LLM agents and lets them access resources in real time. Those resources can change over time and with MCP you can even give the LLM the ability to make those changes in a structured, constrained way.
When you train an LLM its weights are static at that point. The other thing is that if you take an open weight model and fine tune it or distill it then you can end up making it worse along some dimensions even if it ends up being better for your specific case. See this article on catastrophic forgetting:
https://cobusgreyling.medium.com/catastrophic-forgetting-in-llms-bf345760e6e2
MachuPikacchu / Machu Pikacchu
npub1r6…4gmmd
2025-04-01 23:31:45
in reply to nevent1q…sesf
Author Public Key
npub1r6ggl0qazvwp02rlxgrf75lkfazuwhu35tmdg0u25eqsjax6243qh4gmmdPublished at
2025-04-01 23:31:45Event JSON
{
"id": "d0c0719398f699cb8bd47ed8c1e237103143cd5983c9b69591f3a081d9066147",
"pubkey": "1e908fbc1d131c17a87f32069f53f64f45c75f91a2f6d43f8aa6410974da5562",
"created_at": 1743550305,
"kind": 1,
"tags": [
[
"e",
"0bc68585e10ded67ce54cd2fbaf5da502f2c919cbec6567c26d74556c132a7ce",
"",
"root"
],
[
"p",
"460c25e682fda7832b52d1f22d3d22b3176d972f60dcdc3212ed8c92ef85065c"
],
[
"r",
"https://cobusgreyling.medium.com/catastrophic-forgetting-in-llms-bf345760e6e2"
]
],
"content": "MCP is just an API for LLM agents and lets them access resources in real time. Those resources can change over time and with MCP you can even give the LLM the ability to make those changes in a structured, constrained way.\n\nWhen you train an LLM its weights are static at that point. The other thing is that if you take an open weight model and fine tune it or distill it then you can end up making it worse along some dimensions even if it ends up being better for your specific case. See this article on catastrophic forgetting:\n\nhttps://cobusgreyling.medium.com/catastrophic-forgetting-in-llms-bf345760e6e2",
"sig": "35842bd52e434b13a02f0e155d96e13ad8e15491564fc2ffc9fc869ee452e504276515fa792d270c2baf1fcb5d30b2678ca7bf573deadc8d411728206795bd2f"
}