Why self host #AI in #Education?
Apart from data sovereignty and privacy reasons there is consistency. If your #LLM is externally hosted, e.g. #ChatGPT you are never exactly sure of the model or how long it will be supported.
Responses from LLM’s can be inconsistent at the best of times, but if the model changes without you knowing responses can be even more unpredictable.
This is why tools like #ollama matter
https://ollama.com/
Marcus Green /
npub1h4…8nmje
2025-02-07 10:08:16
Author Public Key
npub1h4d544vfux5yvp20kmauz86gruez5p39srm2m6uk7xf5p5hm42yqy8nmjeSeen on
wss://relay.mostr.pubPublished at
2025-02-07 10:08:16Event JSON
{
"id": "6938d2f3b2745c6165bbd92437a99b38fc662b4f0eb1bbcc694d8200d937c337",
"pubkey": "bd5b4ad589e1a846054fb6fbc11f481f322a062580f6adeb96f19340d2fbaa88",
"created_at": 1738922896,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"education"
],
[
"t",
"llm"
],
[
"t",
"chatgpt"
],
[
"t",
"ollama"
],
[
"proxy",
"https://fosstodon.org/users/marcusgreen/statuses/113962050970949273",
"activitypub"
]
],
"content": "Why self host #AI in #Education?\n\nApart from data sovereignty and privacy reasons there is consistency. If your #LLM is externally hosted, e.g. #ChatGPT you are never exactly sure of the model or how long it will be supported. \n\nResponses from LLM’s can be inconsistent at the best of times, but if the model changes without you knowing responses can be even more unpredictable.\n\nThis is why tools like #ollama matter\n\nhttps://ollama.com/",
"sig": "a6b931e9c60f3bc1d5629c5312796781315a745b11dbd41879c50365a7c636f1c27038ec36efe73ff602d9ebad0c056dce928a1bd650869ed2a1308b30c22fde"
}