Huggingface offers a free API to train LLM weights. You can also use most VPS providers to access a GPU powerful enough to do it 100% custom. As the demand for this goes up the price will come down and frontends that make it more accessible will be open source and readily available.
Additionally LLaMA was a massive breakthrough in dramatically reducing the compute power required to run LLMs. I run Alpaca 7B locally on my phone.
Pablo Xannybar
npub17r…jjtgg
2023-07-12 22:19:33
in reply to nevent1q…ll34
Author Public Key
npub17rlc0emedw5xljztfqrmykjaacsx6ujvdas64zznjadrnhhwlavq4jjtggPublished at
2023-07-12 22:19:33Event JSON
{
"id": "b2b0fee37b2b714b92b75a5b92b1fa1161b541f096aa196331dd324f0ea3dfdb",
"pubkey": "f0ff87e7796ba86fc84b4807b25a5dee206d724c6f61aa8853975a39deeeff58",
"created_at": 1689200373,
"kind": 1,
"tags": [
[
"e",
"e1937a566f14f1a6d92e50eec91847aa7d46b1626fb4052fd2c10e096617fbf4",
"",
"root"
],
[
"e",
"0d7f1b07c6354bfa14361aa1c75560968b7793623d4f87be64428889c6cee578"
],
[
"e",
"9ee5c1a6f2bf67944916733e221abc2c98809d4ae4c22e73b464166be0036f87",
"",
"reply"
],
[
"p",
"f0ff87e7796ba86fc84b4807b25a5dee206d724c6f61aa8853975a39deeeff58"
],
[
"p",
"104a9e01bfa9fd7d89920636bf25bb28f1fa5ee4a12201fad462fb79c9b5b2e9"
]
],
"content": "Huggingface offers a free API to train LLM weights. You can also use most VPS providers to access a GPU powerful enough to do it 100% custom. As the demand for this goes up the price will come down and frontends that make it more accessible will be open source and readily available.\n\nAdditionally LLaMA was a massive breakthrough in dramatically reducing the compute power required to run LLMs. I run Alpaca 7B locally on my phone.",
"sig": "baee0a017c3c8e2bae73c104101fd29cff76c44e254d16b6a2c0a82886ab1c50ae8f9e4ea2d60594f2e1a7c6a6eea46cdae00b2edc0e3221622b609833a56a80"
}