#AI #GenerativeAI #LLMs #Llama #Copyright #IP #Books3: "Upwards of 170,000 books, the majority published in the past 20 years, are in LLaMA’s training data. In addition to work by Silverman, Kadrey, and Golden, nonfiction by Michael Pollan, Rebecca Solnit, and Jon Krakauer is being used, as are thrillers by James Patterson and Stephen King and other fiction by George Saunders, Zadie Smith, and Junot Díaz. These books are part of a dataset called “Books3,” and its use has not been limited to LLaMA. Books3 was also used to train Bloomberg’s BloombergGPT, EleutherAI’s GPT-J—a popular open-source model—and likely other generative-AI programs now embedded in websites across the internet. A Meta spokesperson declined to comment on the company’s use of Books3; Bloomberg did not respond to emails requesting comment; and Stella Biderman, EleutherAI’s executive director, did not dispute that the company used Books3 in GPT-J’s training data."
https://www.theatlantic.com/technology/archive/2023/08/books3-ai-meta-llama-pirated-books/675063/
Miguel Afonso Caetano /
npub1pw…r95z7
2023-08-20 09:06:51
Author Public Key
npub1pwuvltfvfme0d987k6rs3an6jnv9k2w32zqdlqt5hpy9u3cmv6ps2r95z7Published at
2023-08-20 09:06:51Event JSON
{
"id": "356ce776f581e7a909e4a74a754373b0398300b31ad80a1d6f748761ae585ee2",
"pubkey": "0bb8cfad2c4ef2f694feb68708f67a94d85b29d15080df8174b8485e471b6683",
"created_at": 1692522411,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"t",
"generativeAI"
],
[
"t",
"LLMs"
],
[
"t",
"llama"
],
[
"t",
"copyright"
],
[
"t",
"ip"
],
[
"t",
"books3"
],
[
"proxy",
"https://tldr.nettime.org/users/remixtures/statuses/110921148788797268",
"activitypub"
]
],
"content": "#AI #GenerativeAI #LLMs #Llama #Copyright #IP #Books3: \"Upwards of 170,000 books, the majority published in the past 20 years, are in LLaMA’s training data. In addition to work by Silverman, Kadrey, and Golden, nonfiction by Michael Pollan, Rebecca Solnit, and Jon Krakauer is being used, as are thrillers by James Patterson and Stephen King and other fiction by George Saunders, Zadie Smith, and Junot Díaz. These books are part of a dataset called “Books3,” and its use has not been limited to LLaMA. Books3 was also used to train Bloomberg’s BloombergGPT, EleutherAI’s GPT-J—a popular open-source model—and likely other generative-AI programs now embedded in websites across the internet. A Meta spokesperson declined to comment on the company’s use of Books3; Bloomberg did not respond to emails requesting comment; and Stella Biderman, EleutherAI’s executive director, did not dispute that the company used Books3 in GPT-J’s training data.\"\nhttps://www.theatlantic.com/technology/archive/2023/08/books3-ai-meta-llama-pirated-books/675063/",
"sig": "0c28eb80688e39e41364e9f85fd0f1be3c272f8ea9f18ff58e4ed121de7be6b749904f6ec35d308c28f03dc600e272a73a29194282c05cffb0f5d23a77ef9af3"
}