This is an under-appreciated point about using LLMs to summarize text (turning a longer text into a shorter text that maintains the essence of the original). Making summaries is hard to do well! It requires understanding and subtlety.
Making a BAD summary is an easy task for an LLM, which flattens everything probabilistically. People using these cheap tools are going to be throwing a lot of babies out with a lot of bathwater and never even knowing it. https://infosec.exchange/@david_chisnall/113085164920773681
James Gleick /
npub1gs…twxft
2024-09-05 21:52:11
Author Public Key
npub1gsqxlu3pj34alvqauqpvwflw7q7xgm3mmzyjp8vdz3u9vxde425qttwxftPublished at
2024-09-05 21:52:11Event JSON
{
"id": "e385edefe4f5fe511d5f37edaf9286ad0b7a189b1bb5793209764f9c8cc799c3",
"pubkey": "44006ff221946bdfb01de002c727eef03c646e3bd889209d8d14785619b9aaa8",
"created_at": 1725573131,
"kind": 1,
"tags": [
[
"proxy",
"https://mas.to/users/gleick/statuses/113087160758969663",
"activitypub"
]
],
"content": "This is an under-appreciated point about using LLMs to summarize text (turning a longer text into a shorter text that maintains the essence of the original). Making summaries is hard to do well! It requires understanding and subtlety.\n\nMaking a BAD summary is an easy task for an LLM, which flattens everything probabilistically. People using these cheap tools are going to be throwing a lot of babies out with a lot of bathwater and never even knowing it. https://infosec.exchange/@david_chisnall/113085164920773681",
"sig": "a2a156cc4a7b20881851a474b8e95937b1f9c4405001c0d738d5dfd0aacd3c4df4883b36098ae23e7f67eadc8e7cc717922c44a8e9fe7dcffa21aff5ce2746a3"
}