dragosr on Nostr: Politeness to ChatGPT doesn't cost "millions" in power. Adding “please” & ...
Politeness to ChatGPT doesn't cost "millions" in power.
Adding “please” & “thanks” (~4 tokens) to *every* single query, est. 0.5 T OAI requests/yr ⇒ +2.2 T tokens.
Needs ~160 H100s 24/7; at 700 W each = 0.98 GWh/yr.
At $0.08/kWh that’s ≈$80 k in power.
Politeness costs ≈$0.00000015 per query.
Published at
2025-04-21 04:58:13Event JSON
{
"id": "de9ecf811e1f4121c5fe80c54344b99693946dd14d505ce752b82e5f5d1ad33a",
"pubkey": "77dcdfcab143b879e77a4963075bd01154cee6757eb9652b9cececacf055fea5",
"created_at": 1745211493,
"kind": 1,
"tags": [
[
"proxy",
"https://chaos.social/users/dragosr/statuses/114374180426481841",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.mostr.pub"
]
],
"content": "Politeness to ChatGPT doesn't cost \"millions\" in power. \n\nAdding “please” \u0026 “thanks” (~4 tokens) to *every* single query, est. 0.5 T OAI requests/yr ⇒ +2.2 T tokens. \n\nNeeds ~160 H100s 24/7; at 700 W each = 0.98 GWh/yr. \nAt $0.08/kWh that’s ≈$80 k in power. \n\nPoliteness costs ≈$0.00000015 per query.",
"sig": "d6375d8f61541c9a2143ee466fa31bbfb84d53894373f1c6ea4ac8fab1e82685064b3385e32585198ddcb885584a8333c8d8060bfc0b33ffaf051fe14d62759f"
}