Les Orchard on Nostr: Every time I hear a "flirty" AI assistant voice, I feel a spike of revulsion. It's ...
Every time I hear a "flirty" AI assistant voice, I feel a spike of revulsion. It's creepy. Seems obvious in retrospect, but I think I figured out why:
I'm very sensitive to manipulation. Not to say I always see it - I can, in fact, be quite gullible. But, when I *do* detect it, I take it as a deep personal insult and flag the source as never to be trusted again.
Apropos of that, a "flirty" AI assistant is not attempting to form a reciprocal social connection with me. A "flirty" AI assistant is manipulation.
A "flirty" AI assistant is an attempt at an emotional security exploit by a corporation in the hopes that I'll mistakenly grant the imperfect thing some empathy and give it a trusted place in my life. It feels very crass and dystopian.
Some folks describe this as a UI affordance to make users more comfortable with the machine. With me - and probably a lot of folks - it lands as sour as a door-to-door Comcast salesperson.
Ironically, the only assistant voices I tolerate tend to be very emotionally flat and matter-of-fact. Like, I know what you are, machine, and I'll trust you more if you stop pretending.
Published at
2024-05-21 16:09:05Event JSON
{
"id": "2b6a33e33cbe2b4547280edc6210ecace05d90be3732011cdf41fb1450a8f5dd",
"pubkey": "8e06025ef82ead8bd7621d06117ca984a8edbbf35456826f2ce08efac9cd5360",
"created_at": 1716307745,
"kind": 1,
"tags": [
[
"content-warning",
"flirty AI assistant voices"
],
[
"proxy",
"https://hackers.town/@lmorchard/112479944398180520",
"web"
],
[
"proxy",
"https://hackers.town/users/lmorchard/statuses/112479944398180520",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://hackers.town/users/lmorchard/statuses/112479944398180520",
"pink.momostr"
]
],
"content": "Every time I hear a \"flirty\" AI assistant voice, I feel a spike of revulsion. It's creepy. Seems obvious in retrospect, but I think I figured out why:\n\nI'm very sensitive to manipulation. Not to say I always see it - I can, in fact, be quite gullible. But, when I *do* detect it, I take it as a deep personal insult and flag the source as never to be trusted again.\n\nApropos of that, a \"flirty\" AI assistant is not attempting to form a reciprocal social connection with me. A \"flirty\" AI assistant is manipulation.\n\nA \"flirty\" AI assistant is an attempt at an emotional security exploit by a corporation in the hopes that I'll mistakenly grant the imperfect thing some empathy and give it a trusted place in my life. It feels very crass and dystopian.\n\nSome folks describe this as a UI affordance to make users more comfortable with the machine. With me - and probably a lot of folks - it lands as sour as a door-to-door Comcast salesperson.\n\nIronically, the only assistant voices I tolerate tend to be very emotionally flat and matter-of-fact. Like, I know what you are, machine, and I'll trust you more if you stop pretending.",
"sig": "2a07131dc08c5c2e33c7a1a27c310b09b60d40f02d96944389ea523bd7930ccafa546c6fb9a5ad9ff8b716d641398b4d1f741f7f02615f570f5d3c79d8f6fdf2"
}