Today is Stanislav Petrov Day. It's a day when I take some time to reflect on the importance of questioning technology. Because that is what Stanislav Petrov did when he averted nuclear war on September 26 in 1983.
"We can't wait anymore."
"7 minutes until the first warhead is in the observation zone."
"We won't have time to retaliate. You have to make a decision!"
"You see it?"
"Could be."
"No. That's not heat from a missile."
"Damn!"
"Let's keep looking."
"THE COMPUTER CAN'T BE WRONG!"
"I don't understand it."
"Damn it! They have to confirm this damn attack."
"All thirty levels of security levels confirms the attack!"
"Infrared devices verify heat from all five launched missiles!"
"What are we going to do?"
Stanislav Petrov: "Nothing. I don't trust the computer. We'll wait."
This dialogue is from a re-enactment in the documentary The Man Who Saved the World.
Last year I wrote about three learnings I take away from his story.
1. Embrace multiple perspectives.
Petrov was educated as an engineer rather than a military man. He knew the unpredictability of machine output.
2. Look for multiple confirmation points.
To confirm our beliefs we should expect many different variables to line up and tell us the same story. If one or more variables are saying something different, we need to pursue those anomalies to understand why. If the idea of a faulty system lines up with all other variables, that makes it more likely.
3. Reward exposure of faulty systems.
If we keep praising our tools for their excellence and efficiency it's hard to later accept their defects. When shortcomings are found, this needs to be communicated just as clearly and widely as successes. Maintaining an illusion of perfect, neutral and flawless systems will keep people from questioning the systems when the systems need to be questioned.
https://axbom.com/lessons-from-stanislav-petrov/
Per Axbom /
npub15y…nj00n
2023-09-26 17:03:33
Author Public Key
npub15yp336mavfhkps702nyfzakug07mtzq4hlv5cj084mahj8s8rjsq8nj00nPublished at
2023-09-26 17:03:33Event JSON
{
"id": "ae4cfdd1e1e4eb91e57458af03e8f92458efa4d3e852106cd8ca600fcf39a677",
"pubkey": "a10318eb7d626f60c3cf54c89176dc43fdb58815bfd94c49e7aefb791e071ca0",
"created_at": 1695747813,
"kind": 1,
"tags": [
[
"proxy",
"https://axbom.me/objects/f697e593-a490-46d9-9a35-1892b1bb36fd",
"activitypub"
]
],
"content": "Today is Stanislav Petrov Day. It's a day when I take some time to reflect on the importance of questioning technology. Because that is what Stanislav Petrov did when he averted nuclear war on September 26 in 1983.\n\n\"We can't wait anymore.\"\n\"7 minutes until the first warhead is in the observation zone.\"\n\"We won't have time to retaliate. You have to make a decision!\"\n\"You see it?\"\n\"Could be.\"\n\"No. That's not heat from a missile.\"\n\"Damn!\"\n\"Let's keep looking.\"\n\"THE COMPUTER CAN'T BE WRONG!\"\n\"I don't understand it.\"\n\"Damn it! They have to confirm this damn attack.\"\n\"All thirty levels of security levels confirms the attack!\"\n\"Infrared devices verify heat from all five launched missiles!\"\n\"What are we going to do?\"\n\nStanislav Petrov: \"Nothing. I don't trust the computer. We'll wait.\"\n\nThis dialogue is from a re-enactment in the documentary The Man Who Saved the World.\n\nLast year I wrote about three learnings I take away from his story.\n\n1. Embrace multiple perspectives.\nPetrov was educated as an engineer rather than a military man. He knew the unpredictability of machine output.\n\n2. Look for multiple confirmation points.\nTo confirm our beliefs we should expect many different variables to line up and tell us the same story. If one or more variables are saying something different, we need to pursue those anomalies to understand why. If the idea of a faulty system lines up with all other variables, that makes it more likely.\n\n3. Reward exposure of faulty systems.\nIf we keep praising our tools for their excellence and efficiency it's hard to later accept their defects. When shortcomings are found, this needs to be communicated just as clearly and widely as successes. Maintaining an illusion of perfect, neutral and flawless systems will keep people from questioning the systems when the systems need to be questioned.\n\nhttps://axbom.com/lessons-from-stanislav-petrov/",
"sig": "be0e0fb9faeb8ec5eaac888da92b80d8a80fd6903f85279b1da2eaa57d300feaa63797b1c25e9a23672331151f47a348514a39eb386f4bfdfb8cf1748ab922df"
}