this post was submitted on 27 Apr 2024
137 points (96.6% liked)

Technology

59055 readers
3173 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Moral Crumple Zones discusses how humans are used to absorb liability from automated systems.

With Tesla’s Autopilot and Full Self-Driving linked to hundreds of crashes, dozens of deaths getting traction, it’s time to remind everyone that Tesla’s design choice to disengage self-driving in the instant before impact is intentional to ensure the driver is in control during the moment of impact, even though self-driving disengaged way too late for the human to react.

In my opinion, they’re sacrificing both bystanders and customers to preserve immunity from liability.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 12 points 6 months ago

"Analyzing several high-profile accidents involving complex and automated socio-technical systems and the media coverage that surrounded them, I introduce the concept of a moral crumple zone to describe how responsibility for an action may be misattributed to a human actor who had limited control over the behavior of an automated or autonomous system. Just as the crumple zone in a car is designed to absorb the force of impact in a crash, the human in a highly complex and automated system may become simply a component—accidentally or intentionally—that bears the brunt of the moral and legal responsibilities when the overall system malfunctions. While the crumple zone in a car is meant to protect the human driver, the moral crumple zone protects the integrity of the technological system, at the expense of the nearest human operator."<

Great. Humans taking the fall for technology.