LWN.net Logo

Three Laws

Three Laws

Posted Oct 30, 2009 17:17 UTC (Fri) by tialaramex (subscriber, #21167)
In reply to: New DoD memo on Open Source Software (David Wheeler's Blog) by michaeljt
Parent article: New DoD memo on Open Source Software (David Wheeler's Blog)

The story I was thinking of, "... That Thou Art Mindful of Him" does not involve weakening the laws at all. You might be thinking of "Little Lost Robot" in which a robot with a dangerously incomplete Law One is hiding among otherwise identical robots.

In "That Thou Art Mindful" the robots are given more powerful abilities to make decisions based on the laws in order to be suitable for use on Earth, where they could encounter complicated scenarios with conflicting orders, simultaneous dangers and so on. So rather than being "hard coded" with a description of what makes something human, they're taught about this separately. This is to allow them to develop judgements about whether particular individuals are "fit" to order them about, and if humans give conflicting orders, which to obey.

The result is: "By the Three Laws, the human-beings-like-the-others are of lesser account and can neither be obeyed nor protected when that conflicts with the need of obedience to those like ourselves and of protection of those like ourselves". The story ends shortly after - having established the threat there is no need to describe the violent consequences.


(Log in to post comments)

Three Laws

Posted Oct 30, 2009 17:31 UTC (Fri) by michaeljt (subscriber, #39183) [Link]

> The story I was thinking of, "... That Thou Art Mindful of Him" does not involve weakening the laws at all. You might be thinking of "Little Lost Robot" in which a robot with a dangerously incomplete Law One is hiding among otherwise identical robots.

It has been a long time since I read any Dr A. (Maybe even since his death.) I seemed to recall that the point of that story was that to counter scepticism about the laws of robotics, they were twisted (well in fact the robot's definition of a human being was, but in the end it amounted to the same) to try to make them please everyone, with unforeseen consequences.

Copyright © 2012, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds