Chicago Boyz

                 
 
 
What Are Chicago Boyz Readers Reading?
 

 
  •   Enter your email to be notified of new posts:
  •   Problem? Question?
  •   Contact Authors:

  • CB Twitter Feed
  • Blog Posts (RSS 2.0)
  • Blog Posts (Atom 0.3)
  • Incoming Links
  • Recent Comments

    • Loading...
  • Authors

  • Notable Discussions

  • Recent Posts

  • Blogroll

  • Categories

  • Archives

  • Sneaky Robots and Robotic Bureaucrats

    Posted by David Foster on January 10th, 2019 (All posts by )

    An artificial intelligence program was assigned the task of turning satellite images into street maps.  It was graded by comparing reconstructed images (reconstructed from the map) and comparing them with the original; also, by the clarity of the street map.  The grades were used by the program to continually improved its performance.

    But what the program sneakily learned to do was to encode details of the original image into the street map, in a manner invisible to humans, thereby optimizing its grade on the reconstructed image…independently of how well the street map…which was the actual desired product…actually reflected the original image.

    Humans, also, often respond to incentives in ways very different from those expected by the designers of those incentives…as many creators of sales commission plans and manufacturing bonus plans have discovered.  Bureaucracies, especially, tend to respond to the measurements placed on them in ways that are not consistent with the interests of the larger organization or society that they are supposed to be serving.  See Stupidity, Communist-Style and Capitalist-Style and The Reductio ad Absurdum of Bureaucratic Liberalism.

     

    One Response to “Sneaky Robots and Robotic Bureaucrats”

    1. Mike K Says:

      I call it a Principal Agent Problem,

      This dilemma exists in circumstances where agents are motivated to act in their own best interests, which are contrary to those of their principals, and is an example of moral hazard.

      Even by algorithms. I wonder about “smart” thermostats that mighty connect with the public utility and figure out how to increase their own revenue.

    Leave a Reply

    Comments Policy:  By commenting here you acknowledge that you have read the Chicago Boyz blog Comments Policy, which is posted under the comment entry box below, and agree to its terms.

    A real-time preview of your comment will appear under the comment entry box below.

    Comments Policy

    Chicago Boyz values reader contributions and invites you to comment as long as you accept a few stipulations:

    1) Chicago Boyz authors tend to share a broad outlook on issues but there is no party or company line. Each of us decides what to write and how to respond to comments on his own posts. Occasionally one or another of us will delete a comment as off-topic, excessively rude or otherwise unproductive. You may think that we deleted your comment unjustly, and you may be right, but it is usually best if you can accept it and move on.

    2) If you post a comment and it doesn't show up it was probably blocked by our spam filter. We batch-delete spam comments, typically in the morning. If you email us promptly at we may be able to retrieve and publish your comment.

    3) You may use common HTML tags (italic, bold, etc.). Please use the "href" tag to post long URLs. The spam filter tends to block comments that contain multiple URLs. If you want to post multiple URLs you should either spread them across multiple comments or email us so that we can make sure that your comment gets posted.

    4) This blog is private property. The First Amendment does not apply. We have no obligation to publish your comments, follow your instructions or indulge your arguments. If you are unwilling to operate within these loose constraints you should probably start your own blog and leave us alone.

    5) Comments made on the Chicago Boyz blog are solely the responsibility of the commenter. No comment on any post on Chicago Boyz is to be taken as a statement from or by any contributor to Chicago Boyz, the Chicago Boyz blog, its administrators or owners. Chicago Boyz and its contributors, administrators and owners, by permitting comments, do not thereby endorse any claim or opinion or statement made by any commenter, nor do they represent that any claim or statement made in any comment is true. Further, Chicago Boyz and its contributors, administrators and owners expressly reject and disclaim any association with any comment which suggests any threat of bodily harm to any person, including without limitation any elected official.

    6) Commenters may not post content that infringes intellectual property rights. Comments that violate this rule are subject to deletion or editing to remove the infringing content. Commenters who repeatedly violate this rule may be banned from further commenting on Chicago Boyz. See our DMCA policy for more information.