The three laws of robotics, according to science fiction author Isaac Asimov, are:

1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
2. A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

I would gladly have accepted a $20 million Pentagon contract for the job of pointing out these three laws.

OK, maybe $25 million.

Sadly, the Pentagon has instead hired a bunch of philosophy professors from leading U.S. universities to tell them how to make robots murder people morally and ethically.

Of course, this conflicts with the first law above. A robot designed to kill human beings is designed to violate the first law.

The whole project even more fundamentally violates the second law. The Pentagon is designing robots to obey orders precisely when they violate the first law, and to always obey orders without any exception. That’s the advantage of using a robot. The advantage is not in risking the well-being of a robot instead of a soldier. The Pentagon doesn’t care about that, except in certain situations in which too many deaths of its own humans create political difficulties. And there are just as many situations in which there are political advantages for the Pentagon in losing its own human lives: “The sacrifice of American lives is a crucial step in the ritual of commitment,” wrote William P. Bundy of the CIA, an advisor to Presidents Kennedy and Johnson. A moral being would disobey the orders these robots are being designed to carry-out, and — by being robots — to carry out without any question of refusal. Only a U.S. philosophy professor could imagine applying a varnish of “morality” to this project.

The Third Law should be a warning to us. Having tossed aside Laws one and two, what limitations are left to be applied should Law three be implemented? Assume the Pentagon designs its robots to protect their own existence, except when . . . what? Except when doing so would require disobeying a more important order? But which order is more important? Except when doing so would require killing the wrong kind of person(s)? But which are they? The humans not threatening the robot? That’s rather a failure as a limitation.

Let’s face it, the Pentagon needs brand new laws of robotics. May I suggest the following:

1. A Pentagon robot must kill and injure human beings as ordered.
2. A Pentagon robot must obey all orders, except where such orders result from human weakness and conflict with the mission to kill and injure.
3. A Pentagon robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

This set of laws differs from Asimov’s in a number of ways.  For one thing, it completely lacks morality.  It is designed for killing, not protecting.  By prioritizing killing in the First Law, rather than protecting, this set of laws also allows for the possibility of robots sacrificing themselves to kill rather than to protect — as well as the possibility of robots turning on their masters.

This set of laws differs much less — possibly not at all — from the set of laws currently followed by human members of the U.S. military. The great distinction that people imagine between autonomous and piloted drones vanishes when you learn a little about the thought habits of human drone pilots. They, like other members of the U.S. military, follow these laws:

1. A Pentagon human must kill and injure human beings as ordered.
2. A Pentagon human must obey all orders, except where such orders result from human weakness and conflict with the mission to kill and injure.
3. A Pentagon human must protect its own existence as long as such protection does not conflict with the First or Second Law.

The job of the philosophy professors is to apply these laws to robots while neither changing them nor letting on to have figured out what they are.  In other words, it’s just like teaching a course in the classics to a room full of students.  Thank goodness our academia has produced the men and women for this job.

David Swanson wants you to declare peace at http://WorldBeyondWar.org  His new book is War No More: The Case for Abolition. He blogs athttp://davidswanson.org and http://warisacrime.org and works for http://rootsaction.org. He hosts Talk Nation Radio. Follow him on Twitter: @davidcnswanson and FaceBook

David Swanson is an author, activist, journalist, and radio host. He is executive director of World BEYOND War and campaign coordinator for RootsAction.org. Swanson’s books include War Is A Lie and When the World Outlawed War. He blogs at DavidSwanson.org and WarIsACrime.org. He hosts Talk World Radio. He is a Nobel Peace Prize Nominee.

Donate

1 Comment

  1. So right!

    Time for a viewing of Battleship Galactica:
    The human Colonial forces, comprised of the Twelve Colonies of Man, have agreed to make peace with their mortal enemies, the robotic Cylons, who they created. Doesn’t go so well for the humans.

Leave A Reply

Subscribe

All the latest from Z, directly to your inbox.

Institute for Social and Cultural Communications, Inc. is a 501(c)3 non-profit.

Our EIN# is #22-2959506. Your donation is tax-deductible to the extent allowable by law.

We do not accept funding from advertising or corporate sponsors.  We rely on donors like you to do our work.

ZNetwork: Left News, Analysis, Vision & Strategy

Subscribe

All the latest from Z, directly to your inbox.

THE WIND CRIES FREEDOM

The Wind Cries Freedom, the new book from Z co-founder Michael Albert, is a sweeping oral history of a future American revolution.

Through thirty interconnected chapters, it draws out the strategies, failures, turning points, and hard-won wisdom of a movement that called itself the Revolutionary Participatory Society. These are not the polished memoirs of politicians: they are the unfiltered accounts of people who organized in neighborhoods, hospitals, universities, stadiums, courthouses, and places of worship, and kept a shared vision alive through cynicism and exhaustion.

The result is speculative political fiction that reads like history: messy, human, and quietly hopeful in the way that only real experience and long thought can produce.

Get your copy and peruse more features on the book’s website below.

“Read it, argue with it, but don’t look away. The future it recalls is one we must still fight to deserve.”

Yanis Varoufakis

“The most unusual and intriguing combination of prophecy, manifesto, and movement building manual that I have ever encountered.”

Bill Fletcher Junior

“This work fills a huge gap in our social movement literature.”

Cynthia Peters

You've just read your article on Z this month.

DOES Z'S SURVIVAL MATTER?

You keep coming back for a reason: serious political analysis, movement reporting, and debate beyond the priorities of corporate media. Today, Z is in a precarious financial position. If Z is part of how you understand the world, help keep it going. The readers who give monthly are the reason this work survives between fundraisers.

Z is in a precarious financial position. If it’s part of how you understand the world, help keep it going.

Number of donors705
Our goal1,000

Sustainers at $9/month or more receive the digital Z Magazine.

Already a sustainer? Click here and we won’t ask again. Thank you!

Your reading count is stored only in your browser and is never sent to us.

Sound is muted by default.  Tap 🔊 for the full experience

CRITICAL ACTION

Critical Action is a longtime friend of Z and a music and storytelling project grounded in liberation, solidarity, and resistance to authoritarian power. Through music, narrative, and multimedia, the project engages the same political realities and movement traditions that guide and motivate Z’s work.

If this project resonates with you, you can learn more about it and find ways to support the work using the link below.

Z is in the most precarious financial position in its history.

Z is a place to think beyond the limits of the present.

For decades, Z has brought together political analysis, movement reporting, debate, and visions of a different future from writers and activists around the world. That work is more than journalism. It is movement infrastructure: movements need places to develop ideas, test arguments, learn from experience, and imagine what comes next.

In the first two days of this fundraiser, 19 donors and 8 new monthly sustainers stepped up. Help us reach 1,000 donors who keep Z independent, for everyone.

For decades, Z has published the analysis, debate, and visions movements need, free of paywalls, ads, and billionaire owners. If that work should continue, Z needs your support now.

Number of donors705
Our goal1,000

Sustainers at $9/month or more receive the digital Z Magazine.

Subscribe

Join the Z Community – receive event invites, announcements, a Weekly Digest, and opportunities to engage.

Exit mobile version