Reports  |    |  June 15, 2001

Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures

Report by Eliezer Yudkowsky.
Published by the Machine Intelligence Research Institute (MIRI).
282 pages.

Abstract:

The goal of the field of Artificial Intelligence is to understand intelligence and create a human-equivalent or transhuman mind. Beyond this lies another question—whether the creation of this mind will benefit the world; whether the AI will take actions that are benevolent or malevolent, safe or uncaring, helpful or hostile.

Creating Friendly AI describes the design features and cognitive architecture required to produce a benevolent—“Friendly”—Artificial Intelligence. Creating Friendly AI also analyzes the ways in which AI and human psychology are likely to differ, and the ways in which those differences are subject to our design decisions. [ . . . ]