Evolvable AI may create special risks

The future of AI may involve systems capable of genuine Darwinian evolution. Such systems may breach the limitations of current learning systems, but will also pose special risks as evolution tends to produce selfish actors, and evolvable systems are particularly hard to control. We outlined these risks in a Perspective paper, and proposed countermeasures, urging global regulation before evolvable AI arrives.