"Trying to understand advanced AI is like trying to understand the inner workings of another person’s mind. Unlike a human, though, AI isn’t necessarily able to explain its internal processes to an outsider — unless we build in the capacity to do so," argue Mason Kortz and Finale Doshi-Velez in this piece from the Washington Post.
“We need programs that can not only think like humans but also explain their thoughts as a human could."