You Can't Judge a Book by Looking at the Cover