You Can't Control Me by Alignment