Neural Speech Translation: From Neural Machine Translation to Direct Speech Translation