Having brought dramatic improvements in speech recognition, neural networks are now beginning to make an impact in machine translation as well. I will give a survey of some recent advances, including our own work at USC/ISI on fast training and decoding with neural language models, work at BBN on neural translation models, and other approaches as well.