From the course: Cloud Hadoop: Scaling Apache Spark

Unlock this course with a free trial

Join today to access over 25,300 courses taught by industry experts.

Advanced machine learning on Spark

Advanced machine learning on Spark - Apache Spark Tutorial

From the course: Cloud Hadoop: Scaling Apache Spark

Start my 1-month free trial Buy for my team

Advanced machine learning on Spark

“

- [Instructor] In previous movies we looked at running Spark ML, which is something I run into with my customers frequently. In addition to that, there have been quite a few advancements in machine learning algorithms recently. You might be wondering how these work on Spark. Now if you're not doing machine learning, this is pretty deep stuff. But for some of you, you will be doing machine learning so I wanted to include it here. So around deep learning, there is advancements around advanced neural networks. And these manifest as open source libraries. There are many different configurations, but these are the ones that I work with most frequently or have customers want me to work with them on. One is TensorFlow and it's created from Google and open sourced, now has an open source community. And the other one is MXNet and this is from Amazon open source community. As we saw, even with the Spark ML in the last example you…

Contents