Deep Learning with Apache Spark - MasterClass!

Deep learning has solved tons of interesting real-world problems in recent years. Apache Spark has emerged as the most important and promising Machine Learning tool and currently a stronger challenger of the Hadoop ecosystem. In this course, you’ll learn about the major branches of AI and get familiar with several core models of Deep Learning in its natural way.

This comprehensive 3-in-1 course is a fast-paced guide to implementing practical hands-on examples, streamlining Deep Learning with Apache Spark. You’ll begin by exploring Deep Learning Neural Networks using some of the most popular industrial Deep Learning frameworks. You’ll apply built-in Machine Learning libraries within Spark, also explore libraries that are compatible with TensorFlow and Keras. Next, you’ll create a deep network with multiple layers to perform computer vision and improve cybersecurity with Deep Reinforcement Learning. Finally, you’ll use a generative adversarial network for training and create highly distributed algorithms using Spark.

By the end of this course, you'll develop fast, efficient distributed Deep Learning models with Apache Spark.

Contents and Overview

This training program includes 3 complete courses, carefully chosen to give you the most comprehensive training possible.

The first course, Deep Learning with Apache Spark, covers deploying efficient deep learning models with Apache Spark. The tutorial begins by explaining the fundamentals of Apache Spark and deep learning. You will set up a Spark environment to perform deep learning and learn about the different types of neural net and the principles of distributed modeling (model- and data-parallelism, and more). You will then implement deep learning models (such as CNN, RNN, LTSMs) on Spark, acquire hands-on experience of what it takes, and get a general feeling for the complexity we are dealing with. You will also see how you can use libraries such as Deeplearning4j to perform deep learning on a distributed CPU and GPU setup. By the end of this course, you'll have gained experience by implementing models for applications such as object recognition, text analysis, and voice recognition. You will even have designed human expert games.

The second course, Apache Spark Deep Learning Recipes, covers over 35 recipes that streamline eep learning with Apache Spark. This video course starts offs by explaining the process of developing a neural network from scratch using deep learning libraries such as Tensorflow or Keras. It focuses on the pain points of convolution neural networks. We’ll predict fire department calls with Spark ML and Apple stock market cost with LSTM. We’ll walk you through the steps to classify chatbot conversation data for escalation. By the end of the video course, you'll have all the basic knowledge about apache spark.

The third course, Mastering Deep Learning using Apache Spark, covers designing Deep Learning models to edge industrial-grade apps. You’ll begin with building deep learning networks to deal with speech data and explore tricks to solve NLP problems and classify video frames using RNN and LSTMs. You’ll also learn to implement the anomaly detection model that leverages reinforcement learning techniques to improve cybersecurity. Moving on, you’ll explore some more advanced topics by performing prediction classification on image data using the GAN encoder and decoder. Then you’ll configure Spark to use multiple workers and CPUs to distribute your Neural Network training. Finally, you’ll track progress, solve the most common problems in your neural network, and debug your models that run within the distributed Spark engine.

By the end of this course, you'll develop fast, efficient distributed Deep Learning models with Apache Spark.

About the Authors

● Tomasz Lelek is a Software Engineer, programming mostly in Java and Scala. He has been working with the Spark and ML APIs for the past 5 years with production experience in processing petabytes of data. He is passionate about nearly everything associated with software development and believes that we should always try to consider different solutions and approaches before solving a problem. Recently he was a speaker at conferences in Poland, Confitura and JDD (Java Developers Day), and at Krakow Scala User Group. He has also conducted a live coding session at Geecon Conference. He is a co-founder of initlearn, an e-learning platform that was built with the Java language. He has also written articles about everything related to the Java world.