Skip to main content

Implementing Predictive Analytics with Spark in Azure HDInsight Microsoft

About This Course

Are you ready for big data science? In this course, learn how to implement predictive analytics solutions for big data using Apache Spark in Microsoft Azure HDInsight. You will learn how to work with Scala or Python to cleanse and transform data, build machine learning models with Spark MLlib (the machine learning library in Spark), and create real-time machine learning solutions using Spark Streaming. Plus, find out how to use R Server on Spark to work with data at scale in the R language.

Note: To complete the hands-on elements in this course, you will require an Azure subscription and a Windows client computer. You can sign up for a free Azure trial subscription (a valid credit card is required for verification, but you will not be charged for Azure services). Note that the free trial is not available in all regions. It is possible to complete the course and earn a certificate without completing the hands-on practices.


  • Using Spark to work with data
  • Preprocessing data for machine learning in Spark
  • Building machine learning models in Spark
  • Using R at scale with R Server on Spark


  • Familiarity with Hadoop clusters in HDInsight
  • Familiarity with database concepts and basic SQL query syntax
  • Familiarity with basic programming constructs (for example, variables, loops, conditional logic)
  • A basic knowledge of statistics and machine learning
  • A willingness to learn actively and persevere when troubleshooting technical problems is essential

Course Staff

Course Staff Image #1

Graeme Malcolm

Senior Content Developer

Microsoft Learning Experiences

Graeme has been a trainer, consultant, and author for longer than he cares to remember, specializing in SQL Server and the Microsoft data platform. He is a Microsoft Certified Solutions Expert for the SQL Server Data Platform and Business Intelligence. After years of working with Microsoft as a partner and vendor, he now works in the Microsoft Learning Experiences team as a senior content developer, where he plans and creates content for developers and data professionals who want to get the best out of Microsoft technologies.

Course Staff Image #2

Richard Conway

Microsoft MVP

Richard Conway has been a software developer for the last 20 years, working across the City of London and globally. As an author of 8 books, numerous courses, a Microsoft Regional Director and a Microsoft Most Valuable Professional in Azure he keeps himself pretty busy! He’s the founder of the UK Azure Group and the IoT Innovators UK communities with over 10,000 members nationwide between them. During the day he works for Elastacloud, a company he co-founded to drive Azure and build large scale solutions for Big Data, Big Compute and machine learning.

  1. Course Number

  2. Classes Start