Building Big Data Pipelines with R & Sparklyr & Power BI udemy course free download
What you'll learn:
System Design for Big Data Pipelines
- Learn about the building blocks of a big data pipeline, their functions, and challenges
- Adapt an end-to-end methodical approach to designing a big data pipeline
- Explore techniques to ensure the overall scaling of a big data pipeline
- Study design patterns for building blocks, their advantages, shortcomings, applications, and available technologies
- Focus additionally on Infrastructure, Operations, and Security for Big Data deployments
- Exercise the learnings in the course with a Batch and real-time use case study
Requirements::
- Big Data Technology Concepts
- Familiarity with Big Data Technologies like Apache Spark, Apache Kafka, and NoSQL
- Development / Deployment Experience with Big Data Technologies and Pipelines
- Software Design and Development Experience including Cloud & Microservices
Description:
Welcome to the Building Big Data Pipelines with R & Sparklyr & PowerBI course. In this course we will be creating a big data analytics solution using big data technologies for R.
In our use case we will be working with raw earthquake data, we will be applying big data processing techniques to extract transform and load the data into usable datasets. Once we have processed and cleaned the data, we will use it as a data source for building predictive analytics and visualizations.
Power BI Desktop is a powerful data visualization tool that lets you build advanced queries, models and reports. With Power BI Desktop, you can connect to multiple data sources and combine them into a data model. This data model lets you build visuals, and dashboards that you can share as reports with other people in your organization.
Sparklyr is an open-source library that is used for processing big data in R, by providing an interface between R and Apache Spark. It allows you to take advantage of Spark's ability to process and analyze large datasets in a distributed and interactive manner. It also provides interfaces to Spark's distributed machine learning algorithms and much more.
-
You will learn how to create big data processing pipelines using R
-
You will learn machine learning with geospatial data using the Sparklyr library
-
You will learn data analysis using Sparklyr, R and Power BI
-
You will learn how to manipulate, clean and transform data using Spark dataframes
-
You will learn how to create Geo Maps in Power BI Desktop
-
You will also learn how to create dashboards in Power BI Desktop
Who this course is for:
- R Developers at any level
- Data Engineers at any level
- Developers at any level
- Machine Learning engineers at any level
- Data Scientists at any level
- GIS Developers at any level
- The curious mind
Course Details:
- 2.5 hours on-demand video
- 1 article
- Access on mobile and TV
- Full lifetime access
- Certificate of completion