Databricks Essentials for Spark Developers (Azure and AWS)

What you'll learn:

• Data Engineering leveraging Databricks features
• Databricks CLI to manage files, Data Engineering jobs and clusters for Data Engineering Pipelines
• Deploying Data Engineering applications developed using PySpark on job clusters
• Deploying Data Engineering applications developed using PySpark using Notebooks on job clusters
• Perform CRUD Operations leveraging Delta Lake using Spark SQL for Data Engineering Applications or Pipelines
• Perform CRUD Operations leveraging Delta Lake using Pyspark for Data Engineering Applications or Pipelines
• Setting up development environment to develop Data Engineering applications using Databricks
• Building Data Engineering Pipelines using Spark Structured Streaming on Databricks Clusters
• Incremental File Processing using Spark Structured Streaming leveraging Databricks Auto Loader cloudFiles
• Overview of Auto Loader cloudFiles File Discovery Modes – Directory Listing and File Notifications
• Differences between Auto Loader cloudFiles File Discovery Modes – Directory Listing and File Notifications
• Differences between traditional Spark Structured Streaming and leveraging Databricks Auto Loader cloudFiles for incremental file processing.

Requirements:

• Programming experience using Python
• Data Engineering experience using Spark
• Ability to write and interpret SQL Queries
• This course is ideal for experienced data engineers to add Databricks as one of the key skill as part of the profile

Description:

Who this course is for:

• Data Engineers who have good knowledge of Apache Spark using Scala or Python or Spark SQL
• Data Scientists with working knowledge of Apache Spark
• IT Aspirants who want to get started with Apache Spark on Cloud
• Introduction to Computer Networks
• React & AWS Amplify build a complete serverless app w/ CI/CD
• Introduction to HTML Complete Beginner to Expert Course
• The JavaScript Bootcamp: Build 20 Real World Projects

Course Details:

• 4 hours on-demand video
• 1 practice test
• Full lifetime access
• Access on mobile and TV
• Certificate of completion

Databricks Essentials for Spark Developers (Azure and AWS) udemy free download

Learn about Databricks Features