Pluralsight – Building Batch Data Pipelines on Google Cloud 2024-6

Published on: 2024-09-07 23:47:30

Categories: 28

Description

Building Batch Data Pipelines on Google Cloud course. This course will help you gain a deep understanding of designing and implementing batch data pipelines in a Google Cloud environment. Considering the huge amount of data that organizations face today, the ability to build efficient and reliable pipelines for data processing and analysis is of particular importance. In this course, the basic concepts of data pipelines, its different patterns (EL, ELT, ETL) and the best methods for choosing the right pattern for each scenario are examined.

What you will learn:

Introduction to batch data pipelines: Understanding the basic concepts of data pipelines, its components and its importance in data processing.
Choosing the right template: Knowing the different patterns of data pipelines (EL, ELT, ETL) and how to choose the right template for each scenario based on data volume, processing complexity and time requirements.
Using Google Cloud tools: Familiarity with powerful Google Cloud tools such as BigQuery, Dataproc, Cloud Data Fusion and Dataflow to build and manage data pipelines.
Running Spark on Dataproc: Learn how to run the Spark big data processing framework on the Dataproc platform and use it to process big data.
Serverless data processing with Dataflow: Getting to know the concepts of serverless data processing and using the Dataflow service to build scalable data pipelines without the need for infrastructure management.
Managing Pipelines with Cloud Data Fusion and Cloud Composer: Learn how to build, manage, and schedule data pipelines using Cloud Data Fusion and Cloud Composer tools.

This course is suitable for people who:

They want to work in the field of data engineering and data analysis.
They intend to design and implement efficient and scalable data pipelines for their organization.
Looking to learn Google Cloud’s powerful tools for data processing.
Interested in learning the basic concepts of data pipelines and best practices for their design and implementation.
Want to gain hands-on experience building various components of data pipelines on Google Cloud.