Data Lake Modernization on Google Cloud: Migrate Workflows

magic_button

Data Lake Modernization

Cloud Dataproc

Big Data

These skills were generated by AI. Do you agree this course teaches these skills?

7 个小时 15 分钟中级 universal_currency_alt 5 积分

Welcome to Migrate Workflows, where we discuss how to migrate Spark and Hadoop tasks and workflows to Google Cloud.

Skill badges validate your practical knowledge on specific products through hands-on labs and challenge assessments. Earn a badge by completing a course or jump straight into the challenge lab to get your badge today. Badges prove your proficiency, enhance your professional profile, and ultimately lead to increased career opportunities. Visit your profile to track badges you’ve earned.

info

课程信息

目标

Describe options on migrating Spark to Google Cloud
Migrate spark Jobs directly to to Dataproc (“Lift and Shift”)
Optimize Spark Jobs to run on Google Cloud
Refactor Spark Jobs to use native Google Cloud services
Convert a Spark job to a serverless implementation using Cloud Functions

前提条件

Required: Have completed the Data Engineering on Google Cloud training, Be a Google Cloud Certified Professional Data Engineer or have equivalent expertise in Data Engineering, Have access to Cloud Connect – Partners. Recommended: Experience building data processing pipelines, Experience with Apache Beam and Apache Hadoop Java or Python programming expertise. Organizational requirements: The Cloud Partner organization must have implemented at least one Data Warehouse solution previously on any Data Warehouse platform.

受众

Data Warehouse Deployment Engineers, Data Warehouse Consultants, Data Warehouse Architects. Technical Project Leads, Technical Project Managers, Data / Business Analyst.

支持的语言

English

Data Lake Modernization on Google Cloud: Migrate Workflows

Data Lake Modernization on Google Cloud: Migrate Workflows

实验室挑战赛的强大作用