Loading...
No results found.
Share on LinkedIn Feed Twitter Facebook Share on LinkedIn Feed Twitter Facebook

Apply your skills in Google Cloud console

Your Learning progress might get lost. Sign in or Join to save your progress.
close

Data Lake Modernization on Google Cloud: Migrate Workflows

Data Lake Modernization on Google Cloud: Migrate Workflows

magic_button Apache Spark Dataproc Workflows
These skills were generated by AI. Do you agree this course teaches these skills?
7 hours 15 minutes Intermediate universal_currency_alt 5 Credits

Welcome to Migrate Workflows, where we discuss how to migrate Spark and Hadoop tasks and workflows to Google Cloud.

Skill badges validate your practical knowledge on specific products through hands-on labs and challenge assessments. Earn a badge by completing a course or jump straight into the challenge lab to get your badge today. Badges prove your proficiency, enhance your professional profile, and ultimately lead to increased career opportunities. Visit your profile to track badges you’ve earned.

info
Course Info
Objectives
  • Describe options on migrating Spark to Google Cloud
  • Migrate spark Jobs directly to to Dataproc (“Lift and Shift”)
  • Optimize Spark Jobs to run on Google Cloud
  • Refactor Spark Jobs to use native Google Cloud services
  • Convert a Spark job to a serverless implementation using Cloud Functions
Prerequisites
Required: Have completed the Data Engineering on Google Cloud training, Be a Google Cloud Certified Professional Data Engineer or have equivalent expertise in Data Engineering, Have access to Cloud Connect – Partners. Recommended: Experience building data processing pipelines, Experience with Apache Beam and Apache Hadoop Java or Python programming expertise. Organizational requirements: The Cloud Partner organization must have implemented at least one Data Warehouse solution previously on any Data Warehouse platform.
Audience
Data Warehouse Deployment Engineers, Data Warehouse Consultants, Data Warehouse Architects. Technical Project Leads, Technical Project Managers, Data / Business Analyst.
Available languages
English
What do I do when I finish this course?
After finishing this course, you can explore additional content in your learning path or browse the catalog.
What badges can I earn?
Upon finishing the required items in a course, you will earn a badge of completion. Badges can be viewed on your profile and shared with your social network.
Interested in taking this course with one of our authorized on-demand partners?
Explore Google Cloud content on Coursera and Pluralsight.
Prefer learning with an instructor?
View the public classroom schedule here.
Can I take this course for free?
When you enroll into most courses, you will be able to consume course materials like videos and documents for free. If a course consists of labs, you will need to purchase an individual subscription or credits to be able consume the labs. Labs can also be unlocked by any campaigns you participate in. All required activities in a course must be completed to be awarded the completion badge.

The Power of Challenge Labs

Now you can fast track your way to a skill badge without having to take the entire course. If you're confident with your skills, jump straight to the challenge lab.

Preview