Scribd
Upload
16 views2 pages

Data Engineer Role: GCP & ETL Expert

The document outlines a job description for a Data Engineer with 1 to 2 years of experience, responsible for designing and maintaining data pipelines and cloud infrastructure, particularly in Google Cloud Platform (GCP). Key responsibilities include implementing ETL/ELT processes, managing workflow automation with Apache Airflow, and collaborating with data teams to ensure data accessibility. Required skills include proficiency in Python, experience with GCP services, and a strong understanding of data modeling and pipeline architectures.

Uploaded by

jknikam1702
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
16 views2 pages

Data Engineer Role: GCP & ETL Expert

The document outlines a job description for a Data Engineer with 1 to 2 years of experience, responsible for designing and maintaining data pipelines and cloud infrastructure, particularly in Google Cloud Platform (GCP). Key responsibilities include implementing ETL/ELT processes, managing workflow automation with Apache Airflow, and collaborating with data teams to ensure data accessibility. Required skills include proficiency in Python, experience with GCP services, and a strong understanding of data modeling and pipeline architectures.

Uploaded by

jknikam1702
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Data Engineer

Role Overview
We are seeking a Data Engineer with 1 to 2 years of experience to join our team. In this role,
you will be responsible for designing, developing, and maintaining scalable data pipelines and
cloud-based data infrastructure to support data processing, storage, and analytics. You will
work closely with data scientists, analysts, and other stakeholders to ensure seamless data
integration, automation, and accessibility. The ideal candidate has a strong foundation in
ETL/ELT processes, workflow orchestration, and cloud-based data solutions, particularly within
Google Cloud Platform (GCP).

Responsibilities
●​ Design, build, and maintain scalable and efficient ETL/ELT pipelines to process
large-scale datasets.
●​ Implement and manage workflow automation and orchestration using Apache Airflow.
●​ Build and optimize data infrastructure using Google Cloud Platform (GCP) services like
Cloud Storage, DataProc, Cloud Run, Pub/Sub, and BigQuery.
●​ Integrate and manage data warehouses, particularly BigQuery.
●​ Design and develop dynamic and interactive dashboards using Looker, Metabase, and
Superset to present insights to clients and internal stakeholders.
●​ Develop and maintain CI/CD pipelines for seamless deployment and continuous
integration of data solutions.
●​ Monitor and troubleshoot data pipeline issues, ensuring data quality and consistency.
●​ Leverage best practices for data governance, security, and compliance in cloud
environments.
●​ Collaborate with data scientists, analysts, and other stakeholders to understand data
needs and deliver reliable data solutions.
Required Skills
●​ Strong proficiency in Python programming for data engineering tasks.
●​ In-depth knowledge of ETL processes and data pipeline architectures.
●​ Experience with Airflow for orchestration and scheduling.
●​ Solid experience working with Google Cloud Platform (GCP) services, including Cloud
Storage, DataProc, Cloud Run, Pub/Sub, and BigQuery.
●​ Proficiency in building and maintaining CI/CD pipelines.
●​ Experience with data modeling, database design, and querying.
●​ Strong problem-solving skills, with the ability to troubleshoot and optimize complex
data pipelines.

Qualifications
●​ Bachelor’s or Master’s degree in Computer Science, Information Technology, or a
related field.
●​ 1 to 2 years of experience in data engineering or a similar role.
●​ Experience working with big data technologies and cloud-based data platforms.
●​ Strong understanding of SQL, NoSQL databases, and data warehousing concepts.
●​ Certifications in GCP, Airflow, or Data Engineering are a plus.

You might also like