Job Title: Data Engineer
Job ID:
Experience: 3 – 6 Years
Location: Ahmedabad / Pune / Remote
Shift:
Term: Full time
Role Overview:
The ideal candidate will have 3 to 6 years of hands-on experience designing, building,
and maintaining scalable data pipelines and cloud-based data platforms, with a solid
understanding of Medallion Architecture (Bronze, Silver, Gold) for organizing and
delivering reliable, governed data across the organization. You will collaborate closely
with business stakeholders to ensure the reliable delivery of high-quality data across
the organization.
This role offers an exciting opportunity to work with modern data technologies
including Snowflake, Databricks, and real-time streaming architectures, contributing
directly to data-driven decision making at scale.
Key Responsibilities:
- Design, develop, and maintain scalable, high-performance data pipelines
following Medallion Architecture and ETL/ELT workflows for batch and real-time
data ingestion
- Build and optimize data models, tables, and views within Snowflake aligned with
the Medallion pattern to support analytical and operational use cases
- Develop and manage Databricks workflows, notebooks, and Delta Lake pipelines
for large-scale data processing
- Implement real-time streaming data solutions to enable low-latency data
availability across the organization
- Collaborate with business stakeholders to understand requirements and deliver
reliable, well-documented data products
- Monitor, troubleshoot, and optimize data pipeline performance, and ensuring
data quality
- Participate in code reviews, enforce best practices, and contribute to technical
documentation
- Apply CI/CD best practices and manage code through Git version control.
- Support data governance initiatives including data lineage, cataloging, and data
quality frameworks
Experience:
- 3 to 6 years of professional experience in data engineering or a related field
- Proven track record working with cloud-native data platforms (Snowflake,
Databricks, or equivalent)
- Knowledge of data orchestration tools such as Azure Data Factory
- Hands-on experience implementing Medallion Architecture (Bronze/Silver/Gold)
in Databricks (Delta Lake) or Snowflake environments
- Hands-on experience designing and building ETL/ELT pipelines for large-scale
data environments
- Experience with real-time and streaming data architectures in production
environments
- Familiarity with data warehousing concepts, dimensional modeling, and data lake
architecture
- Experience working in Agile/Scrum development environments
- Exposure to CI/CD pipelines and DevOps practices for data workflows
- Proficiency in PySpark and/or Python for data transformation and pipeline
development
- Strong SQL skills including query optimization, window functions, and complex
joins
- Experience with cloud platforms such as Azure, AWS, or GCP
Required Skills:
- Core Technologies
o Snowflake
o Databricks
o Delta Lake
o Medallion Architecture
o Real-time Streaming
o Python/ PySpark
o SQL & Data Modelling
- Nice to Have
o Azure Data Factory (ADF)
o Apache Kafka
o Participate in developing the AI agents
Soft Skills:
- Strong problem-solving and debugging abilities.
- Clear and effective communication with technical and non-technical users.
- Attention to detail and commitment to high-quality data output.
- Ability to balance multiple priorities across development and maintenance
workstreams.
Legal Notice: The information transmitted in this document is intended only for the addressee and may contain
2 confidential and/or privileged material. Any interception, review, retransmission, dissemination, or other use of, or
taking of any action upon this information by persons or entities other than the intended recipient is prohibited by law
and may subject them to criminal or civil liability.
Certifications:
- SnowPro Core Certification (Snowflake) (Preferred)
- Databricks Certified Data Engineer Associate or Professional (Preferred)
- Azure Data Engineer Associate (DP-203) (Preferred)
- Confluent Certified Developer for Apache Kafka (Nice to have)
- Microsoft Certified: Azure Data Fundamentals (DP-900) (Nice to have)
Legal Notice: The information transmitted in this document is intended only for the addressee and may contain
3 confidential and/or privileged material. Any interception, review, retransmission, dissemination, or other use of, or
taking of any action upon this information by persons or entities other than the intended recipient is prohibited by law
and may subject them to criminal or civil liability.