Job Summary:
We are seeking a highly skilled Technical Architect with a strong focus on Databricks to
design and implement scalable data platforms and pipelines. The ideal candidate will
lead the migration from legacy systems to a modern Lakehouse architecture, ensuring
data governance, quality, and security while collaborating with various stakeholders to
align technical solutions with business objectives.
Years of Experience: 6-8 yrs
Core Responsibilities:
Design and implement scalable data platforms and pipelines using Azure
Databricks, Apache Spark, Delta Lake, and MLflow.
Lead the migration from legacy platforms to Lakehouse architecture.
Develop batch and streaming data pipelines for ingestion, transformation, and
analytics.
Establish standards for data governance, quality, and security.
Collaborate with stakeholders to align architecture with business goals.
Mentor data engineers and developers on Databricks best practices.
Integrate Databricks with tools like Power BI, Tableau, Kafka, Snowflake, and
Azure Data Factory.
Mandatory Skills:
Strong command of Databricks and Azure.
Proficiency in SQL, Python, Scala, and Spark.
Experience with CI/CD pipelines, DevOps, and orchestration tools like Airflow or
Data Factory.
Familiarity with Azure cloud platforms.
Deep understanding of distributed computing, performance tuning, and data
Security.
Preferred Skills:
Experience with data mesh, data fabric, or enterprise data architectures.
Strong ERP knowledge (e.g., SAP, Salesforce).
Hands-on capability and self-exploration skills to drive analytics adoption across
business teams.
Qualifications:
Bachelor’s or Master’s in Computer Science, Data Science, or a related field.
Certifications such as Azure Solution Architect, Azure Data Engineer, or
Databricks Certified Data Engineer or Solutions Architect.
Domain knowledge in finance, healthcare, or public sector is a plus.
Join our team and play a pivotal role in transforming our data architecture while
mentoring the next generation of data engineers. Your expertise in Databricks will be
crucial in driving our data initiatives forward.