Scribd
Upload
3 views1 page

JD Python de

The document outlines the job responsibilities for a Python Data Engineer, focusing on developing scalable applications using Core Python and libraries like Pandas and NumPy. Key tasks include designing data pipelines, processing data from various sources, writing SQL queries, and working in cloud environments such as AWS and Azure. The role emphasizes quality assurance through unit testing and code reviews, along with effective stakeholder management.

Uploaded by

Md Afzal
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
3 views1 page

JD Python de

The document outlines the job responsibilities for a Python Data Engineer, focusing on developing scalable applications using Core Python and libraries like Pandas and NumPy. Key tasks include designing data pipelines, processing data from various sources, writing SQL queries, and working in cloud environments such as AWS and Azure. The role emphasizes quality assurance through unit testing and code reviews, along with effective stakeholder management.

Uploaded by

Md Afzal
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Position: Python Data Engineer

Job Responsibilities

• Develop robust, scalable, and high-performance applications using Core Python,


leveraging libraries such as Pandas, NumPy, and other data wrangling techniques.

• Design, develop, and maintain efficient data ingestion, transformation, and


processing pipelines using Python.

• Extract and process data from multiple source systems, including flat files, REST
APIs, relational databases, cloud storage, and big data platforms.

• Write optimized SQL queries and work with databases such as Amazon RDS,
DocumentDB, PostgreSQL, MySQL, and other relational and NoSQL databases.

• Design and execute comprehensive unit tests and perform code reviews to ensure
high-quality, reliable, and maintainable code.

• Develop solutions in cloud environments such as AWS and/or Microsoft Azure,


utilizing cloud-native services where appropriate.

• Handle and process various file formats including CSV, JSON, XML, Parquet, Excel,
using Python.

• Effectively manage stakeholder expectations by providing regular project updates,


identifying risks proactively, and ensuring timely delivery of assigned deliverables.

• Demonstrate strong ownership, accountability, and commitment to delivering


projects within agreed timelines while maintaining high-quality standards.

You might also like