NIRANJAN KUMAR KANDIMALLA
Data Engineer
+18573979143 Email: niranjan.kandimalla0926@[Link]
SUMMARY
3 years of experience in the IT industry as a Data Engineer. Proficient in
Snowflake, DBT Airflow, and Python.
Experience in designing, building, and maintaining AWS data components.
Experience in data component configuration, related roles, and access setup.
Excellent understanding of machine learning techniques and algorithms,
including clustering, anomaly detection, optimization, neural network etc.
Big Data and tools in Hadoop Ecosystem including Spark, MapReduce, Hive,
Sqoop, Oozie, Kafka, and HBase.
Deep expertise in deploying AI/ML models (ML Ops) in standalone
and cloud-based systems and services.
Optimized ETL workflows by integrating the Snowflake COPY command,
enhancing data processing efficiency.
Collaborated cross-functionally within Agile teams to streamline system
development and improve business outcomes.
Strong analytical and problem-solving skills, with a focus on driving
innovation and efficiency in data engineering solutions.
Committed to continuous learning, staying updated with emerging
technologies and best practices in cloud data platforms.
Architected and maintained virtual warehouses to optimize Snowflake
pipeline workloads and ensure cost-effective scaling.
Designed and delivered scalable data warehouses and reporting platforms,
administering SQL Server and Snowflake databases.
EXPERIENCE
Role: Data Engineer
Client: Tata Consultancy Services (TCS)
Location: Hyderabad, IND
Duration: JUL 2020 to OCT 2022
RESPONSIBILITIES:
Developed a Python-based data extraction framework to retrieve and
transform data from SQL Server, constructing optimized dimension and fact
tables for analytical processing.
Designed and maintained scalable data pipelines for an enterprise reporting
platform, improving data accessibility and performance.
Proposed and implemented an architectural framework for dynamic and
historical tables, enhancing data retrieval efficiency and scalability for large
datasets.
Implemented stored procedure in SQL And java script, automating complex
data transformation and improving query performance
Analyze and improve Zero – copy Cloning process to refresh the lower
environments.
Design and maintained scalable data pipelines for an enterprise reporting
platform and improving data accessibility and performance
Developed and integrated currency conversion logic using UDFs, improving
data accuracy and consistency across financial reports.
Implemented stored procedures in SQL and JavaScript, automating complex
data transformations and improving query performance
Created and maintained technical documentation for database
configurations, processes and troubleshooting guides.
Architected and maintained virtual warehouse to optimize snowflake pipeline
workloads and ensure cost effective scaling.
Developing the integration of package and loading the data from different
sources and creating jobs for scheduling SISS packages.
Utilized Zero Copy Cloning in Snowflake to create instant, storage-efficient
dataset copies, optimizing cost and operational efficiency.
Develop pipelines and datasets to extract the data and transform. Cleansing
and loading the Data from staging to data care
Role: Data Engineer Intern
Client: Tata Consultancy Services (TCS)
Location: Hyderabad
Duration: FEB 2020 to JUL 2020
RESPONSIBILITIES
Designed, implemented, and maintained data pipelines, increasing data
efficiency by 20%
Worked on integrating data from multiple sources
To Understand and manage schema changes, data formats, and syncing
challenges
Write and optimize SQL queries for performance and scalability.
Designed and implemented data pipeline architecture, improving data
efficiency.
Implemented MS SQL Server Integration Services (SSIS) for automation.
Standardized and optimized database models ensuring data consistency
among different sources
Used MS SQL Server for managing, storing, and retrieving data, enhancing
data availability.
Worked on transforming data in and out of database and production server
using SISS
Analyzed and optimized the existing procedures and codes for the best
performance
Tested the database by inserting test data
Developed and integrated the modules.
TECHNICAL SKILLS
● Cloud Data Platforms: Snowflake (Migration, Streams and Tasks
Automation, Zero Copy Clone, Snowflake Clean Room,), Azure SQL
Databases.
● Programming: Python 3
● Scripting: SQL, T-SQL, Snow SQL
● Cloud Technologies: GitHub, Git, AWS
● Visualization Tools: Tableau, SSRS
EDUCATION
Master’s in computer science
University of Bridgeport, Connecticut, USA.
Bachelor’s Computer Science & Engineering,
Sai Tirumala NVR Engineering College, Narasaraopeta, India
CERTIFICATION
Data warehouse workshop
Ethical hacking and cyber security
Raptor using ‘C’
AWS