Siva Rama Krishna R

Mobile No.: +91 7829251932

E-Mail: sivaramakrishna.r3999@[Link]

PROFILE SUMMARY

 Having 5+ years of experience in IT industry including Big Data Hadoop and SQL Server technologies.
 3 years of Hands on experience with Big Data core components and Eco System (HDFS, Hive, Impala, Sqoop,
Oozie, Ambari, Spark, Spark Sql, Spark Core, Shell Scripting, HBase, Pig, MapReduce)
 Hands-on experience in Cloudera, Hortonworks Distributions.
 Experience in Linux and Scripting (Hive).
 Developed end to end Hive and Impala Dynamic Data Masking applications.
 Adept in end-to-end development of Database Application from requirement analysis to system study,
designing, coding testing, de-bugging, documentation, and implementation.
 Worked on Spark SQL Transformations and actions.

 Worked on Kerberos Setup and Sentry for Authorization.

ORGANISATIONAL EXPERIENCE

 Currently working as Senior Software Developer in FORD, Chennai from Sep’2020 to till date
 Previously worked as Senior Software Developer in MENTIS, Chennai from May’2018 to Sep’2020
 Previously worked as Software Developer in TCS, Bangalore from Dec’2015 to May’2018.

Education Details

 [Link] (Computer Science Engineering) from JNT University, Kakinada (2014).

Technical Skills

 Ecosystem : HDFS, Hive, Impala, Sqoop, Oozie, Spark SQL, Spark Core, HBase, Pig
 Enterprise Hadoop : Apache Hadoop, Cloudera, Hortonworks
 Language : Java
 DB Languages : SQL Server
 NoSql : HBase
 Operating Systems Used : Linux, Unix, Windows
Professional Experience

Project #4 : Reporting & Analytics

Client : FORD, Chennai
Organization : TEK Systems, Chennai
Tools / Platform : HDFS, Hive, Impala, Sqoop, Oozie, Ambari, Alteryx, Spark, Spark SQL, Hue, Hbase.

Description:

As part of Data Hub team we have multiple source of ingestion and data is supplied multiple downstream.
The Hub will work on transforming the unstructured data into meaningful structured format based on the business cases
using Big data Framework. We will provide the data to down streams based on the need in the form of Hive table, REST
API for Application and to the dashboard using multiple connectivity for Reporting purpose.

Roles and Responsibilities:

 Working on historical data.

 As part of development we are doing technical analysis.
 Getting the Approval from Product Owner.
 Developing hive HQL's as per the client requirement.
 Working with query transformation.
 Test the HQL’s thoroughly.
 Creating oozie jobs for scheduling and test the results after running the jobs.
 Prepare the test cases document and share with client.
 Getting the Approval from Product Owner for Production Launch.
 Copy the oozie jobs from QA to Production environment and schedule the Jobs.
 Monitoring the oozie jobs.
 Worked on production releases.
 Done testing of applications in migration from Horton works to cloudera.
 Solving production issues.

Project #3 : Data Masking

Client : Credit Suisse, Switzerland
Organization : MENTIS, Chennai
Tools / Platform : HDFS, Hive, Impala, Sqoop, Oozie, Spark, Spark SQL, Core java, Spark Core, Hue, Hbase.

Description:

Credit Suisse has two divisions, Private Banking & Wealth Management and Investment Banking. A Shared
Services department provides support functions like risk management, legal, IT and marketing to all areas. Operations
are divided into four regions: Switzerland, Europe, the Middle East and Africa, the Americas and the Asian Pacific. Mentis
offering the masking product to protect the data from unauthorized users.
Roles and Responsibilities:

 Involved in the architectural design of hive and impala for Mentis masking applications.
 Developing Discovery, Static Data Masking and Dynamic Data Masking Products.
 Creating Hive and Impala UDF’s.
 Creating the masking views and handling all runtime related issues
 Performance tuning
 Handling different type of Tables in Hive
 Interacting with the clients on product related issues.
 Processing the hive tables using Spark RDD’s.
 Developing the Spark UDF’s.
 Connecting to Hive through Spark SQL and applied some transformations and actions to analyze the data.
 Created Java functions for Hive.
 Created Java functions for Impala.
 Used core java for developing the Masking functions.

Project #2 : Disney
Client : Disney, US
Organization : TCS, Bangalore
Tools / Platform : HDFS, Hive, Impala, Sqoop, Map Reduce, Pig , Oozie, HBase, Sqoop, Linux, Sql

Description:

The Walt Disney Company is a well know provider of Multinational mass media, Entertainment in USA and which
is having business operation in Worldwide. The Hadoop Ecosystems defines and facilitated daily analyses of 60 to 80GB
of website, Digital market, Digital media and print sources data collected by external sources. Having 40 nodes Hadoop
cluster which holds 1008TB cluster capacity. Providing the machinery revenue for daily analysis. Online print
advertisement and surveys solutions.

Roles and Responsibilities:

 Analyzing the functional specifications as per the requirements.

 Using Sqoop to transfer the data between Oracle Database and HDFS.
 Imported millions of structured data from relational databases using Sqoop import to process using Hive and stored
the data into HDFS in CSV format.
 Involved in emitting processed data from Hadoop to relational databases or external file systems using Sqoop, HDFS
GET or CopyToLocal.
 Writing Hive queries.
 Storing and retrieving data using HQL from Hive.
 Developing Hive DDLs to create, alter and drop Hive TABLES.
 Working with hive complex data types.
 Working with partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to
optimize performance.
 Developing solutions to pre-process large sets of structured, with different file formats (Text file, Avro data files,
Sequence files, Xml and JSON files, ORC and Parquet).
Project #1 : Data Migration for NIA
Client : New India Assurance
Organization : TCS, Bangalore
Tools / Platform : PL/SQL, SQL, 9i/10g/11g, SQL*Plus

Description: New India Assurance Co. Ltd, the first fully Indian owned insurance company in India, has hired CMC Ltd for
carrying out a long-term project. With a wide range of policies New India has become one of the largest non-life
insurance companies, not only in India, but also in the Afro-Asian region. In this project our job is to extract data from
and migrate it properly. We have developed a utility for testing of that extracted data before delivery. We have to
generate files for those data. After completion of file generations and testing we deliver those files for core Insurance
solution.

Roles and Responsibilities:

 Worked as a Database application developer to develop the business application using Oracle SQL and PL/SQL.
 Designed and created database tables, Synonyms, views, procedures and Functions.
 Built and maintained SQL scripts, indexes, reports and queries for data analysis and extraction.
 Developed SQL Queries to fetch data from different tables using joins and Sub Queries.
 Developed PL/SQL Functions, Cursors for various calculations in the application.
 Worked with business users and application developers to identify business needs and provide solutions.
 Implemented Trigger for accepting valid data and for audit purpose.
 Developed, modified, and optimized complex queries to data retrieval and modification.
 Using SQL*Loader to load data items from different source system files to database and export excel data into
database tables using command prompt, Load and SQL*loader.