HCL 1ST ROUND: Gopi Bodu, Ifran
1) Tell me about technical expertise?
2) What types of sources you have in current project?
3) For API which type of data you are accessing?
4) How to connect APIs using databricks?
5) Have u done any automation in your project, what are those?
6) Can you explain how you are connecting teams’ channel and sending mail?
7) Do you have any exp in databricks cluster management?
8) Through SMTP connector what type of files you are receiving?
9) ADLS have excel file and having multiple sheets, how to read each sheet wise data separately?
10) How you are scheduling databricks notebooks?
11) How to schedule ADF pipelines?
12) What type of issues you faced in ADF pipelines?
13) Tell me about incremental load in ADF?
14) How to process daily data using PySpark if folder has hierarchical structure?
15) Explain about SCD Type1 and Type2?
16) How you are deploying databricks changes to other environments?
17) Stored procedure running fine still yesterday and quickly too, but today it taking much time and not completed. What
might be the reason?
18) EMP: empid, empname , mgrid Contact : name ,Phn number. How to get empname and manager phone num?
19) How to club all team members code from different feature branches in one chunk for one PR?
TCS 1ST ROUND: Pankaj
1) Tell me about your last project and roles and responsibilities?
2) How to handle out of memory issue?
3) Have u ever received out of memory issue just because of your code?
4) What is the diff between RDD and data frame?
5) Have u ever used spark submit command?
6) How to run a same note book parallel?
7) What is the use of widgets?
8) Do u have any idea about delta live tables?
GENPACT 1ST ROUND: Amit
1) Can you introduce yourself?
2) From when you have started to used cloud services?
3) Can you explain about end to end about HGV project, include source and target?
4) For spark orchestration purpose what you have used?
5) Explain about Producer, consumer and Broker on Kafka architecture?
6) Difference between Interactive cluster and Job cluster?
7) Do u know anything about delta lake house architecture?
8) Slicing method in python?
9) String = "Venkat"[::-1]
print(Srting)
What is the output of above code?
10) How to fetch last 3 letters from above output in python?
11) Explain about spark architecture?
12) What is DAG ?
INFOGAIN 1ST ROUND: Harsh
1) Explain about your day-to-day responsibilities?
2) What is the source and target in your project?
3) Explain about delta lake architecture?
4) What are the steps involved to flow data from data lake architecture to data where housing system?
5) How do u optimize your data lake storage data?
6) What is the difference between coalesce and repartition?
7) How CICD implemented in ADB and ADF?
8) How are you reading data from Kafka topic in databricks?
9) How you are connecting to Kafka topic using autoloader?
10) What is AQE in PySpark?
11) Which spark version and AQE version you are using?
12) Customer feedback table is having custId, productId rating and comments. Some products ratings are null. Write a
PySpark code to get records having null in rating and need to provide rating add comments to them?
13) How to get avg rating of each product?
14) How to get nested attributes value from Json data?
15) How do you handle security in your project?
16) Before Unity catalogue how do you handle security?
HEXAWARE 1ST ROUND:
1) What are the major aspects hold you in your project?
2) Elaborate what kind of data you are pulling from which systems, frequency, volume and orchestration?
3) How did you connect to get JSON data in to landing zone?
4) Explain how you are handling live data including setup and pulling?
5) What kind of challenges you face while setting up live data?
6) What kind of business rules and exception handling have u done in u r project?
DXC 1ST ROUND: Sishil
1) Can you start with your introduction?
2) Can you explain your last project end to end like where u have used ADB and ADF?
3) How would you design a ADF pipe line to incremental load data from on-premises SQL server and a rest API, then you
need to deduplicate the combined dataset and loaded in to SQL database?
4) How would you handle late arriving incremental data?
5) How you will handle partial failures during pipeline run and u need to ensure that pipe resume from point of failure?
6) SQL server having 100 tables and I want to create a single pipeline to copy data from these tables in to their
corresponding (Product table -> Product Container, Model table -> Model Container etc) blob storage?
7) How do you flatten a complex JSON structure into a more readable format using ADF?
8) How would you ensure that one pipe line runs after multiple dependent pipelines are successful? Various Ways ?
9) Write down a query in sql to find manager of your manager?
10) Find no of units sold region wise and product name wise for the period July 2023 to dec 2023 ?