ENHANCING DATA

SCIENCE OUTCOMES
WITH EFFICIENT
WORKFLOW
NVIDIA DLI
 WORKSHOP OUTLINE

Lab 1 Advanced ETL

• Focuses on developing pipeline for ETL
• Discuss Parquet file format
• Perform EDA on real behavior dataset
• Explore various feature engineering techniques for categorical and continuous features
• Demonstrate interoperability

Lab 2 Advanced Analytics

• Build tree-based classification models
• Perform feature selection and fine-tune models with hyperparameter optimization
• Create additional features using neural network embeddings

Lab 3 Deployment
• Deploy data processing pipeline to Triton Inference Server
• Experiment various inference configurations to optimize performance

Assessment
2
 DATA SCIENCE IS NOT A LINEAR PROCESS
Faster Data Processing Leads to Better Data Science Outcomes

Benefits of Accelerated Data Science Workflow

• Higher productivity

• More explorations and iterations can improve model accuracy and optimize inference performance

• Lower time to insight and total cost of ownership

3
AGENDA

Lab 1 – Advanced ETL

Lab 2 – Advanced Analytics

Lab 3 – Deployment
• Deploy data processing pipeline to Triton Inference Server
• Experiment various inference configurations to optimize
performance

Assessment

4
 NVIDIA TRITON INFERENCE SERVER
Deploy, Run, and Scale Trained ML or DL Models

• Executes multiple models on single or multi-GPU configurations

• Supports all popular AI frameworks, including Forest Inference Library

• Dynamically batches requests to increase throughput

• Provides latency and health metrics

• Auto scaling and load balancing

5
 FOREST INFERENCE LIBRARY
FIL Enables High Performance Inference

• cuML’s Forest Inference Library accelerates prediction

(inference) for random forests and boosted decision trees

• Works with existing saved models (XGBoost, LightGBM, and cuML

RF)

• Can be deployed on the Triton Inference Server

• Improve inference performance for:

• Low-latency case – where inference is applied to each instance

arriving in a streaming context

• High-throughput case – where inference is applied to many samples

6
RAPIDS INTEGRATED INTO CLOUD ML FRAMEWORKS
Focused on Robust Functionality, Deployment, and User Experience

8
 SUMMARY
Faster Data Processing Leads to Better Data Science Outcomes

Accelerating data science workflow enable rapid experimentation:

• Create and discover useful features for model training

• Hyperparameter tuning to find the most accurate possible model(s)

• Select features for optimal inference performance

Close integration with major cloud and OSS solution providers to appropriately scale workflows and be
cost efficient

9
END OF LAB 3
11
 LAB 1 SUMMARY

• Focuses on developing pipeline for ETL

• Discuss Parquet file format

• Perform EDA on real behavior dataset

• Explore various feature engineering techniques for categorical and continuous features

• Demonstrate interoperability

12
 LAB 2 SUMMARY

• Build tree-based classification models

• Perform feature selection and fine-tune models with hyperparameter optimization

• Create additional features using neural network embeddings

13
 LAB 3 SUMMARY

• Deploy data processing pipeline to Triton Inference Server

• Experiment various inference configurations to optimize performance

14