Workshop: Machine Learning in HPC Environments
Event TypeWorkshop
Registration Categories
Machine Learning
TimeMonday, 18 November 20199am - 5:30pm
DescriptionThe intent of this workshop is to bring together researchers, practitioners, and scientific communities to discuss methods that utilize extreme scale systems for machine learning. This workshop will focus on the greatest challenges in utilizing HPC for machine learning and methods for exploiting data parallelism, model parallelism, ensembles, and parameter search. We invite researchers and practitioners to participate in this workshop to discuss the challenges in using HPC for machine learning and to share the wide range of applications that would benefit from HPC powered machine learning.
9:00am - 9:01amMachine Learning in HPC Environments
9:01am - 9:10amOpening Remarks: Machine Learning in HPC Environments
9:10am - 10:00amMorning Keynote : HPC for ML and ML for HPC - scalability, communication, and programming
10:00am - 10:30amMachine Learning in HPC Environments Morning Break
10:30am - 11:00amUnderstanding Scalability and Fine-Grain Parallelism of Synchronous Data Parallel Training
11:00am - 11:30amFine-Grained Exploitation of Mixed Precision for Faster CNN Training
11:30am - 12:00pmMetaoptimization on a Distributed System for Deep Reinforcement Learning
12:00pm - 12:30pmScheduling Optimization of Parallel Linear Algebra Algorithms Using Supervised Learning
12:30pm - 2:00pmMachine Learning in HPC Environments Lunch Break
2:00pm - 2:30pmParallel Data-Local Training for Optimizing Word2Vec Embeddings for Word and Graph Embeddings
2:30pm - 3:00pmScalable Hyperparameter Optimization with Lazy Gaussian Processes
3:00pm - 3:30pmMachine Learning in HPC Environments Afternoon Break
3:30pm - 4:20pmAfternoon Keynote - Running large models in minutes: an engineering journey through high performance for AI
4:20pm - 4:50pmGradVis: Visualization and Second Order Analysis of Optimization Surfaces During the Training of Deep Neural Networks
4:50pm - 5:20pmDisCo: Physics-Based Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems
5:20pm - 5:30pmConcluding Remarks - Machine Learning in HPC Environment
Back To Top Button