Habana Deep Learning Examples for Training and Inference

• Habana Deep Learning Examples for Training and Inference
  • Model List and Performance Data
  • Computer Vision
  • Natural Language Processing
  • Audio
  • Generative Models
  • MLPerf™ Training 3.1
  • MLPerf™ Inference 3.1
  • Reporting Bugs/Feature Requests
• Community
  • Hugging Face
  • Fairseq

Model List and Performance Data

Please visit this page for performance information.

This repository is a collection of models that have been ported to run on Habana Gaudi AI accelerator. They are intended as examples, and will be reasonably optimized for performance while still being easy to read.

Computer Vision

Models	Framework	Validated on Gaudi	Validated on Gaudi2
ResNet50, ResNeXt101	PyTorch	Training	Training, Inference
ResNet50 for PyTorch Lightning	PyTorch Lightning	Training	Training
ResNet152	PyTorch	Training	-
MobileNetV2	PyTorch	Training	-
UNet 2D, Unet3D	PyTorch Lightning	Training, Inference	Training, Inference
SSD	PyTorch	Training	Training
GoogLeNet	PyTorch	Training	-
Vision Transformer	PyTorch	Training	-
DINO	PyTorch	Training	-
YOLOX	PyTorch	Training	-
ResNet50 Keras	TensorFlow	Training	Training
ResNeXt101	TensorFlow	Training	Training
SSD	TensorFlow	Training	Training
Mask R-CNN	TensorFlow	Training	Training
UNet 2D	TensorFlow	Training	Training
UNet 3D	TensorFlow	Training	Training
DenseNet	TensorFlow	Training	-
Vision Transformer	TensorFlow	Training	-

Natural Language Processing

Models	Framework	Validated on Gaudi	Validated on Gaudi2
BERT Pretraining and Finetuning	PyTorch	Training, Inference	Training, Inference
DeepSpeed BERT-1.5B, BERT-5B	PyTorch	Training	-
BART	PyTorch	Training	-
HuggingFace BLOOM	PyTorch	Inference	Inference
Megatron-DeepSpeed BLOOM 13B	PyTorch	-	Training
Megatron-DeepSpeed LLaMA 13B	PyTorch	-	Training
Megatron-DeepSpeed LLaMA 2 70B	PyTorch	-	Training
DeepSpeed-Chat	PyTorch	-	Training
BERT	TensorFlow	Training	Training
Transformer	TensorFlow	Training	Training

Audio

Models	Framework	Validated on Gaudi	Validated on Gaudi2
Wav2Vec2ForCTC	PyTorch	Inference	Inference
Hubert	PyTorch	-	Training

Generative Models

Models	Framework	Validated on Gaudi	Validated on Gaudi2
Stable Diffusion	PyTorch Lightning	Training, Inference	Training, Inference
Stable Diffusion FineTuning	PyTorch	Training	Training
Stable Diffusion v2.1	PyTorch	Inference	Inference

MLPerf™ Training 3.1

Models	Framework	Validated on Gaudi	Validated on Gaudi2
GPT3	PyTorch	-	Training
ResNet50	PyTorch	-	Training
BERT	PyTorch	-	Training
ResNet50	TensorFlow	-	Training
BERT	TensorFlow	-	Training

MLPerf™ Inference 3.1

Models	Framework	Validated on Gaudi	Validated on Gaudi2
GPT-J	PyTorch	-	Inference

MLPerf™ is a trademark and service mark of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use is strictly prohibited.

Reporting Bugs/Feature Requests

We welcome you to use the GitHub issue tracker to report bugs or suggest features.

When filing an issue, please check existing open, or recently closed, issues to make sure somebody else hasn't already reported the issue. Please try to include as much information as you can. Details like these are incredibly useful:

• A reproducible test case or series of steps
• The version of our code being used
• Any modifications you've made relevant to the bug
• Anything unusual about your environment or deployment

Community

Hugging Face

• ALBERT Large
• ALBERT XXLarge
• BERT base
• BERT large
• DistilBERT
• GPT2
• RoBERTa
• RoBERTa large
• Swin Transformer
• T5
• Vision Transformer (ViT)

Fairseq

• Wav2Vec 2.0
• Transformer