Advanced Topics

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning

How to take advantage of larger foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

HPO in AutoMM

How to do hyperparameter optimization in AutoMM.

Knowledge Distillation in AutoMM

How to do knowledge distillation in AutoMM.

Customize AutoMM

How to customize AutoMM configurations.

AutoMM Presets

How to use AutoMM presets.

Few Shot Learning with FusionSVM

How to use SVM combined with feature extraction for few shot learning.

Focal Loss

How to use focal loss in AutoMM.

Faster Prediction with TensorRT

How to use TensorRT in accelerating AutoMM model inference.

Continuous Training with AutoMM

Different use cases for continuous training with AutoMM.