Advanced Topics

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning

How to take advantage of large foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

Hyperparameter Optimization in AutoMM

How to do hyperparameter optimization in AutoMM.

Knowledge Distillation in AutoMM

How to do knowledge distillation in AutoMM.

Customize AutoMM

How to customize AutoMM configurations.

AutoMM Presets

How to use AutoMM presets.

Few Shot Learning with AutoMM

How to use foundation models + SVM for few shot learning.

Handling Class Imbalance with AutoMM - Focal Loss

How to use AutoMM to handle class imbalance.

Faster Prediction with TensorRT

How to use TensorRT in accelerating AutoMM model inference.

Continuous Training with AutoMM

Different use cases for continuous training with AutoMM.