Advanced Topics

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuningefficient_finetuning_basic.html

How to take advantage of larger foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

HPO in AutoMMhyperparameter_optimization.html

How to do hyperparameter optimization in AutoMM.

Knowledge Distillation in AutoMMmodel_distillation.html

How to do knowledge distillation in AutoMM.

Customize AutoMMcustomization.html

How to customize AutoMM configurations.

AutoMM Presetspresets.html

How to use AutoMM presets.

Few Shot Learning with FusionSVMfew_shot_learning.html

How to use SVM combined with feature extraction for few shot learning.

Focal Lossfocal_loss.html

How to use focal loss in AutoMM.