Advanced Topics

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuningefficient_finetuning_basic.html

How to take advantage of larger foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

HPO in AutoMMhyperparameter_optimization.html

How to do hyperparameter optimization in AutoMM.

Knowledge Distillation in AutoMMmodel_distillation.html

How to do knowledge distillation in AutoMM.

Customize AutoMMcustomization.html

How to customize AutoMM configurations.