Advanced Topics --------------- .. container:: cards .. card:: :title: Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning :link: efficient_finetuning_basic.html How to take advantage of larger foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL. .. card:: :title: HPO in AutoMM :link: hyperparameter_optimization.html How to do hyperparameter optimization in AutoMM. .. card:: :title: Knowledge Distillation in AutoMM :link: model_distillation.html How to do knowledge distillation in AutoMM. .. card:: :title: Customize AutoMM :link: customization.html How to customize AutoMM configurations. .. toctree:: :maxdepth: 1 :hidden: efficient_finetuning_basic hyperparameter_optimization model_distillation customization