Advanced Topics
---------------
.. container:: cards

   .. card::
      :title: Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning
      :link: efficient_finetuning_basic.html

      How to take advantage of larger foundation models with the help of parameter-efficient finetuning.
      In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

   .. card::
      :title: HPO in AutoMM
      :link: hyperparameter_optimization.html

      How to do hyperparameter optimization in AutoMM.

   .. card::
      :title: Knowledge Distillation in AutoMM
      :link: model_distillation.html

      How to do knowledge distillation in AutoMM.

   .. card::
      :title: Customize AutoMM
      :link: customization.html

      How to customize AutoMM configurations.

   .. card::
      :title: AutoMM Presets
      :link: presets.html

      How to use AutoMM presets.

   .. card::
      :title: Few Shot Learning with FusionSVM
      :link: few_shot_learning.html

      How to use SVM combined with feature extraction for few shot learning.

   .. card::
      :title: Focal Loss
      :link: focal_loss.html

      How to use focal loss in AutoMM.



.. toctree::
   :maxdepth: 1
   :hidden:

   efficient_finetuning_basic
   hyperparameter_optimization
   model_distillation
   customization
   few_shot_learning
   presets
   focal_loss