Basics

• Config System
  • Configs in LiBai
  • Get the Default Config
  • LazyConfig Best Practices
• Features in LiBai
  • Automatic Mixed Precision Training
  • Gradient Clipping
  • Gradient Accumulation
  • Activation Checkpointing
  • ZeRO
• Training
  • Trainer Abstraction
  • Customize a DefaultTrainer
  • Logging of Metrics
• Evaluation
  • Customize Evaluator using DatasetEvaluator
  • Run Evaluator Manually
• Training & Evaluation in Command Line
  • Training
  • Evaluation
  • Quickly check in the respective loop
• Load and Save a Checkpoint in LiBai
• Write Models
  • Construct Models in LiBai
  • Import the model in config
• Write Dataloaders
  • Build Common Dataloaders
• Build New Project on LiBai
  • Introduction
  • Main Function Entry
  • Build Config
  • Start Training
• Distributed Configuration
  • Distributed Setting Example
  • Update Distributed Config with Command Line
• Auto Parallel Training
  • Installation
  • Train/Evaluate model in auto-parallel mode