Notes

• How to use Huggingface’s pretrained weights in LiBai
  • LiBai Transformer vs Huggingface Transformer
  • QKV slicing logic
  • How to correctly load QKV weights
• Detailed instruction on building Vision Transformer models in LiBai
  • Model Architecture
  • A simple Torch implementation of Vision Transformer
  • Implement 3D parallel Vision Transformer in LiBai
  • Details about LiBai’s implementation of the Vision Transformer model
• Frequently Asked Questions
  • Training
  • Model