libai
stable
Tutorials
Notes
How to use Huggingface’s pretrained weights in LiBai
Detailed instruction on building Vision Transformer models in LiBai
Frequently Asked Questions
API Documentation
Changelog
libai
»
Notes
Edit on GitHub
Notes
¶
How to use Huggingface’s pretrained weights in LiBai
LiBai Transformer vs Huggingface Transformer
QKV slicing logic
How to correctly load QKV weights
Detailed instruction on building Vision Transformer models in LiBai
Model Architecture
A simple Torch implementation of Vision Transformer
Implement 3D parallel Vision Transformer in LiBai
Details about LiBai’s implementation of the Vision Transformer model
Frequently Asked Questions
Training
Model
Read the Docs
v: stable
Versions
latest
stable
Downloads
On Read the Docs
Project Home
Builds