GPT
- GitHub - karpathy/nanoGPT: The simplest, fastest repository for training/finetuning medium-sized GPTs.
- GitHub - pytorch-labs/gpt-fast: Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
Graph Transformers
- GitHub - wehos/awesome-graph-transformer: Papers about graph transformers.
-
[2111.10447] DyFormer: A Scalable Dynamic Graph Transformer with Provable Benefits on Generalization Ability
– link prediction, but encoding can be ref
Transformers
-
https://www.bishopbook.com/
– chpt 12 transformer