Skip to content
Fossfits

attention-mechanism.

Listed 11Updated Sep 7, 2026

Sorted by Most popular

  1. vit-pytorchImplementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorchmit · linux25.5k
  2. x-transformersA concise but complete full-attention transformer with a set of promising experimental features from various papersmit · linux5.9k
  3. soundstorm-pytorchImplementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorchmit · linux1.5k
  4. perceiver-pytorchImplementation of Perceiver, General Perception with Iterative Attention, in Pytorchmit · linux1.2k
  5. tab-transformer-pytorchImplementation of TabTransformer, attention network for tabular data, in Pytorchmit · linux1.1k
  6. enformer-pytorchImplementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorchmit · linux573
  7. slot-attentionImplementation of Slot Attention from GoogleAImit · linux498
  8. MultiModalMambaA novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.mit · linux474
  9. deformable-attentionImplementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"mit · linux368
  10. se3-transformer-pytorchImplementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.mit · linux335
  11. bidirectional-cross-attentionA simple cross attention that updates both the source and target in one stepmit · linux199