nystromformer

Here are 3 public repositories matching this topic...

Rishit-dagli / Nystromformer

An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention

machine-learning deep-learning tensorflow keras artificial-intelligence transformer attention-mechanism nystrom nystromformer

Updated Aug 21, 2022
Python

LennartKeller / roberta2longformer

Star

Convert pretrained RoBerta models to various long-document transformer models

nlp transformers pytorch language-model roberta huggingface longformer huggingface-transformers roberta-model longformer-models big-bird nystromformer

Updated Apr 5, 2022
Python

athrva98 / FlashNystrom

Star

Tensor-core CUDA kernels for Nyström attention, linear-time forward and backward with exact autograd gradients. Faster than flash-attention at long sequence length.

cuda pytorch transformer attention attention-mechanism tensor-cores linear-attention nystromformer long-context flash-attention

Updated May 24, 2026
Cuda

Improve this page

Add a description, image, and links to the nystromformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nystromformer topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly