#

linformer

Here are 5 public repositories matching this topic...

awesome-fast-attention

Separius / awesome-fast-attention

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Aug 23, 2021
Python

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.

machine-learning deep-learning paper pytorch artificial-intelligence attention-mechanism linformer

Updated Jul 27, 2022
Python

kuixu / Linear-Multihead-Attention

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

transformer attention-mechanism detr linformer linear-multihead-attention

Updated Jun 23, 2020
Python

pranavphoenix / VisionXformer

Vision Xformers

image deep-learning efficient transformer vision classification gpu-computing attention-mechanism nystrom performer linformer

Updated May 11, 2023
Python

anto18671 / lumenspark

Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch

training text-classification text-generation transformer low-rank-approximation pretraining linformer llm runpod prenormalization layer-scale

Updated Oct 24, 2024
Python

Improve this page

Add a description, image, and links to the linformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the linformer topic, visit your repo's landing page and select "manage topics."