Ross ROSS = Recommend OSS · open-source software intelligence for agents

function: transformers

60 products, primary matches first, then adoption-weighted; health v2 shown.

ProductHealth v2StarsMaturity
time-series-foundation-models/lag-llama
Lag-Llama is the first open-source foundation model for probabilistic time series forecasting, built on a transformer architecture. It prov…
371601active
lucidrains/DALLE-pytorch
A PyTorch implementation/replication of OpenAI's DALL-E, a text-to-image transformer, including a discrete VAE and optional CLIP for rankin…
235627maintenance
explosion/spacy-transformers
A spaCy v3 extension package that provides pipeline components for using pretrained transformer models like BERT, RoBERTa, XLNet, and GPT-2…
711409stable
soda-inria/tabicl
TabICLv2 is an open-source tabular foundation model that performs classification and regression via a single forward pass through a pre-tra…
811309active
Ma-Lab-Berkeley/CRATE
CRATE is the official PyTorch implementation of the Coding RAte reduction TransformEr, a family of 'white-box' transformer architectures de…
291275active
thuml/Large-Time-Series-Model
Official code, datasets, and checkpoints for Timer and Sundial, generative pre-trained Transformer foundation models for general time serie…
581010active
google-research/robotics_transformer
A Python library from Google Research implementing RT-1 (Robotics Transformer), a transformer model for end-to-end robotic control with an …
101743maintenance
invictus717/MetaTransformer
Meta-Transformer is a research framework for unified multimodal learning that maps inputs from 12 modalities (text, images, point clouds, a…
191647maintenance
SKTBrain/KoBERT
KoBERT is a Korean BERT language model pre-trained on Korean Wikipedia by SK Telecom, distributed as a Python package with PyTorch, ONNX, a…
441416maintenance
lucidrains/CoCa-pytorch
A Pytorch implementation of CoCa (Contrastive Captioners), an image-text foundation model that combines contrastive learning with an encode…
231198maintenance
EleutherAI/gpt-neo
GPT-Neo is EleutherAI's implementation of model- and data-parallel GPT-3-style transformer language models built on mesh-tensorflow, with r…
108270abandoned
haotian-liu/LLaVA
LLaVA (Large Language and Vision Assistant) is an open-source multimodal large language model framework implementing visual instruction tun…
2025000active
deepseek-ai/DeepSeek-OCR
DeepSeek-OCR is an open vision-language model from DeepSeek AI that researches 'contexts optical compression' - encoding long text contexts…
4523855active
microsoft/unilm
Microsoft's collection of large-scale self-supervised pre-trained models spanning tasks, 100+ languages, and modalities (text, image, layou…
6722194active
RWKV
RWKV is a novel language model architecture that combines RNN efficiency (linear time, constant memory, no KV-cache) with transformer-level…
6714683active
facebookresearch/vggt
VGGT (Visual Geometry Grounded Transformer) is a feed-forward transformer model from Meta AI and Oxford VGG that infers 3D geometry—camera …
5814292active
PaddlePaddle/PaddleNLP
PaddleNLP is an easy-to-use NLP and large language model development kit built on the PaddlePaddle deep learning framework, with a large pr…
6312967active
OpenVINO
OpenVINO is an open-source toolkit from Intel for optimizing and deploying deep learning inference across CPU, GPU, and NPU hardware. It su…
9510740stable
FoundationVision/VAR
Official PyTorch implementation of Visual Autoregressive Modeling (VAR), a NeurIPS 2024 Best Paper-winning method for scalable image genera…
488729active
DepthAnything/Depth-Anything-V2
Depth Anything V2 is a foundation model for monocular depth estimation, trained on 595K synthetic labeled images and 62M+ real unlabeled im…
568709stable
google-research/bert
Google Research's official TensorFlow implementation of BERT, the Bidirectional Encoder Representations from Transformers language model, a…
1040046maintenance
EleutherAI/gpt-neox
GPT-NeoX is EleutherAI's library for training large-scale autoregressive transformer language models on GPUs, built on NVIDIA's Megatron an…
627459active
aidlearning/AidLearning-FrameWork
AidLux (originally AidLearning) is an AIoT development platform that runs a native Ubuntu Linux environment with GUI, deep learning tooling…
705797active
IDEA-CCNL/Fengshenbang-LM
Fengshenbang-LM is an open-source suite of Chinese large language models and a PyTorch training framework from IDEA Research's CCNL lab, ai…
714123active
huggingface/distil-whisper
Distil-Whisper is a distilled version of OpenAI's Whisper model for English speech recognition, offering 6x faster inference, 49% fewer par…
274112active
QwenLM/Qwen2.5-Omni
Qwen2.5-Omni is an end-to-end multimodal model from Alibaba's Qwen team that understands text, images, audio, and video, and generates stre…
314074active
stanford-futuredata/ColBERT
ColBERT is a fast and accurate neural retrieval model that encodes passages and queries into token-level embedding matrices and scores them…
453924active
pathwaycom/bdh
BDH (Dragon Hatchling) is a biologically inspired large language model architecture that bridges deep learning and neuroscience, implemente…
543519active
NVIDIA/TransformerEngine
Transformer Engine is an NVIDIA library for accelerating Transformer model training and inference on NVIDIA GPUs using low-precision format…
993504active
guillaume-be/rust-bert
A Rust-native library providing ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT-2, RoBERTa, BART, etc.), por…
603076active
facebookresearch/omnilingual-asr
An open-source multilingual speech recognition library from Meta AI supporting over 1,600 languages, including hundreds never previously co…
522898active
physical-superintelligence-lab/Psi0
Psi-Zero (Ψ₀) is an open vision-language-action (VLA) foundation model for dexterous humanoid loco-manipulation, combining a Qwen3-VL backb…
592802active
facebookresearch/perception_models
Meta's Perception Models repository hosting state-of-the-art image, video, and audio encoders (Perception Encoder, PE) and a multimodal lan…
542353active
learnhouse/learnhouse
LearnHouse is a next-generation open-source learning management system (LMS) for creating, sharing, and selling educational content. It com…
992203active
kyegomez/BitNet
A PyTorch implementation of the BitNet architecture from the paper 'BitNet: Scaling 1-bit Transformers for Large Language Models', providin…
721945active
CompVis/taming-transformers
The official implementation of 'Taming Transformers for High-Resolution Image Synthesis' (CVPR 2021), combining a convolutional VQGAN codeb…
326521maintenance
elixir-nx/bumblebee
Bumblebee is an Elixir library providing pre-trained neural network models built on Axon, with integration for downloading models from Hugg…
891662active
FoundationVision/Infinity
Infinity is a bitwise autoregressive text-to-image generation model (CVPR 2025 Oral) with released training and inference code, checkpoints…
561587active
salesforce/CodeTF
CodeTF is a Python transformer library for code large language models, providing unified interfaces for training, fine-tuning, and inferenc…
101480active
Walter0807/MotionBERT
Official PyTorch implementation of MotionBERT (ICCV 2023), a unified pretrained model for learning human motion representations from 2D ske…
651439active
lucidrains/transfusion-pytorch
A PyTorch implementation of Transfusion, MetaAI's approach to predicting the next token and diffusing images with a single multi-modal mode…
751395active
ARahim3/mlx-tune
A Python library for fine-tuning LLMs, vision-language, audio (TTS/STT), embedding, OCR, and JEPA models natively on Apple Silicon Macs usi…
751389active
Tongjilibo/bert4torch
bert4torch is a PyTorch library providing an elegant reimplementation of transformer models (BERT, RoBERTa, T5, GPT, ChatGLM, LLaMA, etc.) …
821328active
tjake/Jlama
Jlama is a modern LLM inference engine written in Java, supporting popular transformer models like Llama, Mistral, Gemma, and Qwen with qua…
511303active
lucidrains/flamingo-pytorch
A PyTorch implementation of DeepMind's Flamingo visual language model architecture, providing the Perceiver Resampler and Gated Cross-Atten…
231269active
brightmart/albert_zh
A repository providing pre-trained ALBERT models for Chinese language, implemented in TensorFlow with PyTorch and Keras conversions. It inc…
323982maintenance
kimiyoung/transformer-xl
Official implementation of Transformer-XL, an attention-based language model architecture that extends context beyond a fixed length via se…
323714maintenance
hezarai/hezar
Hezar is an all-in-one Python AI library for the Persian language, covering NLP, speech recognition, OCR, and image captioning through a ta…
781013active
microsoft/DeBERTa
Official implementation of DeBERTa and DeBERTa V3, transformer-based language models with disentangled attention and decoding-enhanced BERT…
232239maintenance
dmis-lab/biobert
BioBERT is a pre-trained biomedical language representation model (based on BERT) with code for fine-tuning it on biomedical text mining ta…
322204maintenance
alibaba/EasyNLP
EasyNLP is a comprehensive PyTorch-based NLP toolkit from Alibaba that provides training, inference, and deployment for pre-trained languag…
232184maintenance
alibaba/AliceMind
AliceMind is Alibaba's collection of pre-trained encoder-decoder language models and related NLP techniques, including StructBERT, PALM, VE…
232041maintenance
google-research/pegasus
PEGASUS is Google Research's implementation of transformer encoder-decoder models pre-trained with the Gap Sentences Generation objective f…
101655maintenance
microsoft/SpeechT5
Microsoft's unified-modal speech-text pre-training framework implementing SpeechT5 and related models (SpeechLM, SpeechUT, VALL-E X, WavLLM…
321449maintenance
google-research/multilingual-t5
Code and resources for mT5, a massively multilingual text-to-text transformer pretrained on the mC4 corpus covering 101 languages. It repro…
101294maintenance
wilson1yan/VideoGPT
VideoGPT is a PyTorch implementation of a video generation model that combines a VQ-VAE with 3D convolutions and axial attention with a GPT…
321081maintenance
kakaobrain/kogpt
KakaoBrain's KoGPT, a Korean Generative Pre-trained Transformer (GPT) model with 6B parameters, distributed via Hugging Face with inference…
231011maintenance
google-research/magvit
Official JAX implementation of MAGVIT, a masked generative video transformer from a CVPR 2023 paper by Google Research and CMU. It provides…
101000maintenance
deepseek-ai/DeepSeek-V3.2-Exp
DeepSeek-V3.2-Exp is an experimental open-weight large language model release that introduces DeepSeek Sparse Attention for more efficient …
401640experimental
isl-org/ZoeDepth
ZoeDepth is a PyTorch library implementing metric depth estimation from a single image, combining relative and metric depth approaches with…
102839abandoned

page 1 / 1