Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand
•
53
Community Blog & Articles
Community Articles
view all
guide
Introducing 🤗 Accelerate
3
April 16, 2021
guidepartnershipsaws
Distributed Training: Train BART/T5 for Summarization using 🤗 Transformers and Amazon SageMaker
2
April 8, 2021
communityresearchnlp
Understanding BigBird's Block Sparse Attention
6
March 31, 2021
partnershipsaws
The Partnership: Amazon SageMaker and Hugging Face
4
March 23, 2021
guide
My Journey to a serverless transformers pipeline on Google Cloud
2
March 18, 2021
guideaudio
Fine-Tune Wav2Vec2 for English ASR in Hugging Face with 🤗 Transformers
38
March 12, 2021
researchnlp
Hugging Face Reads, Feb. 2021 - Long-range Transformers
3
March 9, 2021
guide
Simple considerations for simple people building fancy neural networks
2
February 25, 2021
open-source-collabnlp
Retrieval Augmented Generation with Huggingface Transformers and Ray
6
February 10, 2021
open-source-collab
Hugging Face on PyTorch / XLA TPUs
3
February 9, 2021
guidenlp
Faster TensorFlow models in Hugging Face Transformers
January 26, 2021
guide
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
4
January 19, 2021
analysisnlp
How we sped up transformer inference 100x for 🤗 API customers
January 18, 2021
guidenlp
Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models
15
November 9, 2020
NEW
Articles from
Team
or
Enterprise organizations will get promoted to the main section.
Tensor Parallelism (TP) in Transformers: 5 Minutes to Understand
•
53
TurkColBERT: A Benchmark of Dense and Late-Interaction Models for Turkish Information Retrieval
•
17
Ellora: Enhancing LLMs with LoRA - Standardized Recipes for Capability Enhancement
•
11
**An Edge-First Generalized LLM LoRA Fine-Tuning Framework for Heterogeneous GPUs**
•
12
Norm-Preserving Biprojected Abliteration
•
50
AI Energy Score v2: Refreshed Leaderboard, now with Reasoning 🧠
•
8
Code a simple RAG from scratch
•
261
Uncensor any LLM with abliteration
•
733
Building Jobly: Semantic Job Matching with RAG and Vector Embeddings
•
12
Making Model Tuning Accessible: This is what we built observing 100s of users tune models!
•
6
DeepFabric: Generate, Train and Evaluate with Datasets curated for Model Behavior Training.
•
5
Engineering Notes: Training a LoRA for Z-Image Turbo with the Ostris AI Toolkit
•
5
KV Caching Explained: Optimizing Transformer Inference Efficiency
•
190
DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge
•
255
Small Language Models (SLM): A Comprehensive Overview
•
109
🛡️ Nemotron PII: Synthesized Data for Privacy-Preserving AI
•
29
Building and evaluating Multimodal Rerankers
•
6
Mastering Tensor Dimensions in Transformers
•
120
A Review on the Evolvement of Load Balancing Strategy in MoE LLMs: Pitfalls and Lessons
•
28
GSMA Open-Telco LLM Benchmarks 2.0: The first dedicated LLM Evaluation for Telecoms
•
22