Speculative Decoding — Think Fast⚡, Then Think Right✅
Speculative Decoding — Think Fast⚡, Then Think Right✅
Apr 13, 2025
substack.com
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
Aug 1, 2024
qualcomm.com
Increase throughput by implementing speculative decoding in AI
0:42
Increase throughput by implementing speculative decoding in AI
97 views2 months ago
YouTubeHareesh Rajendran
Speculative Decoding: Make AI 2-3x Faster for Free | Tech Decoded
6:13
Speculative Decoding: Make AI 2-3x Faster for Free | Tech Decoded
1 month ago
YouTubeToc am
Don't use speculative decoding until you watch this
7:09
Don't use speculative decoding until you watch this
7 views3 weeks ago
YouTubeDigitalOcean
Speculation is all you need: Intro to Speculative Decoding for High Performance Inference
40:19
Speculation is all you need: Intro to Speculative Decoding for High Performance Inference
1 views2 months ago
YouTubeModal
Speculative Decoding: 2-3x Faster LLMs for Free
5:04
Speculative Decoding: 2-3x Faster LLMs for Free
1 views1 month ago
YouTubeThe AI Century
14:45
Google Is Lying To Us About Gemma 4.
51.5K views1 month ago
YouTubeTim Carambat
0:54
HuggingFace Automated ML Research!
13.5K views3 weeks ago
YouTubeArnitly
33:02
Learn How to Make AI Models w/ ML: 3. Hugging Face, Tokenizers & Pre-Trained Models
1.3K views1 month ago
YouTubeOnchain AI Garage
8:38
Speculative Decoding 벤치마크 SPEED-Bench: Draft Accuracy와 Throughput 통합 평가
1 month ago
YouTubeCosmoX
1:02:23
EP5: Speculative Decoding with Nadav Timor
116 views8 months ago
YouTubeThe Information Bottleneck
7:00
SPEED-Bench for Speculative Decoding: Unified Evaluation of Draft Accuracy and Throughput
1 month ago
YouTubeCosmoX
15:39
【AI论文解读】让 speculative decoding 更快更准！任务感知的 Draft 模型优化方案 | TAPS
1 month ago
bilibili熊二等兵
DFVG: A Heterogeneous Architecture for Speculative Decoding with Draft-on-FPGA and Verify-on-GPU | Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2
2 months ago
acm.org
Multi-candidate Speculative Decoding | Natural Language Processing and Chinese Computing
3 months ago
acm.org
6:47
Transformer models: Encoder-Decoders
107K viewsJun 14, 2021
YouTubeHugging Face
24:30
Tutorial 1-Transformer And Bert Implementation With Huggingface
258.1K viewsMay 18, 2021
YouTubeKrish Naik
9:44
AI Text Summarization with Hugging Face Transformers in 4 Lines of Python
72.9K viewsJan 24, 2021
YouTubeNicholas Renotte
1:23
Speculative Speculative Decoding for Faster LLM Inference
2.1K views2 months ago
YouTubeRajistics - data science, AI, and machine learning
37:34
Speculative Decoding Explained
7.8K viewsDec 21, 2023
YouTubeTrelis Research
0:54
Speculative Decoding explained
5K views3 months ago
YouTubeIndividualKex
8:06
How to Use Hugging Face Inference API
62K viewsApr 26, 2024
YouTubeFahd Mirza
36:12
Deep Dive: Optimizing LLM inference
47K viewsMar 11, 2024
YouTubeJulien Simon
57:02
Image Classification with Hugging Face
2.1K viewsJan 9, 2024
YouTubeDataCamp
1:16:34
HuggingFace: Text Generation Inference: Part 1
6.8K viewsApr 11, 2023
YouTubeChallengerSpaceShuttle
8:09
Mistral Small 4 in 8 mins!
7K views2 months ago
YouTube1littlecoder
5:19
vLLM: 8. Speculative decoding settings
665 viewsMar 15, 2025
YouTube개발자 유미
20:41
Python for AI #4: Model Hubs & HuggingFace Tutorial
24.6K viewsMar 11, 2023
YouTubeAssemblyAI
6:06
Hugging Face's Text Embeddings Inference Library
6K viewsOct 28, 2023
YouTubeLearn Data with Mark
See more