MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs | Haibin Lin In this presentation, I will discuss the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of more than 10,000 GPUs. Training LLMs at this scale brings unprecedented challenges to training efficiency and stability. Maintaining high efficiency throughout the training process (i.e., stability) is an im
21:07
MegaScale: Scaling Large Language Model Training to More Than 10,00…
53 viewsJun 13, 2024
FacebookAt Scale
Large Language Models explained briefly
Large Language Models explained briefly
10K viewsNov 20, 2024
substack.com
Introduction to Large Language Models: Everything You Need to Know for 2025 [ Resources] | Lakera – Protecting AI teams that disrupt the world.
Introduction to Large Language Models: Everything You Need to K…
7 months ago
lakera.ai
Advanced Guide to ChatGPT, Embeddings, and Other Large Language Models (LLMs) Online Class | LinkedIn Learning, formerly Lynda.com
Advanced Guide to ChatGPT, Embeddings, and Other Large Lan…
Oct 24, 2024
linkedin.com
A Beginner's Guide to Language Models | Built In
A Beginner's Guide to Language Models | Built In
9 months ago
builtin.com
Small Language Models vs Large Language Models: What's the Difference?
1:00
Small Language Models vs Large Language Models: What's the Diff…
1.2K views1 month ago
YouTubeClickIT DevOps & Software Development
Fundamental Limits of Large Language Models
4:57
Fundamental Limits of Large Language Models
569 views1 month ago
YouTubeAI Research Roundup
14:38
Scaling Large Language Models for Next-Generation Single-Cell Analy…
52 views2 months ago
YouTubeAI Papers Slop
52:04
Intelligence at Scale: AGI, ASI & Local Models w/ Dallen & Tristan | …
96 views3 weeks ago
YouTubeIn Time Tec
8:51
How Large Language Models Actually Work (And Why It Matters)
584 views3 months ago
YouTubeRupesh Dubey
6:40
Scaling Laws for Neural Language Models
9 views1 month ago
YouTubeMayuresh Shilotri
1:01
The Exponential Effects of Scaling AI — From Millions to Trillions of …
3 views2 months ago
YouTubeVirtualization Velocity
2:03:03
Deploying and Scaling Large Language Models in the Enterprise
764 views3 months ago
YouTubeSan Francisco Bay ACM
3 Easy Methods For Improving Your Large Language Model
4.6K viewsSep 18, 2023
YouTubeMaarten Grootendorst
THIS is why large language models can understand the world
386.9K views9 months ago
YouTubeAlgorithmic Simplicity
Ultimate Guide To Scaling ML Models - Megatron-LM | ZeRO | De…
28.5K viewsAug 21, 2022
YouTubeAleksa Gordić - The AI Epiphany
3:13
Scale and Mapwork
174.2K viewsMay 18, 2017
YouTubeRakesha Kissoon
44:33
Large Language Models: Overview & OpenAI API
321 viewsJun 10, 2024
YouTubeEl Habib NFAOUI
2:22
Large Language Models explained
2.5K viewsJun 7, 2024
YouTubeThe Cloud Girl
34:35
Scaling AI with purpose
2.6K viewsOct 30, 2024
YouTubeIBM Technology
5:27
Large Language Models | NEJM Evidence
4K viewsJul 28, 2023
YouTubeNEJM Group
7:19
Large Language Models: Part 2
125.2K viewsJul 17, 2022
YouTubeGraphics in 5 Minutes
8:25
Large Language Models from scratch
368.3K viewsJul 17, 2022
YouTubeGraphics in 5 Minutes
1:38:39
How Do Large Language Models Work?
148 views6 months ago
YouTubeReally Easy AI - Tutorials for Everyone
5:34
How Large Language Models Work
1.3M viewsJul 28, 2023
YouTubeIBM Technology
16:07
MIT CSAIL Explains: Large Language Models: Part 1
7.2K viewsApr 25, 2023
YouTubeMIT CSAIL
49:07
Large Language Models (in 2023)
78.9K viewsOct 5, 2023
YouTubeHyung Won Chung
14:40
Introduction to Large Language Models
163.5K viewsApr 8, 2024
YouTubeGoogle Cloud
4:03
Low-Rank Adaptation (LoRA) Explained
5.3K viewsNov 18, 2023
YouTubeDataMListic
1:03:59
Scaling Data-Constrained Language Models
5K viewsAug 15, 2023
YouTubeSimons Institute for the Theory of Computing
See more videos
Static thumbnail place holder