DeepSpeed
billion-parameters
Overview
Developed byMicrosoft
Founded2020
LicenseApache 2.0
Open source✓ Open Source
Use casedeep learning training optimization
Technical
Integrates with
Also see
Alternative to
Competes with
Knowledge graph stats
Claims42
Avg confidence90%
Avg freshness100%
Last updatedUpdated 19 days ago
Trust distribution
100% unverified
DeepSpeed
framework
deepspeedai/DeepSpeed is an open source AI framework. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. Built with Python, 42,178 GitHub stars.
Compare with...primary use case
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| deep learning training optimization | ○Unverified | High | Fresh | 1 |
| deep learning optimization and model training acceleration | ○Unverified | High | Fresh | 1 |
| deep learning model training optimization | ○Unverified | High | Fresh | 1 |
| distributed deep learning training optimization | ○Unverified | High | Fresh | 1 |
| Deep learning model training optimization and memory efficiency | ○Unverified | High | Fresh | 1 |
| deep learning optimization and inference acceleration | ○Unverified | High | Fresh | 1 |
| deep learning optimization and training acceleration | ○Unverified | High | Fresh | 1 |
| deep learning optimization and distributed training | ○Unverified | High | Fresh | 1 |
| deep learning optimization library | ○Unverified | High | Fresh | 1 |
license type
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Apache 2.0 | ○Unverified | High | Fresh | 1 |
| MIT License | ○Unverified | High | Fresh | 1 |
| Apache License 2.0 | ○Unverified | High | Fresh | 1 |
open source
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| true | ○Unverified | High | Fresh | 1 |
maintained by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Microsoft | ○Unverified | High | Fresh | 1 |
developed by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Microsoft | ○Unverified | High | Fresh | 1 |
supports protocol
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| ZeRO | ○Unverified | High | Fresh | 1 |
| distributed training | ○Unverified | High | Fresh | 1 |
| ZeRO optimizer states partitioning | ○Unverified | High | Fresh | 1 |
| ZeRO optimizer | ○Unverified | High | Fresh | 1 |
| CUDA | ○Unverified | Moderate | Fresh | 1 |
| MPI | ○Unverified | Moderate | Fresh | 1 |
| NCCL | ○Unverified | Moderate | Fresh | 1 |
integrates with
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| PyTorch | ○Unverified | High | Fresh | 1 |
| Hugging Face Transformers | ○Unverified | High | Fresh | 1 |
requires
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| PyTorch | ○Unverified | High | Fresh | 1 |
| Python | ○Unverified | High | Fresh | 1 |
| CUDA | ○Unverified | Moderate | Fresh | 1 |
pricing model
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| free | ○Unverified | High | Fresh | 1 |
supports feature
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| ZeRO optimizer | ○Unverified | High | Fresh | 1 |
| model parallelism | ○Unverified | High | Fresh | 1 |
| gradient compression | ○Unverified | Moderate | Fresh | 1 |
written in
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Python | ○Unverified | High | Fresh | 1 |
supports model
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| transformer models | ○Unverified | Moderate | Fresh | 1 |
founded year
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 2020 | ○Unverified | Moderate | Fresh | 1 |
first released year
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| 2020 | ○Unverified | Moderate | Fresh | 1 |
alternative to
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| FasterTransformer | ○Unverified | Moderate | Fresh | 1 |
| Horovod | ○Unverified | Moderate | Fresh | 1 |
| FairScale | ○Unverified | Moderate | Fresh | 1 |
competes with
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Horovod | ○Unverified | Moderate | Fresh | 1 |
| TensorRT | ○Unverified | Moderate | Fresh | 1 |
| NVIDIA Apex | ○Unverified | Moderate | Fresh | 1 |
| FairScale | ○Unverified | Moderate | Fresh | 1 |
Alternatives & Similar Tools
Commonly Used With
Related entities
Graph Insights
5 entities depend on DeepSpeed
View full impact analysis