# deepspeed

> Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8…

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

- Type: Skill
- Made by: Orchestra-Research
- Category: AI & agents
- Formats: Skills
- Version: cf35db7
- Source: https://github.com/orchestra-research/ai-research-skills/tree/HEAD/08-distributed-training/deepspeed
- Page: https://pluginboard.ai/skills/deepspeed-orchestra-research

## Works with

- ChatGPT
- Claude
- Gemini
- GitHub Copilot
- Cursor
- Claude Code
- Codex
- Antigravity
- Gemini CLI
- Replit
- OpenClaw
- OpenCode
- Hermes Agent

## Install

### ChatGPT

In ChatGPT: Download the deepspeed folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans.

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Claude

In Claude (web or desktop): Download the deepspeed folder and zip the folder itself, then upload it in Customize → Skills.

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Gemini

In Gemini: Download the deepspeed folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it).

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### GitHub Copilot

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.copilot/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Cursor

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.cursor/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Claude Code

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.claude/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

Or all of AI Research Skills (Orchestra), in Claude Code:

```text
/plugin marketplace add Orchestra-Research/AI-Research-SKILLs
/plugin install rag@ai-research-skills
```

### Codex

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.agents/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Antigravity

In Antigravity: Copy the deepspeed folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI).

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Gemini CLI

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.gemini/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Replit

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed .agents/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### OpenClaw

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.openclaw/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### OpenCode

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.config/opencode/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

### Hermes Agent

Run in your terminal:

```shell
npx -y degit Orchestra-Research/AI-Research-SKILLs/08-distributed-training/deepspeed ~/.hermes/skills/deepspeed
```

View the folder on GitHub: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/HEAD/08-distributed-training/deepspeed

---
From Pluginboard (https://pluginboard.ai).