# spark-serverless-reliability-and-state-management

> Enforces timeout-aware rollbacks, resumable checkpoints, and orphan cleanup for serverless Spark workloads on AWS Lambd…

Enforces timeout-aware rollbacks, resumable checkpoints, and orphan cleanup for serverless Spark workloads on AWS Lambda, Glue, and similar runtimes. Use when writing or reviewing Spark jobs in serverless environments, S3 checkpoint patterns, partial-failure recovery, or IceGuard-style state management.

- Type: Skill
- Made by: vaquarkhan
- Category: Cloud & DevOps
- Formats: Skills
- Version: b5d128e
- Source: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management
- Page: https://pluginboard.ai/skills/spark-serverless-reliability-and-state-management

## Works with

- ChatGPT
- Claude
- Gemini
- GitHub Copilot
- Cursor
- Claude Code
- Codex
- Antigravity
- Gemini CLI
- Replit
- OpenClaw
- OpenCode
- Hermes Agent

## Install

### ChatGPT

In ChatGPT: Download the spark-serverless-reliability-and-state-management folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans.

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Claude

In Claude (web or desktop): Download the spark-serverless-reliability-and-state-management folder and zip the folder itself, then upload it in Customize → Skills.

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Gemini

In Gemini: Download the spark-serverless-reliability-and-state-management folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it).

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### GitHub Copilot

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.copilot/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Cursor

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.cursor/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Claude Code

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.claude/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Codex

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.agents/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Antigravity

In Antigravity: Copy the spark-serverless-reliability-and-state-management folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI).

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Gemini CLI

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.gemini/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Replit

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management .agents/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### OpenClaw

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.openclaw/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### OpenCode

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.config/opencode/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

### Hermes Agent

Run in your terminal:

```shell
npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.hermes/skills/spark-serverless-reliability-and-state-management
```

View the folder on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills/tree/HEAD/skills/spark-serverless-reliability-and-state-management

---
From Pluginboard (https://pluginboard.ai).
