# Data Engineering Agent Skills > Data engineering workflows for your agent: spec, plan, build, validate and ship pipelines, with safe backfills and quality gates. Data Engineering Agent Skills is a community skill pack by Viquar Khan that gives your agent operating procedures for data engineering, rather than generic prompts. Each skill sets out when to use it, a step-by-step workflow, red flags and how to verify the result. What you can do with it - Work through a spec-first lifecycle: define the data product, plan small tasks, build in slices, validate, review, backfill safely and ship - Design orchestration in Airflow, MWAA, Cloud Composer, Azure Data Factory, Step Functions or Databricks Workflows, with explicit retries and backfills - Build ingestion, CDC with Debezium and Kafka Connect, streaming with Kafka and Spark, and lakehouse tables in Delta, Iceberg or Hudi - Model warehouses and tune their cost on BigQuery, Snowflake, ClickHouse, Trino and DuckDB, and run analytics engineering with dbt - Put quality and contracts in place with Great Expectations, Deequ, schema registries and reconciliation checks - Handle governance and compliance: lineage, PII, retention and right to delete, GDPR and data residency, Unity Catalog, Purview, Dataplex and Lake Formation - Plan migrations, mainframe offload, incident triage and disaster recovery for data platforms How it works - Start with using-data-engineering-agent-skills, which classifies the work, picks a platform preset and suggests the safest next command - Platform presets cover AWS, Azure, GCP, Databricks, Snowflake, Alibaba Cloud, Informatica, Talend and Apache-first stacks, with starter packs, templates and example scaffolds - Install from the repo with scripts/install.sh, or as the maker's VS Code or JetBrains extension Good to know - The skills are guidance and workflows; your agent still runs the tools and platforms you already use - MIT licensed - Type: Skill - Made by: vaquarkhan - Category: Data & analytics - Formats: Skills - Version: latest - Website: https://vaquarkhan.github.io/data-engineering-agent-skills/ - Source: https://github.com/vaquarkhan/data-engineering-agent-skills - Page: https://pluginboard.ai/skills/data-engineering-agent-skills ## Works with - ChatGPT - Claude - Gemini - GitHub Copilot - Cursor - Claude Code - Codex - Antigravity - Gemini CLI - Replit - OpenClaw - OpenCode - Hermes Agent ## Install ### ChatGPT In ChatGPT: Download the data-engineering-agent-skills folder and zip it, then Plugins → Skills → Create → Upload from your computer. Business and Enterprise plans. View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Claude In Claude (web or desktop): Download each skill’s folder and zip it, then upload them one at a time in Customize → Skills. View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Gemini In Gemini: Download the data-engineering-agent-skills folder, then at gemini.google.com click Customize → Skills → Create → Upload and pick the folder (or a .zip of it). View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### GitHub Copilot Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.copilot/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.copilot/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.copilot/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.copilot/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.copilot/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.copilot/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.copilot/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.copilot/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.copilot/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.copilot/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.copilot/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.copilot/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.copilot/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.copilot/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.copilot/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.copilot/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.copilot/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.copilot/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.copilot/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.copilot/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.copilot/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.copilot/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.copilot/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.copilot/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.copilot/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.copilot/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.copilot/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.copilot/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.copilot/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.copilot/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.copilot/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.copilot/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.copilot/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.copilot/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.copilot/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.copilot/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.copilot/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.copilot/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.copilot/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.copilot/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.copilot/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.copilot/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.copilot/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.copilot/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.copilot/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.copilot/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.copilot/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.copilot/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.copilot/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.copilot/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.copilot/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.copilot/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.copilot/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.copilot/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.copilot/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.copilot/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.copilot/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.copilot/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.copilot/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.copilot/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.copilot/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.copilot/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.copilot/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.copilot/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.copilot/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.copilot/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.copilot/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.copilot/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.copilot/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.copilot/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.copilot/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.copilot/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.copilot/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.copilot/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Cursor Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.cursor/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.cursor/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.cursor/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.cursor/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.cursor/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.cursor/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.cursor/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.cursor/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.cursor/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.cursor/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.cursor/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.cursor/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.cursor/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.cursor/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.cursor/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.cursor/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.cursor/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.cursor/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.cursor/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.cursor/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.cursor/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.cursor/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.cursor/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.cursor/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.cursor/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.cursor/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.cursor/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.cursor/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.cursor/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.cursor/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.cursor/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.cursor/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.cursor/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.cursor/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.cursor/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.cursor/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.cursor/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.cursor/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.cursor/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.cursor/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.cursor/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.cursor/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.cursor/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.cursor/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.cursor/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.cursor/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.cursor/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.cursor/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.cursor/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.cursor/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.cursor/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.cursor/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.cursor/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.cursor/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.cursor/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.cursor/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.cursor/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.cursor/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.cursor/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.cursor/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.cursor/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.cursor/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.cursor/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.cursor/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.cursor/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.cursor/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.cursor/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.cursor/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.cursor/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.cursor/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.cursor/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.cursor/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.cursor/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.cursor/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Claude Code Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.claude/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.claude/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.claude/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.claude/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.claude/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.claude/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.claude/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.claude/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.claude/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.claude/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.claude/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.claude/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.claude/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.claude/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.claude/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.claude/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.claude/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.claude/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.claude/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.claude/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.claude/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.claude/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.claude/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.claude/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.claude/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.claude/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.claude/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.claude/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.claude/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.claude/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.claude/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.claude/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.claude/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.claude/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.claude/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.claude/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.claude/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.claude/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.claude/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.claude/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.claude/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.claude/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.claude/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.claude/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.claude/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.claude/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.claude/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.claude/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.claude/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.claude/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.claude/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.claude/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.claude/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.claude/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.claude/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.claude/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.claude/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.claude/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.claude/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.claude/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.claude/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.claude/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.claude/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.claude/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.claude/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.claude/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.claude/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.claude/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.claude/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.claude/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.claude/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.claude/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.claude/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.claude/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Codex Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.agents/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.agents/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.agents/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.agents/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.agents/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.agents/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.agents/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.agents/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.agents/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.agents/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.agents/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.agents/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.agents/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.agents/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.agents/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.agents/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.agents/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.agents/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.agents/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.agents/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.agents/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.agents/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.agents/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.agents/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.agents/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.agents/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.agents/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.agents/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.agents/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.agents/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.agents/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.agents/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.agents/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.agents/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.agents/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.agents/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.agents/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.agents/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.agents/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.agents/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.agents/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.agents/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.agents/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.agents/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.agents/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.agents/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.agents/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.agents/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.agents/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.agents/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.agents/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.agents/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.agents/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.agents/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.agents/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.agents/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.agents/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.agents/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.agents/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.agents/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.agents/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.agents/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.agents/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.agents/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.agents/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.agents/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.agents/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.agents/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.agents/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.agents/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.agents/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.agents/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.agents/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.agents/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Antigravity In Antigravity: Copy the data-engineering-agent-skills folder into ~/.gemini/config/skills (Antigravity app and IDE) or ~/.gemini/antigravity-cli/skills (Antigravity CLI). View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Gemini CLI Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.gemini/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.gemini/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.gemini/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.gemini/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.gemini/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.gemini/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.gemini/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.gemini/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.gemini/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.gemini/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.gemini/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.gemini/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.gemini/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.gemini/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.gemini/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.gemini/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.gemini/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.gemini/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.gemini/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.gemini/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.gemini/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.gemini/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.gemini/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.gemini/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.gemini/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.gemini/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.gemini/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.gemini/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.gemini/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.gemini/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.gemini/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.gemini/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.gemini/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.gemini/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.gemini/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.gemini/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.gemini/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.gemini/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.gemini/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.gemini/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.gemini/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.gemini/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.gemini/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.gemini/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.gemini/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.gemini/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.gemini/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.gemini/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.gemini/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.gemini/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.gemini/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.gemini/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.gemini/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.gemini/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.gemini/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.gemini/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.gemini/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.gemini/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.gemini/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.gemini/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.gemini/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.gemini/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.gemini/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.gemini/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.gemini/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.gemini/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.gemini/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.gemini/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.gemini/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.gemini/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.gemini/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.gemini/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.gemini/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.gemini/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Replit Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration .agents/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream .agents/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse .agents/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns .agents/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry .agents/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering .agents/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading .agents/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics .agents/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery .agents/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry .agents/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture .agents/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design .agents/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover .agents/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management .agents/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management .agents/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity .agents/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership .agents/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing .agents/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management .agents/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls .agents/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection .agents/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data .agents/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts .agents/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification .agents/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance .agents/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering .agents/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc .agents/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture .agents/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev .agents/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization .agents/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting .agents/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy .agents/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines .agents/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion .agents/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance .agents/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee .agents/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery .agents/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services .agents/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution .agents/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning .agents/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering .agents/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance .agents/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation .agents/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload .agents/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution .agents/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration .agents/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance .agents/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening .agents/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage .agents/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql .agents/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills .agents/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown .agents/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete .agents/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging .agents/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty .agents/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving .agents/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration .agents/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes .agents/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations .agents/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance .agents/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance .agents/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience .agents/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing .agents/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management .agents/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems .agents/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving .agents/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure .agents/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data .agents/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query .agents/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance .agents/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills .agents/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills .agents/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design .agents/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization .agents/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### OpenClaw Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.openclaw/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.openclaw/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.openclaw/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.openclaw/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.openclaw/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.openclaw/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.openclaw/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.openclaw/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.openclaw/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.openclaw/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.openclaw/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.openclaw/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.openclaw/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.openclaw/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.openclaw/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.openclaw/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.openclaw/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.openclaw/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.openclaw/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.openclaw/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.openclaw/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.openclaw/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.openclaw/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.openclaw/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.openclaw/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.openclaw/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.openclaw/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.openclaw/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.openclaw/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.openclaw/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.openclaw/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.openclaw/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.openclaw/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.openclaw/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.openclaw/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.openclaw/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.openclaw/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.openclaw/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.openclaw/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.openclaw/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.openclaw/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.openclaw/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.openclaw/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.openclaw/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.openclaw/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.openclaw/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.openclaw/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.openclaw/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.openclaw/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.openclaw/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.openclaw/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.openclaw/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.openclaw/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.openclaw/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.openclaw/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.openclaw/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.openclaw/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.openclaw/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.openclaw/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.openclaw/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.openclaw/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.openclaw/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.openclaw/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.openclaw/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.openclaw/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.openclaw/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.openclaw/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.openclaw/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.openclaw/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.openclaw/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.openclaw/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.openclaw/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.openclaw/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.openclaw/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### OpenCode Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.config/opencode/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.config/opencode/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.config/opencode/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.config/opencode/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.config/opencode/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.config/opencode/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.config/opencode/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.config/opencode/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.config/opencode/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.config/opencode/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.config/opencode/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.config/opencode/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.config/opencode/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.config/opencode/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.config/opencode/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.config/opencode/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.config/opencode/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.config/opencode/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.config/opencode/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.config/opencode/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.config/opencode/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.config/opencode/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.config/opencode/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.config/opencode/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.config/opencode/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.config/opencode/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.config/opencode/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.config/opencode/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.config/opencode/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.config/opencode/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.config/opencode/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.config/opencode/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.config/opencode/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.config/opencode/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.config/opencode/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.config/opencode/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.config/opencode/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.config/opencode/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.config/opencode/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.config/opencode/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.config/opencode/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.config/opencode/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.config/opencode/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.config/opencode/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.config/opencode/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.config/opencode/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.config/opencode/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.config/opencode/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.config/opencode/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.config/opencode/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.config/opencode/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.config/opencode/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.config/opencode/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.config/opencode/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.config/opencode/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.config/opencode/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.config/opencode/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.config/opencode/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.config/opencode/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.config/opencode/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.config/opencode/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.config/opencode/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.config/opencode/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.config/opencode/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.config/opencode/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.config/opencode/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.config/opencode/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.config/opencode/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.config/opencode/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.config/opencode/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.config/opencode/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.config/opencode/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.config/opencode/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.config/opencode/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills ### Hermes Agent Copy all 74 skills, in your terminal: ```shell npx -y degit vaquarkhan/data-engineering-agent-skills/skills/airflow-and-workflow-orchestration ~/.hermes/skills/airflow-and-workflow-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-beam-unified-batch-and-stream ~/.hermes/skills/apache-beam-unified-batch-and-stream npx -y degit vaquarkhan/data-engineering-agent-skills/skills/apache-hudi-lakehouse ~/.hermes/skills/apache-hudi-lakehouse npx -y degit vaquarkhan/data-engineering-agent-skills/skills/api-and-saas-ingestion-patterns ~/.hermes/skills/api-and-saas-ingestion-patterns npx -y degit vaquarkhan/data-engineering-agent-skills/skills/avro-protobuf-json-schema-registry ~/.hermes/skills/avro-protobuf-json-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/bigquery-and-dataform-platform-engineering ~/.hermes/skills/bigquery-and-dataform-platform-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/cdc-and-incremental-loading ~/.hermes/skills/cdc-and-incremental-loading npx -y degit vaquarkhan/data-engineering-agent-skills/skills/clickhouse-real-time-analytics ~/.hermes/skills/clickhouse-real-time-analytics npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-catalog-and-discovery ~/.hermes/skills/data-catalog-and-discovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-contract-testing-with-schema-registry ~/.hermes/skills/data-contract-testing-with-schema-registry npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-lake-and-zone-architecture ~/.hermes/skills/data-lake-and-zone-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-mesh-and-domain-oriented-design ~/.hermes/skills/data-mesh-and-domain-oriented-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-migration-and-platform-cutover ~/.hermes/skills/data-migration-and-platform-cutover npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-observability-and-sla-management ~/.hermes/skills/data-observability-and-sla-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management ~/.hermes/skills/data-platform-ci-cd-and-release-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-disaster-recovery-and-business-continuity ~/.hermes/skills/data-platform-disaster-recovery-and-business-continuity npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-platform-operating-model-and-service-ownership ~/.hermes/skills/data-platform-operating-model-and-service-ownership npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-and-contract-testing ~/.hermes/skills/data-quality-and-contract-testing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-quality-platforms-and-rule-management ~/.hermes/skills/data-quality-platforms-and-rule-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-reconciliation-and-financial-controls ~/.hermes/skills/data-reconciliation-and-financial-controls npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-resiliency-testing-and-failure-injection ~/.hermes/skills/data-resiliency-testing-and-failure-injection npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-security-compliance-and-regulated-data ~/.hermes/skills/data-security-compliance-and-regulated-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-sharing-and-publishing-contracts ~/.hermes/skills/data-sharing-and-publishing-contracts npx -y degit vaquarkhan/data-engineering-agent-skills/skills/data-specification ~/.hermes/skills/data-specification npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dataplex-and-bigquery-governance ~/.hermes/skills/dataplex-and-bigquery-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering ~/.hermes/skills/dbt-and-analytics-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc ~/.hermes/skills/debezium-and-kafka-connect-cdc npx -y degit vaquarkhan/data-engineering-agent-skills/skills/delta-lake-and-medallion-architecture ~/.hermes/skills/delta-lake-and-medallion-architecture npx -y degit vaquarkhan/data-engineering-agent-skills/skills/duckdb-local-analytics-and-dev ~/.hermes/skills/duckdb-local-analytics-and-dev npx -y degit vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization ~/.hermes/skills/enterprise-etl-and-data-integration-modernization npx -y degit vaquarkhan/data-engineering-agent-skills/skills/esg-and-sustainability-regulatory-reporting ~/.hermes/skills/esg-and-sustainability-regulatory-reporting npx -y degit vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy ~/.hermes/skills/etl-elt-and-modernization-strategy npx -y degit vaquarkhan/data-engineering-agent-skills/skills/feature-store-and-ml-data-pipelines ~/.hermes/skills/feature-store-and-ml-data-pipelines npx -y degit vaquarkhan/data-engineering-agent-skills/skills/file-and-partner-feed-ingestion ~/.hermes/skills/file-and-partner-feed-ingestion npx -y degit vaquarkhan/data-engineering-agent-skills/skills/glue-data-catalog-and-lake-formation-governance ~/.hermes/skills/glue-data-catalog-and-lake-formation-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/great-expectations-deequ-and-cuallee ~/.hermes/skills/great-expectations-deequ-and-cuallee npx -y degit vaquarkhan/data-engineering-agent-skills/skills/incident-triage-and-pipeline-recovery ~/.hermes/skills/incident-triage-and-pipeline-recovery npx -y degit vaquarkhan/data-engineering-agent-skills/skills/java-data-engineering-and-integration-services ~/.hermes/skills/java-data-engineering-and-integration-services npx -y degit vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution ~/.hermes/skills/kafka-resilience-and-schema-evolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakefs-and-data-versioning ~/.hermes/skills/lakefs-and-data-versioning npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lakehouse-table-format-engineering ~/.hermes/skills/lakehouse-table-format-engineering npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lineage-pii-and-governance ~/.hermes/skills/lineage-pii-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/lower-environment-data-masking-and-obfuscation ~/.hermes/skills/lower-environment-data-masking-and-obfuscation npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mainframe-modernization-and-data-offload ~/.hermes/skills/mainframe-modernization-and-data-offload npx -y degit vaquarkhan/data-engineering-agent-skills/skills/master-data-and-entity-resolution ~/.hermes/skills/master-data-and-entity-resolution npx -y degit vaquarkhan/data-engineering-agent-skills/skills/mcp-data-observability-integration ~/.hermes/skills/mcp-data-observability-integration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/microsoft-purview-and-azure-data-governance ~/.hermes/skills/microsoft-purview-and-azure-data-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/notebook-to-production-hardening ~/.hermes/skills/notebook-to-production-hardening npx -y degit vaquarkhan/data-engineering-agent-skills/skills/openmetadata-datahub-and-openlineage ~/.hermes/skills/openmetadata-datahub-and-openlineage npx -y degit vaquarkhan/data-engineering-agent-skills/skills/operational-datastore-selection-relational-and-nosql ~/.hermes/skills/operational-datastore-selection-relational-and-nosql npx -y degit vaquarkhan/data-engineering-agent-skills/skills/orchestration-and-backfills ~/.hermes/skills/orchestration-and-backfills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/pipeline-planning-and-task-breakdown ~/.hermes/skills/pipeline-planning-and-task-breakdown npx -y degit vaquarkhan/data-engineering-agent-skills/skills/privacy-retention-and-right-to-delete ~/.hermes/skills/privacy-retention-and-right-to-delete npx -y degit vaquarkhan/data-engineering-agent-skills/skills/python-data-engineering-and-pipeline-packaging ~/.hermes/skills/python-data-engineering-and-pipeline-packaging npx -y degit vaquarkhan/data-engineering-agent-skills/skills/regional-data-compliance-and-sovereignty ~/.hermes/skills/regional-data-compliance-and-sovereignty npx -y degit vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving ~/.hermes/skills/reverse-etl-and-operational-data-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/safe-backfill-and-replay-orchestration ~/.hermes/skills/safe-backfill-and-replay-orchestration npx -y degit vaquarkhan/data-engineering-agent-skills/skills/scala-data-engineering-on-jvm-runtimes ~/.hermes/skills/scala-data-engineering-on-jvm-runtimes npx -y degit vaquarkhan/data-engineering-agent-skills/skills/schema-evolution-and-contract-migrations ~/.hermes/skills/schema-evolution-and-contract-migrations npx -y degit vaquarkhan/data-engineering-agent-skills/skills/semantic-layer-and-metric-governance ~/.hermes/skills/semantic-layer-and-metric-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/snowflake-native-pipelines-and-governance ~/.hermes/skills/snowflake-native-pipelines-and-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/source-reliability-and-extraction-resilience ~/.hermes/skills/source-reliability-and-extraction-resilience npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-and-distributed-processing ~/.hermes/skills/spark-and-distributed-processing npx -y degit vaquarkhan/data-engineering-agent-skills/skills/spark-serverless-reliability-and-state-management ~/.hermes/skills/spark-serverless-reliability-and-state-management npx -y degit vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems ~/.hermes/skills/streaming-and-messaging-systems npx -y degit vaquarkhan/data-engineering-agent-skills/skills/superset-and-metrics-serving ~/.hermes/skills/superset-and-metrics-serving npx -y degit vaquarkhan/data-engineering-agent-skills/skills/terraform-and-data-platform-infrastructure ~/.hermes/skills/terraform-and-data-platform-infrastructure npx -y degit vaquarkhan/data-engineering-agent-skills/skills/test-data-preparation-and-synthetic-data ~/.hermes/skills/test-data-preparation-and-synthetic-data npx -y degit vaquarkhan/data-engineering-agent-skills/skills/trino-presto-federated-query ~/.hermes/skills/trino-presto-federated-query npx -y degit vaquarkhan/data-engineering-agent-skills/skills/unity-catalog-and-lakehouse-governance ~/.hermes/skills/unity-catalog-and-lakehouse-governance npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-agent-skills ~/.hermes/skills/using-data-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/using-data-engineering-agent-skills ~/.hermes/skills/using-data-engineering-agent-skills npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-and-schema-design ~/.hermes/skills/warehouse-and-schema-design npx -y degit vaquarkhan/data-engineering-agent-skills/skills/warehouse-performance-and-cost-optimization ~/.hermes/skills/warehouse-performance-and-cost-optimization ``` View the skills on GitHub: https://github.com/vaquarkhan/data-engineering-agent-skills --- From Pluginboard (https://pluginboard.ai).