Data Engineering Suite

Comprehensive toolkit for data engineers working with databases, ETL pipelines, and data infrastructure. Includes database design, optimization, and cloud services integration.

## Features

- Database design and optimization tools
- Cloud data services integration
- SQL query optimization and debugging
- Data pipeline automation

## Use Cases

- Building and optimizing data pipelines
- Managing cloud-based data infrastructure
- Database performance tuning
- Migrating data systems to the cloud

## TL;DR

A collection of six Claude resources for working with databases and cloud data sources. It pairs a database-focused agent and rules with MCP servers for AWS and Airtable, plus commands for optimizing and debugging.

- `database-specialist-agent` and `database-expert` rules for schema design and query tuning
- `aws-services-mcp-server` for connecting Claude to AWS services
- `airtable-mcp-server` for reading and writing Airtable data
- `optimize` and `debug` commands for iterating on queries and pipelines

## Collection Overview

**Collection Type:** Data Infrastructure
**Focus Area:** Databases & Cloud Data Sources
**Skill Level:** Intermediate to Advanced

## What's Included

## Collection Contents

Six resources for database and cloud data work

- **database-specialist-agent** (agent): An agent focused on database design and query work.
- **database-expert** (rules): Rules that guide Claude toward database best practices.
- **aws-services-mcp-server** (MCP): Connects Claude to AWS services.
- **airtable-mcp-server** (MCP): Connects Claude to Airtable data.
- **optimize** and **debug** (commands): Commands for optimizing and debugging queries and pipelines.

## Quick Start

Install the database agent and rules first, then add the AWS and Airtable MCP servers, and finish with the optimize and debug commands. Each component is independent and can be used on its own.

## Prerequisites

- Basic SQL knowledge
- AWS account (for AWS services integration)
- Understanding of database concepts

## Recommended Order

1. `database-specialist-agent`
2. `database-expert`
3. `aws-services-mcp-server`
4. `airtable-mcp-server`
5. `optimize`
6. `debug`

## Troubleshooting

### AWS MCP server auth conflicts with Airtable MCP credentials

Configure separate credential stores for each MCP server. Use AWS_PROFILE env var for aws-services-mcp-server, AIRTABLE_API_KEY for airtable-mcp-server. Keep credentials in different config files.

### Database agent and rules provide contradicting optimization advice

Install database-expert rules before database-specialist-agent. Agent will defer to rules for best practices. Update rules file to match your database engine (PostgreSQL, MySQL, etc.).

### MCP servers fail to initialize due to missing AWS SDK dependencies

Install AWS SDK before MCP servers: npm install @aws-sdk/client-rds @aws-sdk/client-dynamodb @aws-sdk/client-s3. Then reinstall aws-services-mcp-server to detect installed SDKs.

### Optimize command incompatible with database agent's schema format

Ensure database-specialist-agent and optimize command use same schema definition format. Install agent first to establish format, then install optimize command to inherit conventions.

### Collection setup fails without proper AWS region configuration

Set AWS_REGION environment variable before installing MCP servers: export AWS_REGION=us-east-1. Configure region in Claude Code settings under MCP server preferences. Restart Claude after setting.