Skip to content

Latest commit

 

History

History
290 lines (202 loc) · 14.6 KB

File metadata and controls

290 lines (202 loc) · 14.6 KB
data-architecture banner

🏗️ data-architecture

The open-source Claude plugin for data architects.

Community-built skills that turn Claude into a senior data architect — for modeling, platforms, cloud, AI, and modernization.

CI Skills Contributors PRs Welcome License: MIT Stars

🚀 Quick Start · 📚 Browse Skills · ✏️ Contribute a Skill · 🗺️ Roadmap


What is this?

data-architecture is a living, community-built Claude plugin that gives Claude the skills of a senior data architect.

Think of it like brain modules for your AI — each skill you install teaches Claude how to:

  • Design data models using Data Vault 2.0, Star Schema, 3NF, and AUDM
  • Architect modern platforms: Data Mesh, Data Fabric, Lakehouse, Lambda
  • Evaluate and choose cloud technologies: Snowflake, Databricks, Azure Synapse
  • Build supply chain analytics from real KPI catalogs
  • Design AI/ML feature stores and RAG architectures
  • Execute data modernization and migration playbooks

Built at Data Architect School (Accenture, 2024) · 5-day curriculum · community-driven · MIT licensed


⚡ Quick Start

Install a skill into Claude (30 seconds)

# 1. Clone
git clone https://github.com/wjlgatech/data-architecture.git

# 2. Pick a skill and read its instructions
cat skills/day1-modeling/SKILL.md

# 3. Paste into Claude's system prompt or use as a Project instruction

Use a slash command

Once installed, Claude responds to built-in commands:

/design-model I need to model a pharmaceutical supply chain with 30 KPIs

/choose-architecture We have 5 source systems, daily batch + real-time events

/kpi-catalog Order Fulfillment domain, OTIF and Perfect Order needed

/audit-vault Review my Hub-Link-Satellite design for DV 2.0 compliance

🗺️ Roadmap

Day Module Commands Status
0️⃣ Skill Orchestrator discover-client, assess-maturity, orchestrate-engagement, translate-for-stakeholder, estimate-effort Active
1️⃣ Intro to Data Architecture & Modeling design-model, choose-architecture, kpi-catalog, audit-vault, dimension-map Active
2️⃣ Data Management design-mdm, check-data-quality, governance-check, lifecycle-plan, security-review Active
3️⃣ Cloud Data & Technology design-cloud-platform, design-data-platform, design-ingestion-pipeline, design-api-layer, multi-region-plan Active
4️⃣ Data Intelligence, Analytics & AI analyze-big-data, design-nlp-pipeline, build-mlops-pipeline, design-realtime-intelligence, responsible-ai-review Active
5️⃣ Data Strategy & GenAI design-genai-architecture, data-strategy-alignment, build-data-product, modernization-roadmap, operating-model-design Active

6 skills · 30 commands · full 5-day curriculum complete. PRs welcome to extend any module.


📁 Repository Structure

data-architecture/
├── skills/                       # 🧠 Claude skills (one folder = one skill module)
│   ├── skill-orchestrator/       # Meta-skill: client intake, maturity, engagement orchestration
│   ├── day1-modeling/            # Data modeling: Vault, Star, 3NF, AUDM
│   │   ├── SKILL.md              # Main Claude instructions (paste into system prompt)
│   │   ├── metadata.json         # Skill metadata, version, tags
│   │   ├── commands/             # Slash command definitions
│   │   └── references/           # Deep reference material
│   ├── day2-data-management/     # MDM, Data Quality, Governance, Lifecycle, Security
│   ├── day3-cloud-data/          # Cloud platforms, Lakehouse, FHIR, multi-region
│   ├── day4-analytics/           # Big data, clinical NLP, MLOps, real-time, responsible AI
│   ├── day5-strategy/            # GenAI/RAG, data products, modernization, operating model
│   └── index.json                # Machine-readable skill registry
│
├── knowledge-base/               # 📚 Cross-skill shared domain knowledge
│   ├── healthcare-standards.md   # HL7 FHIR, ICD-10, LOINC, SNOMED
│   ├── cloud-platform-patterns.md
│   ├── analytics-patterns.md
│   └── genai-data-patterns.md
│
├── schemas/                      # 🔒 JSON schemas for CI validation
├── templates/                    # 🧩 Copy-paste starters for new skills
├── examples/                     # 📖 Real case studies (interactive HTML)
│   ├── newlife-pharmacy/         # Pharma supply chain — Day 1
│   └── newlife-hospital/         # Healthcare HIS — Days 2–5
├── docs/                         # 📄 Architecture decisions, specs
├── tests/                        # ✅ Validation scripts (run by CI)
├── scripts/                      # 🛠️ CLI tooling
└── .github/                      # ⚙️ Workflows, issue/PR templates

🤝 Contributing

We merge PRs every day. If your skill passes CI, it gets merged.

# 1. Fork + clone
git clone https://github.com/YOUR_USERNAME/data-architecture.git

# 2. Create a branch
git checkout -b skill/your-skill-name

# 3. Copy the template
cp -r templates/skill-template skills/your-skill-name

# 4. Fill in SKILL.md and metadata.json

# 5. Validate locally
npm run validate

# 6. Open a PR — we'll review and merge same day

→ Full guide: CONTRIBUTING.md

→ Easy wins: good first issue


🏆 Contributors


Paul Wu

🏗️ Founder

🎓 Live Portfolio — Data Architect School Solutions

Proof of expertise, not slides. Each solution below is a fully-interactive artifact built end-to-end from a real case study. Click to explore.


Day 1 · Pharmaceutical Supply Chain Data Model

NewLife Pharmacy — D2P supply chain, 30 KPIs, Data Vault 2.0 vs. Star Schema decision

One-line verdict: Chose Data Vault 2.0 over Star Schema because multi-vendor invoice discrepancies require storing multiple source "truths" simultaneously — something a Star Schema can't do without picking a winner at ETL time.

Dimension Decision
Architecture Data Vault 2.0 — 9 Hubs, 6 Links, 6+ Satellites
Analytics Layer Star Schema Information Marts on top of Business Vault
KPIs catalogued 30 KPIs across Inventory, Order Fulfillment, Transportation, Returns, Warehousing
External enrichment FDA Drug Shortages · Weather API · FreightWaves · IQVIA · EPA Emissions
Key insight DV stores supplier A and supplier B versions in separate Satellites; golden record resolved in Business Vault — never at load time

▶ Open Interactive Solution →


Day 2 · Unified Health Information System — MDM, Governance & Security

NewLife Hospital — 300 hospitals, 90+ countries, 200M+ patients, HIPAA + GDPR

One-line verdict: Federated Hub-and-Spoke MDM — the only pattern that gives a global patient identity and data residency compliance simultaneously. Pure centralised violates GDPR. Pure decentralised makes "unified" impossible.

Dimension Decision
MDM Architecture Federated Hub-and-Spoke — Global Hub (de-ID MPI + reference) + Regional Nodes (full PHI per jurisdiction)
MDM Domains Party (Patient MPI, Physician) · Places (Facilities) · Things (Drugs) · Reference (ICD-10, LOINC, SNOMED)
Regulatory GDPR · HIPAA · PIPL · DPDP · PDPA — attribute-level consent, data residency routing, right-to-erasure workflow
Data Quality Profile → Rules → Cleanse → Monitor; ≥99% patient completeness; 100% drug code accuracy
Governance EGC → DGC → Domain Owners → Stewards · RBAC + ABAC · Break-glass emergency access with full audit
Lifecycle Hot/Warm/Cold/Archive metadata-driven policy engine — 7 lifecycle stages automated
Security Zero Trust + field-level AES-256 + DevSecOps (Build → Test → Deploy → Operate)

▶ Open Interactive Solution →



Day 3 · Cloud Data Platform — Azure Medallion Lakehouse

NewLife Hospital — Multi-region healthcare data platform, FHIR R4 API, Medallion Lakehouse, 90+ countries

One-line verdict: Azure Medallion Lakehouse (Bronze/Silver/Gold) on Delta Lake — the only pattern that handles FHIR R4 streaming ingestion, multi-jurisdictional data residency, and clinical AI feature serving from a single coherent architecture.

Dimension Decision
Platform Azure — ADF, Event Hub, Databricks, Delta Lake, Synapse, ADLS Gen2
Architecture Medallion Lakehouse — Bronze (raw FHIR) → Silver (cleaned) → Gold (marts)
APIs FHIR R4 with SMART on FHIR OAuth 2.0, geo-load balancing, 99.9% SLA
Multi-Region Hub-and-spoke — 5 regional nodes, data residency enforcement per GDPR/PIPL/PDPA
Security Zero Trust, Private Endpoints, Azure Purview RBAC, field-level encryption
Clinical AI Predictive sepsis, NLP discharge summaries, imaging triage — all within Medallion Gold

▶ Open Interactive Solution →


Day 4 · Data Intelligence, Analytics & AI

NewLife Hospital — Clinical NLP, Medical Imaging AI, Real-time Sepsis Alerting, MLOps, $2M→$6M Year-1 ROI

One-line verdict: Lambda architecture for batch + streaming analytics, with a unified MLOps platform (MLflow + Databricks) that governs clinical models from FDA SaMD Class II compliance to bedside alerting in under 60 seconds.

Dimension Decision
Big Data Lambda architecture — Spark batch (Databricks) + Kafka/Event Hub streaming
Clinical NLP spaCy + Med7 + BERT-clinical pipeline: 92%+ F1 on entity extraction
Imaging AI CNN + ViT ensemble, 3-stage review workflow, FDA SaMD Class II governance
Real-time NEWS2 sepsis score — Kafka → Feature Store → model inference → alert in <60s
MLOps MLflow + AzureML: Experiment → Train → Validate → Deploy → Monitor → Retrain
Responsible AI Bias audit, GDPR Art. 22 human-in-loop, FDA SaMD classification, explainability
ROI Year 1: $2M invest → $6M return · Year 2: $4M → $16M · Year 3: $8M → $40M

▶ Open Interactive Solution →


Day 5 · Data Strategy, GenAI & Final Blueprint

NewLife Hospital — RAG pipeline, Data Products, $127M NPV business case, 5-year operating model

One-line verdict: A GenAI Clinical Intelligence Platform built on Retrieval-Augmented Generation, with PHI de-identification gate, vector store serving 200M+ patient records, and a federated data product marketplace — all governed by a CDO-led operating model with a measurable $127M NPV over 5 years.

Dimension Decision
GenAI Architecture RAG pipeline — PHI De-ID → Chunking → Embedding → Vector Store → LLM → Audit
Vector Store Azure AI Search (hybrid dense + sparse) — HIPAA-compliant, 200M+ patient records
Data Products Federated marketplace — 12 certified products across Clinical, Ops, Finance, Research
Modernization Legacy EHR → Cloud: Assess (3I) → Lift-and-Shift → Re-platform → Re-architect
Operating Model CDO → Data Domains → Product Owners → Engineers · Hub-and-Spoke federated
Business Case $127M NPV, 287% ROI, 18-month payback — board-ready financial model

▶ Open Interactive Solution →


📖 Case Studies

Case Study Domain Days Link
NewLife Pharmacy Supply Chain Pharmaceutical D2P Day 1 View →
NewLife Hospital — Data Management Healthcare MDM + Governance Day 2 View →
NewLife Hospital — Cloud Platform Healthcare Lakehouse + FHIR Day 3 View →
NewLife Hospital — Analytics & AI Clinical NLP, MLOps, Sepsis AI Day 4 View →
NewLife Hospital — Strategy & GenAI RAG, Data Products, $127M NPV Day 5 View →

📜 License

MIT © 2024 wjlgatech and contributors.


Built with ❤️ at Data Architect School · ⭐ Star if useful