stock-bot/DOCKER.md

🐳 Trading Bot Docker Infrastructure

This directory contains the Docker Compose configuration for the Trading Bot infrastructure, including databases, caching, monitoring, and admin tools.

🏗️ Architecture Overview

┌─────────────────────────────────────────────────────────────────┐
│                    Trading Bot Infrastructure                    │
├─────────────────────────────────────────────────────────────────┤
│  🐉 Dragonfly (Redis)  │  🐘 PostgreSQL  │  📊 QuestDB         │
│  Events & Caching      │  Operational DB  │  Time-series Data   │
│  Port: 6379           │  Port: 5432      │  Port: 9000/8812    │
├─────────────────────────────────────────────────────────────────┤
│  🔧 Redis Insight     │  🛠️ PgAdmin      │  📈 Prometheus      │
│  Dragonfly GUI        │  PostgreSQL GUI  │  Metrics Collection │
│  Port: 8001          │  Port: 8080      │  Port: 9090         │
├─────────────────────────────────────────────────────────────────┤
│                    📊 Grafana Dashboard                         │
│                    Visualization & Alerting                     │
│                         Port: 3000                             │
└─────────────────────────────────────────────────────────────────┘

🚀 Quick Start

1. Start Core Infrastructure

# Start essential services (Dragonfly, PostgreSQL, QuestDB)
npm run infra:up

# Or use the management script
npm run docker:start

2. Start Admin Interfaces

# Start Redis Insight and PgAdmin
npm run docker:admin

3. Start Full Development Environment

# Start infrastructure + admin + your trading services
npm run dev:full

📊 Service Access Points

Service	URL	Credentials	Purpose
Dragonfly	localhost:6379	None	Redis-compatible cache & events
PostgreSQL	localhost:5432	trading_user / trading_pass_dev	Operational database
QuestDB Console	http://localhost:9000	None	Time-series database GUI
QuestDB Wire	localhost:8812	admin / quest	PostgreSQL protocol access
Redis Insight	http://localhost:8001	None	Dragonfly/Redis management
PgAdmin	http://localhost:8080	admin@tradingbot.local / admin123	PostgreSQL management
Prometheus	http://localhost:9090	None	Metrics collection
Grafana	http://localhost:3000	admin / admin123	Dashboards & alerts

🛠️ Management Commands

Using NPM Scripts (Recommended)

# Infrastructure management
npm run docker:start          # Start core services
npm run docker:stop           # Stop all services
npm run docker:restart        # Restart services
npm run docker:status         # Show service status
npm run docker:logs          # Show logs
npm run docker:reset         # Reset all data (destructive)

# Additional services
npm run docker:admin          # Start admin interfaces
npm run docker:monitoring     # Start monitoring stack

# Quick development
npm run dev:full              # Infrastructure + admin + services
npm run dev:clean             # Reset + full restart

Using PowerShell Script Directly

# Basic operations
./scripts/docker.ps1 start
./scripts/docker.ps1 stop
./scripts/docker.ps1 status

# View logs for specific service
./scripts/docker.ps1 logs -Service dragonfly

# Development mode (lighter configuration)
./scripts/docker.ps1 start -Dev

# Get help
./scripts/docker.ps1 help

Using Docker Compose Directly

# Start core services
docker-compose up -d dragonfly postgres questdb

# Start with development overrides
docker-compose -f docker-compose.yml -f docker-compose.dev.yml up -d

# Start monitoring (optional)
docker-compose --profile monitoring up -d

# View logs
docker-compose logs -f

# Stop everything
docker-compose down

# Reset all data
docker-compose down -v

🗃️ Database Schemas

PostgreSQL Structure

trading.*          -- Orders, positions, executions, accounts
strategy.*         -- Strategies, signals, performance
risk.*             -- Risk limits, events, monitoring
audit.*            -- System events, health, configuration

Initial Data

The PostgreSQL database is automatically initialized with:

• Common stock symbols (AAPL, GOOGL, etc.)
• Demo trading account with $100k
• Sample mean reversion strategy
• Basic risk limits
• Audit triggers for data tracking

📈 Monitoring & Observability

Prometheus Metrics

The setup includes Prometheus configuration to monitor:

• Trading bot services (ports 3001, 3002, 4001)
• Dragonfly performance
• PostgreSQL health
• QuestDB metrics

Grafana Dashboards

Access Grafana at http://localhost:3000 to view:

• Trading system performance
• Database metrics
• Service health
• Risk monitoring

🔧 Configuration

Environment Variables

Services use these environment variables (configured in docker-compose.yml):

# Dragonfly
DRAGONFLY_HOST=localhost
DRAGONFLY_PORT=6379

# PostgreSQL
POSTGRES_HOST=localhost
POSTGRES_PORT=5432
POSTGRES_DB=trading_bot
POSTGRES_USER=trading_user
POSTGRES_PASSWORD=trading_pass_dev

# QuestDB
QUESTDB_HOST=localhost
QUESTDB_PORT=8812
QUESTDB_DB=qdb

Development vs Production

• Development: Use docker-compose.dev.yml for lighter resource usage
• Production: Use base docker-compose.yml with proper secrets management

🚨 Troubleshooting

Common Issues

Port Conflicts

# Check what's using a port
netstat -ano | findstr :6379

# Kill process if needed
taskkill /PID <process_id> /F

Permission Issues

# Ensure Docker is running as administrator
# Check Docker Desktop settings

Data Corruption

# Reset all data and restart fresh
npm run docker:reset

Service Won't Start

# Check logs for specific service
npm run docker:logs
./scripts/docker.ps1 logs -Service dragonfly

Health Checks

All services include health checks. Monitor with:

npm run docker:status
docker ps --filter "name=trading-bot"

🔒 Security Notes

Development Security

• Default passwords are for development only
• No SSL/TLS in development mode
• Services exposed on localhost only

Production Considerations

• Change all default passwords
• Enable SSL/TLS encryption
• Use Docker secrets for sensitive data
• Implement proper backup strategies
• Set up log rotation
• Configure firewall rules

📋 Maintenance

Backup Data

# Backup PostgreSQL
docker exec trading-bot-postgres pg_dump -U trading_user trading_bot > backup.sql

# Backup Dragonfly (if persistence enabled)
docker exec trading-bot-dragonfly redis-cli BGSAVE

Update Services

# Pull latest images
docker-compose pull

# Restart with new images
npm run docker:restart

Clean Up

# Remove unused containers and images
docker system prune

# Remove all trading-bot related containers and volumes
docker-compose down -v --remove-orphans

🎯 Next Steps

1. Start the infrastructure: npm run docker:start
2. Open admin interfaces: npm run docker:admin
3. Configure your services: Update .env files to use Docker services
4. Start development: npm run dev:full
5. Monitor health: Check http://localhost:8001 and http://localhost:8080

For more advanced configuration, see the individual service documentation in the database/ and monitoring/ directories.