Overview

⚡ 0 req/min ⏱ 0ms p50 ✓ All Systems Operational
API Requests/min
↑ 0 total
P99 LATENCY
✓ healthy
Uptime
✓ running
Total Requests
0.0% errors
API requests/min, uptime, and error rate are live from Railway · Pipeline p99 latency from load test (docs/benchmarks.md) · View raw metrics

Pipeline Architecture

WebSocket feed · live trades & quotes · 3 default tickers + universal search Polygon.io 6 partitions · idempotent producer · exactly-once Kafka Pydantic schema validation · invalid → SQS DLQ Validation Stream processing · VWAP · z-score · momentum · exactly-once Faust Hot storage · ticker#shard key · 48hr TTL · conditional writes DynamoDB 5 endpoints · rate limited · 1s cache · custom dashboard FastAPI Failed messages · 3 retries → DLQ · 5 DLQ retries → S3 archive SQS DLQ Isolation Forest · rolling retrain · 0.3ms inference Anomaly ML Precomputed features · DynamoDB · 7-day TTL Feature Store Cold storage · Hive partitioning · Snappy compression · Athena S3 Parquet News polling · 60s interval · 3 tickers · deduplication Finnhub API Separate topic · low frequency · independent scaling Kafka market.news <1ms inference · compound score -1.0 to +1.0 VADER Sentiment Joins sentiment + volume z-score · 60s temporal window Correlator Sentiment store · 30-day TTL · strong correlation flagging DynamoDB market_sentiment
Why this component
Technical details

    Live Data

    🔔
    Market Closed
    Live data resumes automatically at market open
    AAPL NVDA MSFT

    Latest Quote — AAPL

    $207.94
    ↓ 0.27% · 14:32:01
    Vol: 4,821 · VWAP: $207.72

    Aggregations

    VWAP (1min) $207.72
    VWAP (5min) $207.48
    Volume Z-Score +2.41
    Momentum -0.84%

    Feature Vector

    vwap_5min $207.48
    volume_zscore +2.41
    price_momentum -0.84%
    trade_frequency 89/min
    bid_ask_spread $0.03
    updated_at 14:32:01
    News Sentiment

    Price (last 60s)

    Pipeline Status

    GET /health example response · use GET /metrics for live API operational data (p99, uptime, request counts)

    {
      "status": "healthy",
      "mode": "demo",
      "uptime_seconds": 3600,
      "checked_at": "2026-04-08T14:32:01.123Z",
      "note": "Running in demo mode — simulated data"
    }

    GET /quotes/{ticker} example (200)

    {
      "ticker": "AAPL",
      "price": 207.94,
      "volume": 4821,
      "timestamp": "2026-04-23T14:32:01.123Z",
      "sequence_number": 8472910
    }
    Polygon.io
    WebSocket: UP · Events: 14,832/sec
    Kafka Broker
    Lag: 42 msgs · 6 partitions
    Faust Worker
    Processing · 14,832 e/s
    DynamoDB
    Write p99: 18ms · Throttles: 0
    S3 Storage
    Last flush: 3m · 2.3 GB
    Dead Letter Q
    Depth: 0 · Retries: 0

    Throughput (last 10 min)

    Consumer Lag

    Anomalies

    Total Anomalies: 7 · High Severity: 3 · Most Active: AAPL (3)
    All AAPL NVDA MSFT