HybridInference Developer Documentation

Internal documentation for developing and operating the HybridInference platform.

For user-facing documentation (API usage, IDE integration, available models), see the FreeInference docs.

Developer Guide:

• Installation
  • Production (Docker)
  • Development Setup
  • Configuration
  • Verification
  • Documentation Structure
  • Troubleshooting
• Deployment Guide
  • Quick Start (Docker)
  • Prerequisites
  • Service Architecture
  • Common Operations
  • Configuration
  • Nginx and HTTPS
  • Subscription Account Management
  • Monitoring
  • Database
  • Troubleshooting
• Architecture Overview
  • System Architecture
  • Network Layer
  • Core Components
  • Key Design Principles
  • Data Flow
• Hybrid Inference Routing System
  • Architecture
  • Features
  • Configuration
  • Running the Server
  • API Endpoints
  • Extending the System
  • Migration Notes
• Adding a New Local Model
  • Overview
  • Private Server (No Public Internet)
  • Step 1: Start the Local Model Server
  • Step 2: Add the Model to config/models.yaml
  • Step 3: Add Optional Remote Fallbacks
  • Step 4: Restart the Gateway
  • Step 5: Verify Through HybridInference
  • Routing Notes
  • Troubleshooting
• Adding a New Model (OpenRouter-Compatible)
  • Overview
  • Quick Start
  • Adding a New Provider
  • Configuration Reference
  • BaseAdapter API Reference
  • Advanced Features
  • Examples
  • Troubleshooting
  • Best Practices
  • See Also
• Configuration Guide
  • 1. Environment Variables and Priority
  • 2. models.yaml (Required)
  • 3. routing.yaml (Optional)
  • 4. Running the System
  • 5. Subscription Adapters (Claude / Codex)
  • 6. FAQ
• PostgreSQL Admin Playbook
  • Environment Variables
  • Restart Admin Stack
  • Access pgAdmin Securely
  • Register Primary Database
  • Post-Restart Checks
• OpenRouter-Compatible API Gateway
  • Architecture
  • Features
  • Development Setup
  • Production Deployment
  • API Surface
  • Logging and Metrics
  • Testing
  • Troubleshooting
  • Related Docs
• FreeInference Deployment
  • Cloudflare + Nginx + FastAPI (current)
  • Legacy Architectures
• Claude Code Setup
  • Quick Setup (macOS / Linux)
  • Manual Setup
  • Available Models
  • Usage
  • Troubleshooting
  • Uninstall
• FASRC Deployment
  • docker
• Contributing
  • Development Setup
  • Code Quality Standards
  • Development Workflow
  • Testing
  • Documentation
  • Pull Request Guidelines
• Staging Guide
  • Why this staging shape
  • Default ports
  • First-time server bootstrap
  • Required env for a typical staging run
  • Start staging
  • SSH forwarding
  • Common operations
  • Notes for model monitor