Multi-Account API Pooling: Maximize AI Throughput with Load Balancing

Why API Key Pooling Matters

AI providers enforce rate limits per API key. When you hit the limit, your assistant stops responding until the cooldown expires. With Flaxu's multi-account pooling, you can distribute requests across multiple keys so that hitting a limit on one key simply shifts traffic to the next.

How P2C Load Balancing Works

Flaxu uses a Power of 2 Choices (P2C) algorithm for key selection. When a request comes in, the system picks two random healthy keys from your pool, then selects the one with lower recent usage. This achieves near-optimal load distribution without the overhead of tracking global state.

Key Features

• Priority routing: Assign priority 1-10 to each key. Higher priority keys are preferred.
• Daily token budgets: Set spending caps per key. When a key's daily budget is exhausted, it's temporarily removed from rotation.
• Auto-recovery: Throttled keys automatically rejoin the pool after the cooldown period.
• Real-time health dashboard: See which keys are healthy, throttled, or over budget in Settings.

Google Account Pool for Gemini

Beyond API keys, you can also connect multiple Google accounts for Gemini. Each Google account provides its own rate limit quota for the Gemini API. By connecting 3-4 Google accounts, you effectively multiply your Gemini throughput by that factor.

Setting Up a Google Account Pool

1. Go to Settings > Google Gemini
2. Click "Add Account" to connect a Google account
3. Google will ask for Gemini API permission (this does not affect your Flaxu login)
4. Repeat for additional accounts

Once multiple accounts are connected, the system automatically rotates between them. The Settings page shows a badge with the number of connected accounts and their health status.

Combining with Provider Fallback

For maximum reliability, combine key pooling with provider fallback. If all your Claude keys are throttled, the system can automatically switch to GPT or Gemini. Configure your fallback provider priority in Settings.

Getting Started

Multi-account pooling is available on both the Starter ($9/mo) and Pro ($29/mo) plans. Simply add multiple API keys for the same provider in Settings > API Keys, and the system handles the rest automatically.