All work

Flume

API infrastructure

Manage AI API access without sharing the original keys.

Flume — Website screenshot
Project overview

What it is.

Who it’s for

Developers and teams using AI provider APIs across scripts, services and individual workstations.

Flume is a proxy between an application and its AI providers. Instead of copying a provider’s main API key into every script or teammate’s environment, a team gives each consumer its own token. We built the product around controlling that access and seeing which consumer generates the requests, token usage and estimated cost.

  • Provider connections behind a shared proxy interface
  • Separate provider-scoped tokens for services and people
  • Token expiry, model restrictions, request limits and spend caps
  • Streaming responses and existing SDK request formats
  • Usage, latency and estimated cost reporting
Visit Flume (opens in a new tab)

What it does.

Separate the key from its consumers.

The provider key is stored encrypted on the server. Applications use issued proxy tokens instead, each tied to a provider. A team can give its development scripts, production service and individual users separate tokens. Revoking one consumer does not require distributing a new provider key to everybody else.

Set boundaries for each token.

Tokens can carry an expiry, a model allowlist, daily request limits and a spend cap. The proxy checks these rules before forwarding requests. That makes access something the team can adjust per service or person, rather than an all-or-nothing permission attached to the original provider key.

See where usage comes from.

The dashboard breaks activity down by token and provider, including request counts, latency and available token-usage data. Model pricing tables produce cost estimates, including relevant cache rates. These figures help investigate an unexpected bill or compare workloads; they are estimates rather than a replacement for the provider’s invoice.

Keep the application’s request flow.

Supported integrations retain the provider’s request paths, bodies and response shapes, with clients pointing at the proxy URL. Streaming responses pass through to the application. The proxy records usage information for metering rather than building a library of users’ prompts and generated responses.

How it works.

  1. Connect a provider

    Add the provider key to Flume and choose the account or service it represents.

  2. Issue a scoped token

    Create a separate token for a consumer and set the limits or expiry it needs.

  3. Route and review

    Point the client at the proxy, then inspect usage and revoke or adjust access as the workload changes.

Next projectConvrt
That idea you keep coming back to?

Let’s build it.

A website, an app, or something a little harder to explain.
Tell us what you have in mind. We’ll take it from there.

Tell us about your project