weightsapi.INFERENCEConsole
Navigation
FAQ

Frequently asked questions

Practical answers about WeightsAPI access, API integration, crypto credit, billing and data handling.

At a glance

Clear answers about access, models, costs, data and service availability.

Getting started

Understand what is available today and prepare your first integration.

What can I use today?

Manage API keys, create crypto funding orders and place dedicated GPU orders. Check service status for model availability; payment credit and GPU activation require confirmation.

Browse the model catalogue and documentation, sign in to the console, and create or revoke API keys. Crypto checkout supplies the amount, network, address and payment deadline; credit requires a verified transaction. Dedicated orders can be placed and paid from confirmed credit, with hardware activated after provisioning. Check status and the quickstart before sending model requests.

Sign in and confirm a top-up of at least USD 100 before AI use. Each later top-up has the same minimum; after qualification, a smaller remaining balance stays usable when it covers the request. Key permissions, spending caps and model availability still apply. Pending payments do not unlock access. Check service status before sending requests.

Do I need to complete KYC?

The current sign-in flow has no identity-document upload or KYC verification step. A signed-in account is still required, and usage remains associated with that account.

How do I create an account and an API key?

Sign in to the console, create a key with spending and model controls, and copy its secret immediately because it appears only once.

Sign in to the console and create a named key with a positive spending cap and, if useful, a list of allowed models. Copy the secret when it appears: the console reveals it only at creation. Keep it in a server-side environment variable or secret manager. Keys control access; available credit and an available model are also required. See authentication.

What do I need for my first successful request?

Use an available model, an authorized key and sufficient confirmed credit. Choose an exact model ID and keep the output within the deployment’s limits.

Use the base URL in the quickstart, send your API key as a Bearer token and choose an exact model ID returned by /v1/models. Set an output-token limit that fits your budget and the deployment’s context window. Check service status before submitting requests.

AI access requires sign-in, one confirmed top-up of at least USD 100, an authorized API key and enough available credit for the request. Each later top-up also has a USD 100 minimum; smaller remaining balances stay usable when they cover the request. Credit requires transaction verification. Check service status for model availability before sending traffic.

Can I reuse an existing OpenAI or Anthropic integration?

OpenAI Chat Completions needs a new base URL, key and model; Anthropic also requires SDK, message-format and response-parsing changes.

For an OpenAI Chat Completions integration, the main changes are the base URL, API key and model ID. Provider-specific APIs and features need separate checks. An Anthropic integration also needs changes to the SDK, message format, system prompt placement and response parsing. Follow the migration guide, then test representative prompts, tools and structured outputs against a connected deployment before moving traffic. Compatibility with a familiar request format does not guarantee identical model behavior.

How should I choose a model?

Evaluate the smallest suitable model on your own tasks, then verify its availability, context limits and required tool or schema support.

Start with the task: short interactive chat, coding, reasoning or longer document input. Compare the model pages for publisher specifications, service context and input/output rates. Check model availability and evaluate the smallest suitable candidate on your own tasks. Verify tool calling or schema support separately before committing an application to a model.

Models and API features

Check the scope of compatibility and the requirements of each feature.

Are the models uncensored?

WeightsAPI adds no content filter at the gateway. The catalogue includes original models and fine-tuned variants published by their respective creators, including Dolphin and Hermes. Some variants are designed to reduce refusals; model training can still cause refusals. Read each model’s source and behavior notes.

What does OpenAI-compatible mean here?

The API uses Chat Completions, legacy Completions and model discovery routes. Check the selected deployment’s capabilities; provider-specific APIs are not interchangeable.

WeightsAPI accepts the Chat Completions, legacy Completions and model discovery request formats. Generation requires an available deployment that supports the selected operation. Responses, Assistants and provider-specific tools are not drop-in replacements. Consult the API reference for supported operations, then validate the features your application uses before switching traffic.

Does the API support streamed responses?

Use server-sent events for streamed chat responses on an available deployment, and retain the final usage record for billing.

Set stream: true for an available chat deployment and consume complete server-sent events. A network chunk is not necessarily one message, and the final usage record can arrive after the answer text finishes. Keep the API key on your server when forwarding a stream to a browser. The streaming guide covers usage and interrupted connections; check service status for availability.

Can a model call tools or run actions for my application?

Your application validates and executes tool calls. The selected model and deployment must support the tool format before actions can be enabled.

The gateway forwards tool definitions to the selected model. A model can return a requested tool name and arguments; your application decides whether to execute the action. Validate both against an allowlist and the current user’s permissions, then return the result in the conversation. WeightsAPI does not execute your application’s tools. Check deployment support and follow function calling before enabling actions.

Can I require a response to match a JSON schema?

Strict JSON requires a deployment with compatible constrained decoding. Validate every response against your schema and handle invalid or incomplete output.

Strict schema output requires constrained decoding and support for your schema in the selected deployment. Asking a model to “return JSON” alone does not guarantee a schema match. The gateway forwards response_format; confirm strict-mode support for the deployment before relying on it. Follow the structured-output guide, validate every result with the same schema, and handle truncation or rejection explicitly.

Are embeddings, batch, audio and image services available?

Check the API reference and service status before using embeddings, reranking, managed batch processing, audio transcription or image generation.

These operations need their own supported deployment. A listed capability or rate does not establish an active endpoint, and sending multiple chat requests from your application is different from a managed batch API. Check the API reference and service status before designing around an auxiliary service.

Crypto deposits

Read the exact asset, network and payment status before sending funds.

Which cryptocurrencies and networks can I use?

Use the asset and network choices shown in the current payment configuration; a displayed receiving address does not establish confirmed credit.

Choose the exact asset and network shown in checkout and use the receiving address saved with your order. A token on another network is not interchangeable. The order retains its asset, network and address even if the payment configuration changes. Credit appears only after the incoming transaction has been matched and verified. See billing.

How do I add crypto credit?

Checkout calculates the crypto amount for your USD top-up and displays the fixed receiving address, network, exchange rate and payment deadline.

Create a funding order for at least USD 100. The server obtains a recent market rate and fixes the amount to send for 10 minutes, including for USDT and USDC. Keep the order reference and pay network fees separately. Transaction matching and credit confirmation remain separate verified steps; creating an order or refreshing its status does not add credit. See the billing guide.

Why might a deposit remain pending?

An order stays pending until its transfer is matched, verified and credited. Starting a payment or refreshing its status does not confirm it.

An order starts in an awaiting-confirmation state. Its transfer must be matched and verified before account credit is recorded. A payment declaration or status refresh cannot mark it paid. Keep the order reference and public transaction identifier, and do not send another payment merely because the first is pending. The support guide lists the details to retain; confirmation and resolution times are not guaranteed.

What happens if I send the wrong asset or use the wrong network?

Recovery and refunds for wrong-asset or wrong-network transfers are not established; use the exact destination recorded in your funding order.

A recovery policy for wrong-network or wrong-asset transfers has not been established. Do not assume a transfer can be credited, recovered or refunded. Before transferring, verify the asset, network, address and amount against the current deposit instructions before sending. If a transfer problem occurs, provide the order reference and public transaction identifier through support; never share a wallet seed phrase or private key.

How is the crypto amount calculated and when does it expire?

The USD target is converted at a recent market rate. The crypto amount is rounded up to the asset’s smallest unit and fixed for 10 minutes.

Checkout shows the rate source, rate timestamp and payment deadline. USDT and USDC use their actual market rates, not an assumed one-dollar parity. If no recent rate is available, retry the calculation before sending funds. An existing order without a quote can receive one without changing its reference or address.

After expiry, get a new quote only if you have not already sent funds. Keep the original order for a transfer already sent; confirmations may arrive later. An exact payment received within its quote window qualifies for the quoted USD credit after verification. Late transfers or different amounts require review; a pending payment does not unlock AI access. See billing.

Billing and API keys

Understand usage charges, reserved credit and controls on each key.

How is a model request priced?

Costs use separate model rates for actual input and output tokens, settled from provider-confirmed usage after an initial credit reservation.

Shared inference has separate input and output rates for each model. An admitted request reserves enough credit for the counted input and maximum requested output, then settles against authoritative usage at the rates saved with that reservation. Use the pricing table to estimate your workload. Models without published prices cannot accept paid requests. A request rejected before inference dispatch does not create a token charge. See billing.

Why can my available credit be lower than my balance?

Available credit is the ledger balance minus outstanding inference reservations, which remain held until authoritative usage can be settled.

Balance comes from the account ledger; available credit also subtracts outstanding inference reservations. A reservation holds the maximum admitted request cost so concurrent requests cannot spend the same credit. When authoritative usage arrives, the final charge replaces the hold. If a stream breaks or provider usage is missing, that reservation can remain pending reconciliation. A disconnected client does not prove generation stopped. Consult streaming and billing, and report an unresolved hold through support.

What do spending caps and model restrictions protect?

Spending caps cover each key’s lifetime usage and outstanding reservations, while model allowlists restrict its permitted models; caps do not reset monthly.

Each key has a lifetime USD spending cap that includes recorded usage and outstanding reservations. It does not reset monthly. A model allowlist limits the exact model IDs the key may use; an empty list permits all available catalogue models. Use separate keys to distinguish applications and environments in usage records. Key controls do not add account credit or change model availability. See authentication.

What should I do if I lose or expose an API key?

Revoke an exposed key promptly, create a replacement and update your application; existing secrets cannot be displayed again.

The console cannot show an existing secret again. Create a replacement key, store it securely, update the applications that use it, and revoke the old key. If the key was exposed, revoke it promptly and inspect the account’s usage records. Revocation prevents new requests from being admitted with that key; work already admitted can still settle. Never paste an API key into a support message, public repository or browser bundle. Follow the authentication guide.

Can I withdraw unused credit or get an automatic refund?

Wallet withdrawals are currently unavailable. Confirmed credit can pay for service use; cancelling a GPU order before activation returns its payment to your account balance.

Wallet withdrawals are currently unavailable. Use confirmed prepaid credit for eligible model requests or dedicated GPU orders. Cancelling a paid GPU order before activation returns that rental payment to your WeightsAPI account balance; it does not send cryptocurrency to a wallet. No automatic refund or wallet payout is promised. Review billing before adding credit.

Data and privacy

Separate prompt handling from the records needed to operate an account.

Does WeightsAPI store my prompts or model responses?

The gateway does not persist prompts or responses in its application database. Account records remain, and provider retention requires separate verification.

The gateway does not persist prompts, completion text or tool arguments in its application database, and application logs omit request bodies. Authentication, usage and payment records are stored separately. Provider retention and infrastructure logging require independent verification; gateway behavior is not an end-to-end zero-retention guarantee. Read data handling and the trust page for the scope.

What records are kept if prompt content is not logged?

Account identifiers, key hashes, payment records, token counts, charges and reservation metadata are retained for authentication and accounting without storing conversation text.

The account system keeps identifiers, API-key hashes and metadata, deposit and withdrawal records, token counts, charges and usage aggregates. Request reservations also record the model, applicable rates and settlement state so billing can be reconciled. These records support authentication, spending controls and accounting without storing conversation text. “No content logging” therefore does not mean anonymous usage or no retained records. Consult data handling; retention periods and production data-rights procedures still need published, verified terms.

Dedicated GPU orders retain the selected hardware and model, monthly price, payment and cancellation status, and service dates and endpoint details when provisioning is confirmed.

Does the privacy statement also cover the inference provider?

No: the gateway’s content policy does not establish an inference provider’s retention or training practices, which still need verification.

The gateway’s behavior does not establish another provider’s retention or training policy. Serving a request requires sharing its content with the inference provider. Provider logging, subprocessors and contractual terms require separate verification. If your workload has confidentiality or regulatory requirements, review the trust page and confirm the relevant arrangements before sending sensitive content.

Where will requests be processed, and can I choose a region?

Dallas, Ashburn and Portland are planned locations, with no verified fleet availability, customer-selected region or production data-residency commitment.

Dallas, Ashburn and Portland are target GPU locations. Availability, routing and data residency require confirmation for the actual deployment; location names alone do not establish these conditions. Region choice and end-to-end residency commitments must be agreed for the deployment. Review data handling and the trust page before committing a workload with regional requirements.

Is a confirmed top-up required before using AI?

Every AI interaction requires a qualifying confirmed top-up; the minimum is USD 100 per recharge, not a permanent minimum balance.

Yes. Your account must receive one confirmed top-up of at least USD 100 before any AI interaction; there is no public free-trial allowance. Every later recharge also starts at USD 100. After the initial qualifying top-up, remaining credit below USD 100 can still pay for requests until insufficient. Use an active key with the required model permissions and budget. Checkout provides payment instructions and a time-limited crypto quote. Credit requires a matched, verified transaction; creating or refreshing an order does not confirm payment.

Performance and support

Plan capacity carefully and gather useful details when something fails.

What latency or throughput can I expect?

Performance depends on the model, hardware, workload, serving configuration and concurrency. Validate it with your own workload; no latency or throughput guarantee is offered.

Performance depends on the model, hardware, prompt length, generated length, concurrency and serving configuration. On an available deployment, measure time to first token and generation speed separately using a representative workload. Published model characteristics and hardware specifications are not an SLA. Review dedicated capacity for workloads that need reserved resources and service status for availability.

Are requests unlimited if I have enough credit?

Credit does not make usage unlimited: capacity, context, output limits, model permissions and key spending caps still constrain requests.

No. The current design does not impose a default fixed requests-per-minute product limit on paid traffic, but admission still depends on available credit, key caps, allowed models, output limits, context size and backend capacity. Shared serving can queue, and the playground follows the same confirmed-top-up, available-credit and key-budget rules as API requests. A model’s native context window can also exceed the configured service ceiling. Review limits and handle errors with bounded retries; do not treat credit as a capacity guarantee.

Can I order a dedicated GPU endpoint now?

Yes. Choose a GPU, select a model and place a monthly order. Payment is made from confirmed account credit; hardware becomes available after provisioning is confirmed.

Use the dedicated GPU page to choose a configuration and open checkout. If your balance is insufficient, recharge it in crypto and return once credit is confirmed to pay for the order. A top-up does not pay the rental automatically. The prepaid month starts on activation, with no automatic renewal. Before activation, cancellation returns any rental payment to your account balance. Hardware availability and delivery timing require operator confirmation; an order is not an active machine.

How should I interpret the status page and a 503 error?

A 503 means the required service is unavailable. Check service status and the error message before retrying; a connection setting does not establish uptime.

A 503 service_unavailable means the required deployment or auxiliary service cannot accept the request. Check the status page and error guide before using bounded retries. A connection setting alone is not proof of healthy service or measured uptime. Requests rejected before inference dispatch do not create a token charge.

What information should I include when asking for help?

Include the operation, time and timezone, model, error code and relevant references; remove API keys, wallet secrets and unnecessary prompt content.

Use the support page to prepare the affected operation, approximate time and timezone, model ID, error code and expected result. For billing or deposits, add the request or order reference and public transaction identifier where applicable. Remove API keys, wallet secrets and unnecessary prompt content. Copying a report does not submit it. Official support contacts, service hours and response targets are not published.

Need a next step?

Find the relevant guide or prepare the details of your issue.

Open support