Langbase

Rate Limits

Rate limits are the number of requests that a client can make to the Langbase API within a specific time period. These limits are enforced to ensure fair usage of the API and to prevent abuse.

Overview

We have implemented the following rate limits on the Langbase API. The limits vary by your subscription plan.

PlanRate Limit
Hobby1 request per second (RPS)
Pro300 requests per minute (RPM)
Enterprise300 requests per minute (RPM) – please contact us for higher rate limits
Enterprise Rate Limits

Custom enterprise packages can go upto 1K requests per second. Please contact us for higher limits.

Pipe API v1

Following is the list of Pipe API (v1) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Run: /v1/pipes/run1 RPS300 RPMContact Us
Create pipe: /v1/pipes1 RPS300 RPMContact Us
List pipes: /v1/pipes1 RPS300 RPMContact Us
Update pipe: /v1/pipes/{pipeName}1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Pipe API beta

Following is the list of Pipe API (beta) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Run: /beta/run1 RPS300 RPMContact Us
Generate: /beta/generate1 RPS300 RPMContact Us
Chat: /beta/chat1 RPS300 RPMContact Us
Create pipe (user): /beta/user/pipes1 RPS300 RPMContact Us
Create pipe (org): /beta/org/{org}/pipes1 RPS300 RPMContact Us
Update pipe: /beta/pipes/{owner}/{pipe}1 RPS300 RPMContact Us
List pipes (user): /beta/user/pipes1 RPS300 RPMContact Us
List pipes (org): /beta/org/{org}/pipes1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Memory API v1

Following is the list of Memory API (v1) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Create memory: /v1/memory1 RPS300 RPMContact Us
List memory: /v1/memory1 RPS300 RPMContact Us
Delete memory: /v1/memory/{memoryName}1 RPS300 RPMContact Us
Retrieve memory: /v1/memory/retrieve1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Memory API beta

Following is the list of Memory API (beta) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Create memory (user): /beta/user/memorysets1 RPS300 RPMContact Us
Create memory (org): /beta/org/{org}/memorysets1 RPS300 RPMContact Us
List memory (user): /beta/user/memorysets1 RPS300 RPMContact Us
List memory (org): /beta/org/{org}/memorysets1 RPS300 RPMContact Us
Delete memory: /beta/memorysets/{ownerLogin}/{memoryName}1 RPS300 RPMContact Us
Retrieve memory: /beta/memory/retrieve1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Document API v1

Following is the list of Document API (v1) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Upload document: /v1/memory/documents1 RPS300 RPMContact Us
List documents: /v1/memory/{memoryName}/documents1 RPS300 RPMContact Us
Delete document: /v1/memory/{memoryName}/documents/{documentName}1 RPS300 RPMContact Us
Retry embeddings: /v1/memory/{memoryName}/documents/{documentName}/embeddings/retry1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Document API beta

Following is the list of Document API (beta) endpoints and their rate limits based on your subscription plan.

API EndpointsHobby PlanPro PlanEnterprise Plan
Upload document (user): /beta/user/memorysets/documents1 RPS300 RPMContact Us
Upload document (org): /beta/org/{org}/memorysets/documents1 RPS300 RPMContact Us
List documents: /beta/memorysets/{owner}/{memoryName}/documents1 RPS300 RPMContact Us
Retry embeddings: /beta/memorysets/{owner}/documents/embeddings/retry1 RPS300 RPMContact Us

RPS = requests per second
RPM = requests per minute

Unauthenticated Requests

If your request does not have a valid API key, it is considered an unauthenticated request. Limits for them are:

  • Limit: 10 requests per minute
  • Reset Interval: 60 seconds
Warning

Langbase is in the public beta stage right now. These limits and pricing are subject to change without notice. Please bear with us as we improve and get ready for a stable release and massive scale. Already processing tens of billions of AI tokens every month, you're in good hands. Feedback welcomed.

Rate Limit Headers

When you make a request to the Langbase API, it returns the following response headers. These headers convey you the rate limit status.

HeaderDescription
lb-ratelimit-limitThe rate limit applicable to your request.
lb-ratelimit-remainingThe number of requests remaining in the current rate limit window.
lb-ratelimit-resetThe time at which the current rate limit window resets.

About Rate Limits

  • If you exceed the rate limit, you will receive an HTTP status code 429 Too Many Requests error.

  • Rate limits are applied on a per-user or per-organization basis. For organizations, all requests made by the organization are collectively restricted within a single limit window.

  • These limits are subject to adjustment and may differ depending on your subscription plan.

  • If you need higher rate limits, please contact us.