Laminar

LLM engineering
from first principles

Laminar is an open-source platform for engineering LLM products. Trace, evaluate, annotate, and analyze LLM data. Bring LLM applications to production with confidence.

Backed by

Made by the team from

Everything you need to understand
and optimize your LLM application

Full Tracing

Track and understand every step of execution in your LLM app by simply adding a few lines of code.

Start tracing

Semantic events

Have a clear understanding of how your LLM app is being used by tracking semantic events. Define events, such as user sentiment, in plain English. We will catch them in the background and turn them into metrics.

Learn about events

USER_SENTIMENT

CORRECT_TOOL_USED

COMPREHENSION_SCORE

Evaluations

Run custom evaluations at scale. Build custom evaluation pipelines, including LLM evaluations, and run them on custom datasets.

Discover evaluations

Powered by Rust 🦀

Rust allowed us to deliver unparalleled performance and reliability. Laminar can sustain high-throughput and effortlessly scale to processing of millions of tokens per second.

Prompt chain management

Laminar lets you go beyond a single prompt. You can build and host complex chains, including mixtures of agents or self-relfecting LLM pipelines.

Learn about chains