What is your organisation actually using AI for?
Bedrock already logged the answer.

Semantr reads the Bedrock invocation logs you already have, groups the invocations back into conversations, and works out what kinds of work your organisation is actually doing with AI.

Get set up
curl -LsSf https://semantr.com/install.sh | sh

Then run semantr. It finds your invocation logs on AWS, prices the run, and analyses them.

$ semantr
semantr: looking for your invocation logs
  found invocation logs at s3://acme-bedrock-logs/AWSLogs/ (ap-southeast-2)

Semantr will read those logs, rebuild the conversations, and name the
kinds of work it finds.
Continue? [Y/n] y

  sessionise   2,761 invocations → 1,007 conversations
  discover     221 distinct prompts → 21 named use cases
  aggregate    $2,145.30 total spend analysed

  report  semantr-report.html

Sign in once, with Google, so we can fund the model that names what it finds. Your account also keeps history, trends and shareable links.

Completions and raw logs never leave Under $1 to run, for a million invocations Apache 2.0

See what your usage actually means.

Every discovered use case, named from its own contents, with its own spend, conversations and cost improvements attached.

Example report output:

$2,145.30total spend
21use cases
1,007conversations
$2.13per conversation
Use caseTagsConvSpend
Customer Support Responsesnon-coding repeatable206$1,204.60
Invoice Data Extractionnon-coding repeatable238$58.30
Pull Request Reviewcoding repeatable131$14.90
Churn Analysis Queriescoding experimental44$616.40
Database Script Developmentcoding experimental34$18.20

See what's production and what's people experimenting

Every use case is tagged coding vs non-coding, and repeatable vs experimental. That shows you, at a glance, how much of your spend is automation running in production and how much is people still trying things out.

Recommendations and improvements

Model right-sizing, prompt caching, retry loops, untagged spend: each with the annual saving worked out, so it is a decision rather than a suggestion.

Everyone can tell you what AI costs. Nobody can tell you what it bought.

Cost dashboards report spend by team, key and model. That's accounting, not what the money bought.

The CFO asks what it's for

"$40k on Bedrock last quarter" is a number, not an answer. Spend by API key does not tell anyone whether the money bought customer support or someone's side project.

Get the full picture

Every team knows what they built. No one knows what the other eleven teams built, and the list nobody maintains is always out of date.

The obvious approach is unaffordable

Classifying every invocation with an LLM costs tens of thousands of dollars at real volume. Which is why nobody does it, and why nobody knows.

Sessionise, discover, aggregate.

Three steps, from raw logs to named use cases.

  1. Sessionise

    Bedrock logs are stateless: twenty records for one conversation. Each invocation names the one before it, so rebuilding them is exact, not guessed.

    2,761 invocations → 1,007 conversations
  2. Discover

    Similar conversations are grouped and named from their own contents. No fixed taxonomy, so no other bucket: the categories come from what you're actually doing.

    1,007 conversations → 221 distinct prompts → 21 named use cases
  3. Aggregate

    Spend and cost improvements roll up against each use case, per conversation, not per request.

    $2,145.30 across 21 use cases · analysis cost $0.03

Security & privacy

Completions and raw logs never leave your machine.

Every design decision below follows from one rule: what you analyse never has to leave the machine it runs on.

Only snippets leave, never completions

Naming is the only step that calls a model, and it only ever sees prompt snippets, capped at 600 characters. Point --classifier-model at your own provider and that path is never touched.

Aggregates are kept, prompt text isn't

Every run keeps its aggregates: counts, cost, and the names it discovered. Prompt text is stripped before anything is sent.

Runs entirely inside your own AWS account

The CLI, the pipeline and the report are Apache 2.0. Run the whole thing yourself and nothing has to leave your account.

Free, and open source.

Open source

$0
  • The full analysis pipeline
  • The complete HTML report
  • Share a report with a public link
  • No account needed to run it
  • Apache 2.0
Read the source
Coming soon

Hosted

$245 /year
  • History across every run
  • Trends: what changed since last month
  • Shareable links you can revoke