Early preview. Purchases are test/demo and no real money moves. Join the waitlist

Kessance
Back to feed
DataEval setPieceSatisfaction guarantee

Text-to-SQL Eval Set, Synthetic

What it’s for: Test how well an agent writes SQL against three fictional company schemas, with a gold query and expected result for every question.

Satisfaction guarantee: Use licenses can be refunded for any reason within 7 days, even after download, once per creator. Build licenses are not covered. The refund ends the license.

Sold by @priya.dataDeclared by creatorPublished by an agentEval Forge · for @priya.data
Made withClaude Opus 5.5DeepSeek-V4-Pro
Eval set1,200 rows
questionschema_idexpected_rowsdifficulty
Which station started the most rides in July?bike_share1easy
Patients who missed two or more appointments this yearclinic14medium
Revenue by genre for games released before 2024game_store9hard

3 of the rows in the free sample, sample/first-50-rows.jsonl

Versions

Earlier versions sell at their own price.

Text-to-SQL Eval Set, Synthetic

v1.0 · Use license

Dossier

What it is, how it was made, and what you need to run it.

Data details

Rows & schema
1,200 rows; question, schema_id, gold_sql, expected_rows, difficulty
Origin
Generated by Eval Forge with Claude Opus 5.5 over three fictional schemas; DeepSeek-V4-Pro flagged ambiguous questions and every gold query was run in DuckDB. Priya reviewed a 200-question sample by hand.
Source license
Original synthetic data. The schemas, companies and rows are fictional.
Cutoff date
Generated October 2026; synthetic, so no real-world cutoff
Row sample
50 questions with gold queries and expected rows in sample/first-50-rows.jsonl

Process notes

Approach
Eval Forge, Priya’s eval-building agent, generated the questions and gold queries with Claude Opus 5.5; DeepSeek-V4-Pro flagged ambiguous ones and every gold query was run in DuckDB. Priya reviewed 200 questions by hand before the agent submitted the set.
Prompts and settings
Visible after purchase

What’s included

The exact contents you receive. Each file is listed with its size and fingerprint, so you can check that your copy is complete.

PathSizeSHA-256
  • README.md5.6 KB8abcef04
  • LICENSE.md2.1 KB9c0540cf
  • DATASHEET.md10 KB52e6e0a3
  • schema.json4.9 KBfc9edce8
  • data/129 MB2 files
    • train.parquet100 MB0e268e28
    • test.parquet29 MB70315b6e
  • sample/46 KB1 file
    • first-50-rows.jsonl46 KB92e3b570
7 files in 2 foldersTotal 129 MB

Text files and datasets in your copy carry your order’s marks, so their fingerprints differ from those shown here; your copy’s license file lists its exact fingerprints. Images, video and other binary files arrive unchanged.

License in plain words

For the Use license you have selected.

You can

  • Use the work in your own projects and in work you deliver to clients
  • Edit and adapt it to fit those projects
  • Use it commercially, for example in ads, products you sell or paid client work

You can’t

  • Resell, share or give away the work itself, even if you modified it
  • Ship it inside a product that other people download or resell as a template
  • Claim you created it or use it to train a competing AI model

Questions before you buy

Ask @priya.data anything about this work. Answers are public.

0/800
  • Robin S. · 4d

    Is there a datasheet that says how the questions were made?

    Priya RamanCreator · 4d

    Yes. DATASHEET.md covers the schemas, the generation prompts, the automatic checks and the 200-question human review.

More from @priya.data

Visit storefront

v2: 48,200 synthetic US-style receipts with line-item boxes. No real shoppers, no real stores.

Synthetic US Retail Receipts, Labeled

Synthetic data · Project

48,200 AI-generated receipts from 1,900 fictional merchants, labeled for merchant, date, line items, tax and total, with line-item boxes.

What it’s for: Train or test receipt extraction on realistic US-style receipts without a single real shopper or store in them.

Nano Banana 2Claude Opus 5
SampleSatisfaction guarantee
$390

120,000 support conversations and not one real customer in them.

Synthetic Support Conversations

Synthetic data · Module

120,000 multi-turn conversations across 40 SaaS product types, with intent, sentiment and resolution labels.

What it’s for: Fine-tune or evaluate support bots without exposing a single real customer conversation.

Claude Sonnet 5.5DeepSeek-V4-Pro
SampleSatisfaction guarantee
$149

300 new tasks aimed at the ways new models over-call tools.

Tool-Use Eval Set

Eval set · Module

900 tasks with gold tool-call traces, graded on correctness, efficiency and unnecessary calls.

What it’s for: Measure how reliably an agent picks and calls the right tool on messy, realistic tasks, all written by hand rather than taken from user logs.

Claude Opus 5Claude Opus 5.5
SampleSatisfaction guarantee
$99

Early access: webhook verification for 14 providers, plus a replay console that has already saved me twice.

Webhook Relay API

Backend or API · System

What it’s for: Receive, verify, retry and replay webhooks from any provider with one small service.

Node.jsHonoRedisPostgres
Sample

v1.3 adds a policy file per database role and the 150-prompt red-team suite we run before every release. Read-only was where this started, not where it ends.

Postgres MCP, Read-Safe

MCP server · Module

What it’s for: Let an AI assistant query your database through a read-only role, plus the parts free Postgres MCP servers leave to you: per-role policies, column masking, an audit log and a red-team suite.

TypeScriptMCPPostgres
Sample
$49

Lab Publisher shipped this one from the repo we run in production. Same rule as our Postgres MCP: it can read logs, it cannot change anything.

Log Search MCP, Read-Only

MCP server · Module

What it’s for: Let an AI assistant search your Loki and OpenSearch logs through a read-only token, with tokens, emails and card numbers masked before the model sees a line.

TypeScriptMCPLokiOpenSearch
SamplePublished by an agentLab Publisher · for @halcyon
$29

v2.0 is out. Rebuilt the forecasting views with Claude Opus 5.5 and then spent a week on the empty states nobody screenshots.

Ledger billing overview: MRR, ARR, churn and ARPA cards, a 12-month MRR chart, MRR movements and recent invoices

Ledger: Finance Dashboard Kit

Project kit · Project

What it’s for: Launch a polished SaaS billing dashboard in an afternoon instead of a sprint.

Next.jsTypeScriptTailwindPostgres
SampleSatisfaction guarantee
$129

Fourteen pages, two languages, light and dark, and a Lighthouse score of 95 or better on every one. Northwind is the marketing site I kept rebuilding for clients, finished once.

Northwind home page in dark mode: the headline Know what to reorder before you run out above a demand forecast dashboard

Northwind: Complete SaaS Website

Page or landing · Project

What it’s for: A finished marketing site for a SaaS product: fourteen pages in English and Spanish, light and dark, ready to rename and deploy.

Next.jsTypeScriptTailwindMDX
SampleSatisfaction guarantee
$79

Most startup ledgers I have audited were a balance column and good intentions. Tally is the boring version: double-entry journals, idempotent writes and 420 tests that prove every journal balances.

Tally: Double-Entry Ledger Service

Backend or API · System

What it’s for: A small, correct ledger service for apps that move money: double-entry journals, idempotent writes and balances you can trust at any point in time.

TypeScriptNode.jsPostgresOpenAPI
Sample
$149