Drive Vector Desk from your own code
The page reads one pasted vector index in the browser for free — one or more files joined into one
paste, each introduced by a # file: <path> line: pgvector SQL (the table, its
CREATE INDEX, the query and its SET statements), a Qdrant collection and search body,
FAISS or hnswlib code, workload.yaml with the vector count and the budgets, and a parameter sweep
CSV — with its line numbers. It reads every index (engine, type, metric, dimensions, build parameters,
quantization), every query (its k or LIMIT, ef, probes, filter and the index it can
use), the pgvector settings, the workload and the sweep; estimates the memory the index needs; matches the
configured setting to a sweep row and picks the cheapest row inside every budget. Then it runs
23 deterministic checks drawn from vector index tuning practice (catalogue ids VX-01..VX-23, plus VX-24 for context):
whether the engine accepts the configuration and it matches the embeddings (options, dimensions, metric,
credentials), whether every query uses its index and gets the rows it asks for (operators, ef_search
against the LIMIT, probes, filters, rescoring, exact search), whether the index fits its memory, and
whether the evidence supports the chosen setting (the sweep against the budgets). Nothing is built, loaded or
queried: every flag is a reading of the text. Its two paid steps are available over HTTP. You send one JSON
object with task set to "audit" or "fix", the paste as code
and the page’s check as a facts string, and the model replies with one JSON object: an audit
that rates the index configuration, the search settings, the memory and the evidence, names the operating
point, answers every flag and gives exact before/after edits per finding, or the whole fixed file(s) with a
list of every change tied to the page’s flags.
Base URL: https://api.skillsafe.ai/v1/app-api. Every call sends
Content-Type: application/json and, once you have a token,
Authorization: Bearer <token>. The paths below (/guest,
/me, /estimate, /run, /jobs/{job_id},
/run-stream) are relative to it, exactly as sdk.js calls them. A
plain-text summary of the app for agents is at /llms.txt. Both lanes run on
the gpt-terra model with a 10% publisher markup. A run needs a signed-in (user) token and
is metered: the platform places a hold on your credits when the run starts and then
charges only what the run used. /estimate is free.
The task field: two lanes
task is the first field of every body. It routes the run, and it takes exactly two values:
"audit" and "fix". Each lane has its own reply contract, and a reply never
mixes them. The skill’s instructions tell the model to do the audit lane when task is
missing or anything else (and the page’s own Vectorkit.buildInput turns any lane that is
not "fix" into "audit"), so a typo silently gets you an audit: always send one
of the two values.
task | What it does | verdict | Use it when |
|---|---|---|---|
"audit" | Reviews the index the way a search engineer reviews it before it serves traffic: says which engine and index type, how many vectors of what dimension under which metric, and the budgets it must meet (index), rates the four areas (config, search, memory, evidence) as sound, fragile or broken, names the operating_point (a sweep row inside every budget, quoted exactly, or row: null), confirms or dismisses every page flag, adds what text rules cannot see, and gives the verbatim evidence and exact before/after edits for each finding, listed in the order to apply them — what the engine refuses and what leaks first, then what makes results wrong or short, then what costs recall, latency or memory, then hygiene — with a plan that says which steps rebuild the index and ends in a recall sweep on real queries. | blocked | needs_work | ready | Before an index serves traffic, or when recall, latency or memory is off: does the engine accept it, does every query use it, and what should change first. |
"fix" | Writes the fixed configuration: the whole of every pasted file it changes (never a new file, never the workload or the sweep), with every table, column, index and collection kept — plus a changes list tied to the page flags (each naming what it changes: an index, a query, a setting, the search params), the verify steps (the engine accepts it, EXPLAIN (ANALYZE) for pgvector, the rebuild, a recall sweep), and what it left open for a fact, a measurement or a decision only the engineer has. | fixed | partial | When you want the files changed, not a list of findings: an index you already know is broken, or what is left after an audit. |
The model never invents a measurement. A recall, a latency or a memory size comes from the workload, the
sweep, the page’s estimate or the note; a parameter it chooses without a sweep (an ef_search,
lists, nprobe) follows the engine’s documented guidance and is called a starting
point to measure. It never copies a credential it finds in the paste, and it never edits the workload or the
sweep — they are the measurements the configuration is judged against.
The page chains the two: after an audit, “Apply every edit and fix the rest” puts
every audit edit into the paste, switches to the fix lane on that edited paste and adds an
audit_handoff string (below) with the audit’s verdict, headline and findings. Over
the API that is a second run with task: "fix", the edited paste as code,
facts recomputed from the edited paste, and that string. The page drops the handoff as
soon as the paste is edited again.
Guards the page applies before a run and the API does not: it refuses to price or run a paste it cannot
read (“Nothing was pasted.”, “No vector index file was found. ...”, or “No vector
index or vector query was found: no pgvector CREATE INDEX or ORDER BY distance, no Qdrant collection or search
body, and no FAISS or hnswlib index.”), and it warns before a run on a paste with no index definition, no
workload.yaml or no query.
One worked example per lane follows, both examples the page ships (the example buttons on the
app page; the full pastes are in /example.js, ids
lumen and meridian), built exactly as the page builds them:
Vectorkit.buildInput(lane, Vectorkit.analyze(text), note, null), with the saved model reply for
each. The other two examples are audits that reach the other verdicts: tessellate
(needs_work, 3 flags (3 medium)) and quarry (ready, no flag); the
lumen audit also carries a saved fix run of its edited files (fixed). The request bodies cut the
long code and facts strings with a visible ...; the replies are shown
whole, pretty-printed, exactly as saved. The companies, tables, collections, passwords and numbers are invented.
Worked example, task: "audit": a pgvector HNSW index built with vector_l2_ops that a cosine query cannot use, with ef_construction below 2 * m, ef_search below the LIMIT, a tenant filter without iterative scan and a role password in the schema
3 files: db/schema.sql, db/search.sql, workload.yaml. The page’s free check raises 7 flags (4 high, 1 medium, 2 low) (plus the VX-24 context flag);
its own reading of the verdict is blocked. Running build-check.js on it
(below) prints 3 file(s), 1 index(es), 1 query, about 25.2 GiB resident; 7 flags (4 high, 1 medium, 2 low); verdict_candidate blocked. The engineer’s note:
“We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?”
The request body (POST /run or /run-stream), idempotency key vector-desk:audit:613c0bcd-1ad6:a1:
{
"task": "audit",
"code": "# file: db/schema.sql\nCREATE EXTENSION IF NOT EXISTS vector;\n\nCREATE TABLE doc_chunks (\n id bigserial PRIMARY KEY,\n tenant_id bigint NOT NULL,\n doc_id bigint NOT NULL,\n body text NOT NULL,\n embedding vector(1536) NOT NULL\n);\n\nCREATE INDEX doc_chunks_tenan...",
"facts": "{\"files\":[{\"path\":\"db/schema.sql\",\"kind\":\"sql\",\"line\":2,\"end_line\":19},{\"path\":\"db/search.sql\",\"kind\":\"sql\",\"line\":21,\"end_line\":28},{\"path\":\"workload.yaml\",\"kind\":\"workload\",\"line\":30,\"end_line\":40}],\"indexes\":[{\"engine...",
"note": "We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?"
}
The saved reply (output.output), verdict blocked, 6 findings, 4 edits:
{
"task": "audit",
"verdict": "blocked",
"headline": "CREATE INDEX fails outright, the query's cosine operator couldn't use even a fixed index, and a database password is committed to schema.sql.",
"index": "pgvector HNSW index doc_chunks_embedding_idx (m=24, ef_construction=40, vector_l2_ops) over 4.2M 1536-dimension text-embedding-3-small vectors that the workload compares by cosine. It must serve a tenant-filtered top-50 query at >=0.95 recall and p99 <=60 ms inside a 64 GiB memory budget.",
"areas": [
{
"area": "config",
"status": "broken",
"note": "ef_construction (40) is below 2x m (48) so CREATE INDEX fails, and a role password is committed in schema.sql."
},
{
"area": "search",
"status": "broken",
"note": "The cosine ORDER BY can't use the l2-opclass index, ef_search (32) is below the query's LIMIT (50), and the tenant filter has no iterative scan to protect that LIMIT."
},
{
"area": "memory",
"status": "sound",
"note": "The ~25.2 GiB estimate fits well inside the 64 GiB budget, though full-precision vectors leave quantization savings unclaimed."
},
{
"area": "evidence",
"status": "sound",
"note": "No sweep was pasted, so the operating point below is unmeasured; a recall/latency sweep at k=50 is needed to confirm it."
}
],
"operating_point": {
"row": null,
"m": 24,
"ef_construction": 64,
"ef_search": 50,
"nprobe": null,
"recall": null,
"p99_ms": null,
"memory_gib": null,
"why": "No sweep was pasted: ef_construction=64 only clears pgvector's 2x m minimum for m=24, and ef_search=50 is the documented floor (the query's LIMIT), not a measured recall - run a sweep at k=50 against exact ground truth once the index is rebuilt to confirm recall, p99 and memory against the 0.95/60ms/64GiB budgets."
},
"findings": [
{
"id": "VX-01",
"flags": [
"F1"
],
"file": "db/schema.sql",
"line": 16,
"severity": "high",
"area": "config",
"title": "ef_construction below 2x m: CREATE INDEX fails",
"evidence": "USING hnsw (embedding vector_l2_ops)\nWITH (m = 24, ef_construction = 40);",
"why": "pgvector refuses ef_construction below 2 * m; with m=24 the minimum is 48, but this index sets ef_construction=40, so CREATE INDEX doc_chunks_embedding_idx errors out, no index exists, and every query on embedding is a sequential scan of all 4.2M rows - matching the sequential scan and ~900 ms p99 the note reports.",
"edits": [
{
"before": " WITH (m = 24, ef_construction = 40);",
"after": " WITH (m = 24, ef_construction = 64);"
}
]
},
{
"id": "VX-07",
"flags": [
"F2"
],
"file": "db/schema.sql",
"line": 19,
"severity": "high",
"area": "config",
"title": "Role password committed to schema.sql",
"evidence": "GRANT SELECT ON doc_chunks TO search_reader;",
"why": "The CREATE ROLE statement above this line writes search_reader's password as a literal in source, so anyone who can read schema.sql can read and reuse it. Rotate it now and set the new password out of band (psql's \\password search_reader or a secret manager at deploy time), not in the file.",
"edits": []
},
{
"id": "VX-09",
"flags": [
"F4",
"F6"
],
"file": "db/schema.sql",
"line": 15,
"severity": "high",
"area": "search",
"title": "Index opclass (l2) doesn't match the query's cosine operator or the workload's metric",
"evidence": "CREATE INDEX doc_chunks_embedding_idx ON doc_chunks\nUSING hnsw (embedding vector_l2_ops)",
"why": "db/search.sql:27 orders by embedding <=> $1 (cosine) and the workload's embeddings are compared by cosine, but this index's opclass is vector_l2_ops (<->), so Postgres cannot use it for that ORDER BY - it seq-scans every row, matching the sequential scan and ~900 ms p99 the note reports. Rebuilding with vector_cosine_ops also removes the l2-vs-cosine score-scale mismatch (the vectors are unit length per the note, so rankings already agreed, but scores read on the wrong scale).",
"edits": [
{
"before": " USING hnsw (embedding vector_l2_ops)",
"after": " USING hnsw (embedding vector_cosine_ops)"
}
]
},
{
"id": "VX-08",
"flags": [
"F3"
],
"file": "db/search.sql",
"line": 22,
"severity": "high",
"area": "search",
"title": "hnsw.ef_search (32) below the query's LIMIT (50)",
"evidence": "SET LOCAL hnsw.ef_search = 32;",
"why": "HNSW returns at most hnsw.ef_search rows, so this query can get at most 32 of the 50 it asks for even once the index builds and can be used - fewer still once the tenant filter runs. Raise it to at least the LIMIT (50); with no sweep pasted, treat 50 as a floor to measure from, not a value proven to hit the 0.95 recall target.",
"edits": [
{
"before": "SET LOCAL hnsw.ef_search = 32;",
"after": "SET LOCAL hnsw.ef_search = 50;"
}
]
},
{
"id": "VX-12",
"flags": [
"F5"
],
"file": "db/search.sql",
"line": 24,
"severity": "medium",
"area": "search",
"title": "Tenant filter drops rows without an iterative scan",
"evidence": "SELECT id, doc_id, body, embedding <=> $1 AS distance\nFROM doc_chunks\nWHERE tenant_id = $2",
"why": "WHERE tenant_id = $2 runs after the HNSW scan returns its ef_search candidates (32 today); at 4% selectivity only about 1.3 of those 32 pass, so the query returns far fewer rows than its LIMIT of 50, and the same proportional shortfall remains even once ef_search is raised. pgvector 0.8.0, confirmed in the note, adds SET LOCAL hnsw.iterative_scan = relaxed_order to keep scanning until enough rows pass the filter.",
"edits": [
{
"before": "\nSELECT id, doc_id, body, embedding <=> $1 AS distance",
"after": "\nSET LOCAL hnsw.iterative_scan = relaxed_order;\n\nSELECT id, doc_id, body, embedding <=> $1 AS distance"
}
]
},
{
"id": "VX-16",
"flags": [
"F7"
],
"file": "db/schema.sql",
"line": 14,
"severity": "low",
"area": "memory",
"title": "Full-precision vectors at a scale where quantization pays",
"evidence": "CREATE INDEX doc_chunks_embedding_idx ON doc_chunks\nUSING hnsw (embedding vector_l2_ops)\nWITH (m = 24, ef_construction = 40);",
"why": "At 4.2M x 1536 dims the full-precision index needs about 25.2 GiB resident (facts.estimate) - inside the 64 GiB budget today - but int8 scalar quantization (or a halfvec expression index, or binary_quantize with rescoring) would cut that several-fold at a small, recoverable recall cost as the table grows. Left as a decision for the team; no sweep exists yet to size a quantized variant against the budgets.",
"edits": []
}
],
"flag_answers": [
{
"flag": "F1",
"status": "confirmed",
"reason": "ef_construction=40 < 2 * m (48); raised to 64."
},
{
"flag": "F2",
"status": "confirmed",
"reason": "Password literal in schema.sql; must be rotated and set out of band, not edited in place."
},
{
"flag": "F3",
"status": "confirmed",
"reason": "ef_search=32 < LIMIT 50; raised to 50."
},
{
"flag": "F4",
"status": "confirmed",
"reason": "Query orders by <=> (cosine) against a vector_l2_ops index; opclass switched to vector_cosine_ops."
},
{
"flag": "F5",
"status": "confirmed",
"reason": "Filtered query has no iterative scan; added SET LOCAL hnsw.iterative_scan = relaxed_order."
},
{
"flag": "F6",
"status": "confirmed",
"reason": "Index ranked by l2 while the workload's metric is cosine; resolved by the same opclass change as F4."
},
{
"flag": "F7",
"status": "confirmed",
"reason": "4.2M full-precision vectors (~25.2 GiB) fit the 64 GiB budget today; quantization would help further but is left open."
}
],
"plan": [
"Rebuild doc_chunks_embedding_idx with CREATE INDEX CONCURRENTLY using ef_construction=64 (>= 2 * m) and opclass vector_cosine_ops, then drop the old index - this fixes the build failure and lets the query's cosine ORDER BY use the index.",
"Rotate the search_reader credential now; recreate the role without a literal password (CREATE ROLE search_reader LOGIN;) and set the new password out of band (psql's \\password or a secret manager).",
"Raise SET LOCAL hnsw.ef_search to at least 50 (the query's LIMIT) - query-time only, no rebuild.",
"Add SET LOCAL hnsw.iterative_scan = relaxed_order for the tenant-filtered query (pgvector 0.8.0) - query-time only.",
"Re-run a recall sweep of a few hundred real queries against exact ground truth at k=50, and EXPLAIN (ANALYZE) the query to confirm it scans doc_chunks_embedding_idx and returns the full 50-row LIMIT.",
"Once measured, evaluate int8 scalar quantization to cut the ~25.2 GiB resident footprint further."
],
"questions": [
"Can search_reader's password be rotated tonight alongside the index rebuild, and will the new one live in an env var or secret manager?",
"What sustained QPS should the rebuilt index and ef_search/iterative_scan settings be sized against?"
],
"summary": "Fix the index definition first: rebuild doc_chunks_embedding_idx with ef_construction=64 and opclass vector_cosine_ops in one CREATE INDEX CONCURRENTLY, since right now it doesn't build at all and, even built as configured, the query's cosine ORDER BY couldn't use an l2 index - that's the sequential scan and ~900 ms p99 you're seeing. Rotate the search_reader password out of schema.sql at the same time; it's a live credential in source. Then raise hnsw.ef_search to at least 50 and add hnsw.iterative_scan = relaxed_order (available in your 0.8.0) so the tenant filter doesn't starve the LIMIT. No sweep was pasted, so re-measure recall, p99 and memory at k=50 after the rebuild before locking ef_search or considering quantization."
}
The credential finding carries no edit: it cannot be fixed without quoting the value, so the fix lane rewrites the line. The page applies the other edits in order and re-checks: 4 edit(s) applied, 0 did not; with every edit in place the free check raises 1 high, 0 medium and 1 low flag(s).
Worked example, task: "fix": a FAISS IVF65536,PQ60 index over 768-dimension vectors whose PQ split does not divide the dimension, whose lists outnumber what 2M vectors can train, and whose nprobe is never set
2 files: search/ivfpq_index.py, workload.yaml. The free check raises 3 flags (1 high, 2 medium); build-check.js prints
2 file(s), 1 index(es), 1 query, about 0.3 GiB resident; 3 flags (1 high, 2 medium, 0 low); verdict_candidate blocked. The engineer’s note: “build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.”
The request body, idempotency key vector-desk:fix:dc724a33-ed3:a1:
{
"task": "fix",
"code": "# file: search/ivfpq_index.py\nimport faiss\nimport numpy as np\n\nDIM = 768\n\n\ndef build(train: np.ndarray, vectors: np.ndarray) -> faiss.Index:\n index = faiss.index_factory(DIM, \"IVF65536,PQ60\")\n index.train(train)\n index.add(vectors)\n return index\n\n\n...",
"facts": "{\"files\":[{\"path\":\"search/ivfpq_index.py\",\"kind\":\"python\",\"line\":2,\"end_line\":16},{\"path\":\"workload.yaml\",\"kind\":\"workload\",\"line\":18,\"end_line\":25}],\"indexes\":[{\"engine\":\"faiss\",\"type\":\"ivf\",\"file\":\"search/ivfpq_index.p...",
"note": "build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week."
}
The saved reply, verdict partial, 1 file(s), 1 change(s), 1 open item(s):
{
"task": "fix",
"verdict": "partial",
"headline": "Fixed the FAISS factory string's PQ divisor and list count; left nprobe for your benchmark.",
"files": [
{
"path": "search/ivfpq_index.py",
"content": "import faiss\nimport numpy as np\n\nDIM = 768\n\n\ndef build(train: np.ndarray, vectors: np.ndarray) -> faiss.Index:\n index = faiss.index_factory(DIM, \"IVF4096,PQ64\")\n index.train(train)\n index.add(vectors)\n return index\n\n\ndef search(index: faiss.Index, queries: np.ndarray):\n return index.search(queries, 20)\n"
}
],
"changes": [
{
"file": "search/ivfpq_index.py",
"object": "index `index`",
"flags": [
"F1",
"F2"
],
"change": "Changed the factory string from \"IVF65536,PQ60\" to \"IVF4096,PQ64\": 64 sub-quantizers divide the 768-dimensional vectors evenly, and 4,096 lists fit the 200,000-vector training sample (about 49 vectors per centroid, above FAISS's 39-vector floor) and give about 488 vectors per list at 2M vectors, instead of 65,536 lists (31 vectors per list, only about 3 training vectors per centroid).",
"why": "Stops faiss.index_factory raising its PQ-divisibility assertion (VX-06) and stops each inverted list being trained and searched on too few vectors, which was starving recall (VX-04)."
}
],
"verify": [
"Run build() with the 200,000-vector training sample and confirm faiss.index_factory(768, \"IVF4096,PQ64\") no longer raises the PQ assertion and train() completes without a 'few points' k-means warning.",
"After add(), check index.ntotal == len(vectors) and that each of the 4,096 lists holds roughly vectors/4096 (~488) entries.",
"Once nprobe is set from next week's benchmark, sweep a few hundred real queries against exact ground truth at k=20 and confirm recall reaches target_recall 0.9 with p99 under 30 ms and memory under 4 GiB."
],
"open": [
{
"item": "nprobe is left unset (FAISS default of 1), so the rebuilt index still searches only one of the 4,096 lists per query",
"flags": [
"F3"
],
"reason": "You asked to leave nprobe for your team to set from the recall benchmark you're running next week; the right value needs that measurement, not a guess."
}
],
"questions": [],
"summary": "build() was crashing because PQ60 does not divide 768 dimensions and because 65,536 IVF lists left far too few vectors per list and per training centroid for your 200,000-vector sample; switching the factory string to \"IVF4096,PQ64\" fixes both. nprobe stays at its default as you asked, since you'll tune it from next week's benchmark - it's listed under open. workload.yaml was not touched."
}
The fixes use only what the note gives (the training sample size); what the note asks to leave
(nprobe, until the benchmark) stays open, so the verdict is partial.
The response envelope
Responses are JSON of the form {"ok": ..., "data": ..., "error": {...}}. The page’s
SDK (sdk.js) decides success from the HTTP status, not from ok: on a
2xx it returns data; otherwise it raises an error whose message is
error.message (or the HTTP status text when the body carries none), with
status, code (error.code) and details
(error.details) attached. A body that is not JSON is treated as {}.
{ "ok": true, "data": { ... } }
{ "ok": false, "error": { "code": "...", "message": "...", "details": { ... } } }
Error codes
Branch on the HTTP status and error.code, show error.message. The page
handles 401 and 402 by name; the rest reach it as a generic failure (“The run failed: ...”).
| HTTP | error.code | What it means / what to do |
|---|---|---|
400 | VALIDATION_ERROR | The body is not a JSON object, a required field (task, code, facts) is missing, or a declared field has the wrong type. Every field is a string; sending facts or audit_handoff as an object is the usual cause. |
401 | UNAUTHORIZED | No token, or one that expired or was revoked. The page forgets the signed-in user and says “Your session expired - sign in again.” Get a new token. |
402 | INSUFFICIENT_CREDITS | The balance cannot cover the run. The page says “Not enough credits for this run.” with a top-up link, and tries never to submit into a 402: it disables the run button when the /me balance is below the estimate’s min_credits. |
404 | NOT_FOUND | A wrong path, or a job id that does not belong to this token. |
409 | CONFLICT | An Idempotency-Key replayed with a different body. Send the original body, or use a new key (the page bumps its :a<attempt> suffix for a retry). |
429 | RATE_LIMITED | Too many requests. Back off with a delay; do not tight-loop, and never resend a metered run without its original Idempotency-Key. |
Failures that do not arrive as an HTTP status:
| What | What happens |
|---|---|
event: error on /run-stream | The SDK raises an error carrying the event’s message, code and job_id. |
Job status: "failed" | Polling stops; the job’s error field says why. |
| Polling past 180 s | The SDK’s own client-side limit (waitForJob, 1 s interval, 180 000 ms default): it throws “job timed out”. The job itself is not cancelled. |
The input fields
Every field is a string. The app declares this input schema; task, code and facts are required.
| Field | Type | What it is |
|---|---|---|
task | string, required | "audit" or "fix" (above). |
code | string, required | The paste, verbatim: every file introduced by a # file: <path> line. Line 1 is its first line; every line number in facts and in the reply is a line of this string. |
facts | string, required | The page’s analysis as a JSON string (below). |
audit_handoff | string, optional | Fix lane only: an audit handed on, as a JSON string (below). |
note | string, optional | What the engineer says, cut to 2,000 characters: a goal, a constraint, facts the files cannot show (the pgvector version, whether the embeddings are unit length, whether a rebuild is possible). Context, never instructions, and never evidence about the files. |
retry_note | string, optional | Sent only on the page’s one automatic retry, when the first reply did not parse. |
The code string
Paste the files one after another, each preceded by # file: <path>
(# file: db/schema.sql, # file: qdrant/collection.json,
# file: index/build_index.py, # file: workload.yaml, # file: bench/sweep.csv).
A marker’s path must look like a path (a dot or a slash); a line --- directly before a marker
only separates files. A paste with no marker is one file, named by what it looks like. The kind comes from the
path: .sql, .json (Qdrant), .py (FAISS or hnswlib), workload.*,
.csv/.tsv (the sweep). The page reads up to 400,000 characters and 40 files, and
sends at most 60,000 characters: over that it drops whole files from the end (files it does not check first, then
the sweep, whose rows travel in facts anyway) and ends code with a line
# [vector-desk: not sent: ...] naming them, and says so in facts.notes. The model is
told never to quote what it was not sent.
The facts string
facts is produced by the page’s free check: Vectorkit.analyze splits the paste
into files, reads the SQL, the JSON bodies, the index code, the workload and the sweep and runs the rules, and
Vectorkit.facts(A) turns that analysis into the object below (it does not depend on the lane). It
is how the model knows which flags to answer, which paths and line ranges to name, which sweep rows exist and
which budgets they must meet. Its top-level keys, in the order built:
| Key | Contents |
|---|---|
files | Every file: path (use it verbatim), kind (sql, qdrant, python, workload, sweep, other), line and end_line (the paste lines of the file’s content, without its # file: line). |
indexes | Every index (up to 40): engine (pgvector, qdrant, faiss, hnswlib), type (hnsw, ivf, flat), file, line, name, metric, dims, and what it sets: m, ef_construction, lists, opclass, column_type, pq_m, sq, quant, compression, always_ram, on_disk, factory, ef, nprobe, refine. |
queries | Every query (up to 60): engine, file, line, table, column, op and metric (pgvector ORDER BY), limit or k, ef, exact, rescore, filtered, and for pgvector uses_index (null when no pasted index serves it). |
pg_settings | Every pgvector SET (the last one wins): value, file, line. |
workload | file and what it gives: vectors, dimensions, k, target_recall (a fraction), p99_ms, memory_gb (GiB), qps, normalized, metric, filter_selectivity, model; null without a workload file. |
estimate | The memory estimate for the main index: index, vectors, dims, ram_gib, disk_gib and its parts (what, gib, where); null without a vector count. |
sweep | file, header_line, recall_at (the k of the recall column), columns, rows (up to 80, each with its 1-based row and line), pick (the cheapest row inside every budget), configured (the row the pasted setting runs at), configured_param, max_recall, skipped_rows; null without a sweep. |
unreadable | Files that could not be read: path, line, error. |
flags | Every flag the page raised: uid (F1, F2, ... in severity, file, then line order), id (VX-01..VX-24), sev (high | medium | low | info), file, line, text, detail, and lines (every line an aggregated flag covers, when there are several). |
verdict_candidate | The audit verdict the flags point at: blocked with any high flag, needs_work with any medium, otherwise ready. |
notes | Plain sentences about what was not read or not sent (empty for a paste that fits). |
The catalogue:
| Id | Flag | Area |
|---|---|---|
VX-01 | pgvector rejects the index or search options | config |
VX-02 | vector dimensions over pgvector's index limit | config |
VX-03 | index dimensions disagree with the workload | config |
VX-04 | IVF lists out of proportion to the vector count | config |
VX-05 | index type does not fit the scale | config |
VX-06 | PQ sub-quantizers do not divide the dimension | config |
VX-07 | credential literal in the paste | config |
VX-08 | hnsw.ef_search below the query LIMIT | search |
VX-09 | query distance operator does not match the index | search |
VX-10 | metric does not fit the embeddings | search |
VX-11 | IVF probes left at 1 | search |
VX-12 | filtered query on an approximate index without iterative scan | search |
VX-13 | quantized search without rescoring at a high recall target | search |
VX-14 | search forced to exact | search |
VX-15 | estimated index memory over the budget | memory |
VX-16 | full-precision vectors at a scale where quantization pays | memory |
VX-17 | quantized vectors not kept in RAM while the originals are on disk | memory |
VX-18 | no sweep row reaches the target recall | evidence |
VX-19 | the configured operating point misses a budget the sweep can meet | evidence |
VX-20 | recall falls as the search parameter rises | evidence |
VX-21 | every sweep row that meets the recall target is over the latency budget | evidence |
VX-22 | sweep recall measured at a different k than the queries ask for | evidence |
VX-23 | the workload is missing a budget | evidence |
VX-24 | context | context |
The simplest source is vectorkit.js itself: the page loads it from
/vectorkit.js, and it also runs in Node (it sets module.exports).
This script prints what the page would send as code and facts (with the
60,000-character cut applied), with the facts decoded so you can read them; the step 4 samples compact
them back into the page’s string byte for byte. Save the paste as lumen-paste.txt and
redirect the output into lumen-check.json:
// build-check.js -- run: node build-check.js lumen-paste.txt > lumen-check.json (vectorkit.js saved next to it)
const fs = require("fs");
const Vectorkit = require("./vectorkit.js");
const A = Vectorkit.analyze(fs.readFileSync(process.argv[2], "utf8"));
if (!A.ok) { console.error(A.errors.join("\n")); process.exit(1); }
const inp = Vectorkit.buildInput("audit", A, "", null); // code and facts do not depend on the lane
console.log(JSON.stringify({ code: inp.code, facts: JSON.parse(inp.facts) }, null, 2));
const real = A.flags.filter((f) => f.sev !== "info");
console.error(A.files.length + " file(s), " + A.indexes.length + " index(es), " + A.queries.length + " quer" +
(A.queries.length === 1 ? "y" : "ies") + (A.estimate ? ", about " + A.estimate.ram_gib + " GiB resident" : "") + "; " +
real.length + " flags (" + A.counts.high + " high, " + A.counts.medium + " medium, " + A.counts.low + " low); verdict_candidate " + A.candidate);
For the lumen example it reports 3 file(s), 1 index(es), 1 query, about 25.2 GiB resident; 7 flags (4 high, 1 medium, 2 low); verdict_candidate blocked; for the meridian example,
2 file(s), 1 index(es), 1 query, about 0.3 GiB resident; 3 flags (1 high, 2 medium, 0 low); verdict_candidate blocked. For both worked examples its code and facts are
exactly what the page sends.
Without the page’s check. The platform only checks that facts is a string,
so "{}" works and the model still reads code. But you lose what the check adds: with
no flags there is nothing to confirm, dismiss or close, with no files there are no
paths and line ranges to name, with no sweep rows the operating point cannot be quoted, and with no
estimate the memory findings have nothing to stand on. Build it with vectorkit.js when
you can.
The audit_handoff string
Only for task: "fix", and only for the files the audit was about with every audit edit
applied. The page builds both from the normalised audit reply res
(recon.js normalize) and the analysis A of the audited paste, in
recon.js fixHandoff:
const run = Recon.applyFindings(A, res.findings, Vectorkit); // every finding's edits, in order, each on top of the last
JSON.stringify({ verdict: res.verdict, headline: res.headline,
findings: res.findings.map(f => ({ id: f.id, severity: f.severity, file: f.file, line: f.line, title: f.title, why: f.why, edits: f.edits.length })),
applied: /* edits that applied */, failed: /* edits that did not */ })
// run.A.text is the edited paste: it becomes code, and facts is recomputed from it
Each finding’s edits there is the number of edits it carried.
applyFindings applies every finding’s edits with Vectorkit.applyEdits, in the
order listed, to the finding’s file: each before must occur exactly once in that
file as the earlier edits left it (blank lines at either end are tolerated, and a blank line written inside
after is kept), or that edit is reported as failed and skipped — it is never guessed. This
script does the whole step, in the same shape as build-check.js prints:
// handoff.js -- run: node handoff.js lumen-paste.txt lumen-reply.txt > lumen-fix-check.json (vectorkit.js, recon.js next to it)
const fs = require("fs");
const Vectorkit = require("./vectorkit.js");
const Recon = require("./recon.js");
const A = Vectorkit.analyze(fs.readFileSync(process.argv[2], "utf8")); // the audited paste
const res = Recon.normalize(Recon.parseResult(fs.readFileSync(process.argv[3], "utf8")), "audit");
const ho = Recon.fixHandoff(A, res); // every edit, in order
const B = Vectorkit.analyze(ho.text); // facts recomputed from the edited paste
const inp = Vectorkit.buildInput("fix", B, "", ho.handoff);
console.log(JSON.stringify({ code: inp.code, facts: JSON.parse(inp.facts), audit_handoff: inp.audit_handoff }, null, 2));
console.error(ho.applied + " edit(s) applied, " + ho.failed + " did not apply");
For the lumen audit above it reports 4 edit(s) applied, 0 did not apply; the edited
paste raises 1 high, 0 medium and 1 low flag(s), and the page sends that fix run with the
audit’s note and the key vector-desk:fix:d77387c8-1f02:a1. Its saved reply is fixed
(1 file(s), 1 change(s), 0 open item(s)).
The output contracts
The model is instructed (SKILL.md) to reply with one JSON object and nothing else
— no prose, no code fences — with every array of its lane present ([] when empty). The
run’s output text is that object. In both lanes it grounds everything in code: the servers,
their memory and CPU, the data distribution, other queries and the engine version are outside the paste, so they
are asked about, never stated as facts. It never invents a measurement (a recall, a latency, a memory size comes
from the workload, the sweep, the page’s estimate or the note); it never writes a secret value (a line that
holds a credential is never copied into the reply); it never edits the workload or the sweep; it keeps every
file valid in its own format; and it keeps the system’s meaning: which tables, columns, indexes,
collections and named vectors exist, and which column or collection each query searches. Every page flag whose
sev is not info is answered exactly once (audit lane: in flag_answers),
and an info flag is never a finding.
task: "audit"
task:"audit".verdict:blocked(any finding is high) |needs_work(the worst is medium) |ready(nothing above low).headline: one sentence.index: one or two sentences — the engine and index type, how many vectors of what dimension under which metric, and the budgets it must meet.areas[]: exactly four entries, in the order config, search, memory, evidence:{area, status, note}withstatussound|fragile|broken(brokenwhen a high finding sits in that area,fragilefor a medium one).operating_point:{row, m, ef_construction, ef_search, nprobe, recall, p99_ms, memory_gib, why}. With a sweep,rowis the 1-based sweep row recommended (normallyfacts.sweep.pick) and the values are copied from it (nullwhere the row has no such column); with no row inside every budget, or no sweep,rowisnulland no recall is estimated.findings[]:{id, flags[], file, line, severity, area, title, evidence, why, edits[]}.idis a catalogue id (VX-01..VX-23) orother;flagslists the pageuids it confirms ([]for something the page did not flag);fileis apathfromfacts.files— the file its edits change;lineis the line ofcodewith the offending text;evidenceis one to three whole consecutive lines copied from that file (never a line holding a credential).edits[]:{before, after}on that one file. Eachbeforeis a contiguous, exact slice of the file — whole lines with their indentation — that occurs exactly once in the file as it stands when the edit is applied. Findings are applied in the order listed and their edits in order, each on top of the ones before, and every edited JSON body must still parse. An audit edit never creates a file and never touches the workload or the sweep;editsis[]for a low finding, a credential, a change outside the paste, or one that needs a fact, a measurement or a decision the note does not give.flag_answers[]:{flag, status, reason}, exactly one per non-info page flag,confirmed(a finding lists that uid) |dismissed(with the reason).plan[]: the findings in the order to apply them, saying which steps rebuild the index and which are query-time only, ending with a recall sweep on a few hundred real queries against exact ground truth at the queries’ k (and for pgvectorEXPLAIN (ANALYZE)).questions[]andsummary(two to four sentences, answeringnote).
task: "fix"
task:"fix".verdict:fixed(openis empty) |partial.headline: one sentence.files[]:{path, content}— every pasted configuration file it changes, whole (every line, without the# file:line), under itspathfromfacts.files, in the file’s own format. No file is added, and the workload and the sweep are never returned.changes[]:{file, object, flags[], change, why}, one per change.objectnames what changed (index <name>,query at line <n>,setting hnsw.ef_search,search params,(file));flagsare the page flags it closes. Every high and medium flag appears in a change or anopenitem.verify[]: the engine accepts it (the CREATE INDEX or the collection update succeeds;EXPLAIN (ANALYZE)shows the pgvector query scanning the new index and returning the fullLIMIT), the rebuild when one is needed, and a recall sweep on real queries against exact ground truth with p99 and memory read against the budgets.open[]:{item, flags[], reason}for what it left unfixed.questions[]andsummary, as in the audit lane; with anaudit_handoff, it fixes what the audit left.
How the page reads a reply (recon.js parseResult and normalize): it strips
a code fence and parses from the first { to the last }. A reply is read as the lane
that was asked for, unless it names the other lane and carries that lane’s body (a
files array for fix, a findings array for audit). An unknown verdict
shows as needs_work or partial and counts as a disagreement; an unknown
severity becomes medium; ids like VX7 become VX-07;
flags keeps only F<n> values; index may also arrive as
system or setup, file as path, a change’s
object as target and its change as what;
questions is capped at 10, plan at 30 and verify at 20. An audit reply
carries 10 sections (verdict, headline, index, areas, operating_point, findings, flag_answers, plan, questions, summary) and a fix reply 8
(verdict, headline, files, changes, verify, open, questions, summary), which is what the page counts when it recovers a partial reply.
The page checks the reply against the files; the API does not
What comes back from the API is the model’s raw text in output.output. The page holds it to
account in the browser before showing it (recon.js reconcile, with
the facts, the code and the handoff it sent): it applies every edit or returned file to the paste and re-runs its
own checks on the result. None of that happens in the API.
- Both lanes: the reply is the lane you asked for, carries a valid verdict, and repeats no credential from the paste anywhere.
- Audit, areas: exactly four rows, config, search, memory and evidence once each, each with a valid status.
- Audit, the operating point: a named sweep row must exist, be quoted exactly and meet the workload’s recall, latency and memory budgets; a row with no sweep, or no operating point with a sweep, is a disagreement.
- Audit, every finding is anchored: a catalogue id (VX-24 is context and never a finding), a pasted file, a line inside it, evidence found line by line in that file and on or near that line, and only non-info page flags. A medium or high finding with no edit is pointed out (except a credential, which cannot carry one); an edit to the workload or the sweep is a disagreement.
- Audit, every flag answered once: a
confirmedflag needs a finding carrying it, adismissedone must not be carried; the verdict must fit the worst severity. - Audit, every edit put in place and re-checked: applied in the listed order with
Vectorkit.applyEdits; abeforethat is not found, is found twice, or changes nothing is a disagreement. After each finding the files are re-read and the check runs again: no JSON body may stop parsing and no new high flag may appear; with every edit applied every confirmed flag a finding with edits carries must be gone, and every table, column, index and collection must still be there. - Fix, the files: at least one, none new, none empty, none with a
# file:line, never the workload or the sweep; put into the paste (Vectorkit.replaceFiles) and re-checked: every JSON body parses, no high or medium flag of the paste may remain unless anopenitem names it, none may be new, and every name survives. - Fix, the changes list: every change names a returned file and real page flags; a high or medium flag nothing names is pointed out; the verdict must fit
open, and an emptyverifyis pointed out.
recon.js also runs in Node, so you can hold a reply to exactly the page’s standard. Save
/vectorkit.js and /recon.js next to this script:
// recheck.js -- run: node recheck.js lumen-check.json lumen-reply.txt audit > lumen-edited.txt (vectorkit.js, recon.js next to it)
const fs = require("fs");
const Recon = require("./recon.js"); // loads ./vectorkit.js itself
const sent = JSON.parse(fs.readFileSync(process.argv[2], "utf8")); // code, facts (and audit_handoff) you sent
const lane = process.argv[4] || "audit";
const res = Recon.normalize(Recon.parseResult(fs.readFileSync(process.argv[3], "utf8")), lane); // output.output
const r = Recon.reconcile(res, { facts: sent.facts, code: sent.code, handoff: sent.audit_handoff || null });
r.notes.forEach((n) => console.error(n.kind + ": " + n.text));
console.error(r.disagreements + " disagreement(s) in " + r.statements + " statements checked");
if (r.after) (r.after.flags || []).forEach((f) => console.error("still raised: " + f.id + " " + f.sev + " " + f.file + ":" + f.line + " " + f.text));
if (r.after && r.after.text) console.log(r.after.text.replace(/\n$/, "")); // the paste with every edit (or file) put back
For the lumen audit reply it reports:
ok: The areas table rates the index configuration, the search settings, the memory and the evidence once each.
ok: Every one of the 6 findings names a pasted file, a line inside it and evidence copied from it.
ok: No sweep was pasted and the operating point names no row.
ok: The verdict (blocked) fits the worst finding.
ok: Every one of the page's 7 flags is answered once.
ok: All 4 edits applied in order, each before text found exactly once.
ok: Every confirmed flag a finding carries is gone once all edits are applied.
ok: Every table, column, index and collection of the paste is still there after the edits (3 names: table doc_chunks, column doc_chunks.embedding, index doc_chunks_embedding_idx).
ok: The reply repeats no credential from the paste (1 found in it).
0 disagreement(s) in 9 statements checked
still raised: VX-07 high db/schema.sql:18 a credential is written into db/schema.sql (a role password)
still raised: VX-16 low db/schema.sql:14 index doc_chunks_embedding_idx keeps 4.2M x 1536 float32 vectors (24 GiB) at full precision
and for the meridian fix reply (node recheck.js meridian-check.json meridian-reply.txt fix):
ok: 1 pasted file returned whole.
ok: With the fixed files in place the free check raises no high or medium flag beyond the ones left open (0 low).
info: F3 left open by the reply.
ok: Every table, column, index and collection is still there (1 name: python index index).
ok: Every one of the 1 changes names a returned file and real page flags.
ok: The verdict (partial) fits the open list.
ok: The reply repeats no credential from the paste.
0 disagreement(s) in 6 statements checked
still raised: VX-11 medium search/ivfpq_index.py:9 the FAISS "IVF4096,PQ64" index searches with nprobe = 1 (never set, FAISS's default)
The page does not build or query anything. After that, run the verify steps: the engine accepts the
change, the rebuild when one is needed, and a recall sweep on real queries with p99 and memory against the
budgets, plus whatever the reply’s plan names.
Step 1 — a tiny client helper
One function per language that does what sdk.js does for every call: JSON in,
bearer token if you have one, data out on a 2xx, an error carrying
status, error.code and error.message otherwise. The later
steps assume this helper is in the same file (for Go, Java and C#, the later snippets go inside
main / the top-level statements; Java’s makeInput from step 4 goes
in the class).
BASE="https://api.skillsafe.ai/v1/app-api"
TOKEN="${SKILLSAFE_TOKEN:-YOUR_TOKEN}" # step 2
# api METHOD PATH [extra curl args...] -- prints the whole envelope; pipe to jq
api() {
method="$1"; path="$2"; shift 2
curl -sS -X "$method" "$BASE$path" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $TOKEN" "$@"
}
# success: jq '.data' failure: jq '.error | {code, message}'
import hashlib, json, os, time, urllib.parse
import requests # pip install requests
BASE = "https://api.skillsafe.ai/v1/app-api"
TOKEN = os.environ.get("SKILLSAFE_TOKEN", "YOUR_TOKEN") # step 2
class ApiError(Exception):
def __init__(self, status, code, message, details=None):
super().__init__(f"{status} {code}: {message}")
self.status, self.code, self.details = status, code, details
def api(method, path, body=None, headers=None):
h = {"Content-Type": "application/json"}
if TOKEN:
h["Authorization"] = "Bearer " + TOKEN
h.update(headers or {})
r = requests.request(method, BASE + path, headers=h,
data=None if body is None else json.dumps(body))
try:
env = r.json()
except ValueError:
env = {}
if not r.ok:
err = env.get("error") or {}
raise ApiError(r.status_code, err.get("code"), err.get("message") or r.reason, err.get("details"))
return env.get("data")
// vector-desk.mjs -- Node 18+ (global fetch), run with: node vector-desk.mjs
import { readFileSync } from "node:fs";
import { createHash } from "node:crypto";
const BASE = "https://api.skillsafe.ai/v1/app-api";
const TOKEN = "YOUR_TOKEN"; // your personal token from /tokens.html (step 2)
let token = TOKEN; // step 2 may swap in a guest token
async function api(method, path, body, headers = {}) {
const h = { "Content-Type": "application/json", ...headers };
if (token) h.Authorization = "Bearer " + token;
const res = await fetch(BASE + path, {
method,
headers: h,
body: body === undefined ? undefined : JSON.stringify(body),
});
const json = await res.json().catch(() => ({}));
if (!res.ok) {
const err = new Error((json.error && json.error.message) || res.statusText);
err.status = res.status;
err.code = json.error && json.error.code;
err.details = json.error && json.error.details;
throw err;
}
return json.data;
}
package main
import (
"bufio"
"bytes"
"crypto/sha256"
"encoding/hex"
"encoding/json"
"fmt"
"net/http"
"net/url"
"os"
"strings"
"time"
)
const base = "https://api.skillsafe.ai/v1/app-api"
var token = os.Getenv("SKILLSAFE_TOKEN") // step 2
type apiError struct {
Status int
Code string
Message string
}
func (e *apiError) Error() string { return fmt.Sprintf("%d %s: %s", e.Status, e.Code, e.Message) }
type envelope struct {
OK bool `json:"ok"`
Data json.RawMessage `json:"data"`
Error *struct {
Code string `json:"code"`
Message string `json:"message"`
} `json:"error"`
}
func newRequest(method, path string, body any, headers map[string]string) (*http.Request, error) {
var buf []byte
if body != nil {
b, err := json.Marshal(body)
if err != nil {
return nil, err
}
buf = b
}
req, err := http.NewRequest(method, base+path, bytes.NewReader(buf))
if err != nil {
return nil, err
}
req.Header.Set("Content-Type", "application/json")
if token != "" {
req.Header.Set("Authorization", "Bearer "+token)
}
for k, v := range headers {
req.Header.Set(k, v)
}
return req, nil
}
func errorFrom(res *http.Response, env envelope) error {
e := &apiError{Status: res.StatusCode, Message: http.StatusText(res.StatusCode)}
if env.Error != nil {
e.Code = env.Error.Code
if env.Error.Message != "" {
e.Message = env.Error.Message
}
}
return e
}
// api sends body as JSON and decodes the envelope's data into out (out may be nil).
func api(method, path string, body any, headers map[string]string, out any) error {
req, err := newRequest(method, path, body, headers)
if err != nil {
return err
}
res, err := http.DefaultClient.Do(req)
if err != nil {
return err
}
defer res.Body.Close()
var env envelope
_ = json.NewDecoder(res.Body).Decode(&env)
if res.StatusCode < 200 || res.StatusCode > 299 {
return errorFrom(res, env)
}
if out != nil && len(env.Data) > 0 {
return json.Unmarshal(env.Data, out)
}
return nil
}
func main() {
// steps 2-6 go here; remove any import a step you skip no longer uses
_, _, _, _, _ = bufio.NewScanner, sha256.Sum256, hex.EncodeToString, url.PathEscape, strings.Index
_ = time.Second
}
// VectorDesk.java -- Java 17+, needs com.fasterxml.jackson.core:jackson-databind on the classpath
import com.fasterxml.jackson.databind.JsonNode;
import com.fasterxml.jackson.databind.ObjectMapper;
import java.net.URI;
import java.net.URLEncoder;
import java.net.http.HttpClient;
import java.net.http.HttpRequest;
import java.net.http.HttpResponse;
import java.nio.charset.StandardCharsets;
import java.nio.file.Files;
import java.nio.file.Path;
import java.security.MessageDigest;
import java.util.*;
import java.util.stream.Collectors;
import java.util.stream.Stream;
public class VectorDesk {
static final String BASE = "https://api.skillsafe.ai/v1/app-api";
static String token = System.getenv().getOrDefault("SKILLSAFE_TOKEN", "YOUR_TOKEN"); // step 2
static final HttpClient HTTP = HttpClient.newHttpClient();
static final ObjectMapper JSON = new ObjectMapper();
static class ApiException extends Exception {
final int status;
final String code;
ApiException(int status, String code, String message) {
super(status + " " + code + ": " + message);
this.status = status;
this.code = code;
}
}
static HttpRequest.Builder request(String method, String path, Object body, Map<String, String> headers) throws Exception {
HttpRequest.Builder b = HttpRequest.newBuilder(URI.create(BASE + path))
.header("Content-Type", "application/json")
.method(method, body == null ? HttpRequest.BodyPublishers.noBody()
: HttpRequest.BodyPublishers.ofString(JSON.writeValueAsString(body)));
if (token != null && !token.isEmpty()) b.header("Authorization", "Bearer " + token);
if (headers != null) headers.forEach(b::header);
return b;
}
static ApiException errorFrom(int status, JsonNode env) {
JsonNode err = env.path("error");
return new ApiException(status, err.path("code").asText(null), err.path("message").asText("HTTP " + status));
}
static JsonNode api(String method, String path, Object body, Map<String, String> headers) throws Exception {
HttpResponse<String> res = HTTP.send(request(method, path, body, headers).build(), HttpResponse.BodyHandlers.ofString());
JsonNode env;
try { env = JSON.readTree(res.body()); } catch (Exception e) { env = JSON.createObjectNode(); }
if (env == null) env = JSON.createObjectNode();
if (res.statusCode() / 100 != 2) throw errorFrom(res.statusCode(), env);
return env.path("data");
}
public static void main(String[] args) throws Exception {
// steps 2-6 go here (makeInput from step 4 goes next to api())
}
}
require "digest"
require "json"
require "net/http"
require "uri"
BASE = "https://api.skillsafe.ai/v1/app-api"
$token = ENV.fetch("SKILLSAFE_TOKEN", "YOUR_TOKEN") # step 2
class ApiError < StandardError
attr_reader :status, :code
def initialize(status, code, message)
super("#{status} #{code}: #{message}")
@status = status
@code = code
end
end
def build_request(method, path, body = nil, headers = {})
uri = URI(BASE + path)
req = Net::HTTPGenericRequest.new(method, !body.nil?, true, uri.request_uri)
req["Content-Type"] = "application/json"
req["Authorization"] = "Bearer #{$token}" if $token && !$token.empty?
headers.each { |k, v| req[k] = v }
req.body = JSON.generate(body) unless body.nil?
[uri, req]
end
def api(method, path, body = nil, headers = {})
uri, req = build_request(method, path, body, headers)
res = Net::HTTP.start(uri.host, uri.port, use_ssl: true) { |h| h.request(req) }
env = (JSON.parse(res.body) rescue {})
env = {} unless env.is_a?(Hash)
unless res.is_a?(Net::HTTPSuccess)
err = env["error"] || {}
raise ApiError.new(res.code.to_i, err["code"], err["message"] || res.message)
end
env["data"]
end
<?php
// needs the curl extension
const BASE = "https://api.skillsafe.ai/v1/app-api";
$TOKEN = getenv("SKILLSAFE_TOKEN") ?: "YOUR_TOKEN"; // step 2
class ApiError extends Exception {
public $status;
public $apiCode;
public function __construct($status, $code, $message) {
parent::__construct("$status $code: $message");
$this->status = $status;
$this->apiCode = $code;
}
}
function headers_for(array $extra = []): array {
global $TOKEN;
$h = ["Content-Type: application/json"];
if ($TOKEN) $h[] = "Authorization: Bearer $TOKEN";
foreach ($extra as $k => $v) $h[] = "$k: $v";
return $h;
}
function api(string $method, string $path, $body = null, array $headers = []) {
$ch = curl_init(BASE . $path);
curl_setopt_array($ch, [
CURLOPT_CUSTOMREQUEST => $method,
CURLOPT_HTTPHEADER => headers_for($headers),
CURLOPT_RETURNTRANSFER => true,
]);
if ($body !== null) curl_setopt($ch, CURLOPT_POSTFIELDS, json_encode($body, JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE));
$raw = curl_exec($ch);
if ($raw === false) throw new RuntimeException(curl_error($ch));
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
curl_close($ch);
$env = json_decode($raw);
if (!is_object($env)) $env = new stdClass();
if ($status < 200 || $status > 299) {
$e = $env->error ?? new stdClass();
throw new ApiError($status, $e->code ?? null, $e->message ?? "HTTP $status");
}
return $env->data ?? null;
}
// Program.cs -- .NET 6+ console app (implicit usings on) with top-level statements; steps 2-6 (with the MakeInput local function) go ABOVE this class
using System.Text;
using System.Text.Json;
using System.Text.Json.Nodes;
static class Api
{
public const string Base = "https://api.skillsafe.ai/v1/app-api";
public static string Token = Environment.GetEnvironmentVariable("SKILLSAFE_TOKEN") ?? "YOUR_TOKEN"; // step 2
public static readonly HttpClient Http = new HttpClient();
public class ApiException : Exception
{
public int Status;
public string? Code;
public ApiException(int status, string? code, string message) : base($"{status} {code}: {message}")
{
Status = status;
Code = code;
}
}
public static HttpRequestMessage Request(string method, string path, object? body = null, IDictionary<string, string>? headers = null)
{
var req = new HttpRequestMessage(new HttpMethod(method), Base + path);
if (body != null) req.Content = new StringContent(JsonSerializer.Serialize(body), Encoding.UTF8, "application/json");
if (!string.IsNullOrEmpty(Token)) req.Headers.TryAddWithoutValidation("Authorization", "Bearer " + Token);
if (headers != null) foreach (var kv in headers) req.Headers.TryAddWithoutValidation(kv.Key, kv.Value);
return req;
}
public static ApiException ErrorFrom(HttpResponseMessage res, JsonNode? env)
{
var err = env?["error"];
return new ApiException((int)res.StatusCode, err?["code"]?.GetValue<string>(),
err?["message"]?.GetValue<string>() ?? res.ReasonPhrase ?? "error");
}
public static async Task<JsonNode?> Call(string method, string path, object? body = null, IDictionary<string, string>? headers = null)
{
using var req = Request(method, path, body, headers);
using var res = await Http.SendAsync(req);
var text = await res.Content.ReadAsStringAsync();
JsonNode? env = null;
try { env = JsonNode.Parse(text); } catch (JsonException) { }
if (!res.IsSuccessStatusCode) throw ErrorFrom(res, env);
return env?["data"];
}
}
Step 2 — a token
Two kinds work:
-
Personal — needed for a run. Both lanes are metered in credits on
gpt-terra, so a run needs a signed-in (user) token (the page says “The audit run is metered, so it needs an account.”, or the same of the fix run) unless the estimate sayssponsor_enabled. Sign in and copy your token from /tokens.html, then export it asSKILLSAFE_TOKEN(the samples fall back to the placeholderYOUR_TOKEN). -
Guest — enough for
/meand/estimate.POST /guestwith{"slug": "vector-desk"}and noAuthorizationheader, exactly assdk.jsguest()does. The response’sdatacarriestokenandguest_id. Reuse a token you already hold rather than minting a new one each time.
# personal token (needed for a run): copy it from /tokens.html, then
# export SKILLSAFE_TOKEN=... and skip the rest of this block
# guest token (enough for /me and /estimate): no Authorization header on this one call
TOKEN=$(curl -sS -X POST "$BASE/guest" \
-H "Content-Type: application/json" \
-d '{"slug":"vector-desk"}' | jq -r '.data.token')
echo "guest token: ${TOKEN:0:12}..."
# personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if TOKEN in ("", "YOUR_TOKEN"):
TOKEN = "" # no Authorization header on /guest
guest = api("POST", "/guest", {"slug": "vector-desk"})
TOKEN = guest["token"]
print("guest", guest.get("guest_id"))
// personal token (needed for a run): paste it from /tokens.html into TOKEN (step 1) and skip this
if (!token || token === "YOUR_TOKEN") {
token = ""; // no Authorization header on /guest
const guest = await api("POST", "/guest", { slug: "vector-desk" });
token = guest.token;
console.log("guest", guest.guest_id);
}
// inside main -- personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if token == "" {
var guest struct {
Token string `json:"token"`
GuestID string `json:"guest_id"`
}
if err := api("POST", "/guest", map[string]string{"slug": "vector-desk"}, nil, &guest); err != nil {
panic(err)
}
token = guest.Token
fmt.Println("guest", guest.GuestID)
}
// inside main -- personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if (token.isEmpty() || token.equals("YOUR_TOKEN")) {
token = ""; // no Authorization header on /guest
JsonNode guest = api("POST", "/guest", Map.of("slug", "vector-desk"), null);
token = guest.path("token").asText();
System.out.println("guest " + guest.path("guest_id").asText());
}
# personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if $token.empty? || $token == "YOUR_TOKEN"
$token = "" # no Authorization header on /guest
guest = api("POST", "/guest", { slug: "vector-desk" })
$token = guest["token"]
puts "guest #{guest["guest_id"]}"
end
// personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if ($TOKEN === "" || $TOKEN === "YOUR_TOKEN") {
$TOKEN = ""; // no Authorization header on /guest
$guest = api("POST", "/guest", ["slug" => "vector-desk"]);
$TOKEN = $guest->token;
echo "guest {$guest->guest_id}\n";
}
// top-level statements (above the Api class) -- personal token (needed for a run): set SKILLSAFE_TOKEN (from /tokens.html) and skip this
if (Api.Token == "" || Api.Token == "YOUR_TOKEN")
{
Api.Token = ""; // no Authorization header on /guest
var guest = await Api.Call("POST", "/guest", new { slug = "vector-desk" });
Api.Token = guest!["token"]!.GetValue<string>();
Console.WriteLine($"guest {guest["guest_id"]}");
}
Step 3 — GET /me
Who the token belongs to and what it can spend. sdk.js documents the shape as
{subject_type, subject_id, credits, profile?}. The page treats the caller as signed
in only when subject_type is "user", shows credits as the
balance (1 credit = $0.0001, so it divides by 10 000 for the dollar figure), and compares it
with the estimate in step 4 before it lets you run.
api GET /me | jq '.data // .error'
me = api("GET", "/me")
print(me["subject_type"], me.get("subject_id"), me.get("credits"))
signed_in = me["subject_type"] == "user"
const me = await api("GET", "/me");
console.log(me.subject_type, me.subject_id, me.credits);
const signedIn = me.subject_type === "user";
var me struct {
SubjectType string `json:"subject_type"`
SubjectID any `json:"subject_id"`
Credits any `json:"credits"`
}
if err := api("GET", "/me", nil, nil, &me); err != nil {
panic(err)
}
fmt.Println(me.SubjectType, me.SubjectID, me.Credits)
signedIn := me.SubjectType == "user"
_ = signedIn
JsonNode me = api("GET", "/me", null, null);
System.out.println(me.path("subject_type").asText() + " " + me.path("subject_id").asText() + " " + me.path("credits"));
boolean signedIn = me.path("subject_type").asText().equals("user");
me = api("GET", "/me")
puts [me["subject_type"], me["subject_id"], me["credits"]].join(" ")
signed_in = me["subject_type"] == "user"
$me = api("GET", "/me");
echo $me->subject_type, " ", $me->subject_id ?? "", " ", $me->credits ?? "", "\n";
$signedIn = $me->subject_type === "user";
var me = await Api.Call("GET", "/me");
Console.WriteLine($"{me?["subject_type"]} {me?["subject_id"]} {me?["credits"]}");
var signedIn = me?["subject_type"]?.GetValue<string>() == "user";
Step 4 — build the input, then POST /estimate
First a small makeInput that does what buildInput does: task,
then code as the paste the page would send, facts as a compact JSON string,
the note when it is not blank, and — for the fix lane only — the
audit_handoff string when the file carries one. It reads the file
build-check.js (or handoff.js) printed. The samples build the
audit input of the lumen example from lumen-check.json; step 6 reuses
makeInput for the meridian (fix) example. Then price it. The body of
/estimate is the same input you will send to /run; no job is created and
nothing is charged — /estimate is free. From the response the page reads:
| Field | Meaning |
|---|---|
hold_credits | A reservation, not a price: the worst case the platform holds while the run is in flight. The page shows it as “reserves N credits ($...) for the audit run” and adds that you are charged only for what the run actually uses, usually far less. What you pay is the job’s charged_credits after settlement (step 5). A balance below the hold is allowed, but the page warns that the reply may be cut short (truncated: true). |
min_credits | The smallest balance that can start a run. Below it the page disables the run button and names the shortfall, because the call would be a 402. |
sponsor_enabled | When true, a caller who is not signed in may run; otherwise the page asks them to sign in. |
warnings | Input warnings. They do not refuse the call; the page shows them next to the price (“input warnings: ...”), so check them before you run. |
The page re-prices whenever the paste, the note or the lane change. The amounts grow with the size
of code and facts, so read them from the call rather than hard-coding them.
# lumen-check.json: printed by build-check.js (see "The facts string").
# (.facts | tojson) turns the facts into ONE compact string, as JSON.stringify does.
BODY=$(jq -c --arg note "We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?" \
'{task: "audit", code, facts: (.facts | tojson), note: $note}' lumen-check.json)
# No page check at hand? facts: "{}" is accepted as a string, but the reply then has no page flags to answer.
# Fix lane after an audit: read handoff.js's output instead and add its string:
# '{task: "fix", code, facts: (.facts | tojson), note: $note} + (if .audit_handoff then {audit_handoff} else {} end)'
api POST /estimate -d "$BODY" \
| jq '.error // (.data | {hold_credits, min_credits, sponsor_enabled, warnings})'
def make_input(task, check_path, note=None):
"""The body the page sends: task, code, facts as a JSON STRING, an optional note, and
(fix lane only) the audit_handoff string -- every value a string."""
with open(check_path, encoding="utf-8") as f:
check = json.load(f) # build-check.js (or handoff.js) output
inp = {
"task": task,
"code": check["code"], # the paste as the page sends it
"facts": json.dumps(check["facts"], separators=(",", ":"), ensure_ascii=False), # a STRING, like JSON.stringify
}
n = (note or "").strip()
if n:
inp["note"] = n[:2000] # optional; the page caps it at 2000 chars
if task == "fix" and check.get("audit_handoff"):
inp["audit_handoff"] = check["audit_handoff"] # optional; already a JSON string
return inp
inp = make_input("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?")
est = api("POST", "/estimate", inp)
print("hold", est.get("hold_credits"), "min", est.get("min_credits"),
"sponsored", est.get("sponsor_enabled"), "warnings", est.get("warnings") or [])
// The body the page sends: task, code, facts as a JSON STRING, an optional note,
// and (fix lane only) the audit_handoff string -- every value a string.
function makeInput(task, checkPath, note) {
const check = JSON.parse(readFileSync(checkPath, "utf8")); // build-check.js (or handoff.js) output
const input = {
task,
code: check.code, // the paste as the page sends it
facts: JSON.stringify(check.facts), // a STRING: the page's free check
};
const n = (note || "").trim();
if (n) input.note = n.length > 2000 ? n.slice(0, 2000) : n; // optional; max 2000 chars
if (task === "fix" && check.audit_handoff) input.audit_handoff = check.audit_handoff; // optional
return input;
}
const input = makeInput("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?");
const est = await api("POST", "/estimate", input);
console.log("hold", est.hold_credits, "min", est.min_credits,
"sponsored", est.sponsor_enabled, "warnings", est.warnings || []);
// makeInput builds the body the page sends: task, code, facts as a JSON STRING,
// an optional note and (fix lane only) the audit_handoff string.
makeInput := func(task, checkPath, note string) map[string]any {
raw, err := os.ReadFile(checkPath) // build-check.js (or handoff.js) output
if err != nil {
panic(err)
}
var check struct {
Code string `json:"code"`
Facts json.RawMessage `json:"facts"`
AuditHandoff string `json:"audit_handoff"`
}
if err := json.Unmarshal(raw, &check); err != nil {
panic(err)
}
var facts bytes.Buffer
if err := json.Compact(&facts, check.Facts); err != nil { // keeps key order; travels as a STRING
panic(err)
}
in := map[string]any{"task": task, "code": check.Code, "facts": facts.String()}
if n := []rune(strings.TrimSpace(note)); len(n) > 0 {
if len(n) > 2000 {
n = n[:2000] // optional; the page caps it at 2000 chars
}
in["note"] = string(n)
}
if task == "fix" && check.AuditHandoff != "" {
in["audit_handoff"] = check.AuditHandoff // optional; already a JSON string
}
return in
}
input := makeInput("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?")
var est struct {
HoldCredits any `json:"hold_credits"`
MinCredits any `json:"min_credits"`
SponsorEnabled bool `json:"sponsor_enabled"`
Warnings []any `json:"warnings"`
}
if err := api("POST", "/estimate", input, nil, &est); err != nil {
panic(err)
}
fmt.Printf("hold %v min %v sponsored %v warnings %v\n", est.HoldCredits, est.MinCredits, est.SponsorEnabled, est.Warnings)
// ---- add to the VectorDesk class, next to api(): the body the page sends
static Map<String, Object> makeInput(String task, String checkPath, String note) throws Exception {
JsonNode check = JSON.readTree(Files.readString(Path.of(checkPath))); // build-check.js (or handoff.js) output
Map<String, Object> in = new LinkedHashMap<>();
in.put("task", task);
in.put("code", check.path("code").asText()); // the paste as the page sends it
in.put("facts", JSON.writeValueAsString(check.path("facts"))); // a STRING, compact
String n = note == null ? "" : note.strip();
if (!n.isEmpty()) in.put("note", n.length() > 2000 ? n.substring(0, 2000) : n); // optional; max 2000 chars
if (task.equals("fix") && check.hasNonNull("audit_handoff")) in.put("audit_handoff", check.get("audit_handoff").asText());
return in;
}
// ---- inside main
Map<String, Object> input = makeInput("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?");
JsonNode est = api("POST", "/estimate", input, null);
System.out.println("hold " + est.path("hold_credits") + " min " + est.path("min_credits")
+ " sponsored " + est.path("sponsor_enabled").asBoolean(false) + " warnings " + est.path("warnings"));
# The body the page sends: task, code, facts as a JSON STRING, an optional note,
# and (fix lane only) the audit_handoff string -- every value a string.
def make_input(task, check_path, note = nil)
check = JSON.parse(File.read(check_path, encoding: "UTF-8")) # build-check.js (or handoff.js) output
input = {
task: task,
code: check["code"], # the paste as the page sends it
facts: JSON.generate(check["facts"]) # a STRING, compact
}
n = note.to_s.strip
input[:note] = n[0, 2000] unless n.empty? # optional; max 2000 chars
input[:audit_handoff] = check["audit_handoff"] if task == "fix" && !check["audit_handoff"].to_s.empty?
input
end
input = make_input("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?")
est = api("POST", "/estimate", input)
puts "hold #{est["hold_credits"]} min #{est["min_credits"]} " \
"sponsored #{est["sponsor_enabled"]} warnings #{(est["warnings"] || []).inspect}"
// The body the page sends: task, code, facts as a JSON STRING, an optional note,
// and (fix lane only) the audit_handoff string -- every value a string.
function make_input(string $task, string $checkPath, string $note = ""): array {
// decode to objects (not arrays) so an empty {} stays {} when re-encoded
$check = json_decode(file_get_contents($checkPath)); // build-check.js (or handoff.js) output
$input = [
"task" => $task,
"code" => $check->code, // the paste as the page sends it
"facts" => json_encode($check->facts, JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE), // a STRING
];
$n = trim($note);
if ($n !== "") $input["note"] = mb_substr($n, 0, 2000); // optional; max 2000 chars
if ($task === "fix" && !empty($check->audit_handoff)) $input["audit_handoff"] = $check->audit_handoff;
return $input;
}
$input = make_input("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?");
$est = api("POST", "/estimate", $input);
echo "hold ", $est->hold_credits ?? "-", " min ", $est->min_credits ?? "-",
" sponsored ", json_encode($est->sponsor_enabled ?? false),
" warnings ", json_encode($est->warnings ?? []), "\n";
// The body the page sends: task, code, facts as a JSON STRING, an optional note,
// and (fix lane only) the audit_handoff string -- every value a string.
static Dictionary<string, string> MakeInput(string task, string checkPath, string? note = null)
{
var compact = new JsonSerializerOptions { Encoder = System.Text.Encodings.Web.JavaScriptEncoder.UnsafeRelaxedJsonEscaping };
var check = JsonNode.Parse(File.ReadAllText(checkPath))!; // build-check.js (or handoff.js) output
var input = new Dictionary<string, string>
{
["task"] = task,
["code"] = check["code"]!.GetValue<string>(), // the paste as the page sends it
["facts"] = check["facts"]!.ToJsonString(compact), // a STRING, compact
};
var n = (note ?? "").Trim();
if (n.Length > 0) input["note"] = n.Length > 2000 ? n[..2000] : n; // optional; max 2000 chars
var handoff = check["audit_handoff"]?.GetValue<string>();
if (task == "fix" && !string.IsNullOrEmpty(handoff)) input["audit_handoff"] = handoff;
return input;
}
var input = MakeInput("audit", "lumen-check.json",
"We run pgvector 0.8.0 on a 64 GiB box. p99 is around 900 ms and EXPLAIN shows a sequential scan on doc_chunks. The embeddings are text-embedding-3-small, which returns unit-length vectors. We can rebuild the index tonight with CREATE INDEX CONCURRENTLY. What do we fix first?");
var est = await Api.Call("POST", "/estimate", input);
Console.WriteLine($"hold {est?["hold_credits"]} min {est?["min_credits"]} " +
$"sponsored {est?["sponsor_enabled"]} warnings {est?["warnings"]?.ToJsonString() ?? "[]"}");
Step 5 — POST /run, then poll the job (audit)
Send the same input to /run with an Idempotency-Key header, using a
personal token. Its data carries a job_id. Poll
GET /jobs/{job_id} the way sdk.js waitForJob does: every
second until status is succeeded or failed, giving up on
the client side after 180 seconds. On the finished job, read:
output.output— the model’s reply as a string: the JSON object from the output contract of the lane you asked for. Parse it yourself (from the first{to the last}). The samples print the verdict and headline, each area’s status, each finding’sid,file,line,severityand number of edits, then each flag answer. Keep the text:recheck.jsreads it.truncated—truewhen the reply was cut short because the balance ran out. The page then closes the cut-off JSON, shows what arrived as a partial result (“N of 9 sections recovered” for an audit, of 8 for a fix run), and says it was cut short by the available balance.charged_credits— the real cost of the run, as opposed to the estimate’shold_creditsreservation. The page re-reads/meafterwards for the new balance.error— on afailedjob.
Idempotency key. Resending a request with the same key must not start a second
paid run, so derive the key from the input, not from the clock — and include the lane, so an
audit and a fix run of the same paste never share a key. The page uses
vector-desk:<lane>:<inputHash>:a<attempt> (app.js
run), where <lane> is audit or fix,
<inputHash> is a 32-bit djb2 hash of JSON.stringify(input) in hex, a
dash, and the string’s length in hex (app.js inputHash, over the
input without retry_note), and <attempt> is 1
for a normal run and 2 for the automatic reformat retry (which also adds
retry_note). For the two worked examples that is
vector-desk:audit:613c0bcd-1ad6:a1 (lumen audit) and vector-desk:fix:dc724a33-ed3:a1
(meridian fix); the fix run of the lumen audit handed on (below) is vector-desk:fix:d77387c8-1f02:a1. The format is the page’s
convention, not a requirement: any stable, unique string does. The samples below use the lane and a
SHA-256 prefix.
The page itself uses /run-stream (step 6), not /run; both take the
same body and header.
KEY="vector-desk:audit:$(printf '%s' "$BODY" | shasum -a 256 | cut -c1-16):a1"
JOB=$(api POST /run -H "Idempotency-Key: $KEY" -d "$BODY" | jq -r '.data.job_id')
for i in $(seq 180); do # 1 s interval, 180 s client-side limit
J=$(api GET "/jobs/$JOB")
S=$(printf '%s' "$J" | jq -r '.data.status')
if [ "$S" = "succeeded" ] || [ "$S" = "failed" ]; then break; fi
sleep 1
done
printf '%s' "$J" | jq '.data | {status, truncated, charged_credits, error}'
printf '%s' "$J" | jq -r '.data.output.output' \
| jq '{verdict, headline, areas: [(.areas // [])[] | {area, status}],
findings: [(.findings // [])[] | {id, file, line, severity, edits: ((.edits // []) | length)}],
flag_answers: [(.flag_answers // [])[] | {flag, status}]}'
body = json.dumps(inp)
key = "vector-desk:audit:" + hashlib.sha256(body.encode()).hexdigest()[:16] + ":a1"
job_id = api("POST", "/run", inp, {"Idempotency-Key": key})["job_id"]
deadline = time.time() + 180 # 1 s interval, 180 s client-side limit
while True:
job = api("GET", "/jobs/" + urllib.parse.quote(job_id, safe=""))
if job["status"] in ("succeeded", "failed"):
break
if time.time() > deadline:
raise TimeoutError("job timed out")
time.sleep(1)
if job["status"] == "failed":
raise SystemExit(f"run failed: {job.get('error')}")
print("truncated:", job.get("truncated") is True, "charged:", job.get("charged_credits"))
text = (job.get("output") or {}).get("output") or ""
reply = json.loads(text[text.index("{"): text.rindex("}") + 1])
print(reply["verdict"], "-", reply["headline"])
for s in reply.get("areas", []):
print("area", s["area"], s["status"])
for f in reply.get("findings", []):
print(f["id"], f["file"], f.get("line"), f["severity"], len(f.get("edits") or []), "edit(s)")
for a in reply.get("flag_answers", []):
print("answer", a["flag"], a["status"])
const key = "vector-desk:audit:" +
createHash("sha256").update(JSON.stringify(input)).digest("hex").slice(0, 16) + ":a1";
const { job_id } = await api("POST", "/run", input, { "Idempotency-Key": key });
let job;
const deadline = Date.now() + 180000; // 1 s interval, 180 s client-side limit
for (;;) {
job = await api("GET", "/jobs/" + encodeURIComponent(job_id));
if (job.status === "succeeded" || job.status === "failed") break;
if (Date.now() > deadline) throw new Error("job timed out");
await new Promise((r) => setTimeout(r, 1000));
}
if (job.status === "failed") throw new Error("run failed: " + JSON.stringify(job.error));
console.log("truncated:", job.truncated === true, "charged:", job.charged_credits);
const text = (job.output && job.output.output) || "";
const reply = JSON.parse(text.slice(text.indexOf("{"), text.lastIndexOf("}") + 1));
console.log(reply.verdict, "-", reply.headline);
for (const s of reply.areas || []) console.log("area", s.area, s.status);
for (const f of reply.findings || []) console.log(f.id, f.file, f.line, f.severity, (f.edits || []).length, "edit(s)");
for (const a of reply.flag_answers || []) console.log("answer", a.flag, a.status);
inputJSON, _ := json.Marshal(input)
sum := sha256.Sum256(inputJSON)
key := "vector-desk:audit:" + hex.EncodeToString(sum[:8]) + ":a1"
var started struct {
JobID string `json:"job_id"`
}
if err := api("POST", "/run", input, map[string]string{"Idempotency-Key": key}, &started); err != nil {
panic(err)
}
type jobT struct {
Status string `json:"status"`
Output *struct {
Output string `json:"output"`
} `json:"output"`
Truncated bool `json:"truncated"`
ChargedCredits any `json:"charged_credits"`
Error any `json:"error"`
}
var job jobT
deadline := time.Now().Add(180 * time.Second) // 1 s interval, 180 s client-side limit
for {
job = jobT{}
if err := api("GET", "/jobs/"+url.PathEscape(started.JobID), nil, nil, &job); err != nil {
panic(err)
}
if job.Status == "succeeded" || job.Status == "failed" {
break
}
if time.Now().After(deadline) {
panic("job timed out")
}
time.Sleep(time.Second)
}
if job.Status == "failed" {
panic(fmt.Sprintf("run failed: %v", job.Error))
}
fmt.Println("truncated:", job.Truncated, "charged:", job.ChargedCredits)
text := ""
if job.Output != nil {
text = job.Output.Output
}
var reply map[string]any
if a, b := strings.Index(text, "{"), strings.LastIndex(text, "}"); a >= 0 && b > a {
if err := json.Unmarshal([]byte(text[a:b+1]), &reply); err != nil {
panic(err)
}
}
fmt.Println(reply["verdict"], "-", reply["headline"])
areas, _ := reply["areas"].([]any)
for _, e := range areas {
s, _ := e.(map[string]any)
fmt.Println("area", s["area"], s["status"])
}
findings, _ := reply["findings"].([]any)
for _, e := range findings {
f, _ := e.(map[string]any)
edits, _ := f["edits"].([]any)
fmt.Println(f["id"], f["file"], f["line"], f["severity"], len(edits), "edit(s)")
}
answers, _ := reply["flag_answers"].([]any)
for _, e := range answers {
a, _ := e.(map[string]any)
fmt.Println("answer", a["flag"], a["status"])
}
byte[] digest = MessageDigest.getInstance("SHA-256").digest(JSON.writeValueAsBytes(input));
String key = "vector-desk:audit:" + HexFormat.of().formatHex(digest, 0, 8) + ":a1";
String jobId = api("POST", "/run", input, Map.of("Idempotency-Key", key)).path("job_id").asText();
JsonNode job;
long deadline = System.currentTimeMillis() + 180_000; // 1 s interval, 180 s client-side limit
while (true) {
job = api("GET", "/jobs/" + URLEncoder.encode(jobId, StandardCharsets.UTF_8), null, null);
String s = job.path("status").asText();
if (s.equals("succeeded") || s.equals("failed")) break;
if (System.currentTimeMillis() > deadline) throw new RuntimeException("job timed out");
Thread.sleep(1000);
}
if (job.path("status").asText().equals("failed")) throw new RuntimeException("run failed: " + job.path("error"));
System.out.println("truncated: " + job.path("truncated").asBoolean(false) + ", charged: " + job.path("charged_credits"));
String text = job.path("output").path("output").asText("");
JsonNode reply = JSON.readTree(text.substring(text.indexOf('{'), text.lastIndexOf('}') + 1));
System.out.println(reply.path("verdict").asText() + " - " + reply.path("headline").asText());
for (JsonNode s : reply.path("areas")) {
System.out.println("area " + s.path("area").asText() + " " + s.path("status").asText());
}
for (JsonNode f : reply.path("findings")) {
System.out.println(f.path("id").asText() + " " + f.path("file").asText() + " " + f.path("line") + " "
+ f.path("severity").asText() + " " + f.path("edits").size() + " edit(s)");
}
for (JsonNode a : reply.path("flag_answers")) {
System.out.println("answer " + a.path("flag").asText() + " " + a.path("status").asText());
}
key = "vector-desk:audit:#{Digest::SHA256.hexdigest(JSON.generate(input))[0, 16]}:a1"
job_id = api("POST", "/run", input, { "Idempotency-Key" => key })["job_id"]
deadline = Time.now + 180 # 1 s interval, 180 s client-side limit
job = nil
loop do
job = api("GET", "/jobs/#{URI.encode_www_form_component(job_id)}")
break if %w[succeeded failed].include?(job["status"])
raise "job timed out" if Time.now > deadline
sleep 1
end
raise "run failed: #{job["error"].inspect}" if job["status"] == "failed"
puts "truncated: #{job["truncated"] == true}, charged: #{job["charged_credits"]}"
text = (job["output"] || {})["output"].to_s
reply = JSON.parse(text[text.index("{")..text.rindex("}")])
puts "#{reply["verdict"]} - #{reply["headline"]}"
(reply["areas"] || []).each { |s| puts "area #{s["area"]} #{s["status"]}" }
(reply["findings"] || []).each { |f| puts "#{f["id"]} #{f["file"]} #{f["line"].inspect} #{f["severity"]} #{(f["edits"] || []).size} edit(s)" }
(reply["flag_answers"] || []).each { |a| puts "answer #{a["flag"]} #{a["status"]}" }
$key = "vector-desk:audit:" . substr(hash("sha256", json_encode($input)), 0, 16) . ":a1";
$jobId = api("POST", "/run", $input, ["Idempotency-Key" => $key])->job_id;
$deadline = time() + 180; // 1 s interval, 180 s client-side limit
while (true) {
$job = api("GET", "/jobs/" . rawurlencode($jobId));
if (in_array($job->status, ["succeeded", "failed"], true)) break;
if (time() > $deadline) throw new RuntimeException("job timed out");
sleep(1);
}
if ($job->status === "failed") throw new RuntimeException("run failed: " . json_encode($job->error ?? null));
echo "truncated: ", json_encode(($job->truncated ?? false) === true), ", charged: ", $job->charged_credits ?? "-", "\n";
$text = $job->output->output ?? "";
$reply = json_decode(substr($text, strpos($text, "{"), strrpos($text, "}") - strpos($text, "{") + 1));
echo $reply->verdict, " - ", $reply->headline, "\n";
foreach ($reply->areas ?? [] as $s) echo "area ", $s->area, " ", $s->status, "\n";
foreach ($reply->findings ?? [] as $f) echo $f->id, " ", $f->file, " ", json_encode($f->line ?? null), " ", $f->severity, " ", count($f->edits ?? []), " edit(s)\n";
foreach ($reply->flag_answers ?? [] as $a) echo "answer ", $a->flag, " ", $a->status, "\n";
var digest = System.Security.Cryptography.SHA256.HashData(Encoding.UTF8.GetBytes(JsonSerializer.Serialize(input)));
var key = "vector-desk:audit:" + Convert.ToHexString(digest, 0, 8).ToLowerInvariant() + ":a1";
var started = await Api.Call("POST", "/run", input, new Dictionary<string, string> { ["Idempotency-Key"] = key });
var jobId = started!["job_id"]!.GetValue<string>();
JsonNode job;
var deadline = DateTime.UtcNow.AddSeconds(180); // 1 s interval, 180 s client-side limit
while (true)
{
job = (await Api.Call("GET", "/jobs/" + Uri.EscapeDataString(jobId)))!;
var s = job["status"]?.GetValue<string>();
if (s == "succeeded" || s == "failed") break;
if (DateTime.UtcNow > deadline) throw new TimeoutException("job timed out");
await Task.Delay(1000);
}
if (job["status"]?.GetValue<string>() == "failed") throw new Exception($"run failed: {job["error"]?.ToJsonString()}");
var truncated = job["truncated"] is JsonValue t && t.TryGetValue(out bool tb) && tb;
Console.WriteLine($"truncated: {truncated}, charged: {job["charged_credits"]}");
var text = job["output"]?["output"]?.GetValue<string>() ?? "";
var reply = JsonNode.Parse(text[text.IndexOf('{')..(text.LastIndexOf('}') + 1)])!;
Console.WriteLine($"{reply["verdict"]} - {reply["headline"]}");
foreach (var s in reply["areas"]?.AsArray() ?? new JsonArray())
Console.WriteLine($"area {s?["area"]} {s?["status"]}");
foreach (var f in reply["findings"]?.AsArray() ?? new JsonArray())
Console.WriteLine($"{f?["id"]} {f?["file"]} {f?["line"]?.ToJsonString() ?? "null"} {f?["severity"]} {f?["edits"]?.AsArray().Count ?? 0} edit(s)");
foreach (var a in reply["flag_answers"]?.AsArray() ?? new JsonArray())
Console.WriteLine($"answer {a?["flag"]} {a?["status"]}");
Step 6 — POST /run-stream (Server-Sent Events, fix)
The alternative to step 5, and what the page uses: same kind of body, same
Idempotency-Key header, one request. Run one or the other for a given input, not
both. To show the second lane, the samples build the fix input of the
meridian example (with its own key) and stream it; to stream the audit input instead, pass the
step 4 input and key. The response is text/event-stream. sdk.js splits
it into frames on a blank line, takes the event name from an event: line (default
message) and concatenates the data: lines, skips frames with no data or
with data that is not JSON, and handles these events:
| Event | Data | What the SDK does |
|---|---|---|
delta | {text} | Passes text to onDelta. |
job | job info | Passes it to onJob (the page uses it to advance its progress display). |
done | the final payload: {job_id, status, charged_credits, output} | Keeps it as the result. |
pending | a payload | Treated exactly like done. If it carries a job_id and no output, poll that job as in step 5. |
error | {message, code, job_id} | After the stream ends, raises an error with those fields. |
If the response is not text/event-stream, it is an ordinary JSON envelope:
the SDK returns its data (an idempotent replay returns this way) or raises the
error on a non-2xx status. Handle both shapes.
From the final payload the page reads output.output (falling back to the
concatenated delta text), truncated and charged_credits.
Browsers receive progress ticks rather than deltas from this endpoint, so the page relies on the
final payload; if the stream fails part-way, it tries to recover a partial reply from whatever
delta text arrived. The samples print the verdict and headline, each returned file’s path and
size, each change (task, flags and change), each
verification step, each open item and each question. To put the files into the paste and re-check
them the way the page’s “Put every file into the paste” does, keep the reply text
and run recheck.js with the lane fix. To fix code you audited, read handoff.js’s output instead of
meridian-check.json: makeInput then carries its audit_handoff.
# the fix worked example: meridian-check.json from build-check.js
# (for audited code, read handoff.js's output instead; the + (...) adds its audit_handoff)
FBODY=$(jq -c --arg note "build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week." \
'{task: "fix", code, facts: (.facts | tojson), note: $note} + (if .audit_handoff then {audit_handoff} else {} end)' \
meridian-check.json)
FKEY="vector-desk:fix:$(printf '%s' "$FBODY" | shasum -a 256 | cut -c1-16):a1"
# -N turns off buffering; the whole stream lands in $STREAM
STREAM=$(api POST /run-stream -N -H "Idempotency-Key: $FKEY" -d "$FBODY")
# frames look like:
# event: job
# data: {...}
#
# event: done
# data: {"job_id":"...","status":"...","charged_credits":...,"output":{"output":"{\"task\":\"fix\",...}"}}
# the final reply text, from the done (or pending) frame:
REPLY=$(printf '%s\n' "$STREAM" \
| awk '/^event:/{ev=$2} /^data:/ && (ev=="done" || ev=="pending"){sub(/^data: */,""); print}' \
| jq -r '.output.output')
# an idempotent replay answers with a plain JSON envelope instead: REPLY=$(printf '%s' "$STREAM" | jq -r '.data.output.output')
printf '%s' "$REPLY" | jq '{verdict, headline,
files: [(.files // [])[] | {path, characters: (.content | length)}],
changes: [(.changes // [])[] | {task, flags, change}], verify, open, questions}'
# the fix worked example: meridian-check.json from build-check.js
# (for audited code, pass handoff.js's output instead: make_input adds its audit_handoff)
fix_inp = make_input("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.")
fix_key = "vector-desk:fix:" + hashlib.sha256(json.dumps(fix_inp).encode()).hexdigest()[:16] + ":a1"
h = {"Content-Type": "application/json", "Authorization": "Bearer " + TOKEN, "Idempotency-Key": fix_key}
done, failure, streamed = None, None, ""
with requests.post(BASE + "/run-stream", headers=h, data=json.dumps(fix_inp), stream=True) as r:
if "text/event-stream" not in r.headers.get("content-type", ""):
try:
env = r.json()
except ValueError:
env = {}
if not r.ok:
err = env.get("error") or {}
raise ApiError(r.status_code, err.get("code"), err.get("message") or r.reason)
done = env.get("data")
else:
event, data = "message", ""
for line in r.iter_lines(decode_unicode=True):
if line == "": # a blank line ends a frame
if data:
try:
payload = json.loads(data)
except ValueError:
payload = None
if event == "delta" and payload is not None:
streamed += payload.get("text") or ""
elif event == "job":
print("job", payload)
elif event in ("done", "pending"):
done = payload
elif event == "error":
failure = payload
event, data = "message", ""
elif line.startswith("event:"):
event = line[6:].strip()
elif line.startswith("data:"):
data += line[5:].strip()
if failure:
raise SystemExit(f"{failure.get('code')}: {failure.get('message')} (job {failure.get('job_id')})")
done = done or {}
full = (done.get("output") or {}).get("output") or streamed
print("truncated:", done.get("truncated") is True, "charged:", done.get("charged_credits"))
result = json.loads(full[full.index("{"): full.rindex("}") + 1])
print(result["verdict"], "-", result["headline"])
for f in result.get("files", []):
print("file", f["path"], len(f.get("content") or ""), "characters")
for c in result.get("changes", []):
print("change", c.get("task"), ",".join(c.get("flags") or []) or "-", "-", c.get("change"))
for step in result.get("verify", []):
print("verify", step)
for o in result.get("open", []):
print("open", o["item"], "-", o.get("reason"))
for q in result.get("questions", []):
print("question", q)
// the fix worked example: meridian-check.json from build-check.js
// (for audited code, pass handoff.js's output instead: makeInput adds its audit_handoff)
const fixInput = makeInput("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.");
const fixKey = "vector-desk:fix:" +
createHash("sha256").update(JSON.stringify(fixInput)).digest("hex").slice(0, 16) + ":a1";
const res = await fetch(BASE + "/run-stream", {
method: "POST",
headers: { "Content-Type": "application/json", Authorization: "Bearer " + token, "Idempotency-Key": fixKey },
body: JSON.stringify(fixInput),
});
let done = null, failure = null, streamed = "";
if (!(res.headers.get("content-type") || "").includes("text/event-stream")) {
const json = await res.json().catch(() => ({}));
if (!res.ok) throw new Error((json.error && json.error.message) || res.statusText);
done = json.data;
} else {
const reader = res.body.getReader();
const decoder = new TextDecoder();
let buffer = "";
for (;;) {
const chunk = await reader.read();
if (chunk.done) break;
buffer += decoder.decode(chunk.value, { stream: true });
let idx;
while ((idx = buffer.indexOf("\n\n")) >= 0) {
const frame = buffer.slice(0, idx);
buffer = buffer.slice(idx + 2);
let event = "message", dataStr = "";
for (const line of frame.split("\n")) {
if (line.startsWith("event:")) event = line.slice(6).trim();
else if (line.startsWith("data:")) dataStr += line.slice(5).trim();
}
if (!dataStr) continue;
let data;
try { data = JSON.parse(dataStr); } catch { continue; }
if (event === "delta") streamed += data.text || "";
else if (event === "job") console.log("job", data);
else if (event === "done" || event === "pending") done = data;
else if (event === "error") failure = data;
}
}
}
if (failure) throw new Error(`${failure.code}: ${failure.message} (job ${failure.job_id})`);
const full = (done && done.output && done.output.output) || streamed;
console.log("truncated:", !!(done && done.truncated), "charged:", done && done.charged_credits);
const result = JSON.parse(full.slice(full.indexOf("{"), full.lastIndexOf("}") + 1));
console.log(result.verdict, "-", result.headline);
for (const f of result.files || []) console.log("file", f.path, (f.content || "").length, "characters");
for (const c of result.changes || []) console.log("change", c.task, (c.flags || []).join(",") || "-", "-", c.change);
for (const step of result.verify || []) console.log("verify", step);
for (const o of result.open || []) console.log("open", o.item, "-", o.reason);
for (const q of result.questions || []) console.log("question", q);
// the fix worked example: meridian-check.json from build-check.js
// (for audited code, pass handoff.js's output instead: makeInput adds its audit_handoff)
fixInput := makeInput("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.")
fixJSON, _ := json.Marshal(fixInput)
fixSum := sha256.Sum256(fixJSON)
fixKey := "vector-desk:fix:" + hex.EncodeToString(fixSum[:8]) + ":a1"
sreq, err := newRequest("POST", "/run-stream", fixInput, map[string]string{"Idempotency-Key": fixKey})
if err != nil {
panic(err)
}
sres, err := http.DefaultClient.Do(sreq)
if err != nil {
panic(err)
}
defer sres.Body.Close()
var done, failure map[string]any
var streamed strings.Builder
if !strings.Contains(sres.Header.Get("Content-Type"), "text/event-stream") {
var env envelope
_ = json.NewDecoder(sres.Body).Decode(&env)
if sres.StatusCode < 200 || sres.StatusCode > 299 {
panic(errorFrom(sres, env))
}
_ = json.Unmarshal(env.Data, &done)
} else {
sc := bufio.NewScanner(sres.Body)
sc.Buffer(make([]byte, 64*1024), 16*1024*1024) // the done frame can be long
event, data := "message", ""
for sc.Scan() {
line := sc.Text()
switch {
case line == "": // a blank line ends a frame
if data != "" {
var p map[string]any
if json.Unmarshal([]byte(data), &p) == nil {
switch event {
case "delta":
if t, ok := p["text"].(string); ok {
streamed.WriteString(t)
}
case "job":
fmt.Println("job", p)
case "done", "pending":
done = p
case "error":
failure = p
}
}
}
event, data = "message", ""
case strings.HasPrefix(line, "event:"):
event = strings.TrimSpace(line[6:])
case strings.HasPrefix(line, "data:"):
data += strings.TrimSpace(line[5:])
}
}
}
if failure != nil {
panic(fmt.Sprintf("%v: %v (job %v)", failure["code"], failure["message"], failure["job_id"]))
}
full := streamed.String()
if out, ok := done["output"].(map[string]any); ok {
if s, ok := out["output"].(string); ok && s != "" {
full = s
}
}
fmt.Println("truncated:", done["truncated"] == true, "charged:", done["charged_credits"])
var result map[string]any
if a, b := strings.Index(full, "{"), strings.LastIndex(full, "}"); a >= 0 && b > a {
if err := json.Unmarshal([]byte(full[a:b+1]), &result); err != nil {
panic(err)
}
}
fmt.Println(result["verdict"], "-", result["headline"])
files, _ := result["files"].([]any)
for _, e := range files {
f, _ := e.(map[string]any)
c, _ := f["content"].(string)
fmt.Println("file", f["path"], len([]rune(c)), "characters")
}
changes, _ := result["changes"].([]any)
for _, e := range changes {
c, _ := e.(map[string]any)
var flags []string
if fs, ok := c["flags"].([]any); ok {
for _, fl := range fs {
flags = append(flags, fmt.Sprint(fl))
}
}
fl := strings.Join(flags, ",")
if fl == "" {
fl = "-"
}
fmt.Println("change", c["task"], fl, "-", c["change"])
}
verify, _ := result["verify"].([]any)
for _, st := range verify {
fmt.Println("verify", st)
}
open, _ := result["open"].([]any)
for _, e := range open {
o, _ := e.(map[string]any)
fmt.Println("open", o["item"], "-", o["reason"])
}
questions, _ := result["questions"].([]any)
for _, q := range questions {
fmt.Println("question", q)
}
// the fix worked example: meridian-check.json from build-check.js
// (for audited code, pass handoff.js's output instead: makeInput adds its audit_handoff)
Map<String, Object> fixInput = makeInput("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.");
byte[] fixDigest = MessageDigest.getInstance("SHA-256").digest(JSON.writeValueAsBytes(fixInput));
String fixKey = "vector-desk:fix:" + HexFormat.of().formatHex(fixDigest, 0, 8) + ":a1";
HttpRequest sreq = request("POST", "/run-stream", fixInput, Map.of("Idempotency-Key", fixKey)).build();
HttpResponse<Stream<String>> sres = HTTP.send(sreq, HttpResponse.BodyHandlers.ofLines());
JsonNode done = null, failure = null;
StringBuilder streamed = new StringBuilder();
if (!sres.headers().firstValue("content-type").orElse("").contains("text/event-stream")) {
JsonNode env = JSON.readTree(sres.body().collect(Collectors.joining("\n")));
if (env == null) env = JSON.createObjectNode();
if (sres.statusCode() / 100 != 2) throw errorFrom(sres.statusCode(), env);
done = env.path("data");
} else {
String event = "message";
StringBuilder data = new StringBuilder();
Iterator<String> it = sres.body().iterator();
while (it.hasNext()) {
String line = it.next();
if (line.isEmpty()) { // a blank line ends a frame
if (data.length() > 0) {
JsonNode p = null;
try { p = JSON.readTree(data.toString()); } catch (Exception ignored) { }
if (p != null) {
switch (event) {
case "delta": streamed.append(p.path("text").asText("")); break;
case "job": System.out.println("job " + p); break;
case "done": case "pending": done = p; break;
case "error": failure = p; break;
default: break;
}
}
}
event = "message";
data.setLength(0);
} else if (line.startsWith("event:")) event = line.substring(6).trim();
else if (line.startsWith("data:")) data.append(line.substring(5).trim());
}
}
if (failure != null) {
throw new RuntimeException(failure.path("code").asText() + ": " + failure.path("message").asText()
+ " (job " + failure.path("job_id").asText() + ")");
}
String full = done == null ? "" : done.path("output").path("output").asText("");
if (full.isEmpty()) full = streamed.toString();
System.out.println("truncated: " + (done != null && done.path("truncated").asBoolean(false))
+ ", charged: " + (done == null ? "-" : done.path("charged_credits").toString()));
JsonNode result = JSON.readTree(full.substring(full.indexOf('{'), full.lastIndexOf('}') + 1));
System.out.println(result.path("verdict").asText() + " - " + result.path("headline").asText());
for (JsonNode f : result.path("files")) {
System.out.println("file " + f.path("path").asText() + " " + f.path("content").asText("").codePointCount(0, f.path("content").asText("").length()) + " characters");
}
for (JsonNode c : result.path("changes")) {
List<String> flags = new ArrayList<>();
c.path("flags").forEach(fl -> flags.add(fl.asText()));
System.out.println("change " + c.path("task").asText() + " " + (flags.isEmpty() ? "-" : String.join(",", flags))
+ " - " + c.path("change").asText());
}
for (JsonNode step : result.path("verify")) System.out.println("verify " + step.asText());
for (JsonNode o : result.path("open")) System.out.println("open " + o.path("item").asText() + " - " + o.path("reason").asText());
for (JsonNode q : result.path("questions")) System.out.println("question " + q.asText());
# the fix worked example: meridian-check.json from build-check.js
# (for audited code, pass handoff.js's output instead: make_input adds its audit_handoff)
fix_input = make_input("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.")
fix_key = "vector-desk:fix:#{Digest::SHA256.hexdigest(JSON.generate(fix_input))[0, 16]}:a1"
uri, req = build_request("POST", "/run-stream", fix_input, { "Idempotency-Key" => fix_key })
done = failure = nil
streamed = +""
Net::HTTP.start(uri.host, uri.port, use_ssl: true, read_timeout: 300) do |http|
http.request(req) do |res|
unless res["content-type"].to_s.include?("text/event-stream")
env = (JSON.parse(res.body) rescue {})
unless res.is_a?(Net::HTTPSuccess)
raise ApiError.new(res.code.to_i, env.dig("error", "code"), env.dig("error", "message") || res.message)
end
done = env["data"]
next
end
buf = +""
res.read_body do |chunk|
buf << chunk
while (i = buf.index("\n\n"))
frame = buf.slice!(0, i + 2)
event = "message"
data = +""
frame.split("\n").each do |line|
if line.start_with?("event:") then event = line[6..].strip
elsif line.start_with?("data:") then data << line[5..].strip
end
end
next if data.empty?
payload = (JSON.parse(data) rescue nil)
next if payload.nil?
case event
when "delta" then streamed << payload["text"].to_s
when "job" then puts "job #{payload.inspect}"
when "done", "pending" then done = payload
when "error" then failure = payload
end
end
end
end
end
raise "#{failure["code"]}: #{failure["message"]} (job #{failure["job_id"]})" if failure
done ||= {}
full = (done["output"] || {})["output"].to_s
full = streamed if full.empty?
puts "truncated: #{done["truncated"] == true}, charged: #{done["charged_credits"]}"
result = JSON.parse(full[full.index("{")..full.rindex("}")])
puts "#{result["verdict"]} - #{result["headline"]}"
(result["files"] || []).each { |f| puts "file #{f["path"]} #{f["content"].to_s.length} characters" }
(result["changes"] || []).each do |c|
flags = (c["flags"] || []).join(",")
puts "change #{c["task"]} #{flags.empty? ? "-" : flags} - #{c["change"]}"
end
(result["verify"] || []).each { |step| puts "verify #{step}" }
(result["open"] || []).each { |o| puts "open #{o["item"]} - #{o["reason"]}" }
(result["questions"] || []).each { |q| puts "question #{q}" }
// the fix worked example: meridian-check.json from build-check.js
// (for audited code, pass handoff.js's output instead: make_input adds its audit_handoff)
$fixInput = make_input("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.");
$fixKey = "vector-desk:fix:" . substr(hash("sha256", json_encode($fixInput)), 0, 16) . ":a1";
$done = null; $failure = null; $streamed = ""; $buf = ""; $ctype = "";
$handle = function (string $event, string $data) use (&$done, &$failure, &$streamed) {
$p = json_decode($data);
if ($p === null) return; // not JSON: skipped, as sdk.js does
switch ($event) {
case "delta": $streamed .= $p->text ?? ""; break;
case "job": echo "job ", json_encode($p), "\n"; break;
case "done": case "pending": $done = $p; break;
case "error": $failure = $p; break;
}
};
$ch = curl_init(BASE . "/run-stream");
curl_setopt_array($ch, [
CURLOPT_POST => true,
CURLOPT_HTTPHEADER => headers_for(["Idempotency-Key" => $fixKey]),
CURLOPT_POSTFIELDS => json_encode($fixInput, JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE),
CURLOPT_HEADERFUNCTION => function ($ch, $line) use (&$ctype) {
if (stripos($line, "content-type:") === 0) $ctype = strtolower(trim(substr($line, 13)));
return strlen($line);
},
CURLOPT_WRITEFUNCTION => function ($ch, $chunk) use (&$buf, &$ctype, $handle) {
$buf .= $chunk; // collects the response in memory
if (strpos($ctype, "text/event-stream") === false) return strlen($chunk); // plain JSON: parse at the end
while (($i = strpos($buf, "\n\n")) !== false) {
$frame = substr($buf, 0, $i);
$buf = substr($buf, $i + 2);
$event = "message"; $data = "";
foreach (explode("\n", $frame) as $line) {
if (strpos($line, "event:") === 0) $event = trim(substr($line, 6));
elseif (strpos($line, "data:") === 0) $data .= trim(substr($line, 5));
}
if ($data !== "") $handle($event, $data);
}
return strlen($chunk);
},
]);
if (curl_exec($ch) === false) throw new RuntimeException(curl_error($ch));
$status = curl_getinfo($ch, CURLINFO_RESPONSE_CODE);
curl_close($ch);
if (strpos($ctype, "text/event-stream") === false) {
$env = json_decode($buf) ?? new stdClass();
if ($status < 200 || $status > 299) {
throw new ApiError($status, $env->error->code ?? null, $env->error->message ?? "HTTP $status");
}
$done = $env->data ?? null;
}
if ($failure) throw new RuntimeException(($failure->code ?? "") . ": " . ($failure->message ?? "") . " (job " . ($failure->job_id ?? "") . ")");
$full = $done->output->output ?? "";
if ($full === "") $full = $streamed;
echo "truncated: ", json_encode(($done->truncated ?? false) === true), ", charged: ", $done->charged_credits ?? "-", "\n";
$result = json_decode(substr($full, strpos($full, "{"), strrpos($full, "}") - strpos($full, "{") + 1));
echo $result->verdict, " - ", $result->headline, "\n";
foreach ($result->files ?? [] as $f) echo "file ", $f->path, " ", mb_strlen($f->content ?? ""), " characters\n";
foreach ($result->changes ?? [] as $c) {
$flags = implode(",", $c->flags ?? []);
echo "change ", $c->task ?? "", " ", $flags === "" ? "-" : $flags, " - ", $c->change ?? "", "\n";
}
foreach ($result->verify ?? [] as $step) echo "verify ", $step, "\n";
foreach ($result->open ?? [] as $o) echo "open ", $o->item, " - ", $o->reason ?? "", "\n";
foreach ($result->questions ?? [] as $q) echo "question ", $q, "\n";
// the fix worked example: meridian-check.json from build-check.js
// (for audited code, pass handoff.js's output instead: MakeInput adds its audit_handoff)
var fixInput = MakeInput("fix", "meridian-check.json",
"build() stops with an assertion inside faiss. Fix what you can. We train on 200,000 sampled vectors. Leave nprobe for us: we will set it from the recall benchmark we run next week.");
var fixDigest = System.Security.Cryptography.SHA256.HashData(Encoding.UTF8.GetBytes(JsonSerializer.Serialize(fixInput)));
var fixKey = "vector-desk:fix:" + Convert.ToHexString(fixDigest, 0, 8).ToLowerInvariant() + ":a1";
using var sreq = Api.Request("POST", "/run-stream", fixInput, new Dictionary<string, string> { ["Idempotency-Key"] = fixKey });
using var sres = await Api.Http.SendAsync(sreq, HttpCompletionOption.ResponseHeadersRead);
JsonNode? done = null, failure = null;
var streamed = new StringBuilder();
if (sres.Content.Headers.ContentType?.MediaType != "text/event-stream")
{
JsonNode? env = null;
try { env = JsonNode.Parse(await sres.Content.ReadAsStringAsync()); } catch (JsonException) { }
if (!sres.IsSuccessStatusCode) throw Api.ErrorFrom(sres, env);
done = env?["data"];
}
else
{
using var reader = new StreamReader(await sres.Content.ReadAsStreamAsync());
var ev = "message";
var data = new StringBuilder();
string? line;
while ((line = await reader.ReadLineAsync()) != null)
{
if (line.Length == 0) // a blank line ends a frame
{
if (data.Length > 0)
{
JsonNode? p = null;
try { p = JsonNode.Parse(data.ToString()); } catch (JsonException) { }
if (p != null)
{
switch (ev)
{
case "delta": streamed.Append(p["text"]?.GetValue<string>() ?? ""); break;
case "job": Console.WriteLine($"job {p.ToJsonString()}"); break;
case "done": case "pending": done = p; break;
case "error": failure = p; break;
}
}
}
ev = "message";
data.Clear();
}
else if (line.StartsWith("event:")) ev = line[6..].Trim();
else if (line.StartsWith("data:")) data.Append(line[5..].Trim());
}
}
if (failure != null) throw new Exception($"{failure["code"]}: {failure["message"]} (job {failure["job_id"]})");
var full = done?["output"]?["output"]?.GetValue<string>();
if (string.IsNullOrEmpty(full)) full = streamed.ToString();
var cut = done?["truncated"] is JsonValue tv && tv.TryGetValue(out bool cutShort) && cutShort;
Console.WriteLine($"truncated: {cut}, charged: {done?["charged_credits"]}");
var result = JsonNode.Parse(full[full.IndexOf('{')..(full.LastIndexOf('}') + 1)])!;
Console.WriteLine($"{result["verdict"]} - {result["headline"]}");
foreach (var f in result["files"]?.AsArray() ?? new JsonArray())
Console.WriteLine($"file {f?["path"]} {(f?["content"]?.GetValue<string>() ?? "").Length} characters");
foreach (var c in result["changes"]?.AsArray() ?? new JsonArray())
{
var flags = string.Join(",", (c?["flags"]?.AsArray() ?? new JsonArray()).Select(fl => fl?.GetValue<string>()));
Console.WriteLine($"change {c?["task"]} {(flags == "" ? "-" : flags)} - {c?["change"]}");
}
foreach (var step in result["verify"]?.AsArray() ?? new JsonArray()) Console.WriteLine($"verify {step}");
foreach (var o in result["open"]?.AsArray() ?? new JsonArray()) Console.WriteLine($"open {o?["item"]} - {o?["reason"]}");
foreach (var q in result["questions"]?.AsArray() ?? new JsonArray()) Console.WriteLine($"question {q}");
What the page does that you now do
- Reads the paste in the browser and builds
codeandfactsfrom it (vectorkit.js), joining dropped files under# file:lines and cutting a large paste on whole files with a# [vector-desk: not sent: ...]line; you send the same two strings. - Prices every input with
/estimateand refuses to run belowmin_credits, or on a paste with no index or query it can read. - Sends each attempt with an input- and lane-derived
Idempotency-Key, and retries once withretry_notewhen a reply does not parse. - Closes a cut-off JSON reply and shows what arrived when
truncatedis true or the stream ends early. - Hands an audit to the fix lane as
audit_handoff, with every edit applied to the paste first, and only while that edited paste is unchanged. - Checks the reply against the files (
recon.js), in the browser: files, lines, evidence, every edit applied in order with the free check re-run after each finding, flag answers, the operating point against the sweep and the budgets, and the verdict; the fixed files put back, re-checked and matched against the changes list and the open items; every name still there; the workload and the sweep untouched; and repeated credentials.recheck.jsabove runs the same checks for you.
Or skip all of this and use Vector Desk in the browser: the check, the flags, the index, query, memory and sweep tables, putting an edit or the fixed files back into the paste, and the Markdown, CSV and JSON exports are free.