Renumber spec 001 decision placeholders to D-040–D-051; record the Danish publication

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Lucas WintherandClaude Opus 5.5 committed 2026-10-30 01:47:27 +01:00
1 parent 30969e86b7
commit 0632f7843b
71 files changed
+244 -236

No files matched your search

+16 -16
View File
@@ -66,10 +66,10 @@ Notes (M1):
- [x] Handle model switching (dispose old pipeline, load new)
- [x] Language / task options for multilingual models (transcribe vs translate)
- [x] Whisper translate only on models trained for it (`canTranslate`; hidden for
large-v3-turbo and `.en`, stale "translate" resets to transcribe — D-WS4a)
large-v3-turbo and `.en`, stale "translate" resets to transcribe — D-044)
- [~] Verify quantized variants (q4/q8/fp16) on both backends; record working
combinations in `models.ts`
- [~] Danish fine-tunes (spec 001 Goal 6, D-WS6a): `whisper-small-danish`,
- [~] Danish fine-tunes (spec 001 Goal 6, D-046): `whisper-small-danish`,
`whisper-large-v3-turbo-danish`, `edda-v0.2`. We converted them to ONNX
(fp32/fp16/q8/q4) and CT2 int8 and verified them on CPU. The catalog
entries hang off `DANISH_MODELS_HF_OWNER`. Still pending: the owner's go
@@ -154,7 +154,7 @@ Notes (M4):
Bun (D-013 supersedes the Transformers.js-under-Bun plan); map the shared
model catalog to faster-whisper model ids in `src/lib/models.ts`
- [x] Batched inference + tuned Silero VAD for server-engine file
transcriptions, live passes sequential (spec 001 Goal 5, D-WS5a):
transcriptions, live passes sequential (spec 001 Goal 5, D-047):
≈ 2× faster on CPU int8 at equal-or-better WER; segments ≤ 30 s chunks
- [x] Degrade gracefully when Python/the sidecar is absent (server engine
unavailable; browser engine untouched — anonymous path deploys with Bun alone)
@@ -352,10 +352,10 @@ cached.
## M8 — Transcription quality and speed (spec 001)
- [x] Transformers.js 4.2.0 → 4.3.2, sequential-session patch regenerated
for 4.3.2 and guarded by `tests/transformers-runtime.test.ts` (D-WS1a).
for 4.3.2 and guarded by `tests/transformers-runtime.test.ts` (D-040).
- [x] WASM sessions back at the default graph optimization level: ort-web
1.31.0-dev loads the q8 decoders at every level (D-WS1c supersedes D-014).
- [x] Vocabulary hint "Names and terms" (D-WS2a) — optional field for every
1.31.0-dev loads the q8 decoders at every level (D-043 supersedes D-014).
- [x] Vocabulary hint "Names and terms" (D-048) — optional field for every
model, remembered in localStorage, sent as `prompt` on file and live
passes (browser and server engines); cut to 120 tokens at a whole word.
faster-whisper gets `initial_prompt` only (hotwords measured, no gain).
@@ -364,15 +364,15 @@ cached.
## Spec 001 — Translate (workstream 4)
- [x] `canTranslate` per model; Task control hidden where false; stale
"translate" resets to transcribe (D-WS4a)
"translate" resets to transcribe (D-044)
- [x] Text translation of any finished transcript, da→en / en→da, Opus-MT
in its own worker, sentence-chunked, timestamps kept for exports (D-WS4b)
in its own worker, sentence-chunked, timestamps kept for exports (D-045)
- [~] Real-browser checks: offline translation (`tests/offline.md` §5),
WebGPU-machine speed (owner)
---
## Spec 001 Goal 7 — Parakeet TDT 0.6B v3 (English, desktop, D-WS7a)
## Spec 001 Goal 7 — Parakeet TDT 0.6B v3 (English, desktop, D-051)
- [x] Runtime decision: Transformers.js 4.2.0/4.3.2 have CTC-only Parakeet → parakeet.js on the
shared onnxruntime-web (one runtime in the bundle, `tests/workerBundle.test.ts`).
- [x] Catalog `family` + exact sizes; worker engine path (≤ 30 s windows, word → chunk
@@ -419,27 +419,27 @@ Found while bootstrapping agent docs (D-036); all fixed on 2026-10-29.
— Light theme via tokens + self-hosted Inter (D-037). Also fixed: the
Backend select overflowed its panel on 390 px-wide phones.
- [ ] An English "Names and terms" hint can pull a short Danish live window
toward English words (one 2 s da_festuge snippet on turbo, D-WS2a).
toward English words (one 2 s da_festuge snippet on turbo, D-048).
Not addressed: suggest same-language hints if it shows up in use.
Found while building transcript translation (D-WS4b), 2026-10-29:
Found while building transcript translation (D-045), 2026-10-29:
- [ ] Transformers.js 4.2 batched Marian generation returns row 0's output for
every row of a padded batch, so translation runs one sentence per call
(~4× slower than batch 8 would be). Re-check after the 4.3 upgrade with
`bun scripts/bench-translate.ts` ("output identical" across batch sizes).
- [ ] The server API still accepts `task: "translate"` with large-v3-turbo
(only the UI hides it, D-WS4a).
(only the UI hides it, D-044).
Found in spec 001 workstream 6 (D-WS6a), open:
Found in spec 001 workstream 6 (D-046), open:
- [ ] Transformers.js 4.2 has no beam search: `num_beams > 1` in a model's
`generation_config.json` (edda-v0.2 ships 5) silently decodes greedily
and does a full-vocabulary top-k per step (D-WS6a). Not fixed: it would
and does a full-vocabulary top-k per step (D-046). Not fixed: it would
mean overriding `num_beams: 1` in the worker, or a patch.
- [ ] On `da_festuge`, neither Danish turbo fine-tune beats the stock turbo
(D-WS6a). Judging them needs a longer, harder Danish reference clip than
(D-046). Judging them needs a longer, harder Danish reference clip than
this repo has.
Found while building the long-form pipeline (spec 001 Goal 3, D-WS3a), 2026-10-29:
Found while building the long-form pipeline (spec 001 Goal 3, D-049), 2026-10-29:
- [ ] "Auto-detect" on the default (chunked) file path does not detect: with no
`language`, Transformers.js 4.2 logs "No language specified - defaulting to
English" and decodes Danish audio as an English translation (da_festuge WER