From 2a1c24ebe5a2a4a3cf8e1c227fb6e69bb75d24d5 Mon Sep 17 00:00:00 2001 From: axiomlogicnexus Date: Thu, 21 May 2026 17:55:27 +0200 Subject: [PATCH] Backfill speech doctrine and narrow Phase 6R-F --- docs/REPO_LICENSE_TRACKING.md | 37 ++- ...SCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md | 15 +- ...ESTRATION_PREPARATION_PACKET_2026-05-21.md | 218 ++++++++++++++++++ ...PERTWIST_IMPLEMENTATION_PHASE_1_KICKOFF.md | 8 +- .../HyperTwist/FEATURE_REGISTRY.md | 2 +- .../HyperTwist/ROADMAP.md | 27 ++- 6 files changed, 285 insertions(+), 22 deletions(-) create mode 100644 docs/arch/HYPERTWIST_PHASE6R_F_FASTER_WHISPER_TRANSCRIPTION_ORCHESTRATION_PREPARATION_PACKET_2026-05-21.md diff --git a/docs/REPO_LICENSE_TRACKING.md b/docs/REPO_LICENSE_TRACKING.md index a821af5..8b72350 100644 --- a/docs/REPO_LICENSE_TRACKING.md +++ b/docs/REPO_LICENSE_TRACKING.md @@ -124,21 +124,28 @@ Status update on `2026-05-21`: - `vivaansinghvi07/rubix-cube-solver` remains partially incorporated - the bounded permissive `Phase 6R-D` `roice3/MagicTile` tiling topology and geometry-family packet is now landed in current code -- `roice3/MagicTile` remains partially incorporated; the current next bounded move is a - source-backed `Phase 6R-E` speech-input / voice sidecar preparation/control pass, starting with - `ggml-org/whisper.cpp`, not a new restrictive packet by default +- `roice3/MagicTile` remains partially incorporated +- the bounded permissive `Phase 6R-E` `ggml-org/whisper.cpp` speech transcript session packet is + now landed in current code +- `ggml-org/whisper.cpp` remains partially incorporated +- the provider-family backfill now keeps the top-level speech/provider contract explicitly + first-party and provider-neutral +- the generic source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` control pass is now consumed +- the current next bounded move is the bounded permissive `Phase 6R-F` `SYSTRAN/faster-whisper` + implementation packet for the Python transcription-service orchestration profile, not a new + restrictive packet by default - use the repo-row README census, the portfolio standing refresh backfill, and the `2R-A` ownership contract for the current queue after that correction This file now also preserves the current truth that future models must not lose: - current curated HyperTwist shallow-eval set: `75` repos -- currently verified live/implemented in checked `UnrealHyperTwist` surfaces: `28` -- permissive live lanes: `17` +- currently verified live/implemented in checked `UnrealHyperTwist` surfaces: `29` +- permissive live lanes: `18` - boundary-sensitive live lanes: `6` - restrictive live lanes: `5` -The seventeen permissive live lanes are: +The eighteen permissive live lanes are: - `Aarav2709/KubeTimr` - `HactarCE/Hyperspeedcube` @@ -157,6 +164,7 @@ The seventeen permissive live lanes are: - `poliva/cubedex` - `newyork-anthonyng/rubiks-cross-trainer` - `roice3/MagicTile` +- `ggml-org/whisper.cpp` The six boundary-sensitive live lanes are: @@ -227,8 +235,8 @@ Current practical interpretation: - the landed `PostHog/posthog` boundary-sensitive widening packet now lives in `docs/HYPERTWIST_PHASE_4R_PACKET_4R_D_POSTHOG_CONTROL_PLANE_IMPLEMENTATION_2026-05-13.md` - the landed `screenpipe/screenpipe` boundary-sensitive widening packet now lives in `docs/HYPERTWIST_PHASE_4R_PACKET_4R_E_SCREENPIPE_CAPTURE_HISTORY_IMPLEMENTATION_2026-05-13.md` - the landed `remotion-dev/remotion` boundary-sensitive widening packet now lives in `docs/HYPERTWIST_PHASE_4R_PACKET_4R_F_REMOTION_MEDIA_EXPORT_IMPLEMENTATION_2026-05-13.md` -- the next bounded move is a source-backed `Phase 6R-E` speech-input / voice sidecar - preparation/control pass, starting with `ggml-org/whisper.cpp` +- the next bounded move is the bounded permissive `Phase 6R-F` `SYSTRAN/faster-whisper` + implementation packet for the Python transcription-service orchestration profile Companion docs: @@ -1422,6 +1430,8 @@ Approved working posture: - keep it bounded behind a speech-input seam - prefer command, dictation, and constrained coach-interaction use over broad “voice assistant platform” scope - the first bounded permissive implementation slice is now landed as a speech transcript session boundary above the existing companion listening lifecycle +- the top-level provider/session contract remains first-party HyperTwist-owned and + provider-neutral; this row does not own that lane - keep model files, downloadable payloads, and future voice-asset review separate from the code-license judgment - treat `SYSTRAN/faster-whisper` as the next complementary queue head for Python orchestration rather than widening `whisper.cpp` into the runtime core @@ -1431,6 +1441,7 @@ Decision date: - `2026-04-24` - refreshed on `2026-05-13` +- refreshed on `2026-05-21` Current licensing judgment: @@ -1456,7 +1467,15 @@ Approved working posture: - HyperTwist may use the codebase directly as the primary Python STT donor/service-layer candidate under the `MIT` code posture - keep it bounded behind a transcription-service seam rather than letting it shape the gameplay/runtime core -- treat it as complementary to `ggml-org/whisper.cpp`: prefer `whisper.cpp` for harder native/runtime boundaries and `faster-whisper` for Python orchestration, batch transcription, and rapid feature delivery +- the top-level provider/session contract remains first-party HyperTwist-owned and + provider-neutral; this row does not own that lane +- treat it as complementary to `ggml-org/whisper.cpp`: prefer `whisper.cpp` for harder + native/runtime boundaries and `faster-whisper` for Python orchestration, batch transcription, + richer VAD/clip orchestration, prompt hints, and rapid feature delivery +- the first bounded `Phase 6R-F` implementation slice is now fixed to: + - Python transcription-service orchestration profile +- keep model files, downloadable payloads, and future voice-asset review separate from the + code-license judgment ### `PostHog/posthog` diff --git a/docs/arch/HYPERTWIST_PHASE6R_E_WHISPER_CPP_SPEECH_TRANSCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md b/docs/arch/HYPERTWIST_PHASE6R_E_WHISPER_CPP_SPEECH_TRANSCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md index d33a01e..ed3d71f 100644 --- a/docs/arch/HYPERTWIST_PHASE6R_E_WHISPER_CPP_SPEECH_TRANSCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md +++ b/docs/arch/HYPERTWIST_PHASE6R_E_WHISPER_CPP_SPEECH_TRANSCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md @@ -38,6 +38,13 @@ The retained owner remains: - `ggml-org/whisper.cpp` +The top-level provider/session contract owner does not change here: + +- first-party HyperTwist remains the provider-neutral `A1 / R1 / F1` owner for the speech + provider-contract lane +- this packet keeps `ggml-org/whisper.cpp` bounded to the narrower `A1 / R1 / F2` + transcript-session donor slice only + The granted family remains bounded to: - speech session configuration @@ -144,9 +151,13 @@ This packet consumes the current `Phase 6R-E` implementation slice. The next clean move is not another immediate `whisper.cpp` widening by default. -The next queue head should be: +The later same-day provider-family backfill and control pass keeps the queue interpretation narrow: -- a source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` preparation/control pass +- first-party HyperTwist remains the top-level provider-neutral speech contract owner +- `SYSTRAN/faster-whisper` may widen only as the bounded Python transcription-service + orchestration donor slice +- `ggml-org/whisper.cpp` does not inherit Python orchestration or broad provider ownership by + implication Keep the future sequencing guards visible: diff --git a/docs/arch/HYPERTWIST_PHASE6R_F_FASTER_WHISPER_TRANSCRIPTION_ORCHESTRATION_PREPARATION_PACKET_2026-05-21.md b/docs/arch/HYPERTWIST_PHASE6R_F_FASTER_WHISPER_TRANSCRIPTION_ORCHESTRATION_PREPARATION_PACKET_2026-05-21.md new file mode 100644 index 0000000..ac13b0e --- /dev/null +++ b/docs/arch/HYPERTWIST_PHASE6R_F_FASTER_WHISPER_TRANSCRIPTION_ORCHESTRATION_PREPARATION_PACKET_2026-05-21.md @@ -0,0 +1,218 @@ +# HyperTwist Phase 6R-F faster-whisper transcription orchestration preparation packet + +Created on `2026-05-21` + +## Status + +- current preparation authority +- bounded post-`Phase 6R-E` control slice +- the first bounded implementation slice should land separately after this packet + +## Purpose + +This packet freezes the next widening order after the landed `Phase 6R-E` `ggml-org/whisper.cpp` +speech transcript-session slice. + +The open task was: + +- define the first bounded source-backed widening packet for `SYSTRAN/faster-whisper` as the + retained Python transcription-service orchestration profile above the already landed first-party + speech session boundary + +It is not: + +- a full `faster-whisper` row transplant +- a replacement for the first-party HyperTwist provider-neutral speech contract +- a live microphone capture or device-permission packet +- a model checkout, payload-shipping, or model-card approval packet +- a real-time streaming or diarization packet +- a `rhasspy/piper` or `coqui-ai/TTS` voice-output packet +- a broad assistant-platform packet + +## Current authority basis + +This preparation packet stands on already-closed authority: + +- `docs/REPO_LICENSE_TRACKING.md` +- `docs/v6_5_deep_manual_pack/HyperTwist/ROADMAP.md` +- `docs/ops/HYPERTWIST_PROVIDER_NEUTRALITY_AND_BYOK_DOCTRINE_2026-05-21.md` +- `docs/arch/HYPERTWIST_PHASE6R_E_WHISPER_CPP_SPEECH_TRANSCRIPT_IMPLEMENTATION_PACKET_2026-05-21.md` + +The key accepted routing facts are: + +- first-party HyperTwist already owns the top-level provider-neutral speech/session contract lane +- `ggml-org/whisper.cpp` already owns the landed offline/native transcript-session donor slice +- `SYSTRAN/faster-whisper` is the next retained donor for Python-side transcription-service + orchestration +- the donor value there is strongest for: + - batched decoding orchestration + - VAD-aware clip orchestration + - word-timestamp and transcript-metadata shaping + - prompt-hint surfaces such as `prefix` and `hotwords` + - language-detection and chunking controls +- ownership denied there is: + - do not let the row absorb the top-level provider contract + - do not let the row absorb BYOK/profile custody + - do not widen into microphone capture or permission shell ownership + - do not widen into downloadable model or payload review + - do not widen into TTS or broad voice-output ownership + - do not widen into a broad assistant platform + +## Why this was the next packet + +The earlier retained queue heads were already landed: + +- `Phase 6R-A` `HactarCE/Hyperspeedcube` +- `Phase 6R-B` `kkoomen/qbr` +- `Phase 6R-C` `vivaansinghvi07/rubix-cube-solver` +- `Phase 6R-D` `roice3/MagicTile` +- `Phase 6R-E` `ggml-org/whisper.cpp` + +That advanced the live queue to: + +- `Phase 6R-F` `SYSTRAN/faster-whisper` + +with the later adjacent retained rows ordered behind it: + +- `rhasspy/piper` +- `coqui-ai/TTS` + +## Required result + +The source-backed control pass for this packet is now complete. + +The first actual `6R-F` implementation packet should: + +- preserve the first-party provider-neutral speech contract as owner +- define one bounded retained slice from `faster-whisper` +- keep the slice inside the accepted speech-input seam +- widen only the first Python orchestration family that can stand on its own without dragging in + model shipping, provider-profile custody, or voice-output scope +- explicitly state which neighboring retained rows stay closed in that packet + +## Source-backed retained basis + +The queue-head decision is now source-backed rather than README-only. + +Inspected retained donor basis: + +- `README.md` +- `setup.py` +- `faster_whisper/transcribe.py` +- `faster_whisper/vad.py` +- `tests/test_transcribe.py` + +Inspected first-party receiving basis: + +- `UnrealHyperTwist/Source/UnrealHyperTwist/Public/HyperTwistRecognition/HyperTwistRecognitionTypes.h` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Public/HyperTwistRecognition/HyperTwistSpeechClient.h` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Private/HyperTwistRecognition/HyperTwistHttpSpeechClient.cpp` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Private/HyperTwistRecognition/HyperTwistMockSpeechClient.cpp` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Public/HyperTwistTraining/HyperTwistTrainingSubsystem.h` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Private/HyperTwistTraining/HyperTwistTrainingSubsystem.cpp` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Public/HyperTwistBootstrap/HyperTwistContractLibrary.h` +- `UnrealHyperTwist/Source/UnrealHyperTwist/Private/HyperTwistBootstrap/HyperTwistContractLibrary.cpp` + +## Narrowed 6R-F slice decision + +The first widening slice is fixed as: + +1. Python transcription-service orchestration profile above the existing first-party speech session + boundary + +not as the broader speech-input or provider platform. + +That narrowed slice covers: + +- first-party transcription-orchestration request policy for: + - batching + - chunk length / clip segmentation + - prompt-hint routing: + - `prefix` + - `hotwords` + - language-detection thresholds and segment-count policy + - condition-on-previous-text and word-timestamp request posture +- first-party transcript metadata shape for orchestration-aware results +- direct-donor speech-client seam updates for: + - mock coverage + - HTTP-sidecar request/response normalization +- active subsystem normalization of the bounded orchestration profile +- focused automation coverage + +## A/R/F clarification by slice + +Provider contract lane: + +- first-party HyperTwist +- `A1 / R1 / F1` + +Landed offline/native transcript-session slice: + +- `ggml-org/whisper.cpp` +- `A1 / R1 / F2` + +Chosen next Python orchestration slice: + +- `SYSTRAN/faster-whisper` +- `A1 / R1 / F2` + +These are different slices. + +Do not let the donor that wins the orchestration slice inherit the provider-contract lane by +accident. + +## Deferred neighboring families + +The first `6R-F` implementation packet must keep these capability families closed: + +- live microphone capture shell +- device-permission shell +- downloadable model checkout, packaging, or payload shipping +- worker-process management beyond the bounded request/response orchestration seam +- real-time streaming, diarization, or broad assistant-platform scope +- provider-profile, BYOK, or OpenAI-compatible endpoint custody +- TTS or voice-output ownership + +## Why this slice is first + +- `faster-whisper` is strongest where the retained donor adds orchestration controls above the + already landed transcript-session contract: + - batch size + - clip/VAD control + - prompt hints + - word timestamps + - language detection +- current first-party code already has a bounded speech session boundary, but it does not yet own a + richer Python orchestration profile for that seam +- keeping model, payload, provider-profile, and voice decisions outside this packet preserves + swapability, provider neutrality, and cleaner legal review + +## Out of scope for the first 6R-F packet + +- microphone capture +- downloadable model checkout or packaging +- provider-profile and BYOK custody +- generic provider dashboarding or usage accounting +- TTS / voice output +- `rhasspy/piper` or `coqui-ai/TTS` +- broad assistant or narration platform work + +## Acceptance criteria + +- the packet records why the live queue advanced from landed `6R-E` to `6R-F` +- the packet records that the first `6R-F` widening slice is the Python transcription-service + orchestration profile only +- the packet states exact out-of-scope families for the first `6R-F` pass +- the packet keeps the speech-lane legal sequencing guard visible: + - keep code-license judgments separate from model, voice, and payload-license review +- the packet keeps the provider-neutrality guard visible: + - first-party HyperTwist remains the top-level provider-contract owner + +## Validation checklist + +1. confirm the landed `Phase 6R-E` packet is the consumed prior queue head +2. confirm the retained `faster-whisper` seam narrows cleanly to the orchestration profile +3. confirm the next implementation packet is framed as bounded source-backed widening rather than a + Python speech-platform transplant + +That is the packet. diff --git a/docs/ops/HYPERTWIST_IMPLEMENTATION_PHASE_1_KICKOFF.md b/docs/ops/HYPERTWIST_IMPLEMENTATION_PHASE_1_KICKOFF.md index 791efb1..39357ee 100644 --- a/docs/ops/HYPERTWIST_IMPLEMENTATION_PHASE_1_KICKOFF.md +++ b/docs/ops/HYPERTWIST_IMPLEMENTATION_PHASE_1_KICKOFF.md @@ -79,11 +79,11 @@ Use these as the current governing docs: The next bounded move remains: -1. source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` preparation/control - pass +1. bounded permissive `Phase 6R-F` `SYSTRAN/faster-whisper` + implementation packet 2. keep it complementary to `ggml-org/whisper.cpp` -3. keep the first widening slice bounded to Python-side transcription-service - orchestration +3. keep the first widening slice bounded to the Python transcription-service + orchestration profile 4. keep model/payload review separate from code-license judgment ## Memory-specific sequencing rule diff --git a/docs/v6_5_deep_manual_pack/HyperTwist/FEATURE_REGISTRY.md b/docs/v6_5_deep_manual_pack/HyperTwist/FEATURE_REGISTRY.md index a0e30ec..4cb6deb 100644 --- a/docs/v6_5_deep_manual_pack/HyperTwist/FEATURE_REGISTRY.md +++ b/docs/v6_5_deep_manual_pack/HyperTwist/FEATURE_REGISTRY.md @@ -181,7 +181,7 @@ repo. |---|---|---|---| | Speech transcript session boundary | Implemented now | landed `whisper.cpp` packet | Current bounded STT truth. | | Provider-backed speech session health and transcript envelopes | Implemented now | first-party speech client surfaces | Current first-party speech seam. | -| Python transcription-service orchestration | Deep-source grounded retained | `faster-whisper` queue head | Next bounded queue move, not yet implemented. | +| Python transcription-service orchestration profile | Deep-source grounded retained | `faster-whisper` source-backed queue head | Bounded to batching, clip/VAD control, prompt hints, language detection, and transcript metadata orchestration; not yet implemented. | | Voice output / narration sidecars | Deep-source grounded retained | `piper`, `coqui-ai/TTS` retained rows | Retained for later bounded work. | | Broad live microphone shell and downloadable payload shipping | Deep-source grounded retained | speech stack retained remainder | Explicitly deferred. | diff --git a/docs/v6_5_deep_manual_pack/HyperTwist/ROADMAP.md b/docs/v6_5_deep_manual_pack/HyperTwist/ROADMAP.md index 266945f..a9fb330 100644 --- a/docs/v6_5_deep_manual_pack/HyperTwist/ROADMAP.md +++ b/docs/v6_5_deep_manual_pack/HyperTwist/ROADMAP.md @@ -62,8 +62,11 @@ Canonical discovery surfaces for roadmap interpretation: now landed in current code - `ggml-org/whisper.cpp` remains partially incorporated; live microphone capture, model/payload shipping, Python orchestration, and voice-output ownership stay deferred -- the current next bounded move is a source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` - preparation/control pass +- the later provider-family backfill keeps the top-level provider/session contract first-party and + provider-neutral rather than donor-owned +- the generic source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` control pass is now consumed +- the current next bounded move is a bounded permissive `Phase 6R-F` `SYSTRAN/faster-whisper` + implementation packet for the Python transcription-service orchestration profile - the repo-row implementation queue is now live from that `Phase 6R-A` entry point rather than waiting on another first-party packet @@ -125,8 +128,8 @@ Current routing truth: - active non-live implementation-board rows: `35` - retained benchmark, oracle, or clean-room-later rows outside the active implementation board: `9` -The next bounded move is a source-backed `Phase 6R-F` `SYSTRAN/faster-whisper` -preparation/control pass. +The next bounded move is a bounded permissive `Phase 6R-F` +`SYSTRAN/faster-whisper` implementation packet. Queue interpretation after that packet: @@ -183,12 +186,24 @@ Queue interpretation after that packet: - Python orchestration / batching / hotword service layer - TTS or voice-output ownership - broad assistant-platform scope -- after the `Phase 6R-E` implementation packet, keep the next queue shape explicit: - - `SYSTRAN/faster-whisper` +- `SYSTRAN/faster-whisper` is now source-backed and narrowed as a partially retained row rather + than a generic future placeholder: + - next implementation slice: + - Python transcription-service orchestration profile + - still deferred: + - microphone capture shell + - provider-profile and BYOK custody + - downloadable model or payload shipping + - TTS or voice-output ownership + - broad assistant-platform scope +- after the `Phase 6R-F` implementation packet, keep the next queue shape explicit: - `rhasspy/piper` - `coqui-ai/TTS` - keep the speech-input / voice sidecar legal sequencing guard visible: - keep code-license judgments separate from model, voice, and payload-license review +- keep the provider-neutral speech-lane guard visible: + - first-party HyperTwist owns the top-level provider/session contract + - `whisper.cpp` and `faster-whisper` may win narrower donor slices without inheriting that lane - keep the optional `Phase 3R-G` browser comparison lane deferred unless the landed primary browser spatial stack exposes a real gap