Repository navigation
feat: add SenseVoiceSmall as a local subtitle transcription option - #244
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
视频没有字幕时,现在可以在「设置 → 字幕转写」选择 SenseVoice · 本地,准备 SenseVoiceSmall 后保存设置,新任务即通过现有转写入口使用该模型。Whisper 保持默认值,组件和权重按需下载,音频不上传,不自动转向云端。
#67 提到的 fork 已有 SenseVoice 实现,但曾忽略 CTC 词级时间戳,将 45 秒语音压成两条 VAD 长字幕。此次参考 123mlly/autoclip#1 的 MIT 许可修复思路,严格配对 words/timestamp,恢复原文空格、标点并按 42 字符、8 秒上限和停顿生成字幕;无效、不完整、重叠或越界时间轴直接报错,不按字数伪造定位。真实词级信息进入现有带 SRT 内容校验的 sidecar。
FunASR/PyTorch 在数据目录独立安装,并只在子进程导入,避免影响 API 与 Whisper 依赖。增加准备、状态、删除、跨进程互斥、重启中断恢复、本地路由和反馈元数据;设置页及文档链接模型权重许可。Windows 实际落盘约 5.8 GB,首次准备提示预留至少 8 GB(含临时空间),安装包不内置权重。
验证:
范围是 FunASR 1.3.14 + SenseVoiceSmall + FSMN-VAD,CPU 两线程。不启用说话人分离,也不代表所有 FunASR 模型、硅基流动云端 SenseVoice、通用插件框架或长视频质量比较已完成。真实 ASR 测试不替代新增功能的桌面安装包真机验收;尚未发布新的正式安装包。
Closes #67