i5ucc / vrctextboxstt Goto Github PK

A SpeechToText application that uses OpenAI's whisper via faster-whisper to transcribe audio and send that information to VRChats textbox system and/or KillFrenzyAvatarText over OSC. Also supports various other methods like OBS via Browsersource and a SteamVR overlay!

License: GNU General Public License v3.0

Python 94.80% HTML 1.16% Batchfile 0.68% C# 3.36%

openai openai-whisper openvr osc vrchat-osc whisper speech-recognition speech-to-text obs vrchat

vrctextboxstt's People

Contributors

Stargazers

Watchers

Forkers

suzedash xiaoyi8383 wishdream

vrctextboxstt's Issues

Copying to Clipboard

Discussed in #7

^{Originally posted by Mage-Enderman July 21, 2023}
As typing in VR is difficult even with good keyboard like XSOverlay, Oculus Link, Desktop+, etc
I think it'd be really good to have a button to copy the text from what you've said to be able to paste it to other places like Discord

Implement as follows:

A copy button, that copies the last transcription to clipboard at will.
Automatic copying, it just writes to clipboard every time the transcription has finished.
The button will be the default, automatic will be a setting that people can switch to.

SteamVR overlay

Would be good to add a timeout for the text in steamvr's overlay so it doesn't stay there forever

Translate speech in various languages into English

Is this feature possible if you have spare time?Thank you so much for considering this request.

Custom Fonts

Feature request on Discord: https://discord.com/channels/1069609487805202552/1186947020758454332

Problem : CascadiaCode does not currently support Chinese Japanese Korean characters

Request : Would like to have a feature that enables user select custom fonts.

Add a feature that lets you choose any given font. Probably for both the Overlay and the Program itself.
Probably use a folder specifically for fonts, that can get loaded into the program on startup.

OBS Source enabled and tried the "OBS only" option

"http://localhost:5000/"

Error response

Error code: 404

Message: Not Found.

Error code explanation: 404 - Nothing matches the given URI.

Why is it sending "/avatar/parameters/KAT_Pointer"?

Discussed in #15

^{Originally posted by Mage-Enderman October 12, 2023}
Even with use KAT set to off I've noticed it's continuously sending "/avatar/parameters/KAT_Pointer"

Custom message formats

Feature request on Discord: https://discord.com/channels/1069609487805202552/1186920811534241802

Problem : When translation is enabled, the original transcription is overwritten

Request : Would like to have a feature that enables user to put both transcription and translation in the same message ( or in a format they choose )

Enable either customization for formatting or just add a toggle to show both in a fixed format.

OBS Browser Source seems to do absolutely nothing

I've added the HTML file to a Browser source in OBS
I've added http://localhost:5000 as a URL too
Neither seem to show any text when I type in to the TextboxSTT app
and similarly also show nothing when I use the Speech to Text function
Idk what I'm doing wrong as there's no documentation on the OBS Source option

OBS Source URL Just errors