Offline Voice Input, auto detect language

[JustaRandom]

Describe the bug
Voice Recognition Language is acting weird when a language or Auto is selected.
It does translate automatically what I say in other languages (French, German) into English and the reverse is the same.

To Reproduce
Change the setting from Offline Voice Input --> Voice Recognition Language to Auto-Detect spoken language, or any languages. And speak.

Expected behavior
I do expect that when spoken in French or German languages, it type what was is said in said language or if Auto is selected that it does not choose the system language.

Extra
Changing Voice Recognition Language to French or German. It does work correctly but just for selected language.

App version & Flavor
V4.1.2 Github - Offline

Device Info

• Model: Poco F3
• OS version: Pixel Os Android 16.2

[LeanBitLab]

auto detection is not reliable, thats the reason i added the manual option, try larger whisper models like distil whisper, if the issue persist then we can confirm the detection need optimisation in leantype too

[JustaRandom]

Just loader the small model from Huggingface
https://huggingface.co/distil-whisper/distil-small.en <-- This is super slow on device compared to yours "ggml-small-q5_1.bin"
On auto does not detect the other speaking languages. Even when manually selected. Just English maybe I do something wrong.
Did a test on the FUTO voice pack as well. Same problem, no Auto, can manual select.
https://keyboard.futo.tech/voice-input-models

Hope this was the feedback you wanted.

[LeanBitLab]

i think this mostly depend on the model we use, the larger the model slower the process but will be more accurate and it will be also depend on the hours of training data it have, my own languages only less than a hour of data trained, ill check if there is anything we can do to improve the auto lang detection

[LeanBitLab]

Just loader the small model from Huggingface https://huggingface.co/distil-whisper/distil-small.en <-- This is super slow on device compared to yours "ggml-small-q5_1.bin" On auto does not detect the other speaking languages. Even when manually selected. Just English maybe I do something wrong. Did a test on the FUTO voice pack as well. Same problem, no Auto, can manual select. https://keyboard.futo.tech/voice-input-models

Hope this was the feedback you wanted.

[JustaRandom]

Hi,
Tried different models, mainly https://huggingface.co/ggerganov/whisper.cpp and downloaded the small 466 MiB multi-languages.
The problem is still the automatic languages selection. Other than that when selecting specific languages it does work.