Problem Description
Right now, all the Whisper models are utilized only within the XNNPACK backend. We could extend the support by exporting them to Vulkan & CoreML backends.
What should be done
Export Whisper family models to CoreML & Vulkan if possible.
Benefits to React Native ExecuTorch
Significant speed-up in speech to text module. A possibility of using bigger model (for example: whisper-base) with similar performance but improved accuracy compared to currently standard whisper-tiny.
Problem Description
Right now, all the Whisper models are utilized only within the XNNPACK backend. We could extend the support by exporting them to Vulkan & CoreML backends.
What should be done
Export Whisper family models to CoreML & Vulkan if possible.
Benefits to React Native ExecuTorch
Significant speed-up in speech to text module. A possibility of using bigger model (for example:
whisper-base) with similar performance but improved accuracy compared to currently standardwhisper-tiny.