Skip to content

Whisper - add CoreML & Vulkan backends support #1124

@IgorSwat

Description

@IgorSwat

Problem Description

Right now, all the Whisper models are utilized only within the XNNPACK backend. We could extend the support by exporting them to Vulkan & CoreML backends.

What should be done

Export Whisper family models to CoreML & Vulkan if possible.

Benefits to React Native ExecuTorch

Significant speed-up in speech to text module. A possibility of using bigger model (for example: whisper-base) with similar performance but improved accuracy compared to currently standard whisper-tiny.

Metadata

Metadata

Assignees

Labels

modelIssues related to exporting, improving, fixing ML modelsperformanceRelated to all issues and tasks focused on improving performance

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions