Description:
The tool currently uses a single, large embedding model by default, which can consume excessive memory.
Provide a model selection option (e.g., small, base, large) so users can choose a model that fits their device’s capabilities.
Benefits:
- Reduces memory usage on devices with limited RAM.
- Lets users balance speed and accuracy according to their needs.
Description:
The tool currently uses a single, large embedding model by default, which can consume excessive memory.
Provide a model selection option (e.g., small, base, large) so users can choose a model that fits their device’s capabilities.
Benefits: