How to Run Qwen3.6-35B-A3B-NVFP4 For Low VRAM (6GB/8GB) 5-Minute Setup Windows
- 30/06/2026
- Templates
The most rapid route to a local installation of this model is through WSL2. Follow the guidelines below to continue. The script... Read More
If you want the fastest local installation for this model, use Docker.
Simply follow the directions outlined below.
>
The installer auto-downloads and deploys the entire model pack.
The setup file includes an intelligent feature that instantly optimizes all configurations for your hardware profile.
The granite-embedding-small-english-r2 model delivers compact yet powerful embeddings for English text, designed for tasks requiring both speed and accuracy. It leverages a refined architecture that balances model size with semantic richness, enabling robust performance on downstream NLP tasks such as classification and retrieval. With a context window of up to 512 tokens, the model captures nuanced relationships across longer passages while maintaining low computational overhead. The embedding vectors are optimized for high-dimensional fidelity, providing discriminative power that rivals larger models in benchmark evaluations. The following table summarizes its core technical specifications:
| Model | granite-embedding-small-english-r2 |
| Parameters | approx. 120M |
| Context Length | 512 tokens |
| Embedding Dim | 768 |
| Training Data | web-scale English corpora |
This combination of efficiency and capability makes it an ideal choice for production environments where resources are constrained but high-quality semantic understanding is essential.
Join The Discussion