Qwen3 Reranker 0.6B GGUF Q5 K M Alternatives

Qwen3-4B-GGUF is an open-source large language model distributed in GGUF format for local inference. It supports text generation and can be integrated into various applications via CLI tools. Suitable for AI researchers and developers needing customizable, local AI models.

Qwen3-0.6B-GGUF is an open-source language model checkpoint in GGUF format, suitable for local inference and experimentation. It enables developers to run, fine-tune, or integrate a compact LLM into their applications or research workflows.

Qwen3-1.7B-GGUF is an open-source checkpoint of the Qwen3 language model in GGUF format, designed for local inference and text generation. It is suitable for developers and researchers who want to integrate or experiment with large language models in their own environments.

Qwen3.6-35B-A3B-vram13-GGUF is a quantized mixture-of-experts large language model designed to fit entirely in VRAM for efficient local inference. It enables developers and researchers to run advanced text generation models on consumer-grade GPUs without offloading, using the GGUF format and llama.cpp compatibility.

Qwen3.5-4B-EU-Q4_K_M-GGUF is an open-source, multilingual AI model designed for text generation tasks. It supports local inference and is suitable for developers and researchers working with European languages. Distributed under the Apache 2.0 license.

Qwen3-ASR-0.6B-gguf is an open source automatic speech recognition model supporting over 30 languages. It is designed for developers and researchers needing accurate speech-to-text transcription in multilingual contexts.

Qwen3-0.6B-GGUF-Quantized is an open-source, quantized large language model distributed via Hugging Face. It is designed for efficient local inference, text generation, and research, supporting Python integration and customization. Ideal for developers and researchers seeking lightweight, modifiable AI models.

Qwen3-1.7B-AutoRound-W4A16-RTN is an open-source large language model hosted on Hugging Face, designed for text generation and inference. It enables developers and researchers to access, fine-tune, and deploy the model for various NLP tasks. The model is accessible via API and CLI and supports self-hosted deployment.

Qwen3.5-0.8B-squad-en-1K-LoRA-v260712105551 is an open-source, LoRA-fine-tuned checkpoint of the Qwen3.5 language model, optimized for NLP tasks such as question answering. Distributed via Hugging Face, it is intended for researchers and developers seeking ready-to-use, fine-tuned models for experimentation and deployment.

Qwen3.5-9B-IQ4_NL-GGUF is an open-source checkpoint of the Qwen 3.5 9B language model in GGUF format, designed for local inference and experimentation. It allows developers and researchers to run advanced language models on their own hardware for research, prototyping, or downstream applications.

Qwen3.6-35B-A3B-MXFP4-MOE-Fast-GGUF is an open-source, large-scale language model supporting both CLI and desktop environments. It is designed for developers and researchers who need high-performance, local text generation capabilities.

Qwen3.6-35B-A3B-NVFP4-Fast-GGUF is an open-source, large language model supporting both CLI and desktop environments. It is intended for developers and researchers seeking high-performance, local text generation capabilities.

Qwen3.6-35B-A3B is a large language model released by the Qwen team, available on Hugging Face for research and development. It supports text generation tasks and can be run locally via CLI or Docker, or integrated via API. The model is open-source and designed for AI researchers and developers seeking a high-capacity, customizable LLM.

Qwen3.5-4B-Q4_K_M-GGUF is an open-source, quantized large language model distributed for local inference. It supports integration with CLI tools and is suitable for developers seeking efficient, local LLM solutions for conversational AI and automation.

Qwen3.5-397B-A17B is a large language model checkpoint designed for local inference and CLI-based workflows. It enables developers and researchers to run advanced language models on their own hardware for experimentation and application development.

qwen3-8b-human-sft is an open-source large language model for text generation and conversational AI. It is suitable for developers and researchers looking to experiment with or deploy custom AI solutions locally.

Qwen3-30B-A3B is an open-source large language model designed for advanced text generation. Distributed under the Apache 2.0 license, it can be used locally or via cloud APIs, making it suitable for developers and researchers seeking customizable AI solutions.

qwen-3.5-4b-fashion-GGUF is an open-source large language model in GGUF format, suitable for local inference and AI research. It allows developers to run advanced language models on their own hardware for experimentation and development.

Qwen3-TTS-GGUF is an open-source text-to-speech AI model distributed via Hugging Face. It allows developers and researchers to perform local voice synthesis and create custom voices for various applications. The model is suitable for experimentation, prototyping, and integration into speech-enabled systems.

Qwen3.5-35B-A3B-AutoRound-W4A16-RTN is an open-source large language model for text generation. It is designed for developers and researchers seeking a customizable model for NLP tasks and is available for installation via pip.

Qwen3.6-27B-FP8 is an open-source large language model distributed via Hugging Face. It supports FP8 quantization for efficient local inference and is suitable for research and development purposes. The model is accessible to AI researchers and developers.

Qwen3.5-35B-A3B-AutoRound-MXFP4-ModelFree is an open-source large language and vision model supporting text, image, and video modalities. It is designed for developers and researchers to build and experiment with advanced AI applications.