NVIDIA Nemotron Nano 12B
NVIDIA Nemotron Nano 12B v2 GGUF is a quantized language model distributed through Hugging Face for local inference. It can be downloaded and run with compatible tools such as llama.cpp and other GGUF runtimes by developers and AI practitioners.
Overview
5 featuresNVIDIA Nemotron Nano 12B sits in PulseGate's Foundation models & chat category. It focuses on running a capable language model locally without relying on a hosted inference service. It is built as an open-source project for developers and AI practitioners. The project is open source (MIT). It runs on the command line, Linux, macOS, and Windows, and it can be self-hosted.
Behind NVIDIA Nemotron Nano 12B is MaziyarPanahi, and it first shipped in 2023. The project is developed in the open on GitHub with 124.5k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 13 similar projects. Key capabilities include GGUF quantization, local inference, and text generation.
Summary written by a language model from the project’s public pages.
- GGUF quantization
- Local inference
- Text generation
- Code generation
- Model downloads
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- multiple
- bLangChain in the HTML
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed18 Aug · 16:27 UTCMaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about NVIDIA Nemotron Nano 12B
- What is NVIDIA Nemotron Nano 12B?
- NVIDIA Nemotron Nano 12B focuses on running a capable language model locally without relying on a hosted inference service. It is catalogued under Foundation models & chat on PulseGate.
- Who is NVIDIA Nemotron Nano 12B for?
- NVIDIA Nemotron Nano 12B is an open-source project built for developers and AI practitioners.
- Is NVIDIA Nemotron Nano 12B free?
- Yes — NVIDIA Nemotron Nano 12B is open source under the MIT license and free to use.
- What platforms does NVIDIA Nemotron Nano 12B run on?
- NVIDIA Nemotron Nano 12B runs on the command line, Linux, macOS, and Windows. It can also be self-hosted.
- Is NVIDIA Nemotron Nano 12B still maintained?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to NVIDIA Nemotron Nano 12B?
- Similar projects tracked by PulseGate include NVIDIA Nemotron Nano 12B, NVIDIA Nemotron Nano 12B V2 VL NVFP4 QAD, and NVIDIA Nemotron Nano 12B V2 VL.NVIDIA Nemotron Nano 12BNVIDIA Nemotron Nano 12B V2 VL NVFP4 QADNVIDIA Nemotron Nano 12B V2 VL
- Who makes NVIDIA Nemotron Nano 12B?
- NVIDIA Nemotron Nano 12B is developed by MaziyarPanahi.
- When did NVIDIA Nemotron Nano 12B launch?
- NVIDIA Nemotron Nano 12B first shipped in 2023.
Similar projects
Closest matches by what these projects do