back

Gemma 2 9B

Gemma

Google · 9B · Dense

Google's best mid-size open model

211.7K downloads 778 likes 2024-06 8K context

Use Cases

chat reasoning

Quantization Options

Quant Bits VRAM Quality Status
Q2_K 2 3.4 GB low
Q3_K_M 3 4.5 GB moderate
Q4_K_M 4 5.1 GB good
Q5_K_M 5 6.3 GB good
Q6_K 6 7.4 GB excellent
Q8_0 8 9.7 GB excellent
F16 16 18.9 GB lossless

About this model

Ollama in a Noogler hat with the Gemma 2 logo

Google’s Gemma 2 model is available in three sizes, 2B, 9B and 27B, featuring a brand new architecture designed for class leading performance and efficiency.

Class leading performance

At 27 billion parameters, Gemma 2 delivers performance surpassing models more than twice its size in benchmarks. This breakthrough efficiency sets a new standard in the open model landscape.

Three sizes: 2B, 9B and 27B parameters

  • 2B Parameters ollama run gemma2:2b
  • 9B Parameters ollama run gemma2
  • 27B Parameters ollama run gemma2:27b

Benchmark

Benchmark

Intended Usage

Open Large Language Models (LLMs) have a wide range of applications across various industries and domains. The following list of potential uses is not comprehensive. The purpose of this list is to provide contextual information about the possible use-cases that the model creators considered as part of model training and development.

  • Content Creation and Communication
    • Text Generation: These models can be used to generate creative text formats such as poems, scripts, code, marketing copy, and email drafts.
    • Chatbots and Conversational AI: Power conversational interfaces for customer service, virtual assistants, or interactive applications.
    • Text Summarization: Generate concise summaries of a text corpus, research papers, or reports.
  • Research and Education
    • Natural Language Processing (NLP) Research: These models can serve as a foundation for researchers to experiment with NLP techniques, develop algorithms, and contribute to the advancement of the field.
    • Language Learning Tools: Support interactive language learning experiences, aiding in grammar correction or providing writing practice.
    • Knowledge Exploration: Assist researchers in exploring large bodies of text by generating summaries or answering questions about specific topics.

Using Gemma 2 with popular tooling

LangChain

from langchain_community.llms import Ollama
llm = Ollama(model="gemma2")
llm.invoke("Why is the sky blue?")

LlamaIndex

from llama_index.llms.ollama import Ollama
llm = Ollama(model="gemma2")
llm.complete("Why is the sky blue?")