Llama3.1 8B
Llama logo

Llama3.1 8B

llama3.1-8bllms.txt
Llama
cerebras

Pricing

  • Input Tokens: $0.3 /M tokens
  • Output Tokens: $0.6 /M tokens

Input Modalities

    Providers

    Groq groq-llama-3.1-8b-instant
    Pricing$0.055$0.088
    Context131K
    Max output131K
    Latency-
    Throughput-
    Uptime
    0.00% uptime 2 days ago
    0.00% uptime yesterday
    0.00% uptime today
    Deepinfra deepinfra-llama-3.1-8b-instant
    Pricing$0.033$0.055
    Context128K
    Max output128K
    Latency-
    Throughput-
    Uptime
    100.00% uptime 2 days ago
    0.00% uptime yesterday
    0.00% uptime today

    Performance for llama3.1-8b

    Uptime is the percentage of requests that succeeded over the past 72 hours. AIHubMix continuously monitors every provider and automatically retries with the next-best provider when one returns an error or responds too slowly; Latency is total round-trip time (lower is better); Throughput is how fast the model writes (tokens per second, higher is better).

    Uptime
    Loading...
    Latency
    Loading...
    Throughput
    Loading...

    Try this model

    Python
    import os
    from openai import OpenAI
    
    client = OpenAI(
        api_key=os.environ["AIHUBMIX_API_KEY"],
        base_url="https://aihubmix.com/v1",
    )
    
    response = client.chat.completions.create(
        model="llama3.1-8b",
        messages=[
          {
            "role": "user",
            "content": "Hello, how are you?"
          }
        ],
        max_tokens=1024,
        stream=False,
    )
    
    print(response.choices[0].message.content)

    Frequently asked questions

    What is Llama3.1 8B?

    cerebras