xLAM-8x7b-r-GGUF / README.md
alabulei's picture
Update README.md
e59f578 verified
metadata
license: cc-by-nc-4.0
model_name: xLAM-8x7b-r
base_model: Salesforce/xLAM-8x7b-r
inference: false
model_creator: Salesforce
quantized_by: Second State Inc.
pipeline_tag: text-generation
tags:
  - function-calling
  - LLM Agent
  - tool-use
  - mistral
language:
  - en

xLAM-7b-fc-r-GGUF

Original Model

Salesforce/xLAM-7b-fc-r

Run with Gaianet

Prompt template

prompt template: llama-3-chat

Context size

chat_ctx_size: 32000

Run with GaiaNet

Quantized with llama.cpp b3613