metadata

license: cc-by-nc-4.0
model_name: xLAM-1b-fc-r
base_model: Salesforce/xLAM-1b-fc-r
inference: false
model_creator: BAAI
quantized_by: Second State Inc.
pipeline_tag: text-generation
tags:
  - function-calling
  - LLM Agent
  - tool-use
  - deepseek
language:
  - en

xLAM-1b-fc-r-GGUF

Original Model

Salesforce/xLAM-1b-fc-r

Run with LlamaEdge

LlamaEdge version: coming soon

Context size: 16000

Quantized GGUF Models

Name	Quant method	Bits	Size	Use case
xLAM-1b-fc-r-Q2_K.gguf	Q2_K	2	560 MB	smallest, significant quality loss - not recommended for most purposes
xLAM-1b-fc-r-Q3_K_L.gguf	Q3_K_L	3	744 MB	small, substantial quality loss
xLAM-1b-fc-r-Q3_K_M.gguf	Q3_K_M	3	704 MB	very small, high quality loss
xLAM-1b-fc-r-Q3_K_S.gguf	Q3_K_S	3	642 MB	very small, high quality loss
xLAM-1b-fc-r-Q4_0.gguf	Q4_0	4	776 MB	legacy; small, very high quality loss - prefer using Q3_K_M
xLAM-1b-fc-r-Q4_K_M.gguf	Q4_K_M	4	873 MB	medium, balanced quality - recommended
xLAM-1b-fc-r-Q4_K_S.gguf	Q4_K_S	4	814 MB	small, greater quality loss
xLAM-1b-fc-r-Q5_0.gguf	Q5_0	5	936 MB	legacy; medium, balanced quality - prefer using Q4_K_M
xLAM-1b-fc-r-Q5_K_M.gguf	Q5_K_M	5	1.00 GB	large, very low quality loss - recommended
xLAM-1b-fc-r-Q5_K_S.gguf	Q5_K_S	5	953 MB	large, low quality loss - recommended
xLAM-1b-fc-r-Q6_K.gguf	Q6_K	6	1.17 GB	very large, extremely low quality loss
xLAM-1b-fc-r-Q8_0.gguf	Q8_0	8	1.43 GB	very large, extremely low quality loss - not recommended
xLAM-1b-fc-r-f16.gguf	f16	16	2.69 GB

Quantized with llama.cpp b3613.