slim-sentiment-onnx

slim-sentiment-onnx is a specialized function calling model that classifies the sentiment of a given text passage and generates a python dictionary with a "sentiment" key and the corresponding value assessment of the sentiment.

This is an ONNX int4 quantized version of slim-sentiment, providing a very fast, very small inference implementation, optimized for AI PCs.

Model Description

  • Developed by: llmware
  • Model type: tinyllama
  • Parameters: 1.1 billion
  • Model Parent: llmware/slim-sentiment
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Sentiment analysis for Agent-based multi-step process workflows
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
5
Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for llmware/slim-sentiment-onnx

Quantized
(5)
this model

Collection including llmware/slim-sentiment-onnx