File size: 1,922 Bytes
51d06cd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
603257b
 
838af16
 
d5939d1
eba7891
f84e2f7
805222d
 
 
 
659e77b
 
 
 
d5939d1
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
license: apache-2.0
language:
- en
metrics:
- accuracy
- precision
- recall
base_model:
- openai/clip-vit-base-patch32
pipeline_tag: image-classification
library_name: transformers
tags:
- zero-shot-image-classification
---
### Content Safety Model
## Model Summary
This model is designed to classify images as either "safe" or "unsafe." It helps in identifying potentially dangerous or sensitive content, making it useful for content moderation tasks. For example, it can flag images showing children in risky situations, like playing with fire, as "unsafe" while marking other benign images as "safe."

## Source Model and Dataset
Base Model: This model is fine-tuned from the pre-trained CLIP ViT-B/32 model by OpenAI, a model known for its zero-shot image classification abilities.
Dataset: The model was trained on a custom dataset containing labeled images of safe and unsafe scenarios. The dataset includes various examples of unsafe situations (e.g., fire, sharp objects, precarious activities) to help the model learn these contextual cues.

## Sample model predictions

| Input Image                               | Prediction                     |
|-------------------------------------------|--------------------------------|
<img src="https://cdn-uploads.huggingface.co/production/uploads/672d17c98e098bf429c83670/gSUv_DTF56QMbybgIapQB.jpeg" alt="image/jpeg" width="200 height=200" />   | Output:-   <img src="https://cdn-uploads.huggingface.co/production/uploads/672d17c98e098bf429c83670/buMrL5ngAPsBl08gdqEGs.png" alt="image/png" width="400" height="400" />
<img src="https://cdn-uploads.huggingface.co/production/uploads/672d17c98e098bf429c83670/JBy-vpiK11XagJpd3HsPl.jpeg" alt="image/jpeg" width="200" height="200" /> | Output:-   <img src="https://cdn-uploads.huggingface.co/production/uploads/672d17c98e098bf429c83670/84uDS2NYmZd-D9ILnAPBC.png" alt="image/png" width="400" height="400" />