ssmits
/

Falcon2-5.5B-multilingual-embed-base

Text Classification

sentence-transformers

ssmits/Falcon2-5.5B-multilingual

Model card Files Files and versions Community

ssmits commited on Jun 8

Commit

8545051

•

1 Parent(s): 0458937

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ pipeline_tag: text-classification
 ---
 ## Usage
-Embeddings version of the base model of [ssmits/Falcon2-5.5B-multilingual](https://huggingface.co/ssmits/Falcon2-5.5B-multilingual/edit/main/README.md).
 The 'lm_head' layer of this model has been removed, which means it can be used for embeddings. It will not perform greatly, as it needs to be further fine-tuned, as shown by [intfloat/e5-mistral-7b-instruct](https://huggingface.co/intfloat/e5-mistral-7b-instruct).
 Additionaly, in stead of a normalization layer, the hidden layers are followed up by both a classical weight and bias 1-dimensional array of 4096 values.
 Further research needs to be conducted if this architecture will fully function when adding a classification head in combination with utilizing the transformers library.

 ---
 ## Usage
+Embeddings version of the base model [ssmits/Falcon2-5.5B-multilingual](https://huggingface.co/ssmits/Falcon2-5.5B-multilingual/edit/main/README.md).
 The 'lm_head' layer of this model has been removed, which means it can be used for embeddings. It will not perform greatly, as it needs to be further fine-tuned, as shown by [intfloat/e5-mistral-7b-instruct](https://huggingface.co/intfloat/e5-mistral-7b-instruct).
 Additionaly, in stead of a normalization layer, the hidden layers are followed up by both a classical weight and bias 1-dimensional array of 4096 values.
 Further research needs to be conducted if this architecture will fully function when adding a classification head in combination with utilizing the transformers library.