Update README.md
Browse files
README.md
CHANGED
@@ -1,44 +1,56 @@
|
|
1 |
library_name: transformers
|
2 |
license: mit
|
3 |
language:
|
4 |
-
|
5 |
-
en
|
6 |
base_model: meta-llama/Llama-2-7b-hf
|
7 |
-
|
8 |
-
|
9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
This model is a fine-tuned version of the LLaMA-2-7B model from Meta, optimized using 1.5 lakh open-source clinical studies data for instruction-based tasks. The fine-tuning process has tailored the model to better understand and generate responses in the domain of clinical studies, making it particularly useful for tasks involving medical and clinical research data.
|
11 |
|
12 |
-
Developed by
|
13 |
-
Model type
|
14 |
-
Language(s) (NLP)
|
15 |
-
License
|
16 |
-
Finetuned from model
|
17 |
-
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
|
|
|
|
|
|
|
|
|
|
|
23 |
This model can be directly used for generating responses or insights from clinical studies data, facilitating tasks such as summarization, information retrieval, and instruction following in the medical and clinical research fields.
|
24 |
|
25 |
-
Downstream Use
|
|
|
26 |
The model can be further fine-tuned or integrated into applications focused on clinical decision support, medical research analysis, or healthcare-related natural language processing tasks.
|
27 |
|
28 |
-
Out-of-Scope Use
|
|
|
29 |
This model is not suitable for real-time medical diagnosis, treatment recommendations, or any other critical medical decision-making processes without human oversight. Misuse in contexts requiring precise and validated medical information could lead to incorrect or harmful outcomes.
|
30 |
|
31 |
-
Bias, Risks, and Limitations
|
|
|
32 |
While the model has been fine-tuned on clinical studies data, it may still exhibit biases present in the original data. Users should be cautious when interpreting outputs, particularly in sensitive or critical contexts such as healthcare. The model may also produce outdated or incorrect information if the underlying data is not current.
|
33 |
|
34 |
-
Recommendations
|
|
|
35 |
Users should critically evaluate the model's outputs and consider the context in which it is being used. It is advisable to have human oversight when deploying the model in healthcare or clinical environments.
|
36 |
|
37 |
-
How to Get Started with the Model
|
38 |
-
Use the code below to get started with the model:
|
39 |
|
40 |
-
python
|
41 |
-
Copy code
|
42 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
43 |
|
44 |
tokenizer = AutoTokenizer.from_pretrained("your-hf-username/clinical-llama-7b")
|
@@ -48,52 +60,3 @@ input_text = "Summarize the following clinical study on..."
|
|
48 |
inputs = tokenizer(input_text, return_tensors="pt")
|
49 |
outputs = model.generate(**inputs)
|
50 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
51 |
-
Training Details
|
52 |
-
Training Data
|
53 |
-
The model was fine-tuned on a dataset of 1.5 lakh open-source clinical studies, focusing on enhancing its ability to follow instructions and generate informative content within the medical and clinical research domains.
|
54 |
-
|
55 |
-
Training Procedure
|
56 |
-
Training regime: Mixed precision training with fp16
|
57 |
-
Hardware: NVIDIA A100 GPUs
|
58 |
-
Training duration: Approximately [insert hours/days]
|
59 |
-
Evaluation
|
60 |
-
Testing Data, Factors & Metrics
|
61 |
-
Testing Data
|
62 |
-
The model was evaluated on a subset of clinical studies data that was not seen during training.
|
63 |
-
|
64 |
-
Metrics
|
65 |
-
The evaluation focused on accuracy in following instructions, the relevance of generated responses, and the preservation of key medical facts.
|
66 |
-
|
67 |
-
Results
|
68 |
-
The fine-tuned model demonstrated improved performance in generating accurate and contextually relevant responses in the domain of clinical studies, outperforming the base model in instruction-following tasks.
|
69 |
-
|
70 |
-
Environmental Impact
|
71 |
-
Hardware Type: NVIDIA A100 GPUs
|
72 |
-
Hours used: [insert hours]
|
73 |
-
Cloud Provider: [insert cloud provider if applicable]
|
74 |
-
Compute Region: [insert compute region]
|
75 |
-
Carbon Emitted: [insert carbon emissions if known]
|
76 |
-
Technical Specifications
|
77 |
-
Model Architecture and Objective
|
78 |
-
The model architecture is based on Meta's LLaMA-2-7B, optimized for natural language processing tasks, with a focus on clinical studies data.
|
79 |
-
|
80 |
-
Compute Infrastructure
|
81 |
-
Hardware
|
82 |
-
Training was conducted on NVIDIA A100 GPUs.
|
83 |
-
|
84 |
-
Software
|
85 |
-
The fine-tuning was performed using the PyTorch framework with the Hugging Face Transformers library.
|
86 |
-
|
87 |
-
Citation
|
88 |
-
If you use this model in your research, please cite:
|
89 |
-
|
90 |
-
bibtex
|
91 |
-
Copy code
|
92 |
-
@article{shekhar2024clinicalllama,
|
93 |
-
title={Clinical Studies Instruction-Finetuned LLaMA-7B},
|
94 |
-
author={Shudhanshu Shekhar},
|
95 |
-
year={2024},
|
96 |
-
howpublished={\url{https://huggingface.co/your-hf-username/clinical-llama-7b}},
|
97 |
-
}
|
98 |
-
Model Card Authors
|
99 |
-
Shudhanshu Shekhar
|
|
|
1 |
library_name: transformers
|
2 |
license: mit
|
3 |
language:
|
4 |
+
- en
|
|
|
5 |
base_model: meta-llama/Llama-2-7b-hf
|
6 |
+
|
7 |
+
---
|
8 |
+
|
9 |
+
# Model Card for Clinical Studies Instruction-Finetuned LLaMA-7B
|
10 |
+
|
11 |
+
## Model Details
|
12 |
+
|
13 |
+
### Model Description
|
14 |
+
|
15 |
This model is a fine-tuned version of the LLaMA-2-7B model from Meta, optimized using 1.5 lakh open-source clinical studies data for instruction-based tasks. The fine-tuning process has tailored the model to better understand and generate responses in the domain of clinical studies, making it particularly useful for tasks involving medical and clinical research data.
|
16 |
|
17 |
+
- **Developed by:** Shudhanshu Shekhar
|
18 |
+
- **Model type:** Instruction-finetuned LLaMA-2-7B
|
19 |
+
- **Language(s) (NLP):** English
|
20 |
+
- **License:** MIT
|
21 |
+
- **Finetuned from model:** Meta's LLaMA-2-7B
|
22 |
+
|
23 |
+
### Model Sources
|
24 |
+
|
25 |
+
- **Repository:** [Link to your Hugging Face model repository]
|
26 |
+
- **Paper [optional]:** [Link to any related paper]
|
27 |
+
- **Demo [optional]:** [Link to a demo if available]
|
28 |
+
|
29 |
+
## Uses
|
30 |
+
|
31 |
+
### Direct Use
|
32 |
+
|
33 |
This model can be directly used for generating responses or insights from clinical studies data, facilitating tasks such as summarization, information retrieval, and instruction following in the medical and clinical research fields.
|
34 |
|
35 |
+
### Downstream Use
|
36 |
+
|
37 |
The model can be further fine-tuned or integrated into applications focused on clinical decision support, medical research analysis, or healthcare-related natural language processing tasks.
|
38 |
|
39 |
+
### Out-of-Scope Use
|
40 |
+
|
41 |
This model is not suitable for real-time medical diagnosis, treatment recommendations, or any other critical medical decision-making processes without human oversight. Misuse in contexts requiring precise and validated medical information could lead to incorrect or harmful outcomes.
|
42 |
|
43 |
+
## Bias, Risks, and Limitations
|
44 |
+
|
45 |
While the model has been fine-tuned on clinical studies data, it may still exhibit biases present in the original data. Users should be cautious when interpreting outputs, particularly in sensitive or critical contexts such as healthcare. The model may also produce outdated or incorrect information if the underlying data is not current.
|
46 |
|
47 |
+
### Recommendations
|
48 |
+
|
49 |
Users should critically evaluate the model's outputs and consider the context in which it is being used. It is advisable to have human oversight when deploying the model in healthcare or clinical environments.
|
50 |
|
51 |
+
## How to Get Started with the Model
|
|
|
52 |
|
53 |
+
```python
|
|
|
54 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
55 |
|
56 |
tokenizer = AutoTokenizer.from_pretrained("your-hf-username/clinical-llama-7b")
|
|
|
60 |
inputs = tokenizer(input_text, return_tensors="pt")
|
61 |
outputs = model.generate(**inputs)
|
62 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|