Titovs jdev8 commited on
Commit
ea71c24
1 Parent(s): 8edc10e

Update README.md (#7)

Browse files

- Update README.md (cda30ccbe21eb6aa8e0aad83c4489e592d851ba4)


Co-authored-by: Anton Shapkin <[email protected]>

Files changed (1) hide show
  1. README.md +12 -11
README.md CHANGED
@@ -2,16 +2,17 @@
2
  license: apache-2.0
3
  datasets:
4
  - JetBrains/KExercises
 
5
  results:
6
- - task:
7
- type: text-generation
8
- dataset:
9
- name: MultiPL-HumanEval (Kotlin)
10
- type: openai_humaneval
11
- metrics:
12
- - name: pass@1
13
- type: pass@1
14
- value: 42.24
15
  tags:
16
  - code
17
  ---
@@ -72,12 +73,12 @@ More details about finetuning can be found in the technical report
72
 
73
  # Fine-tuning data
74
 
75
- For this model we used 15K exmaples of Kotlin Exercices dataset {TODO: link!}. Every example follows HumanEval like format. In total dataset contains about 3.5M tokens.
76
  For more information about the dataset follow the link.
77
 
78
  # Evaluation
79
 
80
- To evaluate we used Kotlin Humaneval (more infromation here)
81
 
82
  Fine-tuned model:
83
 
 
2
  license: apache-2.0
3
  datasets:
4
  - JetBrains/KExercises
5
+ base_model: meta-llama/CodeLlama-7b-hf
6
  results:
7
+ - task:
8
+ type: text-generation
9
+ dataset:
10
+ name: MultiPL-HumanEval (Kotlin)
11
+ type: openai_humaneval
12
+ metrics:
13
+ - name: pass@1
14
+ type: pass@1
15
+ value: 42.24
16
  tags:
17
  - code
18
  ---
 
73
 
74
  # Fine-tuning data
75
 
76
+ For this model we used 15K exmaples of [Kotlin Exercices dataset](https://huggingface.co/datasets/JetBrains/KExercises). Every example follows HumanEval like format. In total dataset contains about 3.5M tokens.
77
  For more information about the dataset follow the link.
78
 
79
  # Evaluation
80
 
81
+ To evaluate we used Kotlin Humaneval ([more infromation here](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval))
82
 
83
  Fine-tuned model:
84