Commit
•
fe37e0c
1
Parent(s):
46afb13
update readme
Browse files
README.md
CHANGED
|
@@ -176,3 +176,10 @@ In summary, a golang struct is a way to define data types in Go. It is a collect
|
|
| 176 |
|
| 177 |
*A struct is a named collection of variables.
|
| 178 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 176 |
|
| 177 |
*A struct is a named collection of variables.
|
| 178 |
|
| 179 |
+
# Benchmark Comparison
|
| 180 |
+
## HumanEval
|
| 181 |
+
|
| 182 |
+
| Model | pass@1 |
|
| 183 |
+
| ------------------------------ | ------ |
|
| 184 |
+
| openllama-3b-v2 (base) | 8.1% |
|
| 185 |
+
| openhermes-llama-3b (finetune) | 9.8% |
|