autoevaluator HF staff commited on
Commit
d610c2a
1 Parent(s): 8c6e3fa

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@sasha

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-9ea0d3-93467145852).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -2,6 +2,48 @@
2
  language: en
3
  tags:
4
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  ### Pegasus Models
 
2
  language: en
3
  tags:
4
  - summarization
5
+ model-index:
6
+ - name: google/pegasus-multi_news
7
+ results:
8
+ - task:
9
+ type: summarization
10
+ name: Summarization
11
+ dataset:
12
+ name: cnn_dailymail
13
+ type: cnn_dailymail
14
+ config: 3.0.0
15
+ split: test
16
+ metrics:
17
+ - type: rouge
18
+ value: 29.0169
19
+ name: ROUGE-1
20
+ verified: true
21
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZThiZDJmMWE2YTI4MTJhYzM2MjY5YWQ4MTllMGIxM2M2MzIyMjNmMDE3ZmRjMmJjMTQ2ZDU5ZWViNGFmZmRiYyIsInZlcnNpb24iOjF9.xEun-mYvx1MxL0l7E6-gs6yptYHmK1rsq2UyjrceFR6KxnKB3077z8uyKaYtpG22GUc0SmbSgwOTzNf3dQYhCQ
22
+ - type: rouge
23
+ value: 10.7428
24
+ name: ROUGE-2
25
+ verified: true
26
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTkyYjQ1NWNhOWJlZmM1MzA3MzRlNmM2ZjNjZDAyZTU5YWI4MDAyZGRhMDdhZGNlODc2NmIzYWY5OGRhZWU1MSIsInZlcnNpb24iOjF9.VOglTU3zW2pyBRAMKVHPtZu-QVM5_li6PeL9_myJmVEutYepn3_9EPFr5Davh66KpLdnTnC_ypUnXTssrP_jDg
27
+ - type: rouge
28
+ value: 17.5856
29
+ name: ROUGE-L
30
+ verified: true
31
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmI3NTRkNzNiMzA0N2Y2NGQwNmYxYWU2MjBmNWE2OGYyNWFhZWU2NTBhZjgxOTA5ZjA0Yzg2MGUwODEwN2IzNCIsInZlcnNpb24iOjF9.zm7XIzPwLeEzkphSh3N46HqpwGzo9jW4QzCKDc9v0aB7ReUS0B52Mo1e9POhLYXKNbmR02SBnPYR8QCv3KslCg
32
+ - type: rouge
33
+ value: 26.3867
34
+ name: ROUGE-LSUM
35
+ verified: true
36
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDBkMTEwZmJmNzM5YjYyNjY5ZjU3N2M3N2I2M2RmYmMxNmY4ZDMwMTA4YThlMmM2Y2UzYmExMWFjMTBjNzRlOCIsInZlcnNpb24iOjF9.ztYTEi_sCTZ4r7znejvzilgQRB2BWXbHRRpZKvQAvWGgiNuVmc2B0ii3CBrfrJnO4wK3AWac12HG1wgP52icAQ
37
+ - type: loss
38
+ value: 3.0776774883270264
39
+ name: loss
40
+ verified: true
41
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWI3NjFlMTdkYmIyMDU0NTk5NWI5YzAxZjgwYmYwMzI0M2I2MDZkODIxZTg3YjI1Njk1ODc0ZjhmMzk1NDg0NCIsInZlcnNpb24iOjF9.aOyesstYBuxYf9kXLjnPfDF6b2B-19t6ZZZn7kRj5Fu7HhcI0YoB-KPmj-DU7ZTKV4kBHYtt3OyMzrYCfO8ZDQ
42
+ - type: gen_len
43
+ value: 201.4861
44
+ name: gen_len
45
+ verified: true
46
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzQ4YWZmYmVmMTMyYjZlZGFkZTIwNTc1MDNhYTJkMzJhZWI2MTk0NTg5OTY2NWFlMzU5NWQ5MmFmN2QyMDE0MSIsInZlcnNpb24iOjF9.BaTL0kA2Gd9z2HHi0r0jr_Cpct3Mo3m-AA2zSmU4wLGRdrUtC4ep8UMxInhYHg-VHslKrrPDK5cxWmfP_Fw1AA
47
  ---
48
 
49
  ### Pegasus Models