-
Notifications
You must be signed in to change notification settings - Fork 6
/
Hotel-v1-eval.txt
62 lines (56 loc) · 3.62 KB
/
Hotel-v1-eval.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
Row mismatch:?#1 <-> #1
Text mismatch:#519
[- L? tân nhi?t tình - H?i bí nh?ng ? trong trung tâm thì có th? ch?p nh?n ???c - D?n phòng th??ng xuyên]
<->
[]
Text mismatch:#584
[- Phong cách hoài c? và trang trí phòng ??p - S?ch s? - Quanh khách s?n có nhi?u công trình ?ang xây nên h?u nh? không th?y view bi?n và r?t ?n]
<->
[]
Evaluation Result >> File:D:/absa-vlsp-2018/evaluators/../experiments/predictions/Hotel-v1.txt<> [D:/absa-vlsp-2018/evaluators/../datasets/vlsp2018_hotel/3-VLSP2018-SA-Hotel-test.txt]
Gold count 46 416 200 93 221 57 198 67 68 144 32 124 10 65 85 51 13 71 151 29 94 21 68 59 8 26 129 3 13 9 5 4 3 1
ANSWER count 28 416 222 112 221 36 185 60 44 125 39 104 8 49 84 36 7 68 132 34 78 17 9 47 0 4 124 0 11 8 2 0 0 0
Correct ANSWER: aspect 19 408 192 83 213 29 167 54 37 105 27 100 6 38 68 31 4 59 120 23 61 11 6 25 0 2 118 0 6 6 2 0 0 0
Precision: aspect 0.6786 0.9808 0.8649 0.7411 0.9638 0.8056 0.9027 0.9000 0.8409 0.8400 0.6923 0.9615 0.7500 0.7755 0.8095 0.8611 0.5714 0.8676 0.9091 0.6765 0.7821 0.6471 0.6667 0.5319 0.0000 0.5000 0.9516 0.0000 0.5455 0.7500 1.0000 0.0000 0.0000 0.0000
Recall: aspect 0.4130 0.9808 0.9600 0.8925 0.9638 0.5088 0.8434 0.8060 0.5441 0.7292 0.8438 0.8065 0.6000 0.5846 0.8000 0.6078 0.3077 0.8310 0.7947 0.7931 0.6489 0.5238 0.0882 0.4237 0.0000 0.0769 0.9147 0.0000 0.4615 0.6667 0.4000 0.0000 0.0000 0.0000
F1 score: aspect 0.5135 0.9808 0.9100 0.8098 0.9638 0.6237 0.8721 0.8504 0.6607 0.7807 0.7606 0.8772 0.6667 0.6667 0.8047 0.7126 0.4000 0.8489 0.8481 0.7302 0.7093 0.5789 0.1558 0.4717 0.0000 0.1333 0.9328 0.0000 0.5000 0.7059 0.5714 0.0000 0.0000 0.0000
Over All ANSWER: aspect:---- 0.8745 0.7817 0.8255
Correct ANSWER: aspect,value 18 386 183 77 202 27 145 54 34 94 27 95 6 29 63 28 3 55 117 21 59 11 6 24 0 2 112 0 6 6 2 0 0 0
Precision: aspect, value 0.6429 0.9279 0.8243 0.6875 0.9140 0.7500 0.7838 0.9000 0.7727 0.7520 0.6923 0.9135 0.7500 0.5918 0.7500 0.7778 0.4286 0.8088 0.8864 0.6176 0.7564 0.6471 0.6667 0.5106 0.0000 0.5000 0.9032 0.0000 0.5455 0.7500 1.0000 0.0000 0.0000 0.0000
Recall: aspect, value 0.3913 0.9279 0.9150 0.8280 0.9140 0.4737 0.7323 0.8060 0.5000 0.6528 0.8438 0.7661 0.6000 0.4462 0.7412 0.5490 0.2308 0.7746 0.7748 0.7241 0.6277 0.5238 0.0882 0.4068 0.0000 0.0769 0.8682 0.0000 0.4615 0.6667 0.4000 0.0000 0.0000 0.0000
F1 score: aspect, value 0.4865 0.9279 0.8673 0.7512 0.9140 0.5806 0.7572 0.8504 0.6071 0.6989 0.7606 0.8333 0.6667 0.5088 0.7456 0.6437 0.3000 0.7914 0.8269 0.6667 0.6860 0.5789 0.1558 0.4528 0.0000 0.1333 0.8854 0.0000 0.5000 0.7059 0.5714 0.0000 0.0000 0.0000
Over All ANSWER: aspect, value:---- 0.8190 0.7322 0.7732
asp#1: ROOM_AMENITIES#CLEANLINESS
asp#2: SERVICE#GENERAL
asp#3: ROOMS#CLEANLINESS
asp#4: ROOMS#COMFORT
asp#5: LOCATION#GENERAL
asp#6: ROOMS#GENERAL
asp#7: ROOMS#DESIGN&FEATURES
asp#8: HOTEL#CLEANLINESS
asp#9: ROOM_AMENITIES#COMFORT
asp#10: ROOM_AMENITIES#DESIGN&FEATURES
asp#11: ROOM_AMENITIES#GENERAL
asp#12: FOOD&DRINKS#STYLE&OPTIONS
asp#13: ROOMS#QUALITY
asp#14: FACILITIES#DESIGN&FEATURES
asp#15: HOTEL#DESIGN&FEATURES
asp#16: FACILITIES#QUALITY
asp#17: HOTEL#QUALITY
asp#18: HOTEL#PRICES
asp#19: HOTEL#GENERAL
asp#20: ROOMS#PRICES
asp#21: HOTEL#COMFORT
asp#22: FACILITIES#GENERAL
asp#23: HOTEL#MISCELLANEOUS
asp#24: ROOM_AMENITIES#QUALITY
asp#25: FACILITIES#MISCELLANEOUS
asp#26: FACILITIES#COMFORT
asp#27: FOOD&DRINKS#QUALITY
asp#28: FOOD&DRINKS#MISCELLANEOUS
asp#29: FACILITIES#PRICES
asp#30: FOOD&DRINKS#PRICES
asp#31: FACILITIES#CLEANLINESS
asp#32: ROOMS#MISCELLANEOUS
asp#33: ROOM_AMENITIES#MISCELLANEOUS
asp#34: ROOM_AMENITIES#PRICES