-
Notifications
You must be signed in to change notification settings - Fork 0
/
results.txt
149 lines (130 loc) · 12.4 KB
/
results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.3
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-02-FRCNN 34.4% 56.5% 24.7% 34.8% 79.5% 62 7 28 27 1667 12112 119 133 25.2% 0.136
MOT17-04-FRCNN 54.6% 73.0% 43.6% 55.7% 93.2% 83 19 43 21 1928 21081 107 123 51.4% 0.108
MOT17-05-FRCNN 52.1% 72.7% 40.6% 50.4% 90.3% 133 17 66 50 376 3430 92 88 43.6% 0.192
MOT17-09-FRCNN 54.6% 75.0% 42.9% 56.6% 99.0% 26 7 16 3 30 2312 36 41 55.3% 0.113
MOT17-10-FRCNN 40.0% 46.5% 35.1% 57.9% 76.7% 57 13 38 6 2258 5403 238 289 38.5% 0.182
MOT17-11-FRCNN 53.7% 69.0% 43.9% 59.6% 93.6% 75 16 36 23 383 3815 67 67 54.8% 0.106
MOT17-13-FRCNN 38.9% 46.0% 33.6% 52.3% 71.5% 110 21 59 30 2432 5554 348 401 28.4% 0.197
OVERALL 47.8% 63.5% 38.3% 52.2% 86.6% 546 100 286 160 9074 53707 1007 1142 43.2% 0.135
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.1
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-02-DPM 18.7% 33.2% 13.0% 25.1% 64.1% 62 5 20 37 2607 13918 159 155 10.2% 0.258
MOT17-04-DPM 24.0% 26.4% 22.0% 45.0% 54.1% 83 8 47 28 18212 26134 611 610 5.5% 0.233
MOT17-05-DPM 32.7% 42.4% 26.6% 40.6% 64.8% 133 4 78 51 1525 4107 130 144 16.7% 0.273
MOT17-09-DPM 32.5% 30.7% 34.5% 60.0% 53.4% 26 5 18 3 2786 2131 95 102 5.9% 0.271
MOT17-10-DPM 25.0% 30.9% 21.0% 40.9% 60.1% 57 6 25 26 3484 7587 177 241 12.4% 0.269
MOT17-11-DPM 35.9% 37.6% 34.4% 54.5% 59.6% 75 11 27 37 3489 4295 78 74 16.7% 0.232
MOT17-13-DPM 20.0% 31.5% 14.6% 22.5% 48.2% 110 5 44 61 2806 9028 154 218 -3.0% 0.288
MOT17-02-FRCNN 34.6% 56.5% 25.0% 35.1% 79.6% 62 7 26 29 1677 12053 105 122 25.5% 0.143
MOT17-04-FRCNN 54.8% 73.4% 43.8% 55.7% 93.3% 83 20 41 22 1908 21085 107 120 51.4% 0.112
MOT17-05-FRCNN 50.9% 71.7% 39.5% 49.1% 89.0% 133 13 68 52 419 3522 77 110 41.9% 0.206
MOT17-09-FRCNN 55.0% 74.9% 43.4% 56.9% 98.2% 26 8 14 4 56 2296 35 41 55.2% 0.127
MOT17-10-FRCNN 40.2% 46.6% 35.3% 57.7% 76.2% 57 14 35 8 2318 5436 191 292 38.1% 0.192
MOT17-11-FRCNN 53.4% 68.7% 43.7% 59.3% 93.3% 75 14 36 25 403 3844 53 64 54.4% 0.115
MOT17-13-FRCNN 40.6% 48.3% 35.0% 51.6% 71.2% 110 16 71 23 2424 5636 247 448 28.6% 0.219
MOT17-02-SDP 31.0% 40.2% 25.3% 46.8% 74.3% 62 6 40 16 3004 9880 250 273 29.3% 0.214
MOT17-04-SDP 64.0% 73.0% 57.0% 76.0% 97.4% 83 43 29 11 968 11420 198 232 73.5% 0.159
MOT17-05-SDP 50.6% 62.4% 42.5% 58.1% 85.2% 133 18 81 34 697 2895 130 167 46.2% 0.193
MOT17-09-SDP 53.0% 65.6% 44.5% 64.0% 94.4% 26 8 15 3 201 1916 51 60 59.3% 0.166
MOT17-10-SDP 45.9% 51.2% 41.6% 70.4% 86.8% 57 25 29 3 1374 3799 227 367 57.9% 0.223
MOT17-11-SDP 54.2% 61.2% 48.7% 71.6% 90.0% 75 27 37 11 747 2683 108 131 62.5% 0.164
MOT17-13-SDP 46.3% 57.8% 38.7% 51.5% 77.1% 110 30 41 39 1785 5647 195 388 34.5% 0.245
OVERALL 41.9% 51.6% 35.3% 52.7% 77.1% 1638 293 822 523 52890 159312 3378 4359 36.0% 0.186
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.1, Bug fixed
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-05-DPM 34.9% 45.3% 28.4% 41.4% 66.1% 133 6 76 51 1469 4051 124 144 18.4% 0.271
MOT17-02-FRCNN 35.2% 57.5% 25.4% 35.4% 80.1% 62 7 26 29 1635 12011 88 107 26.1% 0.142
MOT17-13-FRCNN 45.1% 53.7% 38.9% 54.6% 75.4% 110 21 65 24 2075 5287 225 446 34.8% 0.219
MOT17-13-SDP 48.1% 60.1% 40.1% 53.3% 79.7% 110 36 38 36 1577 5439 179 372 38.2% 0.244
MOT17-05-SDP 52.5% 64.7% 44.1% 60.0% 88.0% 133 21 82 30 568 2766 140 177 49.8% 0.194
MOT17-05-FRCNN 52.9% 74.4% 41.0% 50.1% 90.9% 133 17 68 48 346 3449 74 110 44.1% 0.207
MOT17-11-FRCNN 54.0% 69.5% 44.2% 59.8% 94.1% 75 17 35 23 353 3794 47 59 55.6% 0.116
MOT17-04-DPM 27.4% 30.2% 25.1% 48.2% 57.8% 83 9 46 28 16718 24640 407 423 12.2% 0.232
MOT17-13-DPM 23.5% 37.0% 17.2% 25.0% 53.7% 110 7 41 62 2508 8730 143 218 2.2% 0.288
MOT17-09-FRCNN 54.8% 74.7% 43.3% 57.2% 98.7% 26 7 15 4 40 2280 36 41 55.8% 0.127
MOT17-04-SDP 65.6% 74.8% 58.4% 76.0% 97.5% 83 43 30 10 938 11390 194 224 73.7% 0.159
MOT17-09-DPM 33.6% 31.8% 35.7% 61.7% 55.0% 26 5 18 3 2693 2038 85 92 9.6% 0.270
MOT17-10-FRCNN 42.4% 49.2% 37.2% 59.3% 78.3% 57 15 35 7 2111 5229 167 269 41.5% 0.192
MOT17-04-FRCNN 55.5% 74.3% 44.3% 55.7% 93.3% 83 20 41 22 1911 21088 91 104 51.4% 0.112
MOT17-02-SDP 34.2% 44.3% 27.9% 48.1% 76.3% 62 8 39 15 2769 9645 228 252 32.0% 0.213
MOT17-11-DPM 39.0% 40.8% 37.3% 56.4% 61.7% 75 14 28 33 3305 4111 62 56 20.8% 0.231
MOT17-10-DPM 25.3% 31.3% 21.3% 42.6% 62.6% 57 7 24 26 3264 7367 152 214 16.0% 0.267
MOT17-11-SDP 55.9% 63.1% 50.2% 72.6% 91.3% 75 27 36 12 652 2588 98 119 64.6% 0.164
MOT17-02-DPM 20.2% 36.0% 14.1% 25.9% 66.3% 62 7 16 39 2451 13762 140 131 12.0% 0.255
MOT17-09-SDP 53.6% 66.3% 44.9% 64.3% 94.8% 26 8 15 3 187 1902 49 59 59.8% 0.166
MOT17-10-SDP 47.9% 53.5% 43.4% 71.8% 88.6% 57 28 26 3 1191 3616 206 342 61.0% 0.222
OVERALL 43.9% 54.0% 36.9% 53.9% 78.8% 1638 330 800 508 48761 155183 2935 3959 38.6% 0.187
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.1, Fixed Bug regarding zero motion vectors
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-05-DPM 37.9% 49.3% 30.9% 42.4% 67.7% 133 8 77 48 1399 3981 108 122 20.7% 0.265
MOT17-02-FRCNN 35.2% 57.5% 25.4% 35.4% 80.1% 62 7 26 29 1636 12012 87 109 26.1% 0.143
MOT17-13-FRCNN 49.5% 58.9% 42.7% 56.5% 78.1% 110 27 60 23 1847 5059 160 334 39.3% 0.208
MOT17-13-SDP 53.2% 66.4% 44.4% 55.9% 83.7% 110 44 30 36 1272 5134 121 231 43.9% 0.234
MOT17-05-SDP 54.1% 66.8% 45.5% 60.9% 89.2% 133 23 82 28 509 2707 119 147 51.8% 0.187
MOT17-05-FRCNN 53.9% 75.8% 41.8% 50.9% 92.3% 133 16 70 47 294 3397 59 82 45.8% 0.201
MOT17-11-FRCNN 54.5% 70.1% 44.5% 60.0% 94.5% 75 17 35 23 330 3771 46 55 56.1% 0.114
MOT17-04-DPM 28.7% 31.6% 26.3% 48.2% 57.8% 83 9 46 28 16731 24653 398 408 12.1% 0.228
MOT17-13-DPM 25.0% 39.4% 18.3% 26.1% 56.0% 110 7 44 59 2386 8608 122 178 4.5% 0.278
MOT17-09-FRCNN 54.9% 74.8% 43.3% 57.3% 98.9% 26 7 15 4 34 2274 36 41 56.0% 0.123
MOT17-04-SDP 65.3% 74.5% 58.1% 76.1% 97.5% 83 44 29 10 934 11386 193 216 73.7% 0.157
MOT17-09-DPM 33.7% 31.8% 35.8% 62.3% 55.5% 26 6 17 3 2663 2008 77 81 10.8% 0.267
MOT17-10-FRCNN 44.0% 51.1% 38.7% 59.7% 78.8% 57 15 35 7 2062 5180 149 241 42.4% 0.189
MOT17-04-FRCNN 55.4% 74.1% 44.2% 55.7% 93.3% 83 20 41 22 1902 21079 92 105 51.5% 0.112
MOT17-02-SDP 34.9% 45.2% 28.5% 48.1% 76.3% 62 9 38 15 2776 9652 224 252 31.9% 0.210
MOT17-11-DPM 39.1% 41.0% 37.5% 56.9% 62.2% 75 15 27 33 3264 4070 58 46 21.7% 0.230
MOT17-10-DPM 26.0% 32.1% 21.9% 43.1% 63.3% 57 7 24 26 3203 7306 150 198 17.0% 0.264
MOT17-11-SDP 57.2% 64.6% 51.3% 73.3% 92.2% 75 29 34 12 585 2521 82 90 66.2% 0.162
MOT17-02-DPM 21.3% 37.9% 14.8% 26.0% 66.4% 62 7 16 39 2442 13753 132 125 12.1% 0.253
MOT17-09-SDP 53.2% 65.8% 44.6% 64.3% 94.8% 26 8 15 3 186 1901 50 62 59.9% 0.160
MOT17-10-SDP 53.3% 59.5% 48.2% 72.9% 89.9% 57 31 23 3 1052 3477 189 277 63.3% 0.219
OVERALL 45.0% 55.3% 37.9% 54.3% 79.4% 1638 356 784 498 47507 153929 2652 3400 39.4% 0.184
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.1, Video sequences encoded in H.264 with FFMPEG, consider only P vectors
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-13-FRCNN 23.8% 28.4% 20.5% 44.0% 60.7% 110 2 85 23 3309 6521 745 1041 9.2% 0.257
MOT17-13-SDP 25.2% 31.4% 21.0% 42.6% 63.8% 110 8 62 40 2818 6680 693 976 12.5% 0.273
MOT17-05-DPM 28.5% 36.9% 23.1% 38.4% 61.2% 133 4 70 59 1680 4262 174 222 11.6% 0.286
MOT17-09-SDP 52.3% 64.7% 43.8% 63.8% 94.2% 26 7 16 3 211 1926 58 84 58.8% 0.191
MOT17-11-SDP 50.9% 57.5% 45.7% 69.0% 86.9% 75 18 44 13 985 2921 165 278 56.9% 0.189
MOT17-04-DPM 27.6% 30.3% 25.3% 48.2% 57.8% 83 9 46 28 16710 24632 426 449 12.2% 0.235
MOT17-09-DPM 29.3% 27.7% 31.1% 62.2% 55.4% 26 3 20 3 2667 2012 127 140 9.7% 0.283
MOT17-04-FRCNN 55.3% 74.0% 44.1% 55.6% 93.1% 83 20 41 22 1956 21133 91 133 51.3% 0.123
MOT17-04-SDP 64.9% 74.1% 57.8% 76.0% 97.4% 83 43 30 10 949 11401 199 242 73.6% 0.164
MOT17-05-FRCNN 44.3% 62.3% 34.4% 46.7% 84.8% 133 9 71 53 581 3684 122 222 36.6% 0.232
MOT17-02-SDP 34.8% 45.0% 28.3% 47.7% 75.7% 62 9 38 15 2841 9717 241 278 31.1% 0.214
MOT17-10-DPM 14.3% 17.6% 12.0% 35.8% 52.7% 57 1 29 27 4136 8239 385 578 0.6% 0.292
MOT17-10-FRCNN 25.7% 29.9% 22.6% 50.2% 66.3% 57 7 44 6 3274 6392 520 836 20.7% 0.234
MOT17-02-DPM 22.5% 40.0% 15.7% 26.0% 66.4% 62 7 16 39 2441 13752 136 143 12.1% 0.257
MOT17-02-FRCNN 35.0% 57.1% 25.2% 35.2% 79.7% 62 6 28 28 1666 12042 99 127 25.7% 0.149
MOT17-05-SDP 43.6% 53.8% 36.7% 55.5% 81.4% 133 13 87 33 879 3077 205 282 39.8% 0.211
MOT17-11-FRCNN 49.5% 63.8% 40.5% 57.6% 90.6% 75 13 37 25 564 4005 103 177 50.5% 0.156
MOT17-09-FRCNN 53.8% 73.3% 42.5% 56.8% 98.1% 26 7 16 3 58 2298 41 57 55.0% 0.162
MOT17-13-DPM 12.9% 20.2% 9.4% 19.7% 42.3% 110 1 39 70 3129 9351 352 474 -10.2% 0.311
MOT17-11-DPM 30.6% 32.0% 29.2% 54.9% 60.1% 75 11 29 35 3447 4253 119 140 17.1% 0.249
MOT17-10-SDP 24.7% 27.6% 22.4% 58.8% 72.5% 57 6 48 3 2865 5290 672 1048 31.2% 0.253
OVERALL 38.9% 47.8% 32.7% 51.4% 75.2% 1638 204 896 538 57166 163588 5673 7927 32.8% 0.200
TRAIN DATA, DET_CYCLE 5, TRACKER_IOU_THRES 0.1, Video sequences encoded in H.264 with FFMPEG, consider P and B vectors
IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP
MOT17-13-FRCNN 24.0% 28.6% 20.7% 43.8% 60.6% 110 3 83 24 3325 6537 766 1075 8.7% 0.256
MOT17-13-SDP 25.2% 31.4% 21.0% 42.5% 63.6% 110 8 63 39 2830 6692 709 979 12.1% 0.273
MOT17-05-DPM 28.6% 37.1% 23.2% 38.5% 61.4% 133 3 74 56 1673 4255 171 219 11.8% 0.285
MOT17-09-SDP 51.8% 64.2% 43.5% 63.8% 94.2% 26 7 16 3 211 1926 56 78 58.8% 0.189
MOT17-11-SDP 51.4% 58.1% 46.2% 69.8% 87.8% 75 19 44 12 916 2852 152 268 58.5% 0.188
MOT17-04-DPM 27.2% 29.9% 24.9% 48.2% 57.9% 83 9 46 28 16706 24628 425 445 12.2% 0.234
MOT17-09-DPM 29.8% 28.1% 31.6% 62.3% 55.5% 26 4 20 2 2661 2006 116 129 10.2% 0.282
MOT17-04-FRCNN 55.3% 74.0% 44.1% 55.6% 93.1% 83 20 41 22 1945 21122 91 126 51.3% 0.123
MOT17-04-SDP 64.9% 74.1% 57.8% 76.0% 97.4% 83 43 30 10 952 11404 199 246 73.6% 0.163
MOT17-05-FRCNN 44.2% 62.1% 34.2% 46.7% 84.6% 133 9 71 53 586 3689 120 207 36.5% 0.228
MOT17-02-SDP 34.6% 44.8% 28.2% 47.7% 75.8% 62 9 38 15 2837 9713 233 269 31.2% 0.214
MOT17-10-DPM 16.1% 19.8% 13.5% 36.7% 53.9% 57 2 28 27 4029 8132 359 532 2.5% 0.288
MOT17-10-FRCNN 27.8% 32.3% 24.4% 51.5% 68.0% 57 9 44 4 3114 6232 492 782 23.4% 0.232
MOT17-02-DPM 22.0% 39.1% 15.3% 26.0% 66.5% 62 7 16 39 2438 13749 137 137 12.1% 0.257
MOT17-02-FRCNN 35.0% 57.2% 25.3% 35.2% 79.6% 62 6 28 28 1670 12046 95 127 25.7% 0.149
MOT17-05-SDP 43.7% 53.9% 36.8% 55.8% 81.7% 133 11 90 32 862 3060 204 280 40.3% 0.208
MOT17-11-FRCNN 50.3% 64.7% 41.1% 57.9% 91.1% 75 12 38 25 533 3974 95 165 51.2% 0.152
MOT17-09-FRCNN 53.8% 73.4% 42.5% 56.9% 98.3% 26 7 16 3 53 2293 39 51 55.2% 0.161
MOT17-13-DPM 13.0% 20.5% 9.6% 19.6% 42.2% 110 1 39 70 3135 9357 351 480 -10.3% 0.312
MOT17-11-DPM 30.7% 32.1% 29.4% 55.2% 60.3% 75 12 28 35 3422 4228 109 130 17.8% 0.248
MOT17-10-SDP 27.3% 30.5% 24.8% 60.3% 74.3% 57 8 46 3 2675 5100 617 965 34.6% 0.249
OVERALL 39.1% 48.1% 32.9% 51.6% 75.5% 1638 209 899 530 56573 162995 5536 7690 33.2% 0.199