Complete Results @ http://www.newx-forecasts.com/
Follow the left-side link from 'Storm Contest Verified Forecasts’ – Snow Storm #4 to see the complete station forecast verification table.
In the table...
Yellow cells indicate the best score in category.
Forecast STP is yellow if within +/- 5% of observed STP.
Blue (Red) cells indicate the top (lower) 25% percentile.
SUMSQ: sum of square errors
STP: storm total precipitation
TAE: total absolute
error
AAE: average absolute error
Final Standings - all Forecasters
Forecaster |
Class |
4casts |
Sum Square |
STP |
TOTAL
Absolute |
AVG
Absolute |
|
|
|
|
|
|||||||||||||
Error |
Error Z |
%MPROV over
AVG |
Rank |
113.7 |
Error |
Error Z |
%MPROV over
AVG |
Rank |
Error |
Error Z |
%MPROV over
AVG |
Rank |
Error |
Error Z |
%MPROV over
AVG |
Rank |
RSQ |
RSQ Z |
%MPROV over
AVG |
Rank |
Forecaster |
|||
donsutherland1 |
Senior |
19 |
69.9 |
-0.825 |
58.1% |
1 |
106.6 |
7.10 |
-0.534 |
52.1% |
4 |
29.4 |
-0.981 |
33.0% |
2 |
1.55 |
-0.747 |
26.0% |
4 |
88.0% |
0.948 |
16.7% |
1 |
donsutherland1 |
Brad Yehl |
Journeyman |
19 |
73.7 |
-0.793 |
55.8% |
2 |
101.3 |
12.40 |
-0.167 |
16.4% |
7 |
28.5 |
-1.042 |
35.0% |
1 |
1.50 |
-0.813 |
28.3% |
2 |
87.8% |
0.932 |
16.4% |
2 |
Brad Yehl |
TQ |
Senior |
22 |
78.3 |
-0.754 |
53.1% |
3 |
121.2 |
7.45 |
-0.509 |
49.7% |
5 |
33.7 |
-0.693 |
23.3% |
3 |
1.53 |
-0.772 |
26.8% |
3 |
86.7% |
0.850 |
14.9% |
3 |
TQ |
Herb@MAWS |
Senior |
21 |
93.5 |
-0.624 |
44.0% |
4 |
114.4 |
0.70 |
-0.976 |
95.3% |
1 |
38.5 |
-0.364 |
12.3% |
6 |
1.83 |
-0.354 |
12.3% |
7 |
83.3% |
0.598 |
10.5% |
4 |
Herb@MAWS |
Roger Smith |
Senior |
24 |
102.4 |
-0.549 |
38.7% |
5 |
105.0 |
8.70 |
-0.423 |
41.3% |
6 |
35.3 |
-0.581 |
19.5% |
4 |
1.47 |
-0.853 |
29.7% |
1 |
83.0% |
0.575 |
10.1% |
5 |
Roger Smith |
iralibov |
Senior |
22 |
118.0 |
-0.416 |
29.3% |
6 |
129.0 |
15.25 |
0.030 |
-2.9% |
9 |
39.3 |
-0.313 |
10.5% |
7 |
1.78 |
-0.422 |
14.7% |
6 |
82.5% |
0.531 |
9.3% |
6 |
iralibov |
flame_boy |
Rookie |
22 |
121.7 |
-0.385 |
27.1% |
7 |
134.3 |
20.60 |
0.399 |
-39.0% |
11 |
40.6 |
-0.222 |
7.5% |
8 |
1.85 |
-0.337 |
11.7% |
8 |
80.9% |
0.417 |
7.3% |
7 |
flame_boy |
Shillelagh |
Senior |
22 |
138.0 |
-0.246 |
17.3% |
8 |
100.4 |
13.30 |
-0.105 |
10.3% |
8 |
36.4 |
-0.507 |
17.0% |
5 |
1.65 |
-0.600 |
20.9% |
5 |
76.6% |
0.088 |
1.5% |
8 |
Shillelagh |
Mitchel Volk |
Senior |
20 |
170.7 |
0.032 |
-2.3% |
10 |
114.6 |
0.90 |
-0.962 |
93.9% |
2 |
45.0 |
0.076 |
-2.6% |
10 |
2.25 |
0.219 |
-7.6% |
10 |
75.0% |
-0.029 |
-0.5% |
9 |
Mitchel Volk |
bruced39 |
Senior |
20 |
170.7 |
0.031 |
-2.2% |
9 |
107.5 |
6.20 |
-0.596 |
58.2% |
3 |
42.7 |
-0.080 |
2.7% |
9 |
2.13 |
0.061 |
-2.1% |
9 |
69.9% |
-0.416 |
-7.3% |
10 |
bruced39 |
Donald Rosenfeld |
Senior |
22 |
187.3 |
0.173 |
-12.2% |
11 |
130.8 |
17.10 |
0.157 |
-15.4% |
10 |
50.6 |
0.455 |
-15.3% |
11 |
2.30 |
0.288 |
-10.0% |
11 |
68.4% |
-0.530 |
-9.3% |
11 |
Donald Rosenfeld |
snowman |
Senior |
20 |
362.0 |
1.658 |
-116.8% |
12 |
90.0 |
23.70 |
0.613 |
-59.9% |
12 |
69.1 |
1.709 |
-57.5% |
12 |
3.45 |
1.876 |
-65.2% |
12 |
39.6% |
-2.706 |
-47.6% |
13 |
snowman |
MarkHofmann |
Senior |
21 |
484.1 |
2.696 |
-190.0% |
13 |
173.0 |
59.30 |
3.073 |
-300.1% |
13 |
81.4 |
2.542 |
-85.5% |
13 |
3.88 |
2.455 |
-85.4% |
13 |
58.8% |
-1.258 |
-22.1% |
12 |
MarkHofmann |
Forecast
Parameters |
274 |
Error |
Error Z |
% MPRV |
Rank |
STP |
Error |
Error Z |
%MPRV |
Rank |
Error |
Error Z |
%MPRV |
Rank |
Error |
Error Z |
%MPRV |
Rank |
RSQ |
RSQ Z |
%MPRV |
Rank |
Forecast
Parameters |
|
MIN |
19 |
69.9 |
-0.825 |
-190.0% |
1 |
90.0 |
0.7 |
-0.976 |
-300.1% |
1 |
28.5 |
-1.042 |
-85.5% |
1 |
1.47 |
-0.853 |
-85.4% |
1 |
39.6% |
-2.706 |
-47.6% |
1 |
MIN |
|
MAX |
24 |
484.1 |
2.696 |
58.1% |
13 |
173.0 |
59.3 |
3.073 |
95.3% |
13 |
81.4 |
2.542 |
35.0% |
13 |
3.88 |
2.455 |
29.7% |
13 |
88.0% |
0.948 |
16.7% |
13 |
MAX |
|
AVG |
21 |
167.0 |
0.000 |
0.0% |
7 |
117.5 |
14.8 |
0.000 |
0.0% |
7 |
43.9 |
0.000 |
0.0% |
7 |
2.09 |
0.000 |
0.0% |
7 |
75.4% |
0.000 |
0.0% |
7 |
AVG |
|
Median |
21 |
121.7 |
-0.385 |
27.1% |
7 |
114.4 |
12.4 |
-0.167 |
16.4% |
7 |
39.3 |
-0.313 |
10.5% |
7 |
1.83 |
-0.354 |
12.3% |
7 |
80.9% |
0.417 |
7.3% |
7 |
Median |
|
Mode |
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Mode |
|
STD |
1 |
117.6 |
1.000 |
70.5% |
3.7 |
20.4 |
14.5 |
1.000 |
97.6% |
3.7 |
14.8 |
1.000 |
33.6% |
3.7 |
0.73 |
1.000 |
34.8% |
3.7 |
13.3% |
1.000 |
17.6% |
3.7 |
STD |
|
25% |
20 |
93.5 |
-0.624 |
-2.3% |
4 |
105.0 |
7.1 |
-0.534 |
-15.4% |
4 |
35.3 |
-0.581 |
-2.6% |
4 |
1.55 |
-0.747 |
-7.6% |
4 |
69.9% |
-0.416 |
-7.3% |
4 |
|
|
75% |
22 |
170.7 |
0.032 |
44.0% |
10 |
129.0 |
17.1 |
0.157 |
52.1% |
10 |
45.0 |
0.076 |
19.5% |
10 |
2.25 |
0.219 |
26.0% |
10 |
83.3% |
0.598 |
10.5% |
10 |
|
Perfect Forecasts
Rank |
Forecaster |
'Perfect
Forecast' Stations |
bat avg |
1 |
donsutherland1 |
PVD |
0.053 |
2 |
MarkHofmann |
PWM |
0.048 |
3 |
Donald Rosenfeld |
CAR |
0.045 |
3 |
TQ |
IAD |
0.045 |
5 |
Brad Yehl |
|
0.000 |
5 |
bruced39 |
|
0.000 |
5 |
flame_boy |
|
0.000 |
5 |
Herb@MAWS |
|
0.000 |
5 |
iralibov |
|
0.000 |
5 |
Mitchel Volk |
|
0.000 |
5 |
Roger Smith |
|
0.000 |
5 |
Shillelagh |
|
0.000 |
5 |
snowman |
|
0.000 |
Best Station Forecasts (Batting Average - Percentage of Forecast Stations with Lowest Absolute Error)
Rank |
Forecaster |
'Lowest
Error' Stations |
TOT |
bat avg |
1 |
bruced39 |
CON BDR BDL ISP JFK |
5 |
0.250 |
2 |
donsutherland1 |
PVD ALB ISP JFK |
4 |
0.211 |
3 |
Roger Smith |
BGR ISP JFK ABE |
4 |
0.167 |
4 |
Donald Rosenfeld |
CAR BDR BDL |
3 |
0.136 |
4 |
Shillelagh |
BTV HYA JFK |
3 |
0.136 |
6 |
MarkHofmann |
PWM BOS |
2 |
0.095 |
7 |
iralibov |
ORH BGM |
2 |
0.091 |
7 |
TQ |
ABE IAD |
2 |
0.091 |
9 |
Brad Yehl |
MDT |
1 |
0.053 |
10 |
Mitchel Volk |
BOS |
1 |
0.050 |
11 |
Herb@MAWS |
BDL |
1 |
0.048 |
12 |
flame_boy |
EWR |
1 |
0.045 |
13 |
snowman |
|
0 |
0.000 |
Best Station Forecast Busts (Batting Average - Percentage of Forecast Stations with Highest Absolute Error)
Rank |
Forecaster |
'Highest
Error' Stations |
TOT |
bat avg |
1 |
snowman |
CAR BOS ORH BDL ALB BGM
EWR |
7 |
0.350 |
2 |
MarkHofmann |
BGR CON HYA BDR ISP JFK
ACY |
7 |
0.333 |
3 |
Donald Rosenfeld |
BTV PVD ISP ABE BWI |
5 |
0.227 |
4 |
flame_boy |
PHL IAD DCA |
3 |
0.136 |
5 |
bruced39 |
ABE MDT |
2 |
0.100 |
6 |
iralibov |
PWM |
1 |
0.045 |
6 |
Shillelagh |
BOS |
1 |
0.045 |
8 |
Roger Smith |
SBY |
1 |
0.042 |
9 |
Brad Yehl |
|
0 |
0.000 |
9 |
donsutherland1 |
|
0 |
0.000 |
9 |
Herb@MAWS |
|
0 |
0.000 |
9 |
Mitchel Volk |
|
0 |
0.000 |
9 |
TQ |
|
0 |
0.000 |
Consensus forecast best @ BGR…PWM…ALB
MAX forecast best @ BOS…BGM…EWR
MAX forecast less than observed @ BGM…EWR
MIN forecasts best @ CAR…HYA…PVD…MDT
MIN forecasts more than observed @ HYA
Good association between SUMSQ and TAE Z-scores
*******************************
Verification:
Good data from CDUS41…PNS…and F6 bulletins.
BDL SLR contaminated by FZRA
Rank |
Station |
Snow |
SN:H2O |
1 |
BGM |
13.2 |
10.6 |
2 |
ORH |
12.2 |
10.9 |
3 |
BOS |
10.7 |
9.6 |
4 |
ALB |
10.4 |
11.2 |
5 |
BDL |
10.2 |
8.0 |
6 |
BTV |
9.3 |
20.7 |
7 |
PWM |
9.0 |
12.7 |
8 |
CON |
7.8 |
10.4 |
9 |
BDR |
7.5 |
|
10 |
BGR |
6.7 |
30.5 |
11 |
EWR |
4.6 |
|
12 |
PVD |
4.5 |
|
13 |
ABE |
2.4 |
|
14 |
JFK |
2.2 |
|
15 |
ISP |
1.8 |
|
16 |
MDT |
0.6 |
|
17 |
HYA |
0.5 |
|
18 |
CAR |
0.05 |
|
18 |
IAD |
0.05 |
|
|
PHL |
-
|
|
|
ACY |
-
|
|
|
BWI |
-
|
|
|
DCA |
-
|
|
|
SBY |
-
|
|
|
RIC |
-
|
|
|
ORF |
-
|
|
|
RDU |
-
|
|
|
TOT |
113.7 |
13.8 |
New Daily Records:
WED…05-FEB-14
BOS - 13.2"
(3"; 1976) |
BTV - 9.3"
(7.9"; 1968) |