Welcome to the 21st annual NCAA PT Awards. Starting a 3rd decade, and getting later every year.
The purpose of these awards is to help raise the publicity for those systems that have been
superior in various qualities of interest.  Awards are be based entirely on the numbers
I've monitored with my prediction tracker web pages. For the 2020 season I followed the
weekly performance of 44 computer rating  systems.  This was down by almost 20 systems from
the previous year. With COVID-19 leading to a chaotic schedule several people decided to just
sit out the season.



  MOST STRAIGHT UP WINNERS (Entire Season)

Winner:  ESPN FPI



  This year I collected the predictions of 532 games involving two FBS teams.  Due to COVID-19
scheduling this is almost 250 games fewer than a typical season.
The system that picked the most correct winners was ESPN FPI, 391-141, 73.496%. It seems to me that
this rating system put out by ESPN has been getting a little better each season.  And I want to take
the opportunity to thank them for allowing me access to their game predictions so that they can be
included in these comparisons.  Teamrankings.com and the median of all system predictions finish only
1 and 2 games behind ESPN.  The updated line finished in 15th place, 11 games behind and actually 2
games behind the midweek line. The opening line did not have a good season, finishing 32nd.
The winning percentages are down this year but I think that can be explained by the schedule not including
many non-conference games which are often mismatches.


2020 Winner: ESPN FPI  (73.5%)
2019 Winner: Pigskin Index (76.23%)
2018 Winner: Dokter Entropy (74.77%)
2017 Winner: Ashby Accuratings (74.23%)
2016 Winner: Dokter Entropy, Catherwood Rating System  (72.9%)
2015 Winner: Ted Thompson Average record(78.361%), Pi-Rate Mean
2014 Winner: Ted Thompson CAL
2013 Winner: Ted Thompson SPRS
2012 Winner: Hank Trexler
2011 Winner: Covers.com, Tempo Free Gridiron
2010 Winner: Dokter Entropy
2009 Winner: Pigskin Index
2008 Winner: System Average, System Median
2007 Winner: StatFox
2006 Winner: Thompson SPRS, system average, Sagarin predictive, & Sagarin overall
2005 Winner: Pigskin Index
2004 Winner: Jeff Sagarin's Overall Rating
2003 Winner: Edward Kambour & Jeff Sagarin's Overall Rating
2002 Winner: ARGH Power Ratings
2001 Winner: Massey Ratings
2000 Winner: ARGH Power Ratings
1999 Winner: Vegas line




  SMALLEST DEVIATION FROM ACTUAL GAME SCORES (Entire Season)

Winner:  Computer Adjusted Line

  Deviation from the game score is the difference between the game prediction
and the actual result.  A value of zero would mean the score difference is predicted
exactly.  One property of a good system would be to minimize the system's average
game deviation.
  The computer adjusted line had the smallest average absolulte error this year, 12.8801
points.  The computer adjusted line also won last season. The updated line was second place
and only 0.005 points behind.  The computer line is built on the updated line and removes or
adds a fractions of a point depending on how many systems are on one side of the line.
The winning mark for the season is the highest since 2016 and one of the highest we have ever seen.
Possibly also due to the uncertainty of an unusual season.
ESPN, Dokter, and teamranksing.com all finished behind the lines with 13.00.


2020 Winner: Computer Adjusted Line (12.8801)
2019 Winner: Computer Adjusted Line (12.1873)
2018 Winner: Updated Vegas Line (12.6449)
2017 Winner: Updated Vegas Line (12.2750)
2016 Winner: Updated Vegas Line (12.8984)
2015 Winner: Updated Vegas Line (12.4022)
2014 Winner: Updated Vegas Line (12.4770)
2013 Winner: Computer Adjusted Line
2012 Winner: Computer Adjusted Line
2011 Winner: Computer Adjusted Line
2010 Winner: Computer Adjusted Line
2009 Winner: Computer Adjusted Line (record 11.26)
2008 Winner: Vegas Line
2007 Winner: Vegas Line
2006 Winner: Computer Adjusted Line
2005 Winner: Vegas Line
2004 Winner: Vegas Line
2003 Winner: Vegas Line
2002 Winner: Vegas Line
2001 Winner: Vegas Line
2000 Winner: Vegas Line
1999 Winner: Vegas Line



  BEST AGAINST THE SPREAD (Entire Season)

Winner:  ARGH Ratings


  Beating the spread is not the number one goal for most computer
rating systems.  But it is something that the average person likes
to look at and probably the most popular subject that I get emails
about.  I know that looking at all the games is probably not the
most meaningful of measurements but it is what I have been reporting.
The line of record is taken midweek.  Usually Thursday mornings.
  ARGH Ratings did the best against the spread this year, 278-229, 54.832%.
This was a percentage point better than Pi-ratings Mean in second place.
These numbers are about average for what we have seen the last few years.
The results this season were fairly equally distributed around 50%.


2020 Winner: ARGH Ratings (54.832%)
2019 Winner: Roundtable (54.623%), Keeper (54.534)
2018 Winner: Updated Line (55.906%), Pi-Rate Ratings (55.336%)
2017 Winner: Sagarin Ratings (53.482%)
2016 Winner: Updated Line (53.846), Dave Congrove(collegefootballpoll.com) (53.774)
2015 Winner: Updated Line, Computer Adjusted Line, The Sports Cruncher
2014 Winner: Laffaye RWP
2013 Winner: CPA Rankings (record 56.906%)
2012 Winner: Laz Index, Computer Adjusted Line
2011 Winner: Dunkel Index
2010 Winner: Catherwood Ratings
2009 Winner: Covers.com
2008 Winner: Stephen Kerns
2007 Winner: Nutshell Sports
2006 Winner: Harmon Forecast
2005 Winner: Keeper's College Football Ratings
2004 Winner: Edward Kambour
2003 Winner: Edward Kambour
2002 Winner: Dunkel Index
2001 Winner: BMC Picks
2000 Winner: Dunkel Index
1999 Winner: Average across all systems


  SMALLEST AVERAGE GAME BIAS (Entire Season)

Winner:  thepowerrank.com

  Bias is a little different from deviation.  Deviation measures the
distance between a prediction and the actual result.  Bias combines
distance and location of the prediction.   Bias measures whether the
predictions are too high or too low.  It could be specified in different
terms but my numbers are relative to the home team.
   Ed Feng at thepowerrank.com had the smallest average  bias this season,
-0.1203.  He was actually the ony system less than half a point and one of
only two that didn't give too much to the home teams.  The median value was
1.39 points.


2020 Winner: thepowerranks.com (-0.1203)
2019 Winner: ESPN FPI (0.0599)
2018 Winner: Billingsley+  (-0.0020)
2017 Winner: Laz Index
2016 Winner: Pi-Rate Mean
2015 Winner: SportsTrends
2014 Winner: Billingsley Report
2013 Winner: Ted Thompson Average
2012 Winner: College Football By the Numbers
2011 Winner: The Pi-Rate Ratings
2010 Winner: Sagarin Predictor (record 0.0010)
2009 Winner: CPA Retro Rankings
2008 Winner; Opening Line
2007 Winner: Thompson SPRS
2006 Winner: Congrove Computer Rankings
2005 Winner: Computer Adjusted Line
2004 Winner: CPA Rankings
2003 Winner: Edward Kambour
2002 Winner: Gupta Power Ratings
2001 Winner: Flyman
2000 Winner: ARGH Power Ratings
1999 Winner: Jeff Sagarin




  MOST ACCURATE PREDICTOR (Entire Season)

Winner:  Computer Adjusted Line

  This award is based on mean square error. Mean square error takes
into account both deviation and bias and is perhaps the most commonly
used measure of evaluating estimators. A key feature is a larger penalty
for being farther from the actual result.
  The computer adjusted line had the lowest mean square error, 255.565.  This was
followed by the updated and then midweek line.  ESPN was 4th.


2020 Winner: Computer Adjusted Line (255.565
2019 Winner: Computer Adjusted Line (241.469)
2018 Winner: Updated Vegas Line (260.228)
2017 Winner: Updated Vegas Line (246.617)
2016 Winner: Updated vegas line (276.082)
2015 Winner: Updated vegas line (250.418)
2014 Winner: Updated vegas line (249.765)
2013 Winner: Computer Adjusted Line
2012 Winner: Computer Adjusted Line
2011 Winner: Computer Adjusted Line
2010 Winner: Computer Adjusted Line
2009 Winner: The Vegas Line  (record 206.152)
2008 Winner: The Vegas Line
2007 Winner: The Vegas Line
2006 Winner: The Vegas Line
2005 Winner: The Vegas Line
2004 Winner: The Vegas Line
2003 Winner: The Vegas Line
2002 Winner: The Vegas Line
2001 Winner: The Vegas Line
2000 Winner: The Vegas Line
1999 Winner: The Vegas Line



    ------------------------



  It is debatable how meaningful rating systems are in the early
parts of the season.  How can you rate the teams in the first
week of the season when no teams have played a game yet?  The playoff
committee waits until mid October before releasing its first ranking
of teams.  Some systems choose to wait until around this time
before being made public. Looking at only the second half of the
season also gives an estimate of how well a system does based
only(or mostly) on data from the current year.




   MOST STRAIGHT UP WINNERS (Second Half of Season)



Winner:  Sagarin Ratings


  The second half data started with week 8 and consisted of 347 games
between two FBS teams.  Jeff Sagarin Ratings had the best record picking winners,
264-83, 76.081%.  This is the best we have seen since a record was set in 2015.
Donchess, system median and Harville finished two games behind.
The updated line was in the middle of the pack in 24th place, a game behind the
midweek line but still 8 games better than the opening line.


2020 Winner:  Sagarin Ratings    (76.081%)
2019 Winner:  Pigskin Index      (75.401%)
2018 Winner:  Dave Congrove      (74.390%)
2017 Winner:  Ashby Accuratings  (74.634%)
2016 Winner:  Dokter Entropy     (71.250%)
2015 Winner:  Thompson Average   (78.23%  RECORD)
2014 Winner:  Dave Congrove      (74.822%)
2013 Winner:  CPA Rankings
2012 Winner:  PerformanZ Ratings
2011 Winner:  Tempo Free Gridiron.
2010 Winner:  Brent Craig
2009 Winner:  Massey Ratings
2008 Winner:  Nutshell Sports
2007 Winner:  Edward Kambour
2006 Winner:  Ed Bemiss
2005 Winner:  Dunkel Index
2004 Winner:  Jeff Sagain, Wesley Colley
2003 Winner:  Born Power Index & Edward Kambour
2002 Winner:  Born Power Index
2001 Winner:  Chris Montgomery
2000 Winner:  Geoff Freeze



  SMALLEST DEVIATION FROM ACTUAL GAME SCORES  (Second Half of Season)

Winner:  Pigskin Index

The best for the second half was the Computer Adjusted Line with an average error of 12.6124.
This was closely followed by the updated line then midweek line.  Teamrankings.com comes in
4th.


2020 Winner:  Computer Adjusted Line (12.6124))
2019 Winner:  Pigskin Index  (12.4357)
2018 Winner:  Updated Line   (12.4634)
2017 Winner:  Updated Line   (12.3256)
2016 Winner:  Updated Line   (13.6008)
2015 Winner:  Updated Line   (12.4879)
2014 Winner:  Ashby Accuratings
2013 Winner:  CPA Rankings
2012 Winner:  Computer Adjusted Line
2011 Winner:  Vegas Line
2010 Winner:  Computer Adjusted Line
2009 Winner:  Computer Adjusted Line (record 11.2917)
2008 Winner:  StatFox
2007 Winner:  Edward Kambour
2006 Winner:  Computer Adjusted Line
2005 Winner:  Vegas Line
2004 Winner:  Ken Ashby AccuRatings
2003 Winner:  Vegas Line (opening)
2002 Winner:  Vegas Line
2001 Winner:  Vegas Line
2000 Winner:  Vegas Line



  BEST AGAINST THE SPREAD  (Second Half of Season)



Winner:  ARGH Ratings

  ARGH ratings won the full season and also the second half against the spread with
record of 178-149, 54.434%.  The is the lowest winning percentage of the last decade.
Even though a small majority did better than 50% nobody really did great or bad.
David Harville was 2nd place at only 52.9%.


2020 Winner:  ARGH Ratings   (54.443%)
2019 Winner:  Sagarin Recent (58.378%)
2018 Winner:  Updated Line   (58.955%), Computer Adjusted Line (56.584%), TeamRankings.com (55.890%)
2017 Winner:  ESPN FPI       (54.523%)
2016 Winner:  Lee Burdof     (56.041%)
2015 Winner:  Updated Line, Computer Adjusted Line, SportsTrends.
2014 Winner:  Massey Consensus Rank
2013 Winner:  CPA Rankings (Record 59.322%)
2012 Winner:  Least Squares with team HFA
2011 Winner:  Dunkel Index
2010 Winner:  Least squares regression
2009 Winner:  Sonny Moore
2008 Winner:  StatFox
2007 Winner:  Nutshell Sports
2006 Winner:  Ed Bemiss
2005 Winner:  The Sports Report
2004 Winner:  StatFox          (record 58.94% against updated line)
2003 Winner:  Edward Kambour
2002 Winner:  The Sports Report
2001 Winner:  BMC Picks
2000 Winner:  The Buck System




  SMALLEST AVERAGE GAME BIAS  (Second Half of Season)

Winner:  thepowerrank.com

Thepowerrank.com becomes another system this season to win both full and second half awards in
a given category.  Perhaps that is because the "2nd Half" this year ends up being more than 50% of
all the games due to the COVID driven scheduling.  The numbers were not that great this season.
Feng led with 0.0348 and Sagarin Golden Means was second at 0.1602.  Only one system gave too few
points to the home teams.


2020 Winner:  thepowerrank.com  (0.0348)
2019 Winner:  Roundtable        (0.0029)
2018 Winner:  Laffaye RWP       (-0.0099)
2017 Winner:  Catherwood Ratings   (-0.1561)
2016 Winner:  PerformanZ Ratings
2015 Winner:  CPA Retro
2014 Winner:  Laz Index
2013 Winner:  Colley matrix
2012 Winner:  College Football by the Numbers
2011 Winner:  Stat Fox
2010 Winner:  Sonny Moore
2009 Winner:  Nutshell Girl
2008 Winner:  Dunkel Index
2007 Winner:  CPA Rankings
2006 Winner:  Vegas Line
2005 Winner:  Brent Moore
2004 Winner:  Least Squares Regression
2003 Winner:  Darrly Marsee
2002 Winner:  Massey BCS
2001 Winner:  PerformanZ Ratings
2000 Winner:  Darryl Marsee's Rankings



  MOST ACCURATE PREDICTOR (Second Half of Season)


Winner:  Updated Vegas Line

  The updated Vegas line had the smallest average mean square error over the second
half, 248.877.  This was followed by computer adjusted line, midweek line, and
teamrankings.com in 4th.


2020 Winner:  Updated Line  (248.877)
2019 Winner:  Pigskin Index (245.220)
2018 Winner:  Updated Line  (258.776)
2017 Winner:  Updated Line  (254.153)
2016 Winner:  Updated Line  (297.826)
2015 Winner:  Midweek Line  (254.896)
2014 Winner:  Thompson CAL  (266.308)
2013 Winner:  CPA Rankings
2012 Winner:  Computer Adjusted Line
2011 Winner:  Computer Adjusted Line
2010 Winner:  Computer Adjusted Line
2009 Winner:  Computer Adjusted Line    (record 208.618)
2008 Winner:  Born Power Index
2007 Winner:  Atomic Football
2006 Winner:  Vegas Line
2005 Winner:  Vegas Line
2004 Winner:  Ashby Accuratings
2003 Winner:  Vegas Line
2002 Winner:  Vegas Line
2001 Winner:  Vegas Line
2000 Winner:  Vegas Line






  BEST PREDICTIVE SYSTEM  

Winner:  Pi-Ratings Mean

  To come up with the best overall predictive system I give each system
points for how well they do in all of the above categories.  I then sum up
the points and the system with the highest total is named predictive system
of the year.  So this award goes to the system that is the most well rounded
One flaw can be enough to pull a system out of the running.
 This year the two top were within 0.002 points.  But both are maintained by
the same person.  The best predictive system of 202 was Pi-Ratings Mean with
Pi-Rate ratings coming in a close second.  Pi-Rate Ratings was the best across
the full season. Sagarin Recent was best across the second half only data. But
combining it all together the best over all was Pi-Ratings Mean.
Donchess, ESPN and teamrankings.com also had good seasons.



2020 Winner:  Pi-Ratings Mean
2019 Winner:  Pigskin Index
2018 Winner:  Donchess Dratings.com
2017 Winner:  ESPN FPI
2016 Winner:  Updated Line
2015 Winner:  Atomic Football
2014 Winner:  Billingsley+
2013 Winner:  CPA Rankings
2012 Winner:  System Average
2011 Winner:  Dunkel Index
2010 Winner:  Catherwood Ratings
2009 Winner:  Ed Kambour
2008 Winenr:  StatFox
2007 Winner:  Harmon Forecast
2006 Winner:  Computer Adjusted Line
2005 Winner:  Dunkel Index
2004 Winner:  Ken Ashby AccuRatings
2003 Winner:  Ed Kambour
2002 Winner:  Ed Kambour
2001 Winner:  Kenneth Massey (non-BCS)
2000 Winner:  ARGH Power Ratings