Sunday, December 03, 2006

More Projection stuff

I've added in Marcel, Bill James, and Ron Shandler's projection OPS to the mix. I'm only looking at 114 players who had 500 or more AB, and I had to eliminate a few (Dan Uggla and Hanley Ramirez among others) because not all systems projected minor leaguers. Kenji Johjima had to go, as only ZIPs and CHONE even tried to project him (very well I might add). I don't have access to Baseball Prospectus 2006, so I'll look at Pecota in a week or so.

Here's the results:

Shandler .702
James .685
ZIPs .684
Chone .677
Marcel .664

So Chone is a little behind the more established systems, but at least it passes the monkey test. As I've read before, there's not a whole lot of room to improve. Shandler, the king of fantasy baseball, beats a first year amateur by 2.5%.

But there's something real interesting here. These algorithms all seems to have different workings. They like different players better than others. For example, Shandler had Paul Konerko at .921 - and Konerko did better than that, totally destroying the other projections, in the .850 range. But Shandler missed the boat on Grady Sizemore, projecting only .774. Sizemore beat all of our projections, but the other systems at least had him in the .800's

Take an average of the top 4 projection systems, and we can get an r of .714! (Adding Marcel subtracts from the combined r, all the others add). So the strategy should be to collect all the projection systems that pass the monkey test, combine them, and we have a projection that reaches uncharted waters in accuracy!

Give this a try, and dominate your fantasy league.

15 Comments:

At 6:54 PM, Anonymous David Gassko said...

Good stuff, Sean, but...

The question is whether or not these differences are statistically significant. Actually, that's not really a question. With just 114 observations, one standard deviation is around .093 points of correlation, which means that these differences are meaningless. With one year's worth of data, you actually can't really prove the superiority of one projection system over another.

Really you need over 1,000 observations for a difference of .05 points of correlation to be significant at the 5% level. That's many years of data and low plate appearance cut-off. Since systems are continually improved, and we probably have to assume that the order of their quality changes due to those improvements ( i.e., that they do not off-set, and some systems improve relative to other systems and not just in relation to themselves), I'm not sure you can run any kind of basic correlation test that will give you significant results.

 
At 4:11 PM, Blogger Chone Smith said...

You're probably right in being virtually impossible to state that one projection system beats another.

This is more like a batting championship. It doesn't prove that Joe Mauer is a better average hitter than Derek Jeter - but he had the best average last year.

 
At 7:08 PM, Anonymous Anonymous said...

As I remind people from time to time, there is no "magic" to a level that reaches some arbitrary level of significance (5%, 1%, etc.), so let's NOT call a difference that is not significant at the 5% level "meaningless." It is not meaningless. It simply reflects a "conclusion" with a certain level of uncertainty, more than some and less than others.

It is a really bad habit in the "real world" (ans sometimes even in science) to dismiss a result that is less than some arbitrary sigma level and "accept" it above that level.

The results of the "r's" suggest that each system is better than the one below it. Period.

As well, these things are often Bayesian problems with a priori probabilities. For example, we can probably assume that there is a high likelihood that Shandler is going to beat Marcel and perhaps even the other ones on the list, since Shandler is a smart guy and puts a lot of time and research into his projections.

MGL

 
At 10:33 PM, Blogger ed-hardy-shirts said...

There are ed hardy shirts
,pretty ed hardy shirt for men,

ed hardy womens in the ed hardy online store

designed by ed hardy ,
many cheap ed hardy shirt ,glasses,caps,trouers ed hardy shirts on sale ,

You can go to edhardyshirts.com to have a look ,you may find one of ed hardy clothing fit for you
Top qualitymen's jacket,
These cheap jacket are on sale now,you can find
north face jackets inmage on our web

 
At 10:33 PM, Blogger ed-hardy-shirts said...

Do you wannaghd hair straighteners for you own , we have many
cheap ghd hair straightenersin style and great,you can choose one from these
hair straighteners
Authentic chaussure puma
chaussure sport
And chaussure nike shoes
Come here to have a look of our Wholesale Jeans
Many fashionMens Jeans ,eye-catching
Womens Jeans ,and special out standing
Blue Jeans ,you can spend less money on our
Discount Jeans but gain really fine jeans, absolutely a great bargain.
www.crazypurchase.com
China Wholesale
wholesale from china
buy products wholesale
China Wholesalers
http://weddingdressseason.com

 
At 10:33 PM, Blogger ed-hardy-shirts said...

 CLOTHES-WHOLESALE.US
straighthairgirl.blog126.fc2.com/
seriousblogging.com/crazygirlsshirts
free-blog-site.com/iammyself
d.hatena.ne.jp/hotfishing
www3.atword.jp/deepseaworld
kandypurity.blogspot.com
blog.oricon.co.jp/jacket-love-girl/
blog.goo.ne.jp/sweetyjackets
blog.360.yahoo.com/
azcentral.com/members/Blog/hotfish234
www2.atword.jp/chaussurespuma/
www2.atword.jp/edhardyshirts/
edhardywomens.blogspot.com/
weddingdressseason.com
seriousblogging.com/chaussurenike/
blog.goo.ne.jp/yutome
d.hatena.ne.jp/chaussuresport/
mensjacketscheap.blogspot.com/
pumashoes.cocolog-nifty.com/blog/
free-blog-site.com/mensjeans
d.hatena.ne.jp/womenjeanswholesale/
www2.atword.jp/wholesalejean/
blog.goo.ne.jp/cheapjeans
blog.360.yahoo.com/

 
At 9:48 PM, Blogger poston said...

wholesale gemstone jewelry
wholesale crystal jewelry
crystal wholesale
rock crystal


crystal jewelry
wholesale jewelry
jewelry wholesale
cheap jewelry

 
At 10:12 PM, Blogger Peejay Li said...

I would like to be the supporter of yours. Thank you for sharing such a nice article.
chaussures puma
puma speed cat
Nike Tn Chaussures
requin tn
nike shox
puma shoes
puma CAT
puma basket
puma speed
baskets puma
puma sport
puma femmes
puma shox r4 torch
nike air max requin
nike shox r3
shox rival r3
tn plus
chaussures shox
nike shox r4 torch
air max tn requin
nike tn femme
pas cher nike
tn chaussures
nike rift
nike shox nz
chaussures shox
nike shox rival
shox rival
chaussures requin
jeans online
cheap armani jeans
cheap G-star jeans

 
At 1:32 AM, Blogger lucyliu said...

nike air max 90
nike air max 95
nike air max tn
nike air rift
nike shox r4
nike air max 360
nike shox nz
puma mens shoes
puma shoes
puma speed
nike shoes
nike air
nike air shoes
puma cat
air max trainers
mens nike air max
nike shoes air max
nike shoes shox
air shoes
nike shoe cart
puma future
cheap puma
sports shoes
nike air rifts
nike air rift trainer
nike air
nike rift
nike rift shoes
cheap nike air rifts
bape shoes
jeans shop
diesel jeans
levis jeans

 
At 5:59 PM, Blogger LAN said...

puma mens shoes
puma shoes
puma speed
nike shoes
nike air
nike air shoes
nike air max 90
nike air max 95
nike air max tn
nike air rift
nike shox r4
nike air max 360
nike shox nz
puma cat
air max trainers
mens nike air max
sports shoes
nike air rifts
nike air rift trainer
nike air
nike shoes air max
nike shoes shox
air shoes
Lucyliu IS Lucyliu
nike shoe cart
puma future
cheap puma
nike rift
jeans shop
diesel jeans
levis jeans
nike rift shoes
cheap nike air rifts
bape shoes

 
At 7:34 PM, Blogger janewangleilei said...

jordan 3
jordan 4
jordan 5
jordan 6
jordan 7
jordan 8
jordan 9

 
At 7:34 PM, Blogger janewangleilei said...

jordan 13
jordan 14
jordan 15
jordan 16
jordan 17 rings
jordan 18
jordan 19

 
At 12:57 AM, Blogger janewangleilei said...

You can have a look at it.
jordan shoes
Wow.
newest jordans
jordan 7
Wonderful!
air yeezy
jordan true flight
If you like,you can contact us.
jordan 3
jordan 4
We offer different styles.
jordan 1
jordan 2
Thanks.
jordan 5
jordan ajf shoes
There are cheap shoes to choose
jordan 6
jordan flight 45
Good quality with low price.
air jordan 2010
Air Jordan 2009
Enjoy it!
jumpman
jordan 28

 
At 6:35 AM, Blogger pitt brid said...

Ralph Lauren (Ralph Lauren) Brand Identity:

1. Polo logo: This is Lauren (Ralph Lauren) the most famous symbol, selected from the Ralph Lauren Polo brand aristocratic LOGO, you can associate the origins of clothing he designed.

2.POLO shirt: by Lauren (Ralph Lauren) created by polo shirts, long and short in front of Yibai is playing polo for the charge when the forward movement and design.

3. Cotton long-sleeved shirt: This is almost polo ralph lauren Safe for men and women of classic style to go with a formal suit, narrow skirt, very American style.

4. American flag logo: cowboy wear the best expression of American spirit, so polo ralph lauren outlet online to represent the United States flag.

5.We offer a huge range of ralph lauren polo T-shirts and polo ralph Lauren shirts, including mens, womens and children. Our ralph lauren outlet supplies cheap lacoste polo etc. with best quality, best service, and fastest ship.polo ralph lauren outlet

◆ POLO (Ralph Lauren) Outlet Website:
http://www.ralphlaurenonsale.com/

 
At 10:22 PM, Blogger aiya said...

Office 2010
Microsoft Office 2010
Microsoft word
Office 2007
Microsoft Office
Microsoft Office 2007
Office 2007 key
Office 2007 download
Office 2007 Professional
Outlook 2010
Microsoft outlook
Microsoft outlook 2010
Windows 7

 

Post a Comment

Links to this post:

Create a Link

<< Home