Monday, May 22, 2006

Hot Air: Appropriately Named?

Kevin Carey of Education Sector released a new report recently called “Hot Air: How States Inflate Their Educational Progress Under NCLB. After putting the data together they’ve come up with something called “The Pangloss Index”, which combines 11 different sets of data that the states self-report to identify those states that are the most aggressive in reporting the highest numbers on factors like 4th grade test scores, 8th grades scores, and dropout rates. Their thinking is to expose states like Wisconsin, which has the best cumulative scores and is thus #1 on the index, but gets there by playing fast and loose with the data-gathering required under NCLB.

The devil, as usual, is in the details, and it’s the details that render the report meaningless. Two paragraphs on page 13 are important here. The first is when they’re talking about how they figured the scores for 4th grade, 8th grade, and high school:

This amount, as well as the average proficiency rates in eighth grade and high school, is calculated by averaging separately reported reading and math proficiency rates. If a state reported a proficiency rate in one subject but not the other, the proficiency rate for the reported subject was used.

In the 4th grade, Kansas, Missouri, and Ohio reported scores in math, but not reading. Kentucky and Nevada had scores in reading, but not math. Kansas thus gets to roll along with the 84.4% that they reported in math, while Missouri’s lone score, also in math, is a 43%. Nevada has to use its reading score, 41.5%. My guess is that Carey wanted to stick to those grades that equate to the NAEP test, but I think he would have benefited the paper by taking a score from a nearby grade (3rd or 5th, for example), instead of letting a score stand by itself.

The other paragraph of importance:

Some states did not submit data for some measures. In those cases, states were, for ranking purposes, assigned the median value of those states that did submit data.

27 states had at least one area where they didn’t report a score; Washington State, for example, didn’t report scores for 8th grade math and reading because our big state assessment has been in the 7th grade. New York leads the pack with 6 different areas where they didn’t report a score. For some states they were able to use a score from a different test, the way I described above, but for those states that had no alternate score to rely on they are being judged by the standards of what others are doing, and that doesn’t make sense.

In sum, the goal of what Carey has done here is worthwhile. One of the reasons that we're all in the trouble that we are now is because of the games that have been played with data over the years. Carey, though, commits the same sin that he's taking the states to task for doing, and it lessens the overall impact of what could have been a pretty important piece of work.

2 Comments:

Blogger Mike in Texas said...

I don't really even feel the need to read the study to know its bogus. Making up indexes to measure schools is a favorite tactic of the "reform" crowd.

9:22 AM  
Anonymous Anonymous said...

豆豆聊天室 aio交友愛情館 2008真情寫真 2009真情寫真 aa片免費看 捷克論壇 微風論壇 大眾論壇 plus論壇 080視訊聊天室 情色視訊交友90739 美女交友-成人聊天室 色情小說 做愛成人圖片區 豆豆色情聊天室 080豆豆聊天室 小辣妹影音交友網 台中情人聊天室 桃園星願聊天室 高雄網友聊天室 新中台灣聊天室 中部網友聊天室 嘉義之光聊天室 基隆海岸聊天室 中壢網友聊天室 南台灣聊天室 南部聊坊聊天室 台南不夜城聊天室 南部網友聊天室 屏東網友聊天室 台南網友聊天室 屏東聊坊聊天室 雲林網友聊天室 大學生BBS聊天室 網路學院聊天室 屏東夜語聊天室 孤男寡女聊天室 一網情深聊天室 心靈饗宴聊天室 流星花園聊天室 食色男女色情聊天室 真愛宣言交友聊天室 情人皇朝聊天室 上班族成人聊天室 上班族f1影音視訊聊天室 哈雷視訊聊天室 080影音視訊聊天室 38不夜城聊天室 援交聊天室080 080哈啦聊天室 台北已婚聊天室 已婚廣場聊天室 夢幻家族聊天室 摸摸扣扣同學會聊天室 520情色聊天室 QQ成人交友聊天室 免費視訊網愛聊天室 愛情公寓免費聊天室 拉子性愛聊天室 柔情網友聊天室 哈啦影音交友網 哈啦影音視訊聊天室 櫻井莉亞三點全露寫真集 123上班族聊天室 尋夢園上班族聊天室 成人聊天室上班族 080上班族聊天室 6k聊天室 粉紅豆豆聊天室 080豆豆聊天網 新豆豆聊天室 080聊天室 免費音樂試聽 流行音樂試聽 免費aa片試看A片 免費a長片線上看 色情貼影片 免費a長片 本土成人貼圖站 大台灣情色網 台灣男人幫論壇 A圖網 嘟嘟成人電影網 火辣春夢貼圖網 情色貼圖俱樂部 台灣成人電影 絲襪美腿樂園 18美女貼圖區 柔情聊天網 707網愛聊天室聯盟 台北69色情貼圖區 38女孩情色網 台灣映像館 波波成人情色網站 美女成人貼圖區 無碼貼圖力量 色妹妹性愛貼圖區 日本女優貼圖網 日本美少女貼圖區 亞洲風暴情色貼圖網 哈啦聊天室 美少女自拍貼圖 辣妹成人情色網 台北女孩情色網 辣手貼圖情色網 AV無碼女優影片 男女情色寫真貼圖 a片天使俱樂部 萍水相逢遊戲區 平水相逢遊戲區 免費視訊交友90739 免費視訊聊天 辣妹視訊 - 影音聊天網 080視訊聊天室 日本美女肛交 美女工廠貼圖區 百分百貼圖區 亞洲成人電影情色網 台灣本土自拍貼圖網 麻辣貼圖情色網 好色客成人圖片貼圖區 711成人AV貼圖區 台灣美女貼圖區 筱萱成人論壇 咪咪情色貼圖區 momokoko同學會視訊 kk272視訊 情色文學小站 成人情色貼圖區 嘟嘟成人網 嘟嘟情人色網 - 貼圖區 免費色情a片下載 台灣情色論壇 成人影片分享 免費視訊聊天區 微風 成人 論壇 kiss文學區 taiwankiss文學區

4:56 AM  

Post a Comment

Links to this post:

Create a Link

<< Home