1
Reviews, Visits, and Rankings / US News historic reputation rankings, and comments on Michigan
« on: June 11, 2006, 11:02:53 PM »
Hi all,
I did some research and compiled the reputation (peer and lawyer/judge) from US News from the 1999 edition through this year's edition. This essentially is the same analysis found in the paper: "The Durability of Law School Reputation" by Shmalbeck which can be found easily on Google. First, here is the 8 year average for the top 10 schools (I summed the peer and lawyer/judge reputation scores):
School 1999-2006 Average
Harvard 9.7
Stanford 9.7
Yale 9.6
Chicago 9.5
Columbia 9.4
Michigan 9.2
Virginia 9.1
Berkeley 9.1
NYU 8.9
U Penn 8.8
And the "average rank" over the 8 year period for just the peer reputation scores(this is an identical calculation to the chart on page 5 of Schmalbeck's paper where the author calculated up through 1998):
[EDIT] Just a note, the "average" is not what you typically would expect but rather calculated as follows: Assume three schools are tied for number 1 then each of the recieve an average rank that year of (1+2+3)/3 = 2. I did the calculation this way just to be consistent with Shmalbeck's paper. I don't think it is the best way though.
School 1999-2006 Average
Harvard 1.75
Yale 2.06
Stanford 2.44
Columbia 4.25
Chicago 4.38
Michigan 6.56
Berkeley 7.00
NYU 7.56
Virginia 9.06
U Penn 9.75
A couple of comments and I look forward to the comments of others.
1) In 1974 (see Shmalbeck's paper) and again in 1987 (US News) UMich was ranked 3rd. According to Schmalbeck's paper for the data up through 1998 Mich was in the "top tier" of 6 schools where there was large separation between the number 6 school and the number 7 school (Cal). But now, according to my analysis, the gap has closed. There is now a top tier of 5 schools rather than 6 schools with Mich outside of the "top tier".
2) NYU and U Penn have reputations that are much lower than their overall US News rank. This to me seems to show the extreme flaw in US News ranking methodolgy. If lawyers, judges, and peers all say that (on average) Penn is the 10th best school, then how is it that US News can legitimately place it at 7?
3) Reputation rankings are MUCH MUCH more consistent than US News. It seems to me that US News chooses their methodlogy so that there are changes every year. When going over reptuation data there is hardly any changes. In fact, in all 8 years I examined Michigan was exactly 6th in the peer rankings every year.
I did some research and compiled the reputation (peer and lawyer/judge) from US News from the 1999 edition through this year's edition. This essentially is the same analysis found in the paper: "The Durability of Law School Reputation" by Shmalbeck which can be found easily on Google. First, here is the 8 year average for the top 10 schools (I summed the peer and lawyer/judge reputation scores):
School 1999-2006 Average
Harvard 9.7
Stanford 9.7
Yale 9.6
Chicago 9.5
Columbia 9.4
Michigan 9.2
Virginia 9.1
Berkeley 9.1
NYU 8.9
U Penn 8.8
And the "average rank" over the 8 year period for just the peer reputation scores(this is an identical calculation to the chart on page 5 of Schmalbeck's paper where the author calculated up through 1998):
[EDIT] Just a note, the "average" is not what you typically would expect but rather calculated as follows: Assume three schools are tied for number 1 then each of the recieve an average rank that year of (1+2+3)/3 = 2. I did the calculation this way just to be consistent with Shmalbeck's paper. I don't think it is the best way though.
School 1999-2006 Average
Harvard 1.75
Yale 2.06
Stanford 2.44
Columbia 4.25
Chicago 4.38
Michigan 6.56
Berkeley 7.00
NYU 7.56
Virginia 9.06
U Penn 9.75
A couple of comments and I look forward to the comments of others.
1) In 1974 (see Shmalbeck's paper) and again in 1987 (US News) UMich was ranked 3rd. According to Schmalbeck's paper for the data up through 1998 Mich was in the "top tier" of 6 schools where there was large separation between the number 6 school and the number 7 school (Cal). But now, according to my analysis, the gap has closed. There is now a top tier of 5 schools rather than 6 schools with Mich outside of the "top tier".
2) NYU and U Penn have reputations that are much lower than their overall US News rank. This to me seems to show the extreme flaw in US News ranking methodolgy. If lawyers, judges, and peers all say that (on average) Penn is the 10th best school, then how is it that US News can legitimately place it at 7?
3) Reputation rankings are MUCH MUCH more consistent than US News. It seems to me that US News chooses their methodlogy so that there are changes every year. When going over reptuation data there is hardly any changes. In fact, in all 8 years I examined Michigan was exactly 6th in the peer rankings every year.
Discussion
Resources