<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Judging Methodology</title>
	<atom:link href="http://chicagoboyz.net/archives/2549.html/feed" rel="self" type="application/rss+xml" />
	<link>http://chicagoboyz.net/archives/2549.html</link>
	<description>Some Chicago Boyz know each other from student days at the University of Chicago. Others are Chicago boys in spirit. The blog name is also intended as a good-humored gesture of admiration for distinguished Chicago boys including those pictured above.</description>
	<lastBuildDate>Thu, 24 May 2012 02:03:09 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.4</generator>
	<item>
		<title>By: McDee</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28403</link>
		<dc:creator>McDee</dc:creator>
		<pubDate>Wed, 03 Nov 2004 19:10:31 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28403</guid>
		<description></description>
		<content:encoded><![CDATA[<p>Thanks Shannon for your article. I am one reader who values your input and research on the numbers.</p>
<p>Here’s my input. When I read the headline, approximately a week ago on my Yahoo! Browser, that 100,000 Iraqis had been killed, my response was, “WHAT?</p>
<p>I have learned through the years, that if you are either persistent or patient enough, the truth usually surfaces. Hence, I read the whole Yahoo column. Usually reading leftist material; i.e. Yahoo, MSN, New York Times, etc. I have found if I read “da hole thang” I can get the truth.</p>
<p>You see I only have a High School Education which limits my thinking powers, but then again I have many years of experience which sometimes helps with my intellectual infirmity.</p>
<p>My point is this; the more you read (persistence), the more you understand (truth). The less education that you have, the less you read, the more experience is required (patience), to get to the truth (read more).</p>
<p>So here………If you stop reading at the headline “100,000 Iraqis killed” you can make the assumption that “Bush is a madman and he just loves killing people” and that you should vote for Kerry. I would assume that people in this category only have a 3rd grade education.</p>
<p>If you continue reading, as most people of substance would do, they would realize that an esteemed professor from a highly regarded institution, did in fact pull the data together, and I would like to be associated with that level of intelligence……you probably have a high school education, but would like to be linked to the elitist’s on the left—and vote for Kerry.</p>
<p>Now what separates me from the other high school grads is this; I believe for every 10 years you live past the age of 20, it is equivalent to 1 year of college. So if you live to be 60 and have a high school education, it is the same as a 4 year college degree. I have a B.A. in B.S. This has allowed me to pursue and recognize the truth, and has given me the ability to wade through the sludge of political waste.</p>
<p>One disturbing item, I have not resolved, is the problematic educational level of some of those who oppose your critique of the BS.<br />
I can only assume that some of your detractors hold Doctorate degrees, because they use words like ”penultimate paragraph”, yet their arguments lead me to conclude, they didn’t read “da hole thang”; Or could it mean he only has a 3rd grade education and is in fact 190 years old, to obtain the Doctorate Equivalency Degree. If in fact he holds the DED. It could be concluded he suffers from a physical impairment versus the assumed intellectual impairment. Sad, but he couldn’t read “da hole thang”, to get to the truth. Shame, he probably voted for sKerry.</p>
<p>I’m truly thankful for the opportunity I’ve had to obtain my BA in BS. If for no other reason than my years of service. I also would like to take this opportunity to thank persons like your self that continue to literally “Flush” out the BS.</p>
<p>Not to be confused with “William Hung”; I have never had writing lessons!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28402</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Wed, 03 Nov 2004 15:09:01 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28402</guid>
		<description>This is the Milloy-style &quot;devastating critique&quot; in full cry; invent a bogus standard, apply it only to arguments whose conclusions you dislike, and hope that uninformed onlookers will think that there&#039;s something going on.  

The only basis you have for asserting that &quot;the researchers, reviewers and publisher should have mentioned that the studies pre-war rate was extreme&quot; is your own say-so.  The issue was discussed in significant detail, a fact which you should have made clear, but did not.  They decided that the comparison of their 2003-4 estimate to a UNESCO number based on work in 2000, and a CPA number based on nothing very clear at all, was not a good comparison to make.  Since one of the authors was Richard Garfield, who knows vastly more about Iraqi child mortality numbers than anyone else, I am inclined to accept their judgement.  You apparently think otherwise, but you are able to express that view because they mentioned the issue in the first place.

Your criticism is hollow.  And you should be very wary of raising slurs like &quot;lying by ommission&quot; and &quot;not acceptable in the sciences&quot;, because you would not look very good if held to these standards yourself.</description>
		<content:encoded><![CDATA[<p>This is the Milloy-style &#8220;devastating critique&#8221; in full cry; invent a bogus standard, apply it only to arguments whose conclusions you dislike, and hope that uninformed onlookers will think that there&#8217;s something going on.  </p>
<p>The only basis you have for asserting that &#8220;the researchers, reviewers and publisher should have mentioned that the studies pre-war rate was extreme&#8221; is your own say-so.  The issue was discussed in significant detail, a fact which you should have made clear, but did not.  They decided that the comparison of their 2003-4 estimate to a UNESCO number based on work in 2000, and a CPA number based on nothing very clear at all, was not a good comparison to make.  Since one of the authors was Richard Garfield, who knows vastly more about Iraqi child mortality numbers than anyone else, I am inclined to accept their judgement.  You apparently think otherwise, but you are able to express that view because they mentioned the issue in the first place.</p>
<p>Your criticism is hollow.  And you should be very wary of raising slurs like &#8220;lying by ommission&#8221; and &#8220;not acceptable in the sciences&#8221;, because you would not look very good if held to these standards yourself.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shannon Love</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28401</link>
		<dc:creator>Shannon Love</dc:creator>
		<pubDate>Tue, 02 Nov 2004 17:54:31 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28401</guid>
		<description></description>
		<content:encoded><![CDATA[<p>dsquared,</p>
<p>Just make myself clear I said that:</p>
<p><i>&#8220;(1) did not acknowledge that their studies measurement of pre-war infant mortality differed significantly from all other published sources and (2) they did not seek to explain the difference.&#8221;</i></p>
<p>In (2) I meant that they did seek to explain the difference between the results of their study and the results of other studies of infant mortality for the same period. </p>
<p>Here is the paragraph from p 6 where they discuss infant mortality:</p>
<p><i>&#8220;It is possible that deaths were not reported, because families might wish to conceal the death or because neonatal deaths might go without mention. In other settings, under-reporting of neonatal and infant deaths in  similar  surveys  has  been  documented. 18,19 In particular,  the  further  back  in  time  the  infant  death occurred, the less likely it was to be reported. The recall period of this survey, 2·7 years, was longer than most surveys of crude mortality. Thus, infant deaths from earlier  periods  might  be  under-reported,  and  recent infant deaths might be more readily reported, producing an apparent but spurious increase in infant mortality. We do not think that this is a major factor in this survey for two reasons. First, the preconflict infant mortality rate  (29  deaths  per  1000  livebirths)  we  recorded  is similar  to  estimates  from  neighbouring  countries. 20 Second, the January, 2002, to March, 2003, rate applied to the 366 births recorded in the interview households post-invasion would project 10·4 infant deaths, whereas we noted 21 to have happened. Of these, three were attributed to coalition bombings and three to births at home  when  security  concerns  prevented  travel  to hospital for delivery. Thus, most of the increase in infant mortality is plausibly linked to the conflict, although we acknowledge the potential for recall bias to create an apparent increase in infant mortality. &#8220;</i> </p>
<p>The studies authors list reasons why their measurements might be inaccurate but at no time do they acknowledge that the result they did actually get for pre-war infant mortality is strongly at odds with all other published studies. In fact, they pat themselves on the back for getting a rate the same as neighboring countries. (It&#8217;s exactly the same as Jordans rate) Since we know for a fact that Saddam denied medical care, electricity and clean water to vast swaths of the Shia population does it really seem credible that pre-war Iraq had an infant mortality rate on par with Jordon&#8217;s? </p>
<p>The researchers, reviewers and publisher should have mentioned that the studies pre-war rate was extreme. They did not. In fact, they sought to imply that the study&#8217;s rate was reasonable as it compared to neighboring nations. Such lies of omission might be acceptable in other arena of discourse but they are not in the sciences.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: AMac</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28400</link>
		<dc:creator>AMac</dc:creator>
		<pubDate>Tue, 02 Nov 2004 16:44:49 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28400</guid>
		<description></description>
		<content:encoded><![CDATA[<p>dsquared wrote (6:02am), in reference to my (AMac’s) earlier (5:22am) post:</p>
<p>&gt;There&#8217;s a name for putting arguments in my mouth that I never made, as well.</p>
<p>I see that you and “Daniel” of Crooked Timber are the same person.  You ended <a HREF="http://www.crookedtimber.org/archives/002780.html" rel="nofollow">your C.T. criticism of Love’s post</a> with:</p>
<blockquote><p> They don’t actually raise any principled reasons why the confidence interval ought to be wider than the one published, and therefore they aren’t raising any questions which would make us think that this confidence interval should include zero.</p></blockquote>
<p>As best I could tell, you were saying that any valid critique of the confidence interval must “make us think that this confidence interval should include zero,” i.e. no <i>excess</i> civilian casualties due to the invasion.  (On writing this, I have inserted the word “excess” in the preceding sentence.)  </p>
<p>I don’t see that any of the numerous criticisms by Love invoke a claim that “the confidence interval should include zero,” however “zero” is defined.  I thus made reference to this sentence as a straw-man.  If, indeed, this claim <i>was</i> made, it was not particularly important to Love’s point, or to the points made by those of us who expressed skepticism of Roberts et al. in her comments.</p>
<p>Your response above is:</p>
<p>&gt;There&#8217;s a name for putting arguments in my mouth that I never made, as well.</p>
<p>So you are implying that I am a liar.</p>
<p>I recall your exchange with Steven Den Beste.  Your conduct in that affair was <a HREF="http://www.denbeste.nu/cd_log_entries/2003/03/Intellectualhonesty.shtml" rel="nofollow">not a model of civil discourse.</a>  Nor is your conduct here.</p>
<p>Readers can use <a HREF="http://www.crookedtimber.org/archives/002780.html" rel="nofollow">this link</a> to your Crooked Timber post to see if <i>they</i> can discover what your “zero” comment meant.  Or they can read your 6:02 am explanation, reposted below:</p>
<blockquote><p> The argument I made was that the survey&#8217;s results are interesting despite the wide confidence interval, because that confidence interval is not wide enough to include zero. Why you lot don&#8217;t believe that is your own affair, though I hope nobody thinks I am silly enough to believe you would be raising any of these quibbles if the survey had found 100,000 fewer deaths as a result of the invasion. </p></blockquote>
<blockquote><p> Factually, none of Shannon&#8217;s arguments does give a reason for thinking that the confidence interval should be wider than the one reported; the objections raised to the cluster sampling methodology are all taken account of in the stadnard errors and design effects estimated.</p></blockquote>
<p>This lengthy response doesn’t make your original  assertion any less of a straw man.  Nor does readily imputing base motives to other commenters. </p>
<p>To do so, you would need to provide a link to a “ChicagoBoyz” post that makes the &#8220;zero&#8221; point that you have presumed to rebut.  Kudos if you can; further applause if you acknowledge that, <i>contra</i> your original Crooked Timber post, this is at most a minor part of the credible concerns about this study that have been discussed on this web-log.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28399</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Tue, 02 Nov 2004 15:39:43 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28399</guid>
		<description>&lt;i&gt;(2) they did not seek to explain the difference&lt;/i&gt;

Yes they did; I even gave you the words they used so I have no idea (other than the obvious one) why you continue to make this claim.  To coin a phrase, in a different context, I&#039;m sure you would not have.

Your penultimate paragraph is horribly confused.  If you substitute estimates from a different study into this one, you are ignoring the fact that this has been structured as a cohort study; it relates to changes in the death experience of this one sample as a result of an intervention.  Of course you are going to get spurious results if you throw away the information that this is the same sample measured at two different times, which is why the authors didn&#039;t do it.</description>
		<content:encoded><![CDATA[<p><i>(2) they did not seek to explain the difference</i></p>
<p>Yes they did; I even gave you the words they used so I have no idea (other than the obvious one) why you continue to make this claim.  To coin a phrase, in a different context, I&#8217;m sure you would not have.</p>
<p>Your penultimate paragraph is horribly confused.  If you substitute estimates from a different study into this one, you are ignoring the fact that this has been structured as a cohort study; it relates to changes in the death experience of this one sample as a result of an intervention.  Of course you are going to get spurious results if you throw away the information that this is the same sample measured at two different times, which is why the authors didn&#8217;t do it.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shannon Love</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28398</link>
		<dc:creator>Shannon Love</dc:creator>
		<pubDate>Tue, 02 Nov 2004 15:24:13 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28398</guid>
		<description>dsquared,

&lt;i&gt;&quot;...you claim that the authors of the survey did not mention the issue of infant death...&quot;&lt;/i&gt;

You misunderstood. My complaint is that the study authors (1) did not acknowledge that their studies measurement of pre-war infant mortality differed significantly from all other published sources and (2) they did not seek to explain the difference. They did so even the their own citations list vastly different numbers. 

&lt;i&gt;&quot;And you are now claiming that the study had &quot;16 samples&quot;, when it actually had 33 clusters of 30 households each, covering 7500 individuals&quot;&lt;/i&gt;

Actually I was referring to table 2 (p4) and it&#039;s listing for &quot;Neonatal and unexplained infant&quot; with 6 listed pre-war and 10 listed afterward. I took this as the best data for the number of infant deaths reportedly counted. I could be wrong. In any case the Unicef and other studies counted hundreds or thousands of individuals whereas this study counted a maximum of 65 deaths for individuals &quot;Since the estimate of excess deaths is based on the change in the death rate in the sample rather than the point estimate, this is much less of a problem than you imply&quot;

Sorry, but I think you have that backwards. The estimation of deaths results on an extrapolation of the differences between pre-war and post-war mortality rates. For example, if you substitute the Unicef 2002 rate of 102/1000 for the studies 27/1000, the study shows that the war dramatically improved infant mortality rate to 57/1000 saving the lives of thousands of children. 

The infant mortality anomaly doesn&#039;t mean in and off itself that the study is in error but it does strongly suggest it. The authors, reviewers and publisher showed have acknowledged this and in a different context I an sure they would have.</description>
		<content:encoded><![CDATA[<p>dsquared,</p>
<p><i>&#8220;&#8230;you claim that the authors of the survey did not mention the issue of infant death&#8230;&#8221;</i></p>
<p>You misunderstood. My complaint is that the study authors (1) did not acknowledge that their studies measurement of pre-war infant mortality differed significantly from all other published sources and (2) they did not seek to explain the difference. They did so even the their own citations list vastly different numbers. </p>
<p><i>&#8220;And you are now claiming that the study had &#8220;16 samples&#8221;, when it actually had 33 clusters of 30 households each, covering 7500 individuals&#8221;</i></p>
<p>Actually I was referring to table 2 (p4) and it&#8217;s listing for &#8220;Neonatal and unexplained infant&#8221; with 6 listed pre-war and 10 listed afterward. I took this as the best data for the number of infant deaths reportedly counted. I could be wrong. In any case the Unicef and other studies counted hundreds or thousands of individuals whereas this study counted a maximum of 65 deaths for individuals &#8220;Since the estimate of excess deaths is based on the change in the death rate in the sample rather than the point estimate, this is much less of a problem than you imply&#8221;</p>
<p>Sorry, but I think you have that backwards. The estimation of deaths results on an extrapolation of the differences between pre-war and post-war mortality rates. For example, if you substitute the Unicef 2002 rate of 102/1000 for the studies 27/1000, the study shows that the war dramatically improved infant mortality rate to 57/1000 saving the lives of thousands of children. </p>
<p>The infant mortality anomaly doesn&#8217;t mean in and off itself that the study is in error but it does strongly suggest it. The authors, reviewers and publisher showed have acknowledged this and in a different context I an sure they would have.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28397</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Tue, 02 Nov 2004 14:57:03 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28397</guid>
		<description>Since the estimate of excess deaths is based on the change in the death rate in the sample rather than the point estimate, this is much less of a problem than you imply (you have, of course, not bothered to mention this issue, and I draw my own conclusions about your scientific honesty from that).  

You also do not mention the specific problems with respect to Saddam-era estimates of child mortality, despite the fact that I know you are aware of them.  

Furthermore, you are not being completely honest when you claim that the authors of the survey did not mention the issue of infant deaths; page 6 of the report notes that there is a commonly known problem with respect to underreporting of neonatal deaths in similar surveys; you would never have known about this issue if the paper didn&#039;t mention it.  The authors actually use the phrase &quot;we acknowledge the potential for recall bias to create an apparent increase in infant mortality&quot;.  In my view, this is an extremely generous concession for them to make; I don&#039;t see why underreporting of infant mortality should necessarily affect the change in the reported death rate.

And you are now claiming that the study had &quot;16 samples&quot;, when it actually had 33 clusters of 30 households each, covering 7500 individuals.

All of these issues raise red flags, fireworks and Mighty Wurlitzer Organs playing &quot;Sound Science Hacks Are Here Again&quot; to me, with respect to your own credibility.</description>
		<content:encoded><![CDATA[<p>Since the estimate of excess deaths is based on the change in the death rate in the sample rather than the point estimate, this is much less of a problem than you imply (you have, of course, not bothered to mention this issue, and I draw my own conclusions about your scientific honesty from that).  </p>
<p>You also do not mention the specific problems with respect to Saddam-era estimates of child mortality, despite the fact that I know you are aware of them.  </p>
<p>Furthermore, you are not being completely honest when you claim that the authors of the survey did not mention the issue of infant deaths; page 6 of the report notes that there is a commonly known problem with respect to underreporting of neonatal deaths in similar surveys; you would never have known about this issue if the paper didn&#8217;t mention it.  The authors actually use the phrase &#8220;we acknowledge the potential for recall bias to create an apparent increase in infant mortality&#8221;.  In my view, this is an extremely generous concession for them to make; I don&#8217;t see why underreporting of infant mortality should necessarily affect the change in the reported death rate.</p>
<p>And you are now claiming that the study had &#8220;16 samples&#8221;, when it actually had 33 clusters of 30 households each, covering 7500 individuals.</p>
<p>All of these issues raise red flags, fireworks and Mighty Wurlitzer Organs playing &#8220;Sound Science Hacks Are Here Again&#8221; to me, with respect to your own credibility.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shannon Love</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28396</link>
		<dc:creator>Shannon Love</dc:creator>
		<pubDate>Tue, 02 Nov 2004 13:51:45 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28396</guid>
		<description>dsquared,

I can safely question the studies infant mortality not because I have &quot;mesopotamian dust&quot; on my boots but because the studies estimate of pre-war infant mortality diverges strongly from ALL the other pre-war studies of infant mortality. That does not mean, in an of itself, that the study is inaccurate but it is fact that requires explanation. That the studies authors did not acknowledge this problem (even though their own citations revealed it) nor attempt to explain and that the peer review and editors of Lancet did not also do so, should raise red flags for everybody interested in good science. 

The pre-war infant mortality rate of 23/1000 is the same rate as Jordon&#039;s in the same period. Jordan does not have a police state, UN sanctions or had a war or major civil disturbance in last 25 years. Just as a gut hunch, does it seem plausible that the Iraq of 2002 had the same infant mortality rate?

If it did, that means that the Unicef and other studies were massively inaccurate. But if we had to guess which studies were inaccurate would you pick the Unicef study with it&#039;s thousands of samples conducted in a time of relative peace or the Lancet study with it&#039;s 16 samples? 

You don&#039;t need a PHd in statistics to see there is an anomaly here that requires an explanation or at least notice.</description>
		<content:encoded><![CDATA[<p>dsquared,</p>
<p>I can safely question the studies infant mortality not because I have &#8220;mesopotamian dust&#8221; on my boots but because the studies estimate of pre-war infant mortality diverges strongly from ALL the other pre-war studies of infant mortality. That does not mean, in an of itself, that the study is inaccurate but it is fact that requires explanation. That the studies authors did not acknowledge this problem (even though their own citations revealed it) nor attempt to explain and that the peer review and editors of Lancet did not also do so, should raise red flags for everybody interested in good science. </p>
<p>The pre-war infant mortality rate of 23/1000 is the same rate as Jordon&#8217;s in the same period. Jordan does not have a police state, UN sanctions or had a war or major civil disturbance in last 25 years. Just as a gut hunch, does it seem plausible that the Iraq of 2002 had the same infant mortality rate?</p>
<p>If it did, that means that the Unicef and other studies were massively inaccurate. But if we had to guess which studies were inaccurate would you pick the Unicef study with it&#8217;s thousands of samples conducted in a time of relative peace or the Lancet study with it&#8217;s 16 samples? </p>
<p>You don&#8217;t need a PHd in statistics to see there is an anomaly here that requires an explanation or at least notice.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Sylvain Galineau</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28395</link>
		<dc:creator>Sylvain Galineau</dc:creator>
		<pubDate>Tue, 02 Nov 2004 13:32:54 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28395</guid>
		<description>To his credit, Milton probably knows what he&#039;s talking about when it comes to the bigger losers.

I actually think Kerry will make it, 52 to 49.

And yes, I have some crow on hand in the fridge.</description>
		<content:encoded><![CDATA[<p>To his credit, Milton probably knows what he&#8217;s talking about when it comes to the bigger losers.</p>
<p>I actually think Kerry will make it, 52 to 49.</p>
<p>And yes, I have some crow on hand in the fridge.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28394</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Tue, 02 Nov 2004 12:13:01 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28394</guid>
		<description>There were 33 clusters of 30 households each (minus Fallujah), selected by randomly assigning clusters to Governates, then picking clusters at random within the governate from a GPS system grid (this didn&#039;t happen in Sadr City or Fallujah, where it was unsafe to carry a GPS).

You can get a user ID and password from http://www.bugmenot.com if you want to see the report without registering</description>
		<content:encoded><![CDATA[<p>There were 33 clusters of 30 households each (minus Fallujah), selected by randomly assigning clusters to Governates, then picking clusters at random within the governate from a GPS system grid (this didn&#8217;t happen in Sadr City or Fallujah, where it was unsafe to carry a GPS).</p>
<p>You can get a user ID and password from <a href="http://www.bugmenot.com" rel="nofollow">http://www.bugmenot.com</a> if you want to see the report without registering</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Green Bear</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28393</link>
		<dc:creator>Green Bear</dc:creator>
		<pubDate>Tue, 02 Nov 2004 11:20:19 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28393</guid>
		<description>I haven&#039;t looked at the methodology of the report (I have a bias against registering to view reports in the public domain).  I have seen elsewhere that the sampling error is rather large, which in turn suggests certain features of the design.  The first is that few first stage sampling units were selected, perhaps only two, and that there was no stratification employed (for example, they might have taken clusters from Suni areas in stratum 1, more from Kurdish areas in stratum 2, and so on).

In this case, it might just be that the base numbers are correct, but the survey team was unlucky and got an outlier cluster in their sample.  Alternately, they may not have performed a careful outlier review, which would have resulted in down-weighting the results from the suspect cluster, and so ended up with these numbers.

In short, I would rather suggest a naive design than impute political motives.

Green Bear</description>
		<content:encoded><![CDATA[<p>I haven&#8217;t looked at the methodology of the report (I have a bias against registering to view reports in the public domain).  I have seen elsewhere that the sampling error is rather large, which in turn suggests certain features of the design.  The first is that few first stage sampling units were selected, perhaps only two, and that there was no stratification employed (for example, they might have taken clusters from Suni areas in stratum 1, more from Kurdish areas in stratum 2, and so on).</p>
<p>In this case, it might just be that the base numbers are correct, but the survey team was unlucky and got an outlier cluster in their sample.  Alternately, they may not have performed a careful outlier review, which would have resulted in down-weighting the results from the suspect cluster, and so ended up with these numbers.</p>
<p>In short, I would rather suggest a naive design than impute political motives.</p>
<p>Green Bear</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28392</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Tue, 02 Nov 2004 11:02:00 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28392</guid>
		<description>There&#039;s a name for putting arguments in my mouth that I never made, as well.

The argument I made was that the survey&#039;s results are interesting despite the wide confidence interval, because that confidence interval is not wide enough to include zero.  Why you lot don&#039;t believe that is your own affair, though I hope nobody thinks I am silly enough to believe you would be raising any of these quibbles if the survey had found 100,000 fewer deaths as a result of the invasion.

Factually, none of Shannon&#039;s arguments does give a reason for thinking that the confidence interval should be wider than the one reported; the objections raised to the cluster sampling methodology are all taken account of in the stadnard errors and design effects estimated.</description>
		<content:encoded><![CDATA[<p>There&#8217;s a name for putting arguments in my mouth that I never made, as well.</p>
<p>The argument I made was that the survey&#8217;s results are interesting despite the wide confidence interval, because that confidence interval is not wide enough to include zero.  Why you lot don&#8217;t believe that is your own affair, though I hope nobody thinks I am silly enough to believe you would be raising any of these quibbles if the survey had found 100,000 fewer deaths as a result of the invasion.</p>
<p>Factually, none of Shannon&#8217;s arguments does give a reason for thinking that the confidence interval should be wider than the one reported; the objections raised to the cluster sampling methodology are all taken account of in the stadnard errors and design effects estimated.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: AMac</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28391</link>
		<dc:creator>AMac</dc:creator>
		<pubDate>Tue, 02 Nov 2004 10:22:20 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28391</guid>
		<description></description>
		<content:encoded><![CDATA[<p>I wish this blog used Trackbacks or had otherwise alerted readers to the rebuttal of critiques of Roberts et al. at the partisan-left intellectual blog Crooked Timber, found <a HREF="" rel="nofollow">here as &#8220;Talking Rubbish About Epidemiology.</a>.</p>
<p>Concerning Shannon Love&#8217;s earlier critique and its 140 (as of this writing) follow-on comments, Daniel of C.T. wrote:</p>
<blockquote><p> The Chicago Boyz blog post is an excellent example of the “Devastating Critique”. Surprise surprise, estimating civilian casualties is a difficult business. That’s why the confidence interval is so wide. They don’t actually raise any principled reasons why the confidence interval ought to be wider than the one published, and therefore they aren’t raising any questions which would make us think that this confidence interval should include zero. </p></blockquote>
<p>The last sentence refers to an argument that Daniel earlier imputed to critics of the Roberts et al. study:  that we fault its findings because it rules out zero civilian casualties during the invasion and its aftermath.  There is a name for such arguments.</p>
<p>Some of the many comments posted there are worth reading, though it&#8217;s heavy sailing.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dsquared</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28390</link>
		<dc:creator>dsquared</dc:creator>
		<pubDate>Tue, 02 Nov 2004 06:55:53 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28390</guid>
		<description>&lt;i&gt;In a nutshell, since the study&#039;s methodology doesn&#039;t come anywhere close to reproducing the infant mortality rates measured by other studies, under much better conditions, we can safely assume that its methodology doesn&#039;t accurately measure other deaths either&lt;/i&gt;

I cannot believe that someone claiming to have experience with statistics would make this argument.  It&#039;s ludicrous.

In actual fact, if we accept your view that the 108 figure was politically biased and the real number was 47 per 1000 live births, then you would expect to get a result of exactly 8 infant deaths in a sample of 275 births 4.6% of the time by pure chance (it&#039;s a binomial distribution).  Given the small sample and even a small bias, that probability might be much higher, without affecting the overall result to anything like the degree you seem to want to affect it.

In any case, I will take your bald unsupported assertion &quot;it definitely wasn&#039;t anywhere near 29/1000&quot; more seriously when I see Mesopotamian dust on your boots.  You are now trying to claim that the entire cluster study methodology is unusable, simply in order to challenge a result you don&#039;t like?  For shame.</description>
		<content:encoded><![CDATA[<p><i>In a nutshell, since the study&#8217;s methodology doesn&#8217;t come anywhere close to reproducing the infant mortality rates measured by other studies, under much better conditions, we can safely assume that its methodology doesn&#8217;t accurately measure other deaths either</i></p>
<p>I cannot believe that someone claiming to have experience with statistics would make this argument.  It&#8217;s ludicrous.</p>
<p>In actual fact, if we accept your view that the 108 figure was politically biased and the real number was 47 per 1000 live births, then you would expect to get a result of exactly 8 infant deaths in a sample of 275 births 4.6% of the time by pure chance (it&#8217;s a binomial distribution).  Given the small sample and even a small bias, that probability might be much higher, without affecting the overall result to anything like the degree you seem to want to affect it.</p>
<p>In any case, I will take your bald unsupported assertion &#8220;it definitely wasn&#8217;t anywhere near 29/1000&#8243; more seriously when I see Mesopotamian dust on your boots.  You are now trying to claim that the entire cluster study methodology is unusable, simply in order to challenge a result you don&#8217;t like?  For shame.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: MatyaNoBaka</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28389</link>
		<dc:creator>MatyaNoBaka</dc:creator>
		<pubDate>Tue, 02 Nov 2004 03:01:27 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28389</guid>
		<description>It doesn&#039;t apply in this case, but isn&#039;t there a statistical analysis of variance that is used as an indicator that the data has been smoothed?  I thought there was a drug company and a couple of Aids NGOs that had been caught by it.  And it&#039;s part of the reason even scientists are pushing the journals to make the clinical trial data available on the web for others to analyze?

Thanks,

Matya no baka</description>
		<content:encoded><![CDATA[<p>It doesn&#8217;t apply in this case, but isn&#8217;t there a statistical analysis of variance that is used as an indicator that the data has been smoothed?  I thought there was a drug company and a couple of Aids NGOs that had been caught by it.  And it&#8217;s part of the reason even scientists are pushing the journals to make the clinical trial data available on the web for others to analyze?</p>
<p>Thanks,</p>
<p>Matya no baka</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mitch</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28388</link>
		<dc:creator>Mitch</dc:creator>
		<pubDate>Tue, 02 Nov 2004 02:19:42 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28388</guid>
		<description>Angie, I&#039;m pretty sure it was a cluster something, but not necessarily a cluster sample.</description>
		<content:encoded><![CDATA[<p>Angie, I&#8217;m pretty sure it was a cluster something, but not necessarily a cluster sample.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: James R. Rummel</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28387</link>
		<dc:creator>James R. Rummel</dc:creator>
		<pubDate>Tue, 02 Nov 2004 00:20:39 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28387</guid>
		<description>Milton&#039;s got his head up his ass.

&lt;i&gt;&lt;b&gt;I&#039;m&lt;/b&gt;&lt;/i&gt; the biggest loser at The Chicaho Boyz.

James</description>
		<content:encoded><![CDATA[<p>Milton&#8217;s got his head up his ass.</p>
<p><i><b>I&#8217;m</b></i> the biggest loser at The Chicaho Boyz.</p>
<p>James</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: CounterPundit</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28404</link>
		<dc:creator>CounterPundit</dc:creator>
		<pubDate>Mon, 01 Nov 2004 22:41:26 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28404</guid>
		<description>&lt;strong&gt;Rational Voices Weigh In&lt;/strong&gt;

If you have been following the rightwing propaganda about the Lancet study, you will be glad to see that a few people are weighing in with considered opinions. The original wingnut that I criticized finally seemed to recognize the mistake I pointed o...
</description>
		<content:encoded><![CDATA[<p><strong>Rational Voices Weigh In</strong></p>
<p>If you have been following the rightwing propaganda about the Lancet study, you will be glad to see that a few people are weighing in with considered opinions. The original wingnut that I criticized finally seemed to recognize the mistake I pointed o&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Angie Schultz</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28386</link>
		<dc:creator>Angie Schultz</dc:creator>
		<pubDate>Mon, 01 Nov 2004 20:59:47 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28386</guid>
		<description>You might also address Milton&#039;s assumption that you were born in Chicago, which I find rather questionable given that

1) the &quot;Chicago&quot; part of &quot;Chicagoboyz&quot; refers to the University of Chicago, not all of whose alumni were in fact &lt;i&gt;born&lt;/i&gt; in that city, and

2) the Chicagoboyz website explicitly states that not all Chicagoboyz went to U of C.  

Perhaps cluster sampling was involved.</description>
		<content:encoded><![CDATA[<p>You might also address Milton&#8217;s assumption that you were born in Chicago, which I find rather questionable given that</p>
<p>1) the &#8220;Chicago&#8221; part of &#8220;Chicagoboyz&#8221; refers to the University of Chicago, not all of whose alumni were in fact <i>born</i> in that city, and</p>
<p>2) the Chicagoboyz website explicitly states that not all Chicagoboyz went to U of C.  </p>
<p>Perhaps cluster sampling was involved.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David/California</title>
		<link>http://chicagoboyz.net/archives/2549.html/comment-page-1#comment-28385</link>
		<dc:creator>David/California</dc:creator>
		<pubDate>Mon, 01 Nov 2004 20:55:47 +0000</pubDate>
		<guid isPermaLink="false">http://chicagoboyz.net/archives/002549.html#comment-28385</guid>
		<description>Shannon,

You may wish to perform a follow-up analysis dealing with Milton&#039;s methodology in calculating &quot;biggest loser&quot;.  I was unable to ascertain if &quot;biggest&quot; was a quanitative, qualitative or metaphysical measure.  Perhaps you could help Milton develop his measures?  &quot;Loser&quot;, of course has innumerable definitions; none of which was determinable from Milton&#039;s overly succinct analysis.

Milton, alas, seems to be a representative product of a government education - he &quot;feels&quot; his way to his mathematical verities.  

Perhaps he will accept tutoring?</description>
		<content:encoded><![CDATA[<p>Shannon,</p>
<p>You may wish to perform a follow-up analysis dealing with Milton&#8217;s methodology in calculating &#8220;biggest loser&#8221;.  I was unable to ascertain if &#8220;biggest&#8221; was a quanitative, qualitative or metaphysical measure.  Perhaps you could help Milton develop his measures?  &#8220;Loser&#8221;, of course has innumerable definitions; none of which was determinable from Milton&#8217;s overly succinct analysis.</p>
<p>Milton, alas, seems to be a representative product of a government education &#8211; he &#8220;feels&#8221; his way to his mathematical verities.  </p>
<p>Perhaps he will accept tutoring?</p>
]]></content:encoded>
	</item>
</channel>
</rss>

