{"id":2177,"date":"2016-01-25T21:30:10","date_gmt":"2016-01-26T02:30:10","guid":{"rendered":"https:\/\/cyrussamii.com\/?p=2177"},"modified":"2026-08-11T15:20:05","modified_gmt":"2026-08-11T19:20:05","slug":"inverse-covariance-weighting-versus-factor-analysis","status":"publish","type":"post","link":"https:\/\/cyrussamii.com\/?p=2177","title":{"rendered":"Inverse covariance weighting versus factor analysis"},"content":{"rendered":"

UPDATE August 11, 2026:<\/b> While I am keeping the post below for archival purposes, the current advice is not to use ICW, because of certain pathological properties (such as the rewarding of pure noise). An excellent and thorough discussion can be found in Bruce Wydick’s “Measuring What Matters: A Guide to Index Creation in Applied Microeconomics”, which you can find at his site: [link].<\/a> (I thank Joel Middleton and PM Aronow for reminding me to note these deficiencies here.)<\/i><\/p>\n

These are two ways to take a bunch of variables that are supposed to measure common latent factors and reduce them to a single or a few indices. What is the difference? I get the question fairly often, so I thought I’d put this post up.<\/p>\n

The two approaches do different things. Inverse covariance weighting applies an assumption that there is one latent trait of interest, and constructs an optimal weighted average on the basis of that assumption. Factor analysis tries to partial out an array of orthogonal latent factors. <\/p>\n

An intuitive way to think of it is like this:<\/p>\n

Suppose you have data that consists of three variables: College Math Grade, Math GRE, and Verbal GRE. The two math variables will be highly correlated, and the verbal variable will be somewhat correlated with the math scores.<\/p>\n

The inverse covariance weighted average of these three variables would result in an index that gives about 25% weight to each math score and then 50% weight to the verbal score. It “rewards” the verbal score for providing new information that the math scores don’t. The resulting index could be interpreted as a “general scholastic aptitude” index. <\/p>\n

A factor analysis of these three variables would yield two orthogonal factors, the first factor of which would give almost 50% weight to each math variable and almost zero weight to the verbal variable, and the second would give almost zero weight to each math variable and almost 100% weight to the verbal variable. So you would get a “pure math” factor and a “pure verbal” factor.<\/p>\n

Which one is better? It depends on the goals of your analysis.<\/p>\n

I discuss this a bit more in my lecture on “measurement” in the quant field methods class (see these notes: [PDF]<\/a>). Here is some R code to play around with these concepts too: [link<\/a>].<\/p>\n","protected":false},"excerpt":{"rendered":"

UPDATE August 11, 2026: While I am keeping the post below for archival purposes, the current advice is not to use ICW, because of certain pathological properties (such as the rewarding of pure noise). An excellent and thorough discussion can be found in Bruce Wydick’s “Measuring What Matters: A Guide to Index Creation in Applied … <\/p>\n

Continue reading “Inverse covariance weighting versus factor analysis”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2177","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/posts\/2177","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2177"}],"version-history":[{"count":6,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/posts\/2177\/revisions"}],"predecessor-version":[{"id":4296,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=\/wp\/v2\/posts\/2177\/revisions\/4296"}],"wp:attachment":[{"href":"https:\/\/cyrussamii.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2177"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2177"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cyrussamii.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2177"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}