How many Criteria do we need?

One of the most frequent questions I am asked is how many criteria are required for effective evaluation and selection of a set of proposals, i.e. eligibility criteria aside).  My colleagues and I recommend (from experience and statistically) at least 6 but no more than 12 (max 15 if you catch me on a bad day). 10-12 criteria will usually always discriminate among proposals.  With well developed criteria and language rich grading scales (Language Ladders™ in ProGrid speak), you can very often achieve the same with 6 to 8 criteria.  

Clients who initially “absolutely need” no less than 10-12 have often later reduced the number to between 6 and 8.  After a year, they realize that some criteria are part of the same factor or that one is unnecessary given then other.  

That said, if you have a statistically validated algorithm (say from a regression analysis with a high correlation coefficient and no multicollinearity or heteroscedasticity) for evaluating & selecting the best proposals, i.e. scientifically proven ‘magic’ formula, you should use that…and email me a copy.

Note: if criteria are of the “Yes/NO” variety, i. e. for eligibility, they do not need to go into the criteria used to evaluate, rank and select a proposal.  If a proposal isn’t eligible, it is not necessary to evaluate it any further and is not included in your competition (evaluation & selection task).