Thursday, May 16, 2013

Evaluating research impact: Should grants count?

Warning: This post likely will not be of interest to anyone outside of academia. 

My department is in the midst of our annual faculty evaluations. Each year, our representative "advisory" committee evaluates all of the faculty in our department based on their research impact/influence, teaching, and service over the past 3 years. The collective ratings are factored into the small merit raises we sometimes receive (depending on state budgets). When I get the privilege of serving on the committee, I use as objective an approach as possible for the research component of the evaluation. I look at publication rates, citation rates, and any other metrics that seem reasonable.

Yesterday, I had a fascinating discussion with a colleague on advisory who similarly looks for objective indices of research impact and influence. The discussion led to an interesting difference of opinion, and I'd be curious to hear what others think. So, here's a thought experiment:

Suppose you have two faculty members whose research productivity, publication rates, citation rates, etc. are identical in every respect. The only difference between them is that Faculty member A has two federally funded grants whereas Faculty member B has no grants. How would you rate their research influence/impact:

Option 1: Faculty member A should receive a higher research score because they have grant funding

Option 2: Faculty member B should receive a higher research score because they do not have grant funding

Option 3:  Faculty members A and B should receive the same research score

Please leave your opinion in the comments. I'll post my own answer answer and some further discussion soon.


  1. I'm curious to find out what blog system you happen to be using? I'm experiencing some minor security problems with my latest site and I would like to find something more safeguarded. Do you have any solutions? advantage of SEO

  2. When it comes to having unique website designs in Singapore, you should consider Media One. The website designing agency has been meeting the needs of the businesses for a significant length of time. They would provide you with all kinds of designs to help you rank higher.

  3. Excellent beat ! I would like to apprentice while you amend your web site, how can i subscribe for a blog web site? The account helped me a acceptable deal. I had been a little bit acquainted of this your broadcast provided bright clear idea. aircon tentage singapore

  4. I'm really enjoying the theme/design of your website. Do you ever run into any internet browser compatibility problems? A couple of my blog visitors have complained about my site not operating correctly in Explorer but looks great in Opera. Do you have any solutions to help fix this problem?

  5. Appreciating the hard work you put into your blog and in depth information you provide. It's great to come across a blog every once in a while that isn't the same out of date rehashed material. Wonderful read! I've bookmarked your site and I'm including your RSS feeds to my Google account. business finance solutions

  6. Thanks for your marvelous posting! I quite enjoyed reading it, you might be a great author.I will remember to bookmark your blog and will come back in the future. I want to encourage you to continue your great posts, have a nice day!

  7. I carry on listening to the newscast talk about getting boundless online grant applications so I have been looking around for the finest site to get one. Could you tell me please, where could i get some? Titanium Plate

  8. We absolutely love your blog and find the majority of your post's to be precisely what I'm looking for. Does one offer guest writers to write content for yourself? I wouldn't mind writing a post or elaborating on a number of the subjects you write in relation to here. Again, awesome blog!