Study Section
Study Section
Permission to use, copy, and distribute this publication or excerpts is granted provided
that (1) the copyright notice above appears in all reproductions; (2) use is for noncom-
mercial educational purposes only; and (3) the publication or excerpts are not modified
in any way (except when used for noncommercial educational purposes). Requests
beyond that scope should be directed to labmgmt@[Link].
The views expressed in this publication are those of its contributors and do not
necessarily reflect the views of the Howard Hughes Medical Institute or the Burroughs
Wellcome Fund.
Peer review of grant applications is the cornerstone of the U.S. research enter-
prise. Scientists are routinely asked to serve as peer reviewers for several public
and private funding agencies in the United States and abroad. In the United
States, the National Institutes of Health (NIH) is by far the largest funder of
academic research. That means that sooner or later you will be tapped to be a
reviewer for NIH.
Chances are you were not taught how to review grants during your graduate or
postdoctoral training. While nothing can replace hands-on experience, advice and
suggestions from seasoned reviewers can help prepare you to do a better job, right
from the start.
The SRO makes the initial contacts with scientists, asking them to become
members of a study section. The SRO also assigns grant applications to specific
members of a study section and organizes review meetings, where applications are
discussed.
BWF ♦ HHMI 1
Making the Right Moves A Practical Guide to Scientific Management
♦ Regular standing study sections. These study sections meet three times
a year and are “chartered,” or formally established by the government
with slates of permanent members. (As a result, they are often referred
to as chartered study sections.) They review most of the investigator-
initiated (R awards) applications and career development (K awards)
applications, among others. These study sections vary in terms of sci-
entific focus, size, and typical workload. A list of CSR regular standing
♦ Small Grant (R03)—provides limited funding for a short time to support a variety of types of
projects, including pilot or feasibility studies and collection of preliminary data.
♦ Exploratory/Development Grant (R21)—encourages new, exploratory, and developmental
research projects by providing support for the early stages of project development.
♦ Academic Research Enhancement Award (R15)—supports small research projects in the bio-
medical and behavioral sciences conducted by students and faculty in health professional schools
and other academic components that have not been major recipients of NIH research grant
funds.
2 BWF ♦ HHMI
How to Be a Member of an R01 NIH Study Section
study sections, along with the names of the SRO and the study section
members, is available at [Link]
♦ Individual Predoctoral National Research Service Award for M.D./Ph.D. (F30)—provides a fellow-
ship for predoctoral training leading to a combined M.D./Ph.D.
♦ Predoctoral Individual National Research Service Award (F30)—supports predoctoral individuals
with supervised research training in specified health and health-related areas leading to a Ph.D.
♦ Postdoctoral Individual National Research Service Award (F32)—provides postdoctoral research
training to individuals to broaden their scientific background and extend their potential for re-
search in specified health-related areas.
♦ National Research Service Awards for Senior Fellows (F33)—provides opportunities for experi-
enced scientists to make major changes in the direction of research careers, to broaden scientific
background, to acquire new research capabilities, to enlarge command of an allied research field,
or to take time from regular professional responsibilities for the purpose of increasing capabili-
ties to engage in health-related research.
BWF ♦ HHMI 3
Making the Right Moves A Practical Guide to Scientific Management
The SRO is responsible for appointing study section members and temporary
reviewers.
♦ Scientists who have obtained NIH grants in the area of the study section
4 BWF ♦ HHMI
How to Be a Member of an R01 NIH Study Section
Each application is assigned to at least three study section members: the primary
and secondary reviewers, and one discussant or reader. Together, these three re-
viewers lead the discussion of the application at the study section meeting.
BWF ♦ HHMI 5
Making the Right Moves A Practical Guide to Scientific Management
The reader provides a preliminary score. The reader does not usually have to give
a comprehensive critique of an application before the review meeting but rather
provides shorter, written comments.
After discussing each application, all study section members assign a final score
to it (see section on how scores are calculated). During or after the meeting, a
reviewer has a chance to amend some of his or her comments. Then the SRO
prepares a “summary statement” for the grant applicant. The summary statement
includes the overall score for the application and portions of the written critiques
provided by the primary and secondary reviewers, in the so-called pink sheet.
6 BWF ♦ HHMI
How to Be a Member of an R01 NIH Study Section
Once the discussion is over, study section members score the application.
One week before the study section meeting: The primary and secondary reviewers and the reader provide
written comments and preliminary scores.
Two to three days before the study section meeting: Comments and scores are available for viewing, along
with a proposed list of applications with the lower half of scores, which will not be discussed. (Now is the
time to tell the SRO that you want to rescue an application and include it for discussion—don’t wait until
the meeting to do this.)
Up to two weeks after the study section meeting: Grant critiques are still available for viewing on the review
meeting website. Reviewers have an opportunity to change their written comments.
Two weeks after the study section meeting: The website is closed and the SRO starts to prepare summary
statements to the grant applicants.
BWF ♦ HHMI 7
Making the Right Moves A Practical Guide to Scientific Management
Time Commitment
Most scientists say that it takes about a day to read each grant application as-
signed to them, research the literature, write a critique, and prepare to discuss it
at the review meeting. Study section members spend time reading other review-
ers’ comments and preparing to defend their views if there are any differences of
opinion. Attending a meeting typically requires a couple of days plus travel time.
♦ Broaden your scientific horizons. You will read about research that is not
strictly in your field and hear scientists discuss science from different
perspectives.
♦ Advance your career. This type of service looks good on your CV and is
a good way to network with other scientists in your field.
♦ Become a better mentor. You will be able to tell your students and
postdocs what makes a good grant application.
8 BWF ♦ HHMI
How to Be a Member of an R01 NIH Study Section
But do think about the offer carefully. If you don’t think you have the time to
participate in a particular meeting, it is okay to turn down an SRO letting him or
her know when you might be available (for example, after you finished teaching a
course or once an important site visit is behind you). You could also offer to serve
as an ad hoc reviewer.
Question. I have been asked to be a permanent member of a study section, but I have not yet started the
process of applying for tenure. Should I agree?
Answer. Most established scientists caution against becoming a permanent member of a study section
before obtaining tenure. Until then, your top priority should be establishing your laboratory. Some scientists,
however, point out that serving on a study section as an ad hoc reviewer can be helpful to a career because
you will become more knowledgeable about how to write successful grant applications and you will have
the opportunity to network with other scientists (also see page 8, “Why Serve on a Study Section?”).
♦ If you are being asked to be a permanent member, find out the size of the
study section and how many grant applications each member is asked to
review. The answers might help you choose whether you want to be
BWF ♦ HHMI 9
Making the Right Moves A Practical Guide to Scientific Management
appointed for a four-year term and attend three meetings per year or for a
six-year term and attend two meetings per year.
♦ If you are being asked to serve as an ad hoc member, ask how many
grants you will have to review for this particular meeting. If the SRO
would like you to review 10 grant applications but you don’t have the
time to do so, you can say, “I have too many other obligations right now
but I am happy to review 4.” This is not something that can be “officially”
negotiated but many people do it.
♦ Let the SRO know if there are certain scientific fields covered by the
study section that you are not willing to review or feel uncomfortable
reviewing because you are not sufficiently knowledgeable. Once the grant
applications have been assigned to you, you have a chance to turn cer-
tain ones down if you don’t feel qualified to review them, but that causes
problems for the SRO. It is better to discuss these things upfront.
For R01 applications, the critique consists of a discussion of the following five
criteria:
10 B W F ♦ H H M I
How to Be a Member of an R01 NIH Study Section
♦ Be clear. Reviewers are often too subtle when providing negative feed-
back. If you think there is a fatal flaw in the proposal, say what it is.
Without this information the applicant will make only “cosmetic”
changes and resubmit the application without addressing the flaw.
♦ Don’t rewrite the application. Your job is to assess the application. The
applicant should have a clear idea of where the application falls short, but
you should not suggest experiments or come up with better references.
B W F ♦ H H M I 11
Making the Right Moves A Practical Guide to Scientific Management
♦ Stand your ground. You were chosen to be a reviewer because you are
an accomplished scientist. Don’t be afraid to voice your opinion on the
merits of a proposal if you think another reviewer has missed them. (At
the same time, don’t be afraid to change your mind if another reviewer
points out something you missed.)
♦ Be prepared. Make sure you are prepared to discuss in detail the grants
you are presenting—including issues raised in the online comments—
especially if you feel strongly that they should be funded, along with any
applications you are rescuing. If you don’t present them well, the investi-
gator does not have a chance to get funded. If you are a primary reviewer,
prepare your opening statement carefully, so that you can keep your
discussion within a five-minute time frame.
♦ Focus your discussion. There is no need to talk about every aspect of a
study. Just focus on the main strengths and weaknesses of the proposal,
which will help other study section members arrive at a score.
♦ Be an advocate for the application. Make clear why you think it will
really make a difference.
♦ Avoid repetition. If you agree with everything the previous reviewer said,
just say that you agree and maybe add a couple of points. You don’t need
to give an identical presentation.
♦ Keep the focus on the application. You don’t need to show others how
smart you are! You are there to assess the merits of the applications.
12 B W F ♦ H H M I
How to Be a Member of an R01 NIH Study Section
It is okay to give a score that is different from your preliminary score. If the
discussion changed your mind about a particular application, your score should
reflect that.
Once all the scores are in, individual scores are averaged and then multiplied by
100 to yield a single overall priority score for each application (i.e., 253). Priority
scores are then converted to percentile rankings. This ranking is based on scores
assigned to applications reviewed during the current round of review, plus the
past two review rounds, for standing committees.
NIH is examining ways to improve its system for reviewing R01 grant applica-
tions. The “renovation” plans, scheduled for implementation in 2009 and 2010,
include shortening grant applications—which are currently 25 pages or more.
NIH plans to reduce the description of the experimental approach and methods.
The intent is to make grant writers and reviewers focus more on why something
is worth doing rather than on the details of how to do it. In addition, shorter
grant applications will take less time for reviewers to read, making it possible for
more reviewers to be assigned to each grant application.
Other changes include providing integer “grades” to each of the five rating cri-
teria of grant applications to make more transparent the perceived strengths and
weaknesses of each application, permitting only one resubmission or “amend-
ment” of an application that is not funded (currently, two amended applications
are allowed), providing more incentives and guidance for reviewers, and awarding
more grants to early career investigators.
B W F ♦ H H M I 13
Making the Right Moves A Practical Guide to Scientific Management
Reviewing grant applications is one of the most important services you will be
asked to provide. It goes without saying that you should take this responsibility
seriously. Not only are you deciding on the science that is supported and car-
ried forward, but the way you conduct yourself in a study section will affect your
reputation and standing among your peers.
RESOURCES
Center for Scientific Review, NIH: [Link]
“Getting Funded” (Chapter 9), Making the Right Moves: A Practical Guide to
Scientific Management for Postdocs and New Faculty: [Link]/labmanagement.
ACKNOWLEDGMENTS
The following individuals provided information for this chapter:
Maryrose Franko, Ph.D., Howard Hughes Medical Institute
Laura Knoll, Ph.D., University of Wisconsin–Madison
Tom Misteli, PhD., National Cancer Institute, National Institutes of Health
Toni Scarpa, Ph.D., Center for Scientific Review, National Institutes of Health
Keith R. Yamamoto, Ph.D., University of California, San Francisco
14 B W F ♦ H H M I