About or Appealing an Evidence Rating
is committed to the quality, fairness and transparency of CrimeSolutions.gov.
As part of that commitment, you may inquire regarding an evidence rating or why
a program has not been rated and posted to CrimeSolutions.gov. Your inquiry
should be grounded in:
- A fair reading of the
evidence (please see the program's evidence base).
- An understanding of the
rating procedures and criteria established for CrimeSolutions.gov (please see How We Review and Rate a Program From Start to Finish or How We Review and Rate a Practice From Start to Finish).
the Contact Us form
to submit an inquiry. If your inquiry is regarding a specific rating, we will provide
additional explanation for the evidence rating that was assigned.
We will not provide the identity of the reviewers.
the inquiry and response described above, you may request a formal appeal of an
evidence rating. Our goal is to complete the entire appeal process within 60
CrimeSolutions.gov Appeals Board will work toward providing a systematic
response that addresses all concerns. The Appeals Board is composed of
CrimeSolutions.gov Study Reviewers, supplemented with additional expert
reviewers, if needed.
the Contact Us form
to request a formal appeal of an evidence rating. You will then be provided
additional guidance by CrimeSolutions.gov, which will require that you provide pertinent,
specific information that indicates the necessity for an appellate review.
members of the Appeals Board, selected on the basis of expertise pertinent to
the appeal and the absence of any conflicts of interest, will conduct the
appellate review. Each appellate reviewer will conduct an independent review of
the appeal, the studies in the program's evidence base, and copies of the
original reviewers' scoring instruments. The identities of the original reviewers
will remain anonymous until they are required to participate in the process.
After the separate reviews, the appellate reviewers will participate in a
conference call to discuss the original review and rating, and the concerns
raised by the inquirer, and to reach consensus about the program's evidence
rating. If the appellate reviewers agree that the program's original rating
should not be changed, they will provide a written explanation documenting the
discussion and the reason for their final decision. If they believe a new rating
is warranted, they will provide a written explanation describing how and why
their scores differ from the scores of the original reviewers. A final
conference call will be held between the Appeals Board members and the original
reviewers to discuss the disagreement on the scoring instruments and come to a
consensus on a final program rating.
Once a final consensus rating is reached, we provide a written response
describing the final decision from the Appeals Board.
warranted as a result of the appeal, changes to a program's evidence rating or
additions to information in the program profile will be made on
consider re-reviewing a program or practice when:
evaluation studies, or studies not previously identified, are found that
meet the CrimeSolutions.gov criteria. This may include studies that extend
the follow-up period of previously reviewed studies.
supplemental materials are submitted that better explain the conceptual
framework and fidelity dimensions of the program, which may affect a
program's evidence rating.
meta-analyses, or meta-analyses not previously identified, are found that
meet the CrimeSolutions.gov criteria. This may include meta-analyses that have
been updated since the original review.
new materials may or may not be sufficient to warrant a new evidence rating. If
a Lead Researcher determines that there is sufficient evidence in the new
materials to warrant another review, then the new information is sent to the Study
Reviewers for assessment. Even if the program's evidence rating does not
change, the new evidence and materials may be included or referenced on the program's