How can you develop better research skills assessment rubrics?

1 Identify the purpose and scope of the rubric

The first step is to clarify why and how you want to use the rubric. What are the learning outcomes or objectives of the research project? Who are the target audience and users of the rubric? How will the rubric be applied and scored? These questions will help you determine the appropriate level of detail, complexity, and specificity of the rubric, as well as the criteria and standards that you will use to assess research skills.

2 Review existing rubrics and models

The next step is to look for existing rubrics and models that are relevant to your research topic, discipline, or context. You can find many examples of research skills assessment rubrics online, such as from the Association of American Colleges and Universities (AAC&U) or the Center for Research on Learning and Teaching (CRLT). You can also consult with your peers, mentors, or experts in your field to get their feedback and suggestions. Reviewing existing rubrics and models will help you identify the best practices, strengths, and weaknesses of different approaches, and inspire you to create your own rubric.

3 Define the dimensions and levels of the rubric

The third step is to define the dimensions and levels of the rubric. Dimensions are the categories or components of research skills that you want to assess, such as problem definition, literature review, methodology, analysis, communication, or ethics. Levels are the scales or descriptors that you use to indicate the quality or proficiency of research performance, such as novice, competent, proficient, or expert. You can use numerical, alphabetical, or descriptive labels for the levels, as long as they are clear and consistent. You should also provide a brief explanation or example for each level, to avoid ambiguity or confusion.

4 Develop the criteria and indicators for each dimension and level

The fourth step is to develop the criteria and indicators for each dimension and level. Criteria are the specific expectations or requirements that you use to judge the research performance, such as accuracy, relevance, originality, or clarity. Indicators are the observable or measurable behaviors or outcomes that demonstrate the achievement of the criteria, such as citations, arguments, data, or presentation. You should align the criteria and indicators with the purpose and scope of the rubric, and use clear and concise language to describe them.

5 Test and refine the rubric

The final step is to test and refine the rubric. You can test the rubric by applying it to some sample or actual research projects, and checking if it is valid, reliable, and fair. You can also ask for feedback from your colleagues, students, or stakeholders, and see if they agree with the rubric's design, content, and scoring. You should revise the rubric based on the results of the testing and feedback, and make sure that it is accurate, comprehensive, and useful for your research skills assessment.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?