Research Project Rubric Advanced Standards Programs
This key assessment, Research Project, assesses the following components of CAEP Advanced Standard RA1.1:
- Application of data literacy;
- Use of research and understanding research methodologies;
- Develop supporting school environments; and
- Appropriate applications of technology for the desired outcomes.
Information About the Assessment
In this assessment, UND students/candidates complete an assignment in a course such as Action Research, Progress Monitoring, or a capstone research course. Candidates:
- Develop a research question/s that is focused on improving educational outcomes for P-12 students.
- Write a literature review on the research topic. The literature review must:
- Include scholarly literature from multiple sources;
- Discuss different perspectives on the research topic; and
- Conclude with a synthesis/summary of the research.
- Select a research method that is aligned with the purpose of the study and that will provide you with reliable and valid data to answer the research question/s.
- Analyze data using technological data analysis where appropriate.
- Present and explain findings in relationship to the research question.
- Prepare a narrative explanation of data and findings.
- Present data and findings in visual form (i.e., tables, graphs, charts, diagrams)
- Draw conclusions from the findings focused on improving educational outcomes for diverse populations of P-12 students.
- Include a reference page.
Rubric
Candidate Knowledge, Skills, and Professional Dispositions
RA.1.1 Candidates for advanced preparation demonstrate their proficiencies to understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced, through:
RA.1.1.a Applications of Data Literacy
| Item | Exceeds | Meets | Progressing | Does Not Meet |
|---|---|---|---|---|
|
Interpretation: Ability to explain information presented in data forms (e.g., equations, graphs, diagrams, tables, words). |
Provides thorough and accurate explanations of information presented in data forms. Presents appropriate inferences and implications based on that information. |
Provides a thorough and accurate explanation of information presented in data forms. |
Provides partial or partially accurate explanations of information presented in data forms but may make minor errors such as misinterpretation of units or may leave out minor details in their explanation. |
Attempts to explain information presented in data forms but draws incorrect conclusions about what the information means, or the explanation is unclear or confusing. |
|
Communication: Ability to express data as evidence in support of the argument or purpose of the work (in terms of what evidence is used and how it is formatted, presented, and contextualized). |
Expresses data in a clear, relevant, and contextualized manner that supports the argument or purpose and discusses the strengths or weaknesses of the data in relation to the argument or purpose. |
Expresses data in a clear, relevant, and contextualized manner that supports the argument or purpose. |
Expresses data in support of the argument/purpose but some areas need further explanation to increase clarity, relevancy, and/or context. |
Either does not express data or expresses data that is inaccurate or irrelevant to the argument or purpose. |
|
Representation: Ability to convert relevant information into various data forms (e.g., equations, graphs, diagrams, tables, words). |
Uses a data form or representation that emphasizes the conclusions or significance of the data. |
Converts information into a representation that accurately depicts the data. |
Converts information into a data form that accurately represents the data but may be unclear or confusing in places. |
Converts information into a data form that inaccurately represents the data or that includes irrelevant data. |
RA.1.1.b Use of Research and Understanding of Qualitative, Quantitative, and/or Mixed-methods Research Methodologies
| Item | Exceeds | Meets | Progressing | Does Not Meet |
|---|---|---|---|---|
|
Understanding: Ability to select an appropriate research methodology based on the study's purpose. |
Independently selects an appropriate research methodology based on the purpose of the study; research question aligns with selected method and is clear, concise, and answerable. |
Selects an adequate research methodology based on the purpose of the study but other methodologies might yield better results; research question aligns with selected method and is answerable. |
Selects an adequate research methodology based on the study's purpose with assistance; research question partially aligns with selected methods and is partially answerable. |
Selects an inappropriate research methodology based on the purpose of the study even with assistance; research question is disconnected from method and is written in unanswerable terms. |
|
Use: Ability to employ a research design that results in valid and reliable measures based on the specific methodology. |
Accurately uses optimal research methods to elicit valid/trustworthy and reliable results. |
Research design elicits valid/trustworthy and reliable results but is basic in nature; the research design could be improved to collect better data. |
Identifies appropriate research methods but fidelity in implementation is lacking, resulting in invalid/untrustworthy and/or unreliable results. |
Identifies and/or uses inappropriate research methods. |
|
Collection: Ability to select literature that aligns with the research question/purpose and represents multiple perspectives and findings. |
Literature selected specifically aligns with the research question/purpose and represents multiple perspectives and findings. |
Literature selected specifically aligns with the question/purpose. |
Literature selected provides general information aligned with the research question/purpose, but more specific literature is available. |
Literature is irrelevant to the research question/purpose. |
|
Critical Thinking: Ability to apply higher-order thinking to literature that represents multiple perspectives and findings. |
Evaluates literature that represents multiple perspectives or findings to develop their own perspective, argument, or theory. |
Evaluates multiple perspectives or findings (i.e., discusses the strengths and weaknesses of the literature). |
Analyzes (i.e., compares & contrasts) literature that represents multiple perspectives or findings. |
Presents literature that represents multiple perspectives or findings but does not analyze (i.e., compare & contrast) or evaluate the information. |
RA.1.1.c Develop Supportive School Environments
| Item | Exceeds | Meets | Progressing | Does Not Meet |
|---|---|---|---|---|
|
Culturally Responsive Application: Research addresses the learning and development of all students. |
The theme of developing supportive school environments and learning for all students is strongly evident throughout the research and includes an emphasis on social justice. |
The research and its conclusions address multiple elements of diversity and culture as they apply to developing supportive school environments and learning for all students. |
The research and its conclusions superficially address issues of diversity and culture as they apply to developing supportive school environments and learning for all students or the research may reinforce stereotypes. |
The research does not address the heterogeneity of students, or its conclusions are not responsive to issues of diversity and culture as they apply to developing supportive school environments and learning for all students. |
RA.1.1.e Supporting Appropriate Applications of Technology for the Desired Outcome
| Item | Exceeds | Meets | Progressing | Does Not Meet |
|---|---|---|---|---|
|
Technology: Ability to use technology for design, implementation, and assessment of learning experiences to engage students and improve learning. |
Ready to lead others in the correct and appropriate use of research-focused technology (e.g., Qualtrics, SPSS, NVivo, Excel, etc.); results demonstrate a measurable contribution to the profession. |
Uses technology correctly and appropriately uses data-focused technology (e.g., Qualtrics, SPSS, NVivo, Excel, etc.) to collect and/or analyze data and generate a display of results; results are likely to contribute to the profession. |
Uses technology (e.g., Qualtrics, SPSS, NVivo, Excel, etc.) to collect and/or analyze data and share results; results may or may not contribute to the profession. |
Does not use technology or uses technology either incorrectly or inappropriately to collect and/or analyze data and display results. |