Educational Evaluation 2.0 Portfolio/Reflection
Published on Nov 27, 2015
No Description
MORE DECKS TO EXPLORE
PRESENTATION OUTLINE
Educational Evaluation 2.0
Amy Janssen -- Portfolio
This presentation will provide the evidence that I have met the outcomes for Education Evaluation 2.0. It will also show improvements that I have made in one of my courses to increase student learning.
Photo by instragram.com/amirkuckovic
Goals
- Improve Summative Assessment Scores
- Increase Student Learning
- Help Student Make Connections
I initially identify a single course where I felt improvements could be made. I selected a second semester online course that students continue to struggle with. I have reviewed data in the past that shows student success in this course was lower than other courses.
My initial goal was to improve overall course success rates by improving summative assessment scores, to increase student learning, and to help the students make connections with concepts they were learning.
My initial goal was to improve overall course success rates by improving summative assessment scores, to increase student learning, and to help the students make connections with concepts they were learning.
Photo by MTSOfan
Develop Assessment Plan
Before I determined what improvements to make, I needed to look at the bigger picture of how assessment was used in this specific course.
This led me to develop a total assessment plan for the course. By developing a plan and putting it in table format, I could see what I may be missing.
This led me to develop a total assessment plan for the course. By developing a plan and putting it in table format, I could see what I may be missing.
Photo by krossbow
Questions
- What is the desired outcome?
- What does the student need to do to measure success?
- How often do they need to demonstrate success?
When developing the assessment plan, I thought it was important to ask the main questions:
1. What is the desired outcome? What does the student need to be successful at? These would be the competencies & employability skills.
2. What does the student need to do to get to this outcome and measure their success? These would be all assessment activities the student will complete.need to show their success?
3. How often does the student need to demonstrate their success? This would be the frequency of assessment.
1. What is the desired outcome? What does the student need to be successful at? These would be the competencies & employability skills.
2. What does the student need to do to get to this outcome and measure their success? These would be all assessment activities the student will complete.need to show their success?
3. How often does the student need to demonstrate their success? This would be the frequency of assessment.
Photo by Horia Varlan
Questions
- Who will measure their success?
- How will they know they know?
continued..
4. Who will measure the student's success? Who will evaluate the results of the assessments?
5. How will the student know they know? How will I know they know? How often will the student get feedback and how?
4. Who will measure the student's success? Who will evaluate the results of the assessments?
5. How will the student know they know? How will I know they know? How often will the student get feedback and how?
Photo by Horia Varlan
Assessment Plan
- Linked all 24 Competencies
- Linked Employability Skills
- Frequency of Assessment
- Who provides feedback & how
Each course competency (24 competencies) and employability skills were linked to a specific assessment in order to show where and how the student was being assessed. In the plan, I identified how often the student was assessed throughout the course. I also identified how the student was provided feedback and who provided this feedback.
Photo by mChuca
Identify the Gap
Missing Formative Assessment as a Bridge
After reviewing my assessment plan, I identified that the gap may be between all their practice exercises and the summative assessment. Including additional formative assessments to bridge this gap was my solution.
Photo by Wajahat Mahmood
New Formative Assessments
- 4 Coding Concept Reviews
- Pre-Tests
- Bridge between practice & summative assessment
- Brief; Allowed 2 attempts
I developed four new formative assessments. I named them Coding Concept Reviews and will use them as pre-tests to practice concepts that students have been struggling with.
Each assessment will be very brief, between 7-10 key questions. The student will have two attempts to get a perfect score on these assessments. This will allow the student to make mistakes without being penalized (they have other formative assessments that are done weekly where they are offered the chance to make mistakes and learn from this as well).
Each assessment will be very brief, between 7-10 key questions. The student will have two attempts to get a perfect score on these assessments. This will allow the student to make mistakes without being penalized (they have other formative assessments that are done weekly where they are offered the chance to make mistakes and learn from this as well).
Photo by Kay Gaensler
Blackboard Data
- Data used to guide development
- Past 2 semesters: Identified questions majority of classes got incorrect (75% or more)
I used test data from Blackboard to guide my decisions in what to include in each assessment. I analyzed data from the past two semesters and identified questions on each summative assessment that the majority of the class had wrong (75% or more of the class had these questions incorrect).
These specific questions were then the focus of what I would include in the Coding Concept Reviews.
These specific questions were then the focus of what I would include in the Coding Concept Reviews.
Photo by ckhamken
Plan & Evaluate
- Implement Spring 2016
- Evaluate May 2016
- Compare success rates on individual Summative Assessments for those specific questions
Since this is an online course, these types of assessments cannot be implemented immediately. Each assessment took time to develop. I have already included these assessments in my Course Master and will implement these in the Spring 2016.
I will then evaluate the results in May 2016. The data I used to develop the formative assessments will be used to compare success rates on the same questions in the Summative Assessments. I will be looking for an increase in getting those specific questions correct.
I will then evaluate the results in May 2016. The data I used to develop the formative assessments will be used to compare success rates on the same questions in the Summative Assessments. I will be looking for an increase in getting those specific questions correct.
Photo by Chapendra
Results = SUCCESS
As educators, we know each thing we try is not always successful, but I am confident that after I evaluate results from implementing these new formative assessments, they will show a successful outcome. I expect to see an increase in scores in the Summative Assessments and increase student learning.
Photo by Celestine Chua
