MA+Simplified+Learning+Outcomes

As of summer 2013, we have been instructed to (1) simplify our learning outcomes and (2) state them in terms of what students can do instead of what students understand. Below is a list of the learning outcomes for the MA Program, both simplified and original.


 * Name || Simplified || Original || BYU LOs ||
 * Scholarship || Graduates can understand, evaluate, engage in, and apply scholarly activity in the field of mathematics education. || Graduates understand and can evaluate important issues, trends, theories, paradigms of research, and research findings in the field of mathematics education, as well as their implications for the teaching and learning of mathematics in the public schools, mathematics teacher development, and participation in mathematics education scholarship. || 2 ||
 * Research || Graduates can design and implement a research study in the field of mathematics education. || Graduates understand research methods in mathematics education and can a) locate an interesting and important problem; b) conduct a literature review to situate the problem; c) develop a conceptual framework; d) establish focused research questions; e) choose and implement appropriate methods for collecting and analyzing data; f) address issues of research quality such as validity, reliability, and significance; and g) effectively communicate their work both orally and in writing. || 2, 4 ||
 * Mathematics || Graduates understand the mathematics they need to teach school mathematics. || Graduates understand central concepts, tools of inquiry, and structures of the discipline of mathematics as well as core representations, canonical examples, and alternative algorithms germane to teaching school mathematics. || 2 ||
 * Teaching || Graduates can apply their understanding of mathematics education research in their own teaching. || Graduates understand how to analyze topics from school mathematics in the context of the literature on students’ mathematical thinking, meaningfully apply research on teaching and learning mathematics in their teaching, and use scholarly inquiry as a lens to reflect on that teaching. || 2, 4 ||
 * Professionalism || Graduates demonstrate professionalism by acting appropriately in professional settings, seeking growth opportunities, and contributing to professional organizations. || Graduates demonstrate professionalism through maintaining appropriate relationships and behavior in the school setting, and by seeking opportunities to improve practice and advance the profession through reflecting on practice, soliciting and incorporating feedback, and contributing to professional, school, and community organizations. || 3, 4 ||
 * Spiritual Stewardship || Graduates seek integrity between their personal and professional lives consistent with the restored gospel of Jesus Christ. || Graduates seek integrity between their personal and professional lives consistent with the restored gospel of Jesus Christ by recognizing all students as children of God and striving to nurture their divine potential; applying gospel-centered principles of teaching and learning to family relationships, gospel service, and involvement in the community; and serving as examples of a Christ-centered life within their spheres of influence. || 1, 3, 4 ||


 * Measures for 2012-2013 Academic Year**


 * Scholarship || Direct Measures: Masters Exam Sections I and III, Thesis/Project Proposal Defense, Thesis/Project Final Defense

Indirect Measures: Completion of MthEd 550, 562, 590, 591, 598R, 608, 611R, 660, 661, 663, 695R, 698R, 699R ||
 * Research || Direct Measures: Masters Exam Sections II and III, Thesis/Project Final Defense

Indirect Measures: Completion of MthEd 550, 562, 590, 591, 598R, 608, 611R, 660, 661, 663, 695R, 698R, 699R ||
 * Mathematics || Direct Measures: Masters Exam Section IV

Indirect Measures: Completion of MthEd 550, 562, 598R, 608, 660, 661, 663 ||
 * Teaching || Direct Measures: Peer Teaching Evaluations and Student Ratings

Indirect Measures: Completion of MthEd 550, 562, 590, 591, 598R, 608, 611R, 660, 661, 663 ||
 * Professionalism || Direct Measures: MAPIBS All

Indirect Measures: Completion of MthEd 550, 562, 590, 591, 598R, 608, 611R, 660, 661, 663, 698R, 699R ||
 * Spiritual Stewardship || Direct Measures: MAPIBS 1-3, 7, 9

Indirect Measures: Completion of MthEd 550, 562, 590, 591, 598R, 608, 611R, 660, 661, 663, 695R, 698R, 699R ||

Rubric for Assessing Program LOs
The MA program will be assessed annually at the beginning of winter semester. Because the purpose of the assessment is to see if the learning outcomes have been met by the end of the program, it does not make sense to consider data from students who are still in the program. However, if data is limited to only students who either graduated or dropped out of the program the year before, the data points are insufficient to establish clear trends. Consequently, at each annual evaluation of the program, data will be considered for students who either graduated or dropped out over the past two years. While this means that the data from a particular student will be used in two consecutive evaluations of program learning outcomes, we nonetheless feel that data aggregated across two years will provide a fuller understanding of the success of our program than data from a single year.

In preparation to assess the program learning outcomes, each student who has graduated or dropped out of the program will be evaluated individually on each learning outcome to determine if that learning outcome was met by that student. The criteria for a learning outcome to be met by a student are given below. Once each student has been evaluated on each learning outcome, the number of students who have met each learning outcome will be tallied. If 70% of the students meet a particular learning outcome, then we will conclude that the program is satisfactory with respect to that learning outcome.


 * Criteria for Determining Whether a Student has Met a Particular Learning Outcome**

//LO 1: Scholarship// For each student, data from Sections I and III of the Master's Exam, from their Thesis/Project proposal defense and from their Thesis/Project final defense will be gathered. (If students were given a second chance on any of these measures, data will come from the last attempt.) Students meet this learning outcome if their performance on any two of the three measures is satisfactory.
 * Master's Exam Sections I and III: Students are considered satisfactory on this measure if the average of their scores on the four problems from Sections I and III is at least 70%.
 * Thesis/Project proposal defense: Students are considered satisfactory on this measure if they passed (initially or eventually) their proposal defense.
 * Thesis/Project final defense: Students are considered satisfactory on this measure if they passed (initially or eventually) their final defense.

//LO 2: Research// For each student, data from Sections II and III of the Master's Exam, and from their Thesis/Project final defense will be gathered. (If students were given a second chance on either of these measures, data will come from the last attempt.) Students completing a project meet this learning outcome if their performance on both measures is satisfactory. Students completing a thesis meet this learning outcome if their performance on the thesis defense is satisfactory.
 * Master's Exam Sections II and III: Students are considered satisfactory on this measure if the average of their scores on the four problems from Sections II and III is at least 70%.
 * Thesis/Project final defense: Students are considered satisfactory on this measure if they passed (initially or eventually) their final defense.

//LO 3: Mathematics// For each student, data from Section IV of the Master's Exam will be gathered. (If students were given a second chance to take the Master's Exam, data will come from the last attempt.) Students meet this learning outcome if the average of their scores on the two problems from Section IV is at least 70%.

//LO 4: Teaching// For each student, teacher evaluation and student rating data from the last two courses taught will be gathered and the better of each of those measures will be used for analysis. For students to meet this learning outcome, they must receive a satisfactory rating on both measures.

STUDENT RATINGS: On the student ratings measure, there is an overall course rating, an overall instructor rating, and 23 sub-questions. Eighteen of the 23 sub-questions are rated on a 1-8 scale. If 9 or more of the sub-questions are rated below a 6 or if the overall instructor rating is below a 6, the student will receive an unsatisfactory rating on this measure. TEACHER EVALUATIONS: On the teacher evaluations measure, if the student receives a rating below a 3 in any of the 4 areas (classroom organization; instruction, discussion, and tasks; content; communication), they will receive an unsatisfactory rating on this measure.

//LO 5: Professionalism// For each student, two MA PIBS—the last MA PIBS from the project/thesis advisor and the MA PIBS from the last 3-credit-hour mathematics education course the student took—will be considered. For the student to be considered satisfactory on an item, the student must receive a rating of "meets" or "exceeds" expectations for that item on both MA PIBS. If a students is unsatisfactory on 3 or more items, then the student will be considered unsatisfactory in professionalism.

//LO 6: Spiritual Stewardship// For each student, items 1-3, 7, and 9 from two MA PIBS—the last MA PIBS from the project/thesis advisor and the MA PIBS from the last 3-credit-hour mathematics education course the student took—will be considered. For the student to be considered satisfactory on an item, the student must receive a rating of "meets" or "exceeds" expectations for that item on both MA PIBS. If a students is unsatisfactory on 2 or more items, then the student will be considered unsatisfactory in spiritual stewardship.