Frequently Asked Questions About Assessment at Mānoa

 

1. What's done with the annual reports?

The Assessment Office uses the information in several ways. The Assessment Office

  • locates examples of exemplary assessment practices that it can share with the faculty-at-large (a program's permission is sought before the Assessment Office uses it as an example);
  • identifies issues and concerns that need attention and uses those to guide Assessment Office program development (e.g., when an analysis of reports reveals the need for more attention to curriculum mapping, the Assessment Office offers workshops on that topic);
  • summarizes the reports and conveys that summary to the Faculty Senate, Vice Chancellor for Academic Affairs, and the Western Association of Schools and Colleges (WASC). The summary serves as primary support in Mānoa's case for re-accreditation and meets reporting requirements set by WASC.
  • conveys the reports to the Office of the Vice Chancellor for Academic Affairs for use as part of Program Review.

2. How can I get help with my annual report?

3. What is the goal of program assessment?

The goal is improved student learning and better programs. We rely on this definition of program assessment: "The systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development." (Palomba & Banta, 1999). The unit of interest is typically the degree program and its focused on student learning.

It is not individual student, faculty, or course evaluation.

4. Are program assessment plans, the annual assessment report, and program review all the same?

No, although there are some similarities and even overlap, they are 3 distinct activities.

  • Program assessment is an ongoing process designed to monitor and improve student learning at the program (degree/minor/certificate) level (Mary Allen, 2006).
  • The annual assessment report is a status report on the program assessment plan and a summary of the assessment projects completed that year.
  • Program review is completed every 7 years. Although assessment is a component, program review is comprehensive. It includes a self-study, a quantitative profile of program activity, etc.

5. Who has to do assessment?

Program assessment, which is the focus of the Assessment Office, is required for all programs and units that offer a degree, minor, or certificate. Only programs and units that run a degree program, oversee a minor or certificate do program assessment.
Classroom assessment is done by all course instructors and involves course grades and mid- and/or end-of-semester course evaluations.

6. We ask students to assess themselves and to complete surveys--do these count?

Self-report data are valuable. They provide tremendous insight into student learning when coupled with direct measures of learning. However, self-report data (often collected through surveys and interviews) are not sufficient evidence of learning because they are perceptions of learning and not direct evidence of learning. Direct evidence of student learning is required for program assessment. See Choose a Method for more information about direct and indirect measures.

7. Can the Assessment Office do our program assessment for us?

It really is in the best interest of the program if it completes its own program assessment. Program assessment, when driven by faculty members, is an opportunity for them to closely look at the alignment between courses and the program and the program’s effect on student learning. During the assessment process, faculty members speak with each other, students, and various program stakeholders about what they teach, their expectations, and how they teach. Faculty members are typically in the best position to figure out what to change and to implement that change, when needed, to improve student learning. These benefits would be lost if the Assessment Office took on program assessment for your program. Collaboration between the program and the Assessment Office is recommended.

8. What can the Assessment Office do for programs?

The Assessment Office is here to support your program assessment endeavors. Think of us as your program assessment consultants and technical experts.
  • We offer an array of assessment workshops throughout the school year. If you are unable to attend, we have the PowerPoint and handouts available on our website. Link to Workshop/Events
  • Our web site also contains general assessment information, “how to” guides, helpful resources and links, and templates.
  • We are also available by appointment for individual program consultation; we can provide advice on how to assess your program, what to assess, and how to act on the assessment results.

9. Is the Assessment Office in charge of CAFE/course evaluations?

No. The Office of Faculty Development and Academic Support (OFDAS) offers both mid-semester and end-of-course evaluations (CAFE). Although OFDAS and the Assessment Office work together, OFDAS focuses on course-level support while the Assessment Office focuses on program- and institutional-level support.

Have a question for the Assessment Office? Contact us.

 

updated 9/15/2009