“Nothing has such power to broaden the mind as the ability to investigate systematically and truly all that comes under observation in life.” ― Marcus Aurelius
Assessment provides a clear conceptualization of the goals we set for students, an understanding of how these goals are aligned to the strategies meant to accomplish them, a plan for how progress on these goals can be assessed, a description of the results obtained from assessment methods, and documentation on how these results validate current practices or point to changes needed.
Concerns about Learning Assessment
Learning is a complex process with cognitive, affective, and social dimensions that involves not only knowledge and understanding, but also values, attitudes, and habits of mind that affect students’ success in and beyond the classroom. Teaching as an ongoing process of inquiry, experimentation, and reflection. Taking the time to address questions about teaching, learning, and curricular alignment can dramatically improve the effectiveness of courses and programs, and facilitate valuable interdisciplinary and intercampus discussions about student learning. When properly aligned to learning goals, assessment methods help us determine whether our students are learning what we think they’re learning, as well as how well course/program content, delivery and pedagogy support students’ opportunities to achieve program learning goals.
It is important to acknowledge, however, that meaningful assessment demands careful, thoughtful practitioners, and that the work entailed in assessment projects must be manageable. Assessment can certainly be used in a careless and damaging fashion, especially when assessment is treated as an end in itself. The extent to which a desired outcome is easy to measure can have little to do with the degree to which it is worthy of measurement, and it is important to avoid easy measures that do not sufficiently mirror the complexity of student learning. The process of assessment is useful and meaningful when guided by the curiosity and intellectual dialogue that characterize the culture of higher education, when methods draw on multiple measures, following principles of research, and when instructors’ educational values are made clear through the methods of assessment.
– Adapted from the APA Statement on Outcomes Assessment
Does assessment include faculty or staff evaluation?
No – absolutely not. The purpose of learning assessment is to improve student learning and it is not to be used as a way of evaluating instructors. Similarly, the purpose of administrative assessment is to improve the student experience at QC. No individual faculty or staff member has the sole responsibility for ensuring that program/office goals are met. Therefore, any assessment of progress on academic and administrative goals must not be used to evaluate any individual faculty or staff member.
How is grading different from assessment?
Generally, the goal of grading is to evaluate student learning, whereas the goal of assessment is to improve it. Grading is the analysis and use of data by faculty to make judgments about an individual student’s performance. Assessment, on the other hand, is a way to measure student learning overall and improve student learning within a course or program.
Grading plays an important role in assessment, of course, as grades can provide useful evidence of student learning when they are based on direct measures (tests, projects, papers, etc.) that are clearly linked to course learning goals and consistent with standards. However, assessment typically goes beyond grading by systematically examining patterns of student learning and using this information to improve educational practices.
|Process-oriented (how students learn)
|Product-oriented (what students learned)
|Diagnostic: identify areas for improvement
|Judgmental: assign a letter grade
How is assessment different from research?
Assessment and research are similar in many ways: Both involve asking questions, collecting data, analyzing results, and using the results as reliable evidence. Like research, assessment activities may use quantitative or qualitative research methods, and often benefits from a mixed methods approach.
However, there are important differences. The goal of research is to confirm or challenge hypotheses to guide theory, whereas the goal of assessment is to produce reasonably accurate information about how well we are meeting our goals and to guide local practice. Many factors limit the scope and impact of assessment, including limitations on time, resources, design and implementation. As such, assessment findings typically have implications for a single course, program or institution, whereas research findings are intended to have broader implications.
Decisions about curriculum, teaching techniques, assignments, and syllabi are made regularly and such decisions are best informed by evidence – the findings of assessment activities. Good assessment practices, in the context of a particular course, program or institution, can and should guide local practice and decisions for the continual improvement of the student experience.
Assuming assessment findings will not be published or presented at a conference, assessment activities that are conducted for internal decision-making (and not as part of a “systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge”) do not require IRB review. IRB approval is required for generalizable research involving human subjects. To learn more, see CUNY’s exemption policy, or CUNY’s policies on Human Research.
What constitutes evidence of student learning?
This question is best rephrased as, ‘How do we know that our students are learning?’ and it might be useful to keep in mind that gathering evidence of students’ learning is something you have been doing for most of your academic career.
While the evidence we gather is not the result of randomized controlled trials, we can, however, triangulate our measures of student learning, keep up to date with the literature on teaching and learning, and continually reflect on how learning can be improved. For example, a grade is one measure of student learning, and grades can provide useful evidence of student learning if they are based on direct measures (exams, projects, papers, etc.) that are clearly linked to course learning goals.
Student learning is best measured using several assessment methods (direct and indirect measures ). To avoid easy measures that do not sufficiently mirror the complexity of student learning, we must also take into account the peculiarities of a discipline to which assessment methods are applied.
To learn more, see Linda Susky’s Examples of Evidence of Student Learning, or check out Susan A. Ambrose’ How Learning Works: Seven Research-Based Principles for Smart Teaching.
What is the difference between learning goals and measurable objectives (aka SLOs)?
Learning goals are the broad statements we make about what we expect students to know and be able to do as a result of completing a learning experience (e.g. a reading assignment, a course module, a course or a program). Measurable learning objectives, aka Student learning outcomes (SLOs) are statements that describe the observable or measurable behaviors that would indicate the level of mastery students have achieved as a result of a learning experience. Rephrasing our learning goals for a course or program in this way can help us determine whether the learning goals we set for our students have been met, and is especially helpful for standards-based grading, which focuses on mastery.
Why is it important for a syllabus to include course learning goals and objectives?
Having clear learning goals and measurable objectives (aka SLOs) on syllabi is helpful for both students and instructors. Clearly stated goals and objectives helps students to know what the expectations are for a course ( the learning goals) and how they will be evaluated (the measurable objectives), which can positively impact student motivation and self-efficacy, and encourages students to self-assess. For instructors, having clear learning goals and objectives for a course helps to structure course content, which aids in the effective evaluation of student work. This is also known as mapping — the process of aligning learning goals to assignments and activities to ensure that learning goals are addressed in the course (or curriculum) in ways that support students’ opportunities to develop needed skills and knowledge.
How is academic program assessment different from the Academic Program Review (APR) process?
The APR process is a comprehensive self-assessment to identify a program’s challenges and opportunities in areas of quality, service, efficiency and resources. Assessment of student learning is just one component of this process. Program assessment activities, on the other hand, is totally focused on the assessment student learning and outcomes. Furthermore, while APR self-studies take place once every few years, program assessment should take place much more frequently to gather information that will enable a program to identify issues that may (or may not) require attention in a timely fashion.
What is the connection between assessment and accreditation?
The short answer is that institutions and state policymakers both make use of assessment findings. However, assessment and accreditation are very different processes with very different goals.
Assessment is an internally-managed activity, as opposed to accreditation, in which an outside body evaluates how well an organization is performing. And while accreditation self studies aim to demonstrate that fiscal and human resources are being invested responsibly, faculty and staff conduct assessment activities to improve their programs. Assessment findings are an important part of the accreditation review process since they are a key source of the evidence that we provide to our accreditation bodies, but the primary focus of assessment is the student experience – assessment activities are student-centered and are meant to inform local decisions pertaining to courses, majors, programs, and support offices, whereas accreditation activities are meant to inform external reviewers.
Here at Queens College, we believe student learning assessment is best guided by the intellectual curiosity of faculty about their programs and that assessment should be approached in the spirit of experimentation and innovation. We also abide by our Guiding Principles for Assessment.
Queens College is accredited by the Middle States Commission on Higher Education (MSCHE). To learn more about MSCHE expectations with regards to assessment, see their document on “Assessing Student Learning and Institutional Effectiveness: Middle States Expectations”. To learn more about the accreditation review process at QC, see our Provost’s website on MSCHE Accreditation.
For questions related to other assessment activities, see our Frequently Asked Questions page.