critical thinking and study skills exam

• A Model for the National Assessment of Higher Order Thinking
• International Critical Thinking Essay Test
• Online Critical Thinking Basic Concepts Test
• Online Critical Thinking Basic Concepts Sample Test

Consequential Validity: Using Assessment to Drive Instruction

Translate this page from English...

*Machine translated pages not guaranteed for accuracy. Click Here for our professional translations.

Critical Thinking Testing and Assessment

The purpose of assessment in instruction is improvement. The purpose of assessing instruction for critical thinking is improving the teaching of discipline-based thinking (historical, biological, sociological, mathematical, etc.) It is to improve students’ abilities to think their way through content using disciplined skill in reasoning. The more particular we can be about what we want students to learn about critical thinking, the better we can devise instruction with that particular end in view.

The Foundation for Critical Thinking offers assessment instruments which share in the same general goal: to enable educators to gather evidence relevant to determining the extent to which instruction is teaching students to think critically (in the process of learning content). To this end, the Fellows of the Foundation recommend:

that academic institutions and units establish an oversight committee for critical thinking, and

that this oversight committee utilizes a combination of assessment instruments (the more the better) to generate incentives for faculty, by providing them with as much evidence as feasible of the actual state of instruction for critical thinking.

The following instruments are available to generate evidence relevant to critical thinking teaching and learning:

Course Evaluation Form : Provides evidence of whether, and to what extent, students perceive faculty as fostering critical thinking in instruction (course by course). Machine-scoreable.

Online Critical Thinking Basic Concepts Test : Provides evidence of whether, and to what extent, students understand the fundamental concepts embedded in critical thinking (and hence tests student readiness to think critically). Machine-scoreable.

Critical Thinking Reading and Writing Test : Provides evidence of whether, and to what extent, students can read closely and write substantively (and hence tests students' abilities to read and write critically). Short-answer.

International Critical Thinking Essay Test : Provides evidence of whether, and to what extent, students are able to analyze and assess excerpts from textbooks or professional writing. Short-answer.

Commission Study Protocol for Interviewing Faculty Regarding Critical Thinking : Provides evidence of whether, and to what extent, critical thinking is being taught at a college or university. Can be adapted for high school. Based on the California Commission Study . Short-answer.

Protocol for Interviewing Faculty Regarding Critical Thinking : Provides evidence of whether, and to what extent, critical thinking is being taught at a college or university. Can be adapted for high school. Short-answer.

Protocol for Interviewing Students Regarding Critical Thinking : Provides evidence of whether, and to what extent, students are learning to think critically at a college or university. Can be adapted for high school). Short-answer. 

Criteria for Critical Thinking Assignments : Can be used by faculty in designing classroom assignments, or by administrators in assessing the extent to which faculty are fostering critical thinking.

Rubrics for Assessing Student Reasoning Abilities : A useful tool in assessing the extent to which students are reasoning well through course content.  

All of the above assessment instruments can be used as part of pre- and post-assessment strategies to gauge development over various time periods.

Consequential Validity

All of the above assessment instruments, when used appropriately and graded accurately, should lead to a high degree of consequential validity. In other words, the use of the instruments should cause teachers to teach in such a way as to foster critical thinking in their various subjects. In this light, for students to perform well on the various instruments, teachers will need to design instruction so that students can perform well on them. Students cannot become skilled in critical thinking without learning (first) the concepts and principles that underlie critical thinking and (second) applying them in a variety of forms of thinking: historical thinking, sociological thinking, biological thinking, etc. Students cannot become skilled in analyzing and assessing reasoning without practicing it. However, when they have routine practice in paraphrasing, summariz­ing, analyzing, and assessing, they will develop skills of mind requisite to the art of thinking well within any subject or discipline, not to mention thinking well within the various domains of human life.

For full copies of this and many other critical thinking articles, books, videos, and more, join us at the Center for Critical Thinking Community Online - the world's leading online community dedicated to critical thinking!   Also featuring interactive learning activities, study groups, and even a social media component, this learning platform will change your conception of intellectual development.

Critical Thinking and Study Skills

Increase your success in high school and beyond by learning proven study techniques and test-taking skills. This half-credit course teaches the ACE test-taking method, which will assist students in their approach to high-stakes testing. Throughout the course, Mawi Asgedom, a Harvard graduate who was the first in his family to attend college, will coach you. Mawi is a student success expert who has trained more than a million students. This course provides elective credit.

Pre-Requisites: Credits: 0.5 Estimated Completion Time: 1 segment/10-16 weeks Earliest Start Date: March 2024

Already have an FLVS student login?

• Schools & departments

Critical thinking

Advice and resources to help you develop your critical voice.

Developing critical thinking skills is essential to your success at University and beyond.  We all need to be critical thinkers to help us navigate our way through an information-rich world. 

Whatever your discipline, you will engage with a wide variety of sources of information and evidence.  You will develop the skills to make judgements about this evidence to form your own views and to present your views clearly.

One of the most common types of feedback received by students is that their work is ‘too descriptive’.  This usually means that they have just stated what others have said and have not reflected critically on the material.  They have not evaluated the evidence and constructed an argument.

What is critical thinking?

Critical thinking is the art of making clear, reasoned judgements based on interpreting, understanding, applying and synthesising evidence gathered from observation, reading and experimentation. Burns, T., & Sinfield, S. (2016)  Essential Study Skills: The Complete Guide to Success at University (4th ed.) London: SAGE, p94.

Being critical does not just mean finding fault.  It means assessing evidence from a variety of sources and making reasoned conclusions.  As a result of your analysis you may decide that a particular piece of evidence is not robust, or that you disagree with the conclusion, but you should be able to state why you have come to this view and incorporate this into a bigger picture of the literature.

Being critical goes beyond describing what you have heard in lectures or what you have read.  It involves synthesising, analysing and evaluating what you have learned to develop your own argument or position.

Critical thinking is important in all subjects and disciplines – in science and engineering, as well as the arts and humanities.  The types of evidence used to develop arguments may be very different but the processes and techniques are similar.  Critical thinking is required for both undergraduate and postgraduate levels of study.

What, where, when, who, why, how?

Purposeful reading can help with critical thinking because it encourages you to read actively rather than passively.  When you read, ask yourself questions about what you are reading and make notes to record your views.  Ask questions like:

• What is the main point of this paper/ article/ paragraph/ report/ blog?
• Who wrote it?
• Why was it written?
• When was it written?
• Has the context changed since it was written?
• Is the evidence presented robust?
• How did the authors come to their conclusions?
• Do you agree with the conclusions?
• What does this add to our knowledge?
• Why is it useful?

Our web page covering Reading at university includes a handout to help you develop your own critical reading form and a suggested reading notes record sheet.  These resources will help you record your thoughts after you read, which will help you to construct your argument. 

Reading at university

Developing an argument

Being a university student is about learning how to think, not what to think.  Critical thinking shapes your own values and attitudes through a process of deliberating, debating and persuasion.   Through developing your critical thinking you can move on from simply disagreeing to constructively assessing alternatives by building on doubts.

There are several key stages involved in developing your ideas and constructing an argument.  You might like to use a form to help you think about the features of critical thinking and to break down the stages of developing your argument.

Features of critical thinking (pdf)

Features of critical thinking (Word rtf)

Our webpage on Academic writing includes a useful handout ‘Building an argument as you go’.

Academic writing

You should also consider the language you will use to introduce a range of viewpoints and to evaluate the various sources of evidence.  This will help your reader to follow your argument.  To get you started, the University of Manchester's Academic Phrasebank has a useful section on Being Critical. 

Academic Phrasebank

Developing your critical thinking

Set yourself some tasks to help develop your critical thinking skills.  Discuss material presented in lectures or from resource lists with your peers.  Set up a critical reading group or use an online discussion forum.  Think about a point you would like to make during discussions in tutorials and be prepared to back up your argument with evidence.

For more suggestions:

Developing your critical thinking - ideas (pdf)

Developing your critical thinking - ideas (Word rtf)

Published guides

For further advice and more detailed resources please see the Critical Thinking section of our list of published Study skills guides.

Study skills guides  

• Teaching Tips

A Brief Guide for Teaching and Assessing Critical Thinking in Psychology

In my first year of college teaching, a student approached me one day after class and politely asked, “What did you mean by the word ‘evidence’?” I tried to hide my shock at what I took to be a very naive question. Upon further reflection, however, I realized that this was actually a good question, for which the usual approaches to teaching psychology provided too few answers. During the next several years, I developed lessons and techniques to help psychology students learn how to evaluate the strengths and weaknesses of scientific and nonscientific kinds of evidence and to help them draw sound conclusions. It seemed to me that learning about the quality of evidence and drawing appropriate conclusions from scientific research were central to teaching critical thinking (CT) in psychology.

In this article, I have attempted to provide guidelines to psychol­ogy instructors on how to teach CT, describing techniques I devel­oped over 20 years of teaching. More importantly, the techniques and approach described below are ones that are supported by scientific research. Classroom examples illustrate the use of the guidelines and how assessment can be integrated into CT skill instruction.

Overview of the Guidelines

Confusion about the definition of CT has been a major obstacle to teaching and assessing it (Halonen, 1995; Williams, 1999). To deal with this problem, we have defined CT as reflective think­ing involved in the evaluation of evidence relevant to a claim so that a sound or good conclusion can be drawn from the evidence (Bensley, 1998). One virtue of this definition is it can be applied to many thinking tasks in psychology. The claims and conclusions psychological scientists make include hypotheses, theoretical state­ments, interpretation of research findings, or diagnoses of mental disorders. Evidence can be the results of an experiment, case study, naturalistic observation study, or psychological test. Less formally, evidence can be anecdotes, introspective reports, commonsense beliefs, or statements of authority. Evaluating evidence and drawing appropriate conclusions along with other skills, such as distin­guishing arguments from nonarguments and finding assumptions, are collectively called argument analysis skills. Many CT experts take argument analysis skills to be fundamental CT skills (e.g., Ennis, 1987; Halpern, 1998). Psychology students need argument analysis skills to evaluate psychological claims in their work and in everyday discourse.

Some instructors expect their students will improve CT skills like argument analysis skills by simply immersing them in challenging course work. Others expect improvement because they use a textbook with special CT questions or modules, give lectures that critically review the literature, or have students complete written assignments. While these and other traditional techniques may help, a growing body of research suggests they are not sufficient to efficiently produce measurable changes in CT skills. Our research on acquisition of argument analysis skills in psychology (Bensley, Crowe, Bernhardt, Buchner, & Allman, in press) and on critical reading skills (Bensley & Haynes, 1995; Spero & Bensley, 2009) suggests that more explicit, direct instruction of CT skills is necessary. These results concur with results of an earlier review of CT programs by Chance (1986) and a recent meta-analysis by Abrami et al., (2008).

Based on these and other findings, the following guidelines describe an approach to explicit instruction in which instructors can directly infuse CT skills and assessment into their courses. With infusion, instructors can use relevant content to teach CT rules and concepts along with the subject matter. Directly infus­ing CT skills into course work involves targeting specific CT skills, making CT rules, criteria, and methods explicit, providing guided practice in the form of exercises focused on assessing skills, and giving feedback on practice and assessments. These components are similar to ones found in effective, direct instruc­tion approaches (Walberg, 2006). They also resemble approaches to teaching CT proposed by Angelo (1995), Beyer (1997), and Halpern (1998). Importantly, this approach has been successful in teaching CT skills in psychology (e.g., Bensley, et al., in press; Bensley & Haynes, 1995; Nieto & Saiz, 2008; Penningroth, Despain, & Gray, 2007). Directly infusing CT skill instruction can also enrich content instruction without sacrificing learning of subject matter (Solon, 2003). The following seven guidelines, illustrated by CT lessons and assessments, explicate this process.

Seven Guidelines for Teaching and Assessing Critical Thinking

1. Motivate your students to think critically

Critical thinking takes effort. Without proper motivation, students are less inclined to engage in it. Therefore, it is good to arouse interest right away and foster commitment to improving CT throughout a course. One motivational strategy is to explain why CT is important to effective, professional behavior. Often, telling a compelling story that illustrates the consequences of failing to think critically can mo­tivate students. For example, the tragic death of 10-year-old Candace Newmaker at the hands of her therapists practicing attachment therapy illustrates the perils of using a therapy that has not been supported by good empirical evidence (Lilienfeld, 2007).

Instructors can also pique interest by taking a class poll posing an interesting question on which students are likely to have an opinion. For example, asking students how many think that the full moon can lead to increases in abnormal behavior can be used to introduce the difference between empirical fact and opinion or common sense belief. After asking students how psychologists answer such questions, instructors might go over the meta-analysis of Rotton and Kelly (1985). Their review found that almost all of the 37 studies they reviewed showed no association between the phase of the moon and abnormal behavior with only a few, usually poorly, controlled studies supporting it. Effect size over all stud­ies was very small (.01). Instructors can use this to illustrate how psychologists draw a conclusion based on the quality and quantity of research studies as opposed to what many people commonly believe. For other interesting thinking errors and misconceptions related to psychology, see Bensley (1998; 2002; 2008), Halpern (2003), Ruscio (2006), Stanovich (2007), and Sternberg (2007).

Attitudes and dispositions can also affect motivation to think critically. If students lack certain CT dispositions such as open-mindedness, fair-mindedness, and skepticism, they will be less likely to think critically even if they have CT skills (Halpern, 1998). Instructors might point out that even great scientists noted for their powers of reasoning sometimes fail to think critically when they are not disposed to use their skills. For example, Alfred Russel Wallace who used his considerable CT skills to help develop the concept of natural selection also believed in spiritualistic contact with the dead. Despite considerable evidence that mediums claiming to contact the dead were really faking such contact, Wallace continued to believe in it (Bensley, 2006). Likewise, the great American psychologist William James, whose reasoning skills helped him develop the seeds of important contemporary theories, believed in spiritualism despite evidence to the contrary.

2. Clearly state the CT goals and objectives for your class

Once students are motivated, the instructor should focus them on what skills they will work on during the course. The APA task force on learning goals and objectives for psychology listed CT as one of 10 major goals for students (Halonen et al., 2002). Under critical thinking they have further specified outcomes such as evaluating the quality of information, identifying and evaluating the source and credibility of information, recognizing and defending against think­ing errors and fallacies. Instructors should publish goals like these in their CT course objectives in their syllabi and more specifically as assignment objectives in their assignments. Given the pragmatic penchant of students for studying what is needed to succeed in a course, this should help motivate and focus them.

To make instruction efficient, course objectives and lesson ob­jectives should explicitly target CT skills to be improved. Objectives should specify the behavior that will change in a way that can be measured. A course objective might read, “After taking this course, you will be able to analyze arguments found in psychological and everyday discussions.” When the goal of a lesson is to practice and improve specific microskills that make up argument analysis, an assignment objective might read “After successfully completing this assignment, you will be able to identify different kinds of evidence in a psychological discussion.” Or another might read “After suc­cessfully completing this assignment, you will be able to distinguish arguments from nonarguments.” Students might demonstrate they have reached these objectives by showing the behavior of correctly labeling the kinds of evidence presented in a passage or by indicating whether an argument or merely a claim has been made. By stating objectives in the form of assessable behaviors, the instructor can test these as assessment hypotheses.

Sometimes when the goal is to teach students how to decide which CT skills are appropriate in a situation, the instructor may not want to identify specific skills. Instead, a lesson objective might read, “After successfully completing this assignment, you will be able to decide which skills and knowledge are appropriate for criti­cally analyzing a discussion in psychology.”

3. Find opportunities to infuse CT that fit content and skill requirements of your course

To improve their CT skills, students must be given opportunities to practice them. Different courses present different opportunities for infusion and practice. Stand-alone CT courses usually provide the most opportunities to infuse CT. For example, the Frostburg State University Psychology Department has a senior seminar called “Thinking like a Psychologist” in which students complete lessons giving them practice in argument analysis, critical reading, critically evaluating information on the Internet, distinguishing science from pseudoscience, applying their knowledge and CT skills in simula­tions of psychological practice, and other activities.

In more typical subject-oriented courses, instructors must find specific content and types of tasks conducive to explicit CT skill instruction. For example, research methods courses present several opportunities to teach argument analysis skills. Instructors can have students critically evaluate the quality of evidence provided by studies using different research methods and designs they find in PsycINFO and Internet sources. This, in turn, could help students write better critical evaluations of research for research reports.

A cognitive psychology teacher might assign a critical evalu­ation of the evidence on an interesting question discussed in text­book literature reviews. For example, students might evaluate the evidence relevant to the question of whether people have flashbulb memories such as accurately remembering the 9-11 attack. This provides the opportunity to teach them that many of the studies, although informative, are quasi-experimental and cannot show causation. Or, students might analyze the arguments in a TV pro­gram such as the fascinating Nova program Kidnapped by Aliens on people who recall having been abducted by aliens.

4. Use guided practice, explicitly modeling and scaffolding CT.

Guided practice involves modeling and supporting the practice of target skills, and providing feedback on progress towards skill attainment. Research has shown that guided practice helps student more efficiently acquire thinking skills than unguided and discovery approaches (Meyer, 2004).

Instructors can model the use of CT rules, criteria, and proce­dures for evaluating evidence and drawing conclusions in many ways. They could provide worked examples of problems, writing samples displaying good CT, or real-world examples of good and bad thinking found in the media. They might also think out loud as they evaluate arguments in class to model the process of thinking.

To help students learn to use complex rules in thinking, instruc­tors should initially scaffold student thinking. Scaffolding involves providing product guidelines, rules, and other frameworks to support the process of thinking. Table 1 shows guidelines like those found in Bensley (1998) describing nonscientific kinds of evidence that can support student efforts to evaluate evidence in everyday psychologi­cal discussions. Likewise, Table 2 provides guidelines like those found in Bensley (1998) and Wade and Tavris (2005) describing various kinds of scientific research methods and designs that differ in the quality of evidence they provide for psychological arguments.

In the cognitive lesson on flashbulb memory described earlier, students use the framework in Table 2 to evaluate the kinds of evidence in the literature review. Table 1 can help them evaluate the kinds of evidence found in the Nova video Kidnapped by Aliens . Specifically, they could use it to contrast scientific authority with less credible authority. The video includes statements by scientific authorities like Elizabeth Loftus based on her extensive research contrasted with the nonscientific authority of Bud Hopkins, an artist turned hypnotherapist and author of popular books on alien abduction. Loftus argues that the memories of alien abduction in the children interviewed by Hopkins were reconstructed around the suggestive interview questions he posed. Therefore, his conclu­sion that the children and other people in the video were recalling actual abduction experiences was based on anecdotes, unreliable self-reports, and other weak evidence.

Modeling, scaffolding, and guided practice are especially useful in helping students first acquire CT skills. After sufficient practice, however, instructors should fade these and have students do more challenging assignments without these supports to promote transfer.

5. Align assessment with practice of specific CT skills

Test questions and other assessments of performance should be similar to practice questions and problems in the skills targeted but differ in content. For example, we have developed a series of practice and quiz questions about the kinds of evidence found in Table 1 used in everyday situations but which differ in subject matter from practice to quiz. Likewise, other questions employ research evidence examples corresponding to Table 2. Questions ask students to identify kinds of evidence, evaluate the quality of the evidence, distinguish arguments from nonarguments, and find assumptions in the examples with practice examples differing in content from assessment items.

6. Provide feedback and encourage students to reflect on it

Instructors should focus feedback on the degree of attainment of CT skill objectives in the lesson or assessment. The purpose of feedback is to help students learn how to correct faulty thinking so that in the future they monitor their thinking and avoid such problems. This should increase their metacognition or awareness and control of their thinking, an important goal of CT instruction (Halpern, 1998).

Students must use their feedback for it to improve their CT skills. In the CT exercises and critical reading assignments, students receive feedback in the form of corrected responses and written feedback on open-ended questions. They should be advised that paying attention to feedback on earlier work and assessments should improve their performance on later assessments.

7. Reflect on feedback and assessment results to improve CT instruction

Instructors should use the feedback they provide to students and the results of ongoing assessments to ‘close the loop,’ that is, use these outcomes to address deficiencies in performance and improve instruction. In actual practice, teaching and assessment strategies rarely work optimally the first time. Instructors must be willing to tinker with these to make needed improvements. Reflec­tion on reliable and valid assessment results provides a scientific means to systematically improve instruction and assessment.

Instructors may find the direct infusion approach as summarized in the seven guidelines to be efficient, especially in helping students acquire basic CT skills, as research has shown. They may especially appreciate how it allows them to take a scientific approach to the improvement of instruction. Although the direct infusion approach seems to efficiently promote acquisition of CT skills, more research is needed to find out if students transfer their skills outside of the class­room or whether this approach needs adjustment to promote transfer.

Table 1. Strengths and Weaknesses of Nonscientific Sources and Kinds of Evidence

Table 2. Strengths and Weaknesses of Scientific Research Methods/Designs Used as Sources of Evidence

Abrami, P. C., Bernard, R. M., Borokhovhovski, E., Wade, A., Surkes, M. A., Tamim, R., et al., (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research, 4 , 1102–1134.

Angelo, T. A. (1995). Classroom assessment for critical thinking. Teaching of Psychology , 22(1), 6–7.

Bensley, D.A. (1998). Critical thinking in psychology: A unified skills approach. Pacific Grove, CA: Brooks/Cole.

Bensley, D.A. (2002). Science and pseudoscience: A critical thinking primer. In M. Shermer (Ed.), The Skeptic encyclopedia of pseudoscience. (pp. 195–203). Santa Barbara, CA: ABC–CLIO.

Bensley, D.A. (2006). Why great thinkers sometimes fail to think critically. Skeptical Inquirer, 30, 47–52.

Bensley, D.A. (2008). Can you learn to think more like a psychologist? The Psychologist, 21, 128–129.

Bensley, D.A., Crowe, D., Bernhardt, P., Buckner, C., & Allman, A. (in press). Teaching and assessing critical thinking skills for argument analysis in psychology. Teaching of Psychology .

Bensley, D.A. & Haynes, C. (1995). The acquisition of general purpose strategic knowledge for argumentation. Teaching of Psychology, 22 , 41–45.

Beyer, B.K. (1997). Improving student thinking: A comprehensive approach . Boston: Allyn & Bacon.

Chance, P. (1986) Thinking in the classroom: A review of programs . New York: Instructors College Press.

Ennis, R.H. (1987). A taxonomy of critical thinking dispositions and abilities. In J. B. Baron & R. F. Sternberg (Eds.). Teaching thinking skills: Theory and practice (pp. 9–26). New York: Freeman.

Halonen, J.S. (1995). Demystifying critical thinking. Teaching of Psychology, 22 , 75–81.

Halonen, J.S., Appleby, D.C., Brewer, C.L., Buskist, W., Gillem, A. R., Halpern, D. F., et al. (APA Task Force on Undergraduate Major Competencies). (2002) Undergraduate psychology major learning goals and outcomes: A report. Washington, DC: American Psychological Association. Retrieved August 27, 2008, from http://www.apa.org/ed/pcue/reports.html .

Halpern, D.F. (1998). Teaching critical thinking for transfer across domains: Dispositions, skills, structure training, and metacognitive monitoring. American Psychologist , 53 , 449–455.

Halpern, D.F. (2003). Thought and knowledge: An introduction to critical thinking . (3rd ed.). Mahwah, NJ: Erlbaum.

Lilienfeld, S.O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science , 2 , 53–70.

Meyer, R.E. (2004). Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. American Psychologist , 59 , 14–19.

Nieto, A.M., & Saiz, C. (2008). Evaluation of Halpern’s “structural component” for improving critical thinking. The Spanish Journal of Psychology , 11 ( 1 ), 266–274.

Penningroth, S.L., Despain, L.H., & Gray, M.J. (2007). A course designed to improve psychological critical thinking. Teaching of Psychology , 34 , 153–157.

Rotton, J., & Kelly, I. (1985). Much ado about the full moon: A meta-analysis of lunar-lunacy research. Psychological Bulletin , 97 , 286–306.

Ruscio, J. (2006). Critical thinking in psychology: Separating sense from nonsense. Belmont, CA: Wadsworth.

Solon, T. (2007). Generic critical thinking infusion and course content learning in introductory psychology. Journal of Instructional Psychology , 34(2), 972–987.

Stanovich, K.E. (2007). How to think straight about psychology . (8th ed.). Boston: Pearson.

Sternberg, R.J. (2007). Critical thinking in psychology: It really is critical. In R. J. Sternberg, H. L. Roediger, & D. F. Halpern (Eds.), Critical thinking in psychology. (pp. 289–296) . Cambridge, UK: Cambridge University Press.

Wade, C., & Tavris, C. (2005) Invitation to psychology. (3rd ed.). Upper Saddle River, NJ: Prentice Hall.

Walberg, H.J. (2006). Improving educational productivity: A review of extant research. In R. F. Subotnik & H. J. Walberg (Eds.), The scientific basis of educational productivity (pp. 103–159). Greenwich, CT: Information Age.

Williams, R.L. (1999). Operational definitions and assessment of higher-order cognitive constructs. Educational Psychology Review , 11 , 411–427.

Excellent article.

Interesting and helpful!

APS regularly opens certain online articles for discussion on our website. Effective February 2021, you must be a logged-in APS member to post comments. By posting a comment, you agree to our Community Guidelines and the display of your profile information, including your name and affiliation. Any opinions, findings, conclusions, or recommendations present in article comments are those of the writers and do not necessarily reflect the views of APS or the article’s author. For more information, please see our Community Guidelines .

Please login with your APS account to comment.

About the Author

D. Alan Bensley is Professor of Psychology at Frostburg State University. He received his Master’s and PhD degrees in cognitive psychology from Rutgers University. His main teaching and research interests concern the improvement of critical thinking and other cognitive skills. He coordinates assessment for his department and is developing a battery of instruments to assess critical thinking in psychology. He can be reached by email at [email protected] Association for Psychological Science December 2010 — Vol. 23, No. 10

Student Notebook: Five Tips for Working with Teaching Assistants in Online Classes

Sarah C. Turner suggests it’s best to follow the golden rule: Treat your TA’s time as you would your own.

Teaching Current Directions in Psychological Science

Aimed at integrating cutting-edge psychological science into the classroom, Teaching Current Directions in Psychological Science offers advice and how-to guidance about teaching a particular area of research or topic in psychological science that has been

European Psychology Learning and Teaching Conference

The School of Education of the Paris Lodron University of Salzburg is hosting the next European Psychology Learning and Teaching (EUROPLAT) Conference on September 18–20, 2017 in Salzburg, Austria. The main theme of the conference

Privacy Overview

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base
• Working with sources
• What Is Critical Thinking? | Definition & Examples

What Is Critical Thinking? | Definition & Examples

Published on May 30, 2022 by Eoghan Ryan . Revised on May 31, 2023.

Critical thinking is the ability to effectively analyze information and form a judgment .

To think critically, you must be aware of your own biases and assumptions when encountering information, and apply consistent standards when evaluating sources .

Critical thinking skills help you to:

• Identify credible sources
• Evaluate and respond to arguments
• Assess alternative viewpoints
• Test hypotheses against relevant criteria

Table of contents

Why is critical thinking important, critical thinking examples, how to think critically, other interesting articles, frequently asked questions about critical thinking.

Critical thinking is important for making judgments about sources of information and forming your own arguments. It emphasizes a rational, objective, and self-aware approach that can help you to identify credible sources and strengthen your conclusions.

Critical thinking is important in all disciplines and throughout all stages of the research process . The types of evidence used in the sciences and in the humanities may differ, but critical thinking skills are relevant to both.

In academic writing , critical thinking can help you to determine whether a source:

• Is free from research bias
• Provides evidence to support its research findings
• Considers alternative viewpoints

Outside of academia, critical thinking goes hand in hand with information literacy to help you form opinions rationally and engage independently and critically with popular media.

Scribbr Citation Checker New

The AI-powered Citation Checker helps you avoid common mistakes such as:

• Missing commas and periods
• Incorrect usage of “et al.”
• Ampersands (&) in narrative citations
• Missing reference entries

Critical thinking can help you to identify reliable sources of information that you can cite in your research paper . It can also guide your own research methods and inform your own arguments.

Outside of academia, critical thinking can help you to be aware of both your own and others’ biases and assumptions.

Academic examples

However, when you compare the findings of the study with other current research, you determine that the results seem improbable. You analyze the paper again, consulting the sources it cites.

You notice that the research was funded by the pharmaceutical company that created the treatment. Because of this, you view its results skeptically and determine that more independent research is necessary to confirm or refute them. Example: Poor critical thinking in an academic context You’re researching a paper on the impact wireless technology has had on developing countries that previously did not have large-scale communications infrastructure. You read an article that seems to confirm your hypothesis: the impact is mainly positive. Rather than evaluating the research methodology, you accept the findings uncritically.

Nonacademic examples

However, you decide to compare this review article with consumer reviews on a different site. You find that these reviews are not as positive. Some customers have had problems installing the alarm, and some have noted that it activates for no apparent reason.

You revisit the original review article. You notice that the words “sponsored content” appear in small print under the article title. Based on this, you conclude that the review is advertising and is therefore not an unbiased source. Example: Poor critical thinking in a nonacademic context You support a candidate in an upcoming election. You visit an online news site affiliated with their political party and read an article that criticizes their opponent. The article claims that the opponent is inexperienced in politics. You accept this without evidence, because it fits your preconceptions about the opponent.

There is no single way to think critically. How you engage with information will depend on the type of source you’re using and the information you need.

However, you can engage with sources in a systematic and critical way by asking certain questions when you encounter information. Like the CRAAP test , these questions focus on the currency , relevance , authority , accuracy , and purpose of a source of information.

When encountering information, ask:

• Who is the author? Are they an expert in their field?
• What do they say? Is their argument clear? Can you summarize it?
• When did they say this? Is the source current?
• Where is the information published? Is it an academic article? Is it peer-reviewed ?
• Why did the author publish it? What is their motivation?
• How do they make their argument? Is it backed up by evidence? Does it rely on opinion, speculation, or appeals to emotion ? Do they address alternative arguments?

Critical thinking also involves being aware of your own biases, not only those of others. When you make an argument or draw your own conclusions, you can ask similar questions about your own writing:

• Am I only considering evidence that supports my preconceptions?
• Is my argument expressed clearly and backed up with credible sources?
• Would I be convinced by this argument coming from someone else?

If you want to know more about ChatGPT, AI tools , citation , and plagiarism , make sure to check out some of our other articles with explanations and examples.

• ChatGPT vs human editor
• ChatGPT citations
• Is ChatGPT trustworthy?
• Using ChatGPT for your studies
• What is ChatGPT?
• Chicago style
• Paraphrasing

 Plagiarism

• Types of plagiarism
• Self-plagiarism
• Avoiding plagiarism
• Academic integrity
• Consequences of plagiarism
• Common knowledge

Prevent plagiarism. Run a free check.

Critical thinking refers to the ability to evaluate information and to be aware of biases or assumptions, including your own.

Like information literacy , it involves evaluating arguments, identifying and solving problems in an objective and systematic way, and clearly communicating your ideas.

Critical thinking skills include the ability to:

You can assess information and arguments critically by asking certain questions about the source. You can use the CRAAP test , focusing on the currency , relevance , authority , accuracy , and purpose of a source of information.

Ask questions such as:

• Who is the author? Are they an expert?
• How do they make their argument? Is it backed up by evidence?

A credible source should pass the CRAAP test  and follow these guidelines:

• The information should be up to date and current.
• The author and publication should be a trusted authority on the subject you are researching.
• The sources the author cited should be easy to find, clear, and unbiased.
• For a web source, the URL and layout should signify that it is trustworthy.

Information literacy refers to a broad range of skills, including the ability to find, evaluate, and use sources of information effectively.

Being information literate means that you:

• Know how to find credible sources
• Use relevant sources to inform your research
• Understand what constitutes plagiarism
• Know how to cite your sources correctly

Confirmation bias is the tendency to search, interpret, and recall information in a way that aligns with our pre-existing values, opinions, or beliefs. It refers to the ability to recollect information best when it amplifies what we already believe. Relatedly, we tend to forget information that contradicts our opinions.

Although selective recall is a component of confirmation bias, it should not be confused with recall bias.

On the other hand, recall bias refers to the differences in the ability between study participants to recall past events when self-reporting is used. This difference in accuracy or completeness of recollection is not related to beliefs or opinions. Rather, recall bias relates to other factors, such as the length of the recall period, age, and the characteristics of the disease under investigation.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Ryan, E. (2023, May 31). What Is Critical Thinking? | Definition & Examples. Scribbr. Retrieved March 20, 2024, from https://www.scribbr.com/working-with-sources/critical-thinking/

Is this article helpful?

Eoghan Ryan

Other students also liked, student guide: information literacy | meaning & examples, what are credible sources & how to spot them | examples, applying the craap test & evaluating sources, "i thought ai proofreading was useless but..".

I've been using Scribbr for years now and I know it's a service that won't disappoint. It does a good job spotting mistakes”

The website is not compatible for the version of the browser you are using. Not all the functionality may be available. Please upgrade your browser to the latest version.

• Social Media
• Access Points
• Print/Export Standards
• Computer Science Standards
• Coding Scheme
• B.E.S.T. Standards
• Standards Viewer App
• Course Descriptions
• Graduation Requirements
• Course Reports
• Gifted Coursework
• Career and Technical Education (CTE) Programs
• Browse/Search

Original Student Tutorials

• MEAs - STEM Lessons
• Perspectives STEM Videos
• STEM Reading Resources
• Math Formative Assessments
• Our Review Process
• Professional Development Programs
• iCPALMS Tools
• Resource Development Programs
• Partnership Programs
• User Testimonials
• iCPALMS Account

• Account Information Profile and Notification Settings
• Administration Manage Site Features
• Recycle Bin Delete Items From Your Account
• Not a member yet? SIGN UP
• Account Information
• Administration
• Recycle Bin
• Home of CPALMS
• Standards Info. & Resources
• Course Descriptions & Directory
• Resources Vetted by Peers & Experts
• PD Programs Self-paced Training
• About CPALMS Initiatives & Partnerships
• iCPALMS Florida's Platform

Critical Thinking and Study Skills   (#1700370)

• 2014 - 2015
• 2015 - 2022
• 2022 - And Beyond (current)

Resources related to the standards in this course

Click on the individual standards to find resources, loading...., course standards, general course information and notes, general notes.

This course is designed to develop skills related to critical thinking, learning and problem solving, enabling students to enhance their performance in both academic and non-academic areas. Strategies for acquiring, storing and retrieving information, time management and organizational skills, critical thinking operations and processes, strategies for oral and written communication, and problem solving skills including test taking skills are an integral part of this course.

Florida’s Benchmarks for Excellent Student Thinking (B.E.S.T.) Standards This course includes Florida’s B.E.S.T. ELA Expectations (EE) and Mathematical Thinking and Reasoning Standards (MTRs) for students. Florida educators should intentionally embed these standards within the content and their instruction as applicable. For guidance on the implementation of the EEs and MTRs, please visit https://www.cpalms.org/Standards/BEST_Standards.aspx  and select the appropriate B.E.S.T. Standards package.

Qualifications

As well as any certification requirements listed on the course description, the following qualifications may also be acceptable for the course:

Any academic coverage (any coverage classified as an academic coverage in Rules 6A-4.0101 through 6A-4.0343, Florida Administrative Code ).

General Information

Educator certifications, student resources.

Explore how weathering and erosion may have affected Pnyx Hill, the ancient Greek democratic meeting place which influenced our modern government with this interactive tutorial.

Type: Original Student Tutorial

Explore excerpts from the extraordinary autobiography  Narrative of the Life of Frederick Douglass , as you examine the author's purpose for writing and his use of the problem and solution text structure. By the end of this interactive tutorial, you should be able to explain how Douglass uses the problem and solution text structure in these excerpts to convey his purpose for writing.

Continue to study George Vest's "Eulogy of the Dog" speech and his use of rhetorical appeals. In Part Two of this two-part series, you'll identify his use of ethos and pathos throughout his speech.

Make sure to complete Part One before beginning Part Two. Click HERE to launch Part One.

Read George Vest's "Eulogy of the Dog" speech in this two-part interactive tutorial. In this series, you'll identify and examine Vest's use of ethos, pathos, and logos in his speech. In Part One, you'll identify Vest's use of logos in the first part of his speech. In Part Two, you'll identify his use of ethos and pathos throughout his speech. 

Make sure to complete both part of this series! Click HERE to launch Part Two.

Continue to study epic similes in excerpts from The Iliad in Part Two of this two-part series. In Part Two, you'll learn about mood and how the language of an epic simile produces a specified mood in excerpts from The Iliad .

Make sure to complete Part One before beginning Part Two. Click HERE to view "That's So Epic: How Epic Similes Contribute to Mood (Part One)."

Learn about how epic similes create mood in a text, specifically in excerpts from The Iliad , in this two-part series.

In Part One, you'll define epic simile, identify epic similes based on defined characteristics, and explain the comparison created in an epic simile.

In Part Two, you'll learn about mood and how the language of an epic simile produces a specified mood in excerpts from The Iliad . Make sure to complete both parts!

Click HERE to view "That's So Epic: How Epic Similes Contribute to Mood (Part Two)." 

Continue to read the famous short story “The Bet” by Anton Chekhov and explore the impact of a fifteen-year bet made between a lawyer and a banker. In Part Two, you’ll cite textual evidence that supports an analysis of what the text states explicitly, or directly. You'll also make inferences, support them with textual evidence, and use them to explain how the bet transformed the lawyer and the banker by the end of the story.

Make sure to complete Part One before  beginning Part Two. Click  HERE  to view Part One.

Make sure to complete Part Three after you finish Part Two. Click HERE to view "Risky Betting: Analyzing a Universal Theme (Part Three)." 

Read the famous short story “The Bet” by Anton Chekhov and explore the impact of a fifteen-year bet made between a lawyer and a banker in this three-part tutorial series.

In Part One, you’ll cite textual evidence that supports an analysis of what the text states explicitly, or directly, and make inferences and support them with textual evidence. By the end of Part One, you should be able to make three inferences about how the bet has transformed the lawyer by the middle of the story and support your inferences with textual evidence.

Make sure to complete all three parts!

Click HERE to launch "Risky Betting: Text Evidence and Inferences (Part Two)."

Click HERE to launch "Risky Betting: Analyzing a Universal Theme (Part Three)." 

Identify rhyme, alliteration, and repetition in Edgar Allan Poe's "The Raven" and analyze how he used these sound devices to affect the poem in this interactive tutorial.

Study excerpts from the classic American novel Little Women by Louisa May Alcott in this interactive English Language Arts tutorial. Using excerpts from chapter eight of  Little Women, you'll identify key characters and their actions. You'll also explain how interactions between characters contributes to the development of the plot. 

Examine how allusions contribute to meaning in excerpts from O. Henry's classic American short story “The Gift of the Magi." In this interactive tutorial, you'll determine how allusions in the text better develop the key story elements of setting, characters, and conflict and explain how the allusion to the Magi contributes to the story’s main message about what it means to give a gift.

Learn to identify imagery in William Shakespeare's "Sonnet 18" and explain how that imagery contributes to the poem's meaning with this interactive tutorial.

Study William Shakespeare's "Sonnet 18" to determine and compare two universal themes and how they are developed throughout the sonnet. 

Explore the form and meaning of William Shakespeare's “Sonnet 18.”  In this interactive tutorial, you’ll examine how specific words and phrases contribute to meaning in the sonnet, select the features of a Shakespearean sonnet in the poem, identify the solution to a problem, and explain how the form of a Shakespearean sonnet contributes to the meaning of "Sonnet 18."

Analyze how O. Henry uses details to address the topics of value, sacrifice, and love in his famous short story, "The Gift of the Magi." In this interactive tutorial, you'll also determine two universal themes of the story. 

Explore key story elements in more excerpts from the classic American short story “The Gift of the Magi” by O. Henry.

In Part Two of this two-part series, you'll analyze how important information about two main characters is revealed through the context of the story’s setting and events in the plot. By the end of this tutorial, you should be able to explain how character development, setting, and plot interact in "The Gift of the Magi."

Make sure to complete Part One before beginning Part Two. Click HERE  to launch Part One. 

Explore key story elements in the classic American short story “The Gift of the Magi” by O. Henry. Throughout this two-part tutorial, you'll analyze how important information about two main characters is revealed through the context of the story’s setting and events in the plot. By the end of this tutorial series, you should be able to explain how character development, setting, and plot interact in excerpts from this short story.

Make sure to complete both parts! Click HERE  to view "How Story Elements Interact in 'The Gift of the Magi' -- Part Two."

Learn to distinguish between a gerund phrase that's used as a direct object and a gerund phrase that used as the object of the preposition. In this interactive tutorial, you'll also practice using gerund phrases as a direct object or the object of the preposition in sentences of your own. 

This tutorial is Part Two of a two-part series. Make sure to complete Part One before beginning Part Two. Click HERE  to launch "Spice Up Your Writing Part One: Using Gerund Phrases as Subjects or Subject Complements." 

Read more from the fantasy novel The Princess and the Goblin by George MacDonald in Part Two of this three-part series. By the end of this tutorial, you should be able to compare and contrast the archetypes of two characters in the novel.

Make sure to complete all three parts of this series in order to compare and contrast the use of archetypes in two texts.

Click HERE   to view "Archetypes -- Part One: Examining an Archetype in The Princess and the Goblin ."

Click HERE   to view "Archetypes -- Part Three: Comparing and Contrasting Archetypes in Two Fantasy Stories." 

Learn to determine the important traits of a main character named Princess Irene in excerpts from the fantasy novel  The Princess and the Goblin  by George MacDonald. In this interactive tutorial, you’ll also identify her archetype and explain how textual details about her character support her archetype.  

Click HERE   to view "Archetypes -- Part Two: Examining Archetypes in The Princess and the Goblin. "

Learn to identify aspects of setting and character as you analyze several excerpts from “The Yellow Wallpaper," a chilling short story by Charlotte Perkins Gilman that explores the impact on its narrator of being confined to mostly one room. You'll also determine how the narrator’s descriptions of the story’s setting better reveal her emotional and mental state.

This interactive tutorial is Part One in a two-part series. By the end of Part Two, you should be able to explain how the narrator changes through her interaction with the setting. Click below to launch Part Two.

The Power to Cure or Impair: The Importance of Setting in 'The Yellow Wallpaper' -- Part Two  

Continue to examine several excerpts from the chilling short story “The Yellow Wallpaper” by Charlotte Perkins Gilman, which explores the impact on its narrator of being confined to mostly one room. In Part Two of this tutorial series, you'll determine how the narrator’s descriptions of the story’s setting reveal its impact on her emotional and mental state. By the end of this tutorial, you should be able to explain how the narrator changes through her interaction with the setting.

Make sure to complete Part One before beginning Part Two. Click HERE  to launch "The Power to Cure or Impair: The Importance of Setting in 'The Yellow Wallpaper' -- Part One." 

Explore the mysterious poem “The House on the Hill” by Edwin Arlington Robinson in this interactive tutorial. As you explore the poem's message about the past, you’ll identify the features of a villanelle in the poem. By the end of this tutorial, you should be able to explain how the form of a villanelle contributes to the poem's meaning.

Learn to distinguish between passive and active voice and how to revise sentences by changing them from passive to active voice in this magic-themed tutorial. 

Continue to explore the significance of the famous poem “The New Colossus” by Emma Lazarus, lines from which are engraved on the pedestal of the Statue of Liberty. 

In Part Two of this two-part series, you’ll identify the features of a sonnet in the poem "The New Colossus." By the end of this tutorial, you should be able to explain how the form of a sonnet contributes to the poem's meaning. 

Make sure to complete Part One before beginning Part Two.

Click HERE   to launch "A Giant of Size and Power -- Part One: Exploring the Significance of 'The New Colossus.'"

Continue to examine how setting influences characters in excerpts from The Red Umbrella  by Christina Diaz Gonzalez with this interactive tutorial.

This is part 2 in a two-part series. Make sure to complete Part One first. Click HERE  to launch "Analyzing the Beginning of The Red Umbrella -- Part One: How Setting Influences Events." 

In Part One, explore the significance of the famous poem “The New Colossus” by Emma Lazarus, lines from which are engraved on the pedestal of the Statue of Liberty. 

This famous poem also happens to be in the form of a sonnet. In Part Two of this two-part series, you’ll identify the features of a sonnet in the poem. By the end of this tutorial series, you should be able to explain how the form of a sonnet contributes to the poem's meaning. Make sure to complete both parts!

Click  HERE to launch "A Giant of Size and Power -- Part Two: How the Form of a Sonnet Contributes to Meaning in 'The New Colossus.'"

Explore excerpts from the beginning of the historical fiction novel The Red Umbrella  by Christina Diaz Gonzalez in this two-part series. In Part One, you'll examine how setting influences events. In Part Two, you'll examine how setting influences characters.

Make sure to complete both parts! Click  HERE to launch Part Two.

Learn to distinguish between a gerund phrase that's used as a subject and one that's used as a subject complement. In this interactive tutorial, you'll also practice using gerund phrases as subjects or subject complements in sentences of your own. Using gerund phrases can add detail and variety to your writing.

This is Part One of a two-part series. Click HERE   to launch "Part Two: Using Gerund Phrases as Objects." 

This SaM-1 video provides the students with the optional "twist" for Lesson 17 and the Model Eliciting Activity (MEA) they have been working on in the Grade 3 Physical Science Unit: Water Beach Vacation. 

To see all the lessons in the unit please visit  https://www.cpalms.org/page818.aspx .

This video introduces the students to a Model Eliciting Activity (MEA) and concepts related to conducting experiments so they can apply what they learned about the changes water undergoes when it changes state.  This MEA provides students with an opportunity to develop a procedure based on evidence for selecting the most effective cooler.

This SaM-1 video is to be used with lesson 14 in the Grade 3 Physical Science Unit: Water Beach Vacation. To see all the lessons in the unit please visit  https://www.cpalms.org/page818.aspx .

Learn how to use verbs and verb phrases to convey specific meanings through the use of specific verb tenses: past perfect tense and past perfect progressive tense. 

This interactive tutorial is Part Two in a two-part series. You should complete Part One before beginning Part Two. Click HERE to launch Part One.

Learn how to use verbs and verb phrases to convey specific meanings through the use of specific verb tenses: simple past tense and past progressive tense. 

This interactive tutorial is Part One in a two-part series. In Part Two, you'll explore the use of past perfect tense and past perfect progressive tense. Make sure to complete both parts!

Click HERE to launch Part Two.

Learn how to use verb phrases in particular tenses to convey specific meanings. In this interactive tutorial, you'll explore the use of four verb tenses: simple future, future progressive, future perfect, and future perfect progressive. 

Learn to enhance your writing with verbs and verb phrases in different tenses to convey specific meanings. In Part Two, you'll work with three perfect tenses: present perfect, past perfect, and future perfect.  

We recommend that you complete Part One before starting Part Two. In Part One, you'll work with three simple tenses: past, present, and future. Click HERE to view Part One.

Learn how verbs and verb phrases can convey specific meanings through the use of three verb tenses--simple present, present progressive, and present perfect--in this interactive tutorial.

Learn to enhance your writing with verbs and verb phrases in different tenses to convey specific meanings. In Part One, you'll work with past tense, present tense, and future tense.

We recommend that you complete Part Two after Part One. In Part Two, you'll work with three tenses: present perfect, past perfect, and future perfect. Click  HERE  to view Part Two.

Learn to enhance your writing by using phrases. In this interactive tutorial, you'll learn about absolute phrases and how they can add interest, depth, and variety to your writing.

Learn to enhance your writing by using phrases. In this interactive tutorial, you'll learn about adverb prepositional phrases. Using adverb prepositional phrases will help add interest, depth, and variety to your writing!

Learn to enhance your writing with two types of phrases that can function like adjectives in a sentence: the participle phrase and the prepositional phrase. In this interactive tutorial, you'll discover how phrases can help add detail and specificity to your writing.

Learn about parallel form in this interactive English Language Arts tutorial. In this tutorial, you'll use parallel form with lists in sentences, identify sentences that contain parallel form and sentences that contain faulty parallelism, and practice editing sentences that contain faulty parallelism. You'll also examine how parallel form can add smoothness, clarity, and gracefulness to your writing. 

Learn to enhance your writing by using prepositional phrases. In this interactive tutorial, you'll learn how prepositional phrases add description and specificity and help make your writing more interesting.

Learn to enhance your writing by using noun phrases in this interactive tutorial. Although noun phrases can be used in many ways, here you'll learn how they can be used as the subject of a sentence or the object of a verb to add interest, detail, and specificity to your writing.

Learn 12 new academic vocabulary words in this interactive tutorial! You'll practice the words' synonyms, antonyms, parts of speech, and context clues in order to add them to your vocabulary.

Learn to use commas correctly to set off an introductory clause, phrase, or word at the start of a sentence with this interactive tutorial.

Learn to use commas correctly with this interactive English Language Arts tutorial. You'll review a number of important comma rules, including when not to use a comma, and you'll learn to identify errors in comma usage. 

Learn about two mysterious punctuation marks: quotation marks and the dash. As you complete this interactive tutorial, you'll learn a number of important rules and guidelines to help you use them correctly.

This is Part Two of a two-part series.  Click HERE to launch Part One   to learn about the apostrophe and the ellipsis.

Explore Robert Frost's poem "Mending Wall" and examine words, phrases, and lines with multiple meanings. In this interactive tutorial, you'll analyze how these multiple meanings can affect a reader’s interpretation of the poem.

Learn about four mysterious punctuation marks in this two-part interactive tutorial. In Part One, you'll learn important rules and guidelines to help you correctly use the apostrophe and the ellipsis. 

In Part Two, you'll learn to correctly use quotation marks and the dash. Make sure to complete both parts! Click  HERE to open Part Two.

Examine the topics of transformation and perfection as you read excerpts from the “Myth of Pygmalion” by Ovid and the short story “The Birthmark” by Nathaniel Hawthorne. By the end of this two-part interactive tutorial series, you should be able to explain how the short story draws on and transforms source material from the original myth. 

This tutorial is the second in a two-part series.  Click HERE to launch Part One.

Examine the topics of transformation and perfection as you read excerpts from the “Myth of Pygmalion” by Ovid and the short story “The Birthmark” by Nathaniel Hawthorne. By the end of this two-part interactive tutorial series, you should be able to explain how the short story draws on and transforms source material from the original myth.  

This tutorial is the first in a two-part series. Click HERE to launch Part Two .

Learn three rules for using commas correctly in your writing through use of this interactive English Language Arts tutorial. You'll learn how to join two independent clauses without creating a comma splice, how to identify and offset a nonessential clause in a sentence, and how to use the controversial Oxford comma. 

Learn more about that dreaded word-- plagiarism --in this interactive tutorial that's all about citing your sources, creating a Works Cited page, and avoiding academic dishonesty!

Learn about the ways to correctly use a colon in a sentence by exploring this interactive tutorial! We'll go over contexts where colon use is appropriate, and you'll learn guidelines for colon usage. You'll also learn several important rules for capitalization usage after a colon. By the end, you should be apply to apply these rules to correctly use a colon within a sentence. 

Examine some commonly confused pronouns that often trick people into believing that they have the same meaning when their meanings can be very different. This interactive tutorial will help you properly use the following pronouns: who, whom, which, that, their, there, they're.

Avoid "doppelganger danger" as you examine six pairs of commonly confused words in this interactive tutorial. Learn how to correctly use these commonly confused words to improve your language and writing skills.

Learn and practice how to use semicolons in this interactive tutorial. You'll learn three important rules for using the semicolon to join clauses together. By the end, you should be able to apply these three rules to correctly use a semicolon within a sentence.

Avoid "doppelganger danger" as you examine six pairs of commonly confused words. Learning how to correctly use these commonly confused words will help improve your writing and mastery of English.

Learn to differentiate the connotative and denotative meanings of words in context. In this interactive tutorial, you'll  study excerpts from “Total Eclipse,” an essay written by Annie Dillard. You will analyze Dillard’s word choices throughout portions of her essay to better understand their impact and meanings. 

Examine five pairs of commonly confused words in this interactive tutorial. This tutorial focuses on language and resolving issues of complex usage. You will examine pairs of words that are often confused in order to learn the correct use of each word. By the end of this tutorial, you should be able to accurately use these ten commonly confused words. 

Avoid "doppelganger danger" as you examine fourteen homophones, which are words that sound the same but have different meanings and spellings. Learning how to use these homophones correctly in this interactive tutorial will help you avoid some of the most common usage mistakes.

Avoid "doppelganger danger" as you examine eleven homophones, which are words that sound the same but have different meanings and spellings. Learning how to use these homophones correctly in this interactive tutorial will help you avoid some of the most common usage mistakes.

Avoid "doppelganger danger" as you examine twelve homophones, which are words that sound the same but have different meanings and spellings. Learning how to use these homophones correctly in this interactive tutorial will help you avoid some of the most common usage mistakes.

Learn about adverb clauses, a flavorful ingredient that can enhance your sentences. In this interactive tutorial, you'll learn about adverb clauses and how these clauses can add interest, depth, and variety to your writing.

Learn about adjective clauses and how they can add interest, depth, and variety to your writing in this sweet-themed interactive tutorial.

Learn more about that dreaded word-- plagiarism --in this interactive tutorial that's all about citing your sources and avoiding academic dishonesty!

Explore excerpts from Ralph Waldo Emerson's essay "Self-Reliance" in this two-part series. This tutorial is Part Two. In this tutorial, you will continue to examine excerpts from Emerson's essay that focus on the topic of traveling. You'll examine word meanings and determine the connotations of specific words. You will also analyze the impact of specific word choices on the meaning of this portion of the essay.

Make sure to complete Part One first. Click HERE  to launch Part One.

Explore excerpts from Ralph Waldo Emerson's essay "Self-Reliance" in this two-part interactive tutorial series. You will examine word meanings, examine subtle differences between words with similar meanings, and think about the emotions or associations that are connected to specific words. Finally, you will analyze the impact of specific word choices on the meaning of these excerpts.

Make sure to complete both parts! Click HERE to launch Part Two.

Explore excerpts from Ralph Waldo Emerson's essay "Self-Reliance" in this interactive two-part tutorial. This tutorial is Part Two. In this two-part series, you will learn to enhance your experience of Emerson's essay by analyzing his use of the word "genius." You will analyze Emerson's figurative meaning of "genius" and how he develops and refines the meaning of this word over the course of the essay.

Make sure to complete Part One before beginning Part Two. Click HERE  to view Part One.

Learn to enhance your writing by combining clauses. In this interactive tutorial, you'll learn how to combine independent and dependent clauses to add interest, depth, and variety to your writing. 

Determine the meaning of unknown words and phrases in an informational text about the Bermuda Triangle in this three-part interactive tutorial. In Part 2, you'll practice determining the meaning of unknown vocabulary using context clues and dictionary skills.

Click below to complete all three parts!

Determine the meaning of unknown words and phrases in an informational text about the Bermuda Triangle in this three-part interactive tutorial. In Part 3, you'll practice determining the meaning of unknown vocabulary using context clues and dictionary skills.

Click below to open the first two parts.

Explore excerpts from Ralph Waldo Emerson's essay "Self-Reliance" in this interactive two-part tutorial. In Part One, you’ll learn to enhance your experience of a text by analyzing its use of a word’s figurative meaning. Specifically, you'll examine Emerson's figurative meaning of the key term "genius." In Part Two, you’ll learn how to track the development of a word’s figurative meaning over the course of a text. 

Make sure to complete both parts of the tutorial! Click  HERE to launch Part Two.

Determine the meaning of unknown words and phrases in an informational text about the Bermuda Triangle in this three-part interactive tutorial. In Part 1, you'll practice determining the meaning of unknown vocabulary using context clues and dictionary skills.

Practice analyzing word choices in "The Raven" by Edgar Allan Poe, including word meanings, subtle differences between words with similar meanings, and emotions connected to specific words. In this interactive tutorial, you will also analyze the impact of specific word choices on the meaning of the poem.

This is Part Two of a two-part series. Part One should be completed before beginning Part Two. Click  HERE to open Part One.

Practice analyzing word choices in "The Raven" by Edgar Allan Poe in this interactive tutorial. In this tutorial, you will examine word meanings, examine subtle differences between words with similar meanings, and think about emotions connected to specific words. You will also analyze the impact of specific word choices on the meaning of the poem.

This tutorial is Part One of a two-part series on Poe's "The Raven." Click  HERE to open Part Two.

Learn how to create a Poem in 2 Voices in this interactive tutorial. This tutorial is Part Three of a three-part series. In this tutorial, you will learn how to create a Poem in 2 Voices using evidence drawn from a literary text: The Strange Case of Dr. Jekyll and Mr. Hyde by Robert Louis Stevenson.

You should complete Part One and Part Two of this series before beginning Part Three.   

Click HERE to launch Part One. Click HERE to launch Part Two. 

Get ready to travel back in time to London, England during the Victorian era in this interactive tutorial that uses text excerpts from The Strange Case of Dr. Jekyll and Mr. Hyde . This tutorial is Part Two of a three-part series. You should complete Part One before beginning this tutorial. In Part Two, you will read excerpts from the last half of the story and practice citing evidence to support analysis of a literary text. In the third tutorial in this series, you’ll learn how to create a Poem in 2 Voices using evidence from this story. 

Make sure to complete all three parts! Click to  HERE launch Part One. Click  HERE to launch Part Three. 

Learn how to transform words into other words, including nouns into verbs, verbs into adjectives, adjectives into adverbs, and much more with this interactive tutorial.

Learn how authors create mood in a story through this interactive tutorial. You'll read a science fiction short story by author Ray Bradbury and analyze how he uses images, sound, dialogue, setting, and characters' actions to create different moods. This tutorial is Part One in a two-part series. In Part Two, you'll use Bradbury's story to help you create a Found Poem that conveys multiple moods.

When you've completed Part One, click HERE to launch Part Two.

Practice writing different aspects of an expository essay about scientists using drones to research glaciers in Peru. This interactive tutorial is part four of a four-part series. In this final tutorial, you will learn about the elements of a body paragraph. You will also create a body paragraph with supporting evidence. Finally, you will learn about the elements of a conclusion and practice creating a “gift.” 

This tutorial is part four of a four-part series. Click below to open the other tutorials in this series.

• Drones and Glaciers: Eyes in the Sky (Part 1)
• Drones and Glaciers: Eyes in the Sky (Part 2)
• Expository Writing: Eyes in the Sky (Part 3)
• Expository Writing: Eyes in the Sky (Part 4)

Acquire new vocabulary through this interactive tutorial. You'll learn definitions for 15 new words, as well as their parts of speech, their synonyms and antonyms, and you'll practice using them in context.

Practice citing evidence to support analysis of a literary text as you read excerpts from one of the most famous works of horror fiction of all time,  The Strange Case of Dr. Jekyll and Mr. Hyde. 

This tutorial is Part One of a three-part tutorial. In Part Two, you'll continue your analysis of the text. In Part Three, you'll learn how to create a Poem in 2 Voices using evidence from this story. Make sure to complete all three parts! 

Click  HERE to launch Part Two. Click HERE to launch Part Three. 

Learn how to write an introduction for an expository essay in this interactive tutorial. This tutorial is the third part of a four-part series. In previous tutorials in this series, students analyzed an informational text and video about scientists using drones to explore glaciers in Peru. Students also determined the central idea and important details of the text and wrote an effective summary. In part three, you'll learn how to write an introduction for an expository essay about the scientists' research. 

This tutorial is part three of a four-part series. Click below to open the other tutorials in this series.

• Drones and Glaciers: Eyes in the Sky (Part 2)
• E xpository Writing: Eyes in the Sky (Part 4)

Learn how to identify the central idea and important details of a text, as well as how to write an effective summary in this interactive tutorial. This tutorial is the second tutorial in a four-part series that examines how scientists are using drones to explore glaciers in Peru. 

This tutorial is part two of a four-part series. Click below to open the other tutorials in this series.

Learn about how researchers are using drones, also called unmanned aerial vehicles or UAVs, to study glaciers in Peru. In this interactive tutorial, you will practice citing text evidence when answering questions about a text.

This tutorial is part one of a four-part series. Click below to open the other tutorials in this series.

• Drones and Glaciers: Eyes in the Sky (Part 1)

Learn how to avoid plagiarism in this interactive tutorial. You will also learn how to follow a standard format for citation and how to format your research paper using MLA style. Along the way, you will also learn about master magician Harry Houdini. This tutorial is Part Two of a two-part series on research writing.

Be sure to complete Part One first. Click to view Part One .

Learn about paraphrasing and the use of direct quotes in this interactive tutorial about research writing. Along the way, you'll also learn about master magician Harry Houdini. This tutorial is part one of a two-part series, so be sure to complete both parts.

Check out part two— Avoiding Plaigiarism: It's Not Magic here .

Learn how to create a Found Poem with changing moods in this interactive tutorial. This tutorial is Part Two of a two-part series. In Part One, students read “Zero Hour,” a science fiction short story by author Ray Bradbury and examined how he used various literary devices to create changing moods. In Part Two, students will use words and phrases from “Zero Hour” to create a Found Poem with two of the same moods from Bradbury's story.

Click HERE   to launch Part One.

Cite text evidence and make inferences about the "real" history of Halloween in this spooky interactive tutorial. 

Acquire new vocabulary through this interactive tutorial. You'll learn definitions for 15 new words, as well as their parts of speech, their synonyms and antonyms, and you'll practice using them in context. 

Review strategies for acquiring new vocabulary and then learn fifteen new words in this interactive tutorial. You'll also practice using the words in a variety of ways to help you add them to your vocabulary.

Learn how to cite evidence and draw inferences in this interactive tutorial. Using an informational text about cyber attacks, you'll practice identifying text evidence and making inferences based on the text.

Learn how to define and identify claims being made within a text. This tutorial will also show you how evidence can be used effectively to support the claim being made. Lastly, this tutorial will help you write strong, convincing claims of your own.

Learn to identify explicit textual evidence and make inferences based on the text. In this interactive tutorial, you'll sharpen your analysis skills while reading about the famed American explorers, Lewis and Clark, and their trusted companion, Sacagawea. You'll practice analyzing the explicit textual evidence wihtin the text, and you'll also make your own inferences based on the available evidence. 

Learn several ways to determine the meaning of unfamiliar words, including context clues, word parts, and dictionary skills. In this interactive tutorial, you'll apply these strategies to text passages from John Muir's book A Thousand-mile Walk to the Gulf , which includes vivid descriptions of Florida in the late 1800s.

Explore the mystery of muscle cell metabolism and how cells are able to meet the need for a constant supply of energy. In this interactive tutorial, you'll identify the basic structure of adenosine triphosphate (ATP), explain how ATP’s structure is related it its job in the cell, and connect this role to energy transfers in living things.

Learn to identify and analyze extended metaphors using W.B. Yeats' poem, "The Stolen Child." In this interactive tutorial, we'll examine how Yeats uses figurative language to express the extended metaphor throughout this poem. We'll focus on his use of these seven types of imagery: visual, auditory, gustatory, olfactory, tactile, kinesthetic, and organic. Finally, we'll analyze how the poem's extended metaphor conveys a deeper meaning within the text.

Learn to identify and analyze the central idea of an informational text. In this interactive tutorial, you'll read several informational passages about the history of pirates. First, you'll learn the four-step process for pinpointing the central idea. Then you'll analyze each passage to see how the central idea is developed throughout the text.

Learn how to make inferences based on the information included in the text in this interactive tutorial. Using the short story "The Last Leaf" by O. Henry, you'll practice identifying both the explicit and implicit information in the story. You'll apply your own reasoning to make inferences based on what is stated both explicitly and implicitly in the text. 

Learn some of the basic rules for using semicolons and colons in this baseball-themed tutorial. In this interactive tutorial, you'll practice identifying independent clauses and distinguishing between conjunctive adverbs and coordinating conjunctions. You'll also learn how to organize a list of items using a semicolon. Finally, you'll learn how to introduce a list or quotation using a colon.

Join Baby Bear to answer questions about key details in his favorite stories with this interactive tutorial. Learn about characters, setting, and events as you answer who, where, and what questions.

In this tutorial, you will practice identifying relevant evidence within a text as you read excerpts from Jack London's short story "To Build a Fire." Then, you'll practice your writing skills as you draft a short response using examples of relevant evidence from the story.

Learn how to make inferences using the novel Hoot in this interactive tutorial. You'll learn how to identify both explicit and implicit information in the story to make inferences about characters and events.

Learn how to make inferences when reading a fictional text using the textual evidence provided. In this tutorial, you'll read the short story "The Story of an Hour" by Kate Chopin. You'll practice identifying what is directly stated in the text and what requires the use of inference. You'll practice making your own inferences and supporting them with evidence from the text.

Learn to distinguish between questions that can be answered by science and questions that science cannot answer. This interactive tutorial will help you distinguish between science and other ways of knowing, including art, religion, and philosophy.

Learn to use context clues, including synonyms, antonyms, and inferences, to determine the meaning of unfamiliar words in this interactive tutorial.

In Part Two of this two-part series, you'll continue to explore excerpts from the Romantic novel  Jane Eyre  by Charlotte Brontë. In this tutorial, you'll examine the author's use of juxtaposition, which is a technique of putting two or more elements side by side to invite comparison or contrast. By the end of this tutorial, you should be able to explain how the author’s use of juxtaposition in excerpts from the first two chapters of  Jane   Eyre  defines Jane’s perspective regarding her treatment in the Reed household.

Make sure to complete Part One before beginning Part Two. Click HERE to view Part One. 

Dive deeper into the famous short story “The Bet” by Anton Chekhov and explore the impact of a fifteen-year bet made between a lawyer and a banker.

In Part Three, you’ll learn about universal themes and explain how a specific universal theme is developed throughout “The Bet.”

Make sure to complete the first two parts in the series before beginning Part three. Click HERE to view Part One. Click HERE to view Part Two.

Lesson Plan

In this lesson plan, students will explore the history and meaning behind various patriotic holidays and make personal connections with those holidays including, Constitution Day, Memorial Day, Veteran’s Day, Patriot Day, President’s Day, Independence Day, and Medal of Honor Day.

Type: Lesson Plan

Text Resources

Using this case study students can discuss "How can an employee"s behaviors and actions drive their career stability and path?"

Type: Text Resource

Using this case study, students can answer the question, "What are the limits of fair use regarding copyright protection?"

Using this case study, students can answer the question, "How does the composition of a scene influence how the viewer feels?"

This fun and interactive exercise will give you practice correcting two common types of run-on sentences: comma splices and fused sentences. For each practice item, you must identify the best way to correct either a comma splice or a fused sentence. Explanations of each correct answer are also provided. There’s also an explanation of the rules of proper sentence structure for you to study, simply click the hyperlinked word "rules."

Type: Tutorial

This fun and interactive exercise will give you practice identifying two common types of run-on sentences: comma splices and fused sentences. For each practice item, you must identify whether a run-on sentence is a comma splice or a fused sentence. After every response, you will get immediate feedback. Explanations of each correct answer are also provided. There’s also an explanation of the rules of proper sentence structure for you to study, simply click the hyperlinked word "rules."

This fun and interactive exercise will give you practice in recognizing parallel structure. After every response, you will get immediate feedback. The site also includes an explanation of the rules of parallel structure that you can refer to as you complete this exercise.

This fun and interactive exercise will give you practice in maintaining parallel structure. After every response, you will get immediate feedback. The site also includes an explanation of the rules of parallel structure that you can refer to as you complete this exercise.

This fun and interactive exercise will give you practice in maintaining parallel structure. You will get feedback after every typed response. The site also includes an explanation of the rules of parallel structure that you can refer to as you complete this exercise.

Parent Resources

Congratulations, you have successfully created an account..

A verifications link was sent to your email at ... . Please check your email and click on the link to confirm your email address and fully activate your iCPALMS account. Please check your spam folder.

Did you enter an incorrect email address?

Did not receive an email, you have not completed your profile information. please take a few moments to complete the section below so we can customize your cpalms experience., there was an error creating your account. please contact support [email protected] for assistance..

Like us on Facebook

Stay in touch with CPALMS

Follow Us on Twitter

What Is Critical Thinking?

Who uses critical thinking tests and why, how to prepare for a critical thinking test in 2024, final thoughts, critical thinking tests (2024 guide).

Updated November 18, 2023

Critical thinking is the ability to scrutinize evidence using intellectual skills. Reflective skills are employed to reach clear, coherent and logical conclusions – rather than just accepting information as it is provided.

Critical thinking tests measure the candidate’s understanding of logical connections between ideas, the strength of an argument, alternate interpretations and the significance of a particular claim.

A major facet of critical thinking is the ability to separate facts from opinions and work against any subconscious bias.

In critical thinking tests, employers are looking for people who can think critically about information, showing they are open-minded, good problem-solvers and excellent decision-makers.

Critical thinking tests assess how well a candidate can analyze and reason when presented with specific information.

They are used as part of the application process in several industries, most commonly for professions where employees would need to use advanced judgment and analysis skills in decision-making.

For example:

Academic applications – In some instances, critical thinking tests are used to assess whether prospective students have the skills required to be successful in higher education.

Law – Critical thinking assessments are often used in the legal sector as part of the application process. In many law positions, facts are more important than opinion, subconscious bias or pre-existing ideas so an applicant needs to be skilled in critical thinking.

Finance – In financial institutions, decisions often need to be made based on facts rather than emotion or opinion. Judgments made in banking need to be skilled decisions based on logic and the strength of data and information – so to be successful, candidates need to demonstrate that they will not accept arguments and conclusions at face value.

Graduate roles – In some sectors, critical thinking tests are used in graduate recruitment because they are considered to be predictors of ability.

With several different tests available, suited to different industries, many top-level jobs are likely to include critical thinking assessments as part of the application process.

Critical Thinking Tests Explained

Critical thinking tests are usually presented in a similar format no matter who the publisher is. A paragraph of information and data is given, with a statement that is under scrutiny.

Multiple-choice answers are presented for each statement, and there may be more than one question about the same paragraph.

While each question is presented in the same way, different aspects of critical thinking are assessed throughout the test.

Assessing Assumptions

For this type of question, there may be something ‘taken for granted’ in the information provided – and it might not be explicitly stated.

The candidate needs to evaluate the scenario and conclude whether any assumptions are present. The statement below the scenario may or may not support the statement and the answer selection will be about whether the stated assumption is made or not made in the scenario.

Example Question for Assessing Assumptions

Practice Critical Thinking Test with JobTestPrep

The mainstream media presents information that is supported by the political party in power.

Assumption: The information that the mainstream media presents is always correct.

a) Assumption made b) Assumption not made

Determining Inferences

Following a paragraph of information containing evidence, you will be presented with an inference and need to assess whether the inference is absolutely true, possibly true, possibly false, absolutely false, or it is not possible to reach a decision.

An inference is a conclusion that can be reached based on logical reasoning from the information. Although all the evidence to support (or not support) the inference is included in the passage, it will not be obvious or explicitly stated, which makes the inference harder to conclude.

Example Question for Determining Inferences

It has been snowing all night and there is thick snow on the ground. Today’s weather is sunny and bright.

Inference: The snow will melt today.

a) Possibly true b) Absolutely true c) Possibly false d) Absolutely false e) Not possible to reach a decision

Making Deductions

For this type of question, the information presented will be a set of factual statements and the candidate will need to decide if the deduction applies or does not apply.

This logical thinking is a top-down exercise where all the information is provided and needs to be read in the order it is presented.

If statement A = B, does B = C? There should be no grey areas – it either does or does not follow.

Example Question for Making Deductions

All plants have leaves. All leaves are green.

Proposed deduction: All plants are green.

a) Deduction follows b) Deduction does not follow

If you need to prepare for a number of different employment tests and want to outsmart the competition, choose a Premium Membership from JobTestPrep . You will get access to three PrepPacks of your choice, from a database that covers all the major test providers and employers and tailored profession packs.

Get a Premium Package Now

Interpretation of Conclusions

Presented with information, the candidate needs to assess whether a given conclusion is correct based on the evidence provided.

For the purposes of the test, we need to believe that all the information provided in the paragraph is true, even if we have opinions about the correctness of the statement.

Example Question for Interpretation of Conclusions

When cooking a meal, one of the most important things to get right is the balance between major food groups. Satisfaction from a good meal comes from getting the most nutrition and can therefore be attributed to a wide variety of flavors, including vegetables, a good source of protein and carbohydrates. A balanced diet is about more than just everything in moderation and should be considered a scientific process with measuring of ingredients and efficient cooking methods.

Proposed conclusion: The best meals are those that are scientifically prepared.

a) Conclusion follows b) Conclusion does not follow

Evaluation of Arguments (Analysis of Arguments)

In this analysis section, the candidate is presented with a scenario and an argument that might be in favor of the scenario or against it.

The candidate needs to evaluate whether the argument itself is weak or strong. This needs to be based on the relevance to the scenario and whether it accurately addresses the question.

Example Question for Evaluation of Arguments

Should all drugs be made legal?

Proposed argument: No, all drugs are dangerous to everyone.

a) Argument is strong b) Argument is weak

Most Common Critical Thinking Tests in 2024

Watson glaser test.

Watson Glaser is the most commonly used test publisher for critical thinking assessments and is used by many industries.

When sitting a Watson Glaser test, your results will be compared against a sample group of over 1,500 test-takers who are considered representative of graduate-level candidates.

The test is usually 40 questions long, with 30 minutes to answer, but there is a longer version that asks 80 questions with a time limit of an hour.

Who Uses This Test?

The Watson Glaser Test is used in a wide variety of industries for different roles, especially in the legal and banking sectors. Some employers that use the Watson Glaser Test are:

• Bank of England
• Irwin Mitchell
• Simmons & Simmons

What Is the RED model?

The Watson Glaser Test is based on something called the ‘RED model’. The questions in the test are based on:

• Recognizing assumptions
• Evaluating arguments
• Drawing conclusions

The science behind the Watson Glaser Test shows that candidates who show strong critical thinking skills in these areas are more likely to perform well in roles where logical decisions and judgments have to be made.

Where to Take a Free Practice Test

Watson Glaser Tests have a specific layout and format. If you are going to be completing one of the assessments as part of your application, it’s best to practice questions that match the test format.

You can find Watson Glaser practice tests at JobTestPrep as well as a prep pack to give you all the tips, tricks and information you need to make the most of your practice time.

Take a Practice Watson Glaser Test

SHL Critical Reasoning Battery Test

The SHL Critical Reasoning Battery Test includes questions based on numerical, verbal and inductive reasoning. This test is usually used for managerial and supervisory roles, and can include mechanical comprehension if needed for the job role (usually in engineering or mechanical roles).

You can find out more on JobTestPrep’s SHL Critical Reasoning Battery pages .

Take a Practice SHL Test

The Graduate Management Admissions Test (GMAT) is an online adaptive test – using sophisticated algorithms to adjust the difficulty of the questions according to the answers already provided.

Questions include integrated, quantitative and verbal reasoning as well as an analytical writing assessment. The GMAT is widely used to predict performance in business or management programs in more than 1,700 universities and organizations.

Take a Practice GMAT

Preparation is key to success in any pre-employment assessment. While some people think critical reasoning is not a skill you can practice, there are some steps you can take to perform at your best.

Critical thinking tests are straightforward but not necessarily easy.

Step 1 . Consider Buying a Preparation Pack

If you can determine who the publisher is for the test you will take, it may be worthwhile investing in a prep pack from that particular publisher.

JobTestPrep offers prep packs for many major test publishers. These packs include realistic practice tests as well as study guides, tips and tricks to help you build your own question-solving strategies.

Step 2 . Use Practice Tests

Even if you decide not to purchase a prep pack, taking practice tests will help you focus on the areas where you need to improve to be successful.

It is important to find out the publisher of the test you will take because not all critical thinking tests are at the same level and they may not follow the same structure. Timings, answering methodologies and the number of questions will vary between publishers.

You can usually find out the test publisher before you take the assessment by asking the recruiter or searching online.

Step 3 . Practice Under Test Conditions

Critical thinking tests are timed. To give yourself the best chance of achieving a high score, you need to answer the questions quickly and efficiently.

Practicing under test conditions – including the time limit – will help you to understand how much time you need to spend on each question and will help you to develop efficient time management skills for the assessment.

Practicing under test conditions will also help you focus so you can make the most of the session.

Step 4 . Practice Abstract Reasoning

Abstract reasoning is a form of critical thinking that uses logic to form a conclusion. Some abstract reasoning tests are presented as word problems.

Practicing these is a good way to flex critical thinking muscles. You can find practice questions on the Psychometric Success website .

Step 5 . Practice Critical Thinking in Everyday Life

Reading widely, especially non-fiction, is a good way to practice your critical thinking skills in everyday life.

Newspaper articles, scientific or technical journals, and other sources of information present an opportunity to think about:

• The strength of arguments
• The perspective of the author
• Whether there are enough facts presented to draw the conclusion given
• Whether other conclusions could be drawn from the same information

Step 6 . Revise Logical Fallacies

Knowledge of logical fallacies will help you to judge the effectiveness of an argument. Fallacy describes ‘faulty reasoning’ in an argument and is often seen in hyperbole or opinion pieces in newspapers and magazines.

There are many types of fallacy that you might come across, such as:

• Strawman – An argument that doesn’t address the statement.
• False cause – An argument based on a connection that doesn’t exist.
• Ambiguity – An argument using a phrase that is unclear or that may have different meanings.
• Appeal to popularity – An argument that states it must be true because many people believe it.

There are many others, including red herrings, appeal to authority and false dichotomy. Learning these will help you to identify a weak argument.

Step 7 . Focus on Long-Term Practice

Cramming and panicking about a critical thinking assessment is rarely conducive to great performance.

If you are looking for a career in a sector where critical thinking skills are necessary, then long-term practice will have better results when you come to be assessed. Make critical thinking a part of life – so that every day can be a chance to practice recognizing assumptions.

Key Tips for Critical Thinking Test Success

Understand the format of the test and each question type.

Familiarity is important for any assessment, and in critical thinking tests, it is essential that you can recognize what the question is looking for. As mentioned above, this is usually one of the following:

• Assessing assumptions
• Determining inferences
• Making deductions
• Interpreting conclusions

Practice tests will help you become comfortable with the structure and format of the test, including ways to answer, and will also demonstrate what the question types look like.

Read Test Content Carefully

Taking time to read and understand the content provided in the question is important to ensure that you can answer correctly.

The information you need to determine the correct answer will be provided although it might not be explicitly stated. Careful reading is an important part of critical thinking.

Only Use the Information Provided

While some of the information provided in the critical thinking test might be related to the role you are applying for, or about something that you have existing knowledge of, you mustn't use this knowledge during the test.

A facet of critical thinking is avoiding subconscious bias and opinion, so only use the information that is provided to answer the question.

Look Out for Facts and Fallacies

Throughout the critical thinking test, look out for facts and fallacies in the information and arguments provided.

Identifying fallacies will help you decide if an argument is strong and will help you answer questions correctly.

Critical thinking tests are used as pre-employment assessments for jobs that require effective communication, good problem-solving and great decision-making, such as those in the legal sector and banking.

These tests assess the ability of candidates to question and scrutinize evidence, make logical connections between ideas, find alternative interpretations and decide on the strength of an argument.

All critical thinking tests are not the same, but they do have similar question types. Learning what these are and how to answer them will help you perform better. Practicing tests based on the specific publisher of your test will give you the best results.

You might also be interested in these other Psychometric Success articles:

Or explore the Aptitude Tests / Test Types sections.

• Reference Manager
• Simple TEXT file

People also looked at

Original research article, performance assessment of critical thinking: conceptualization, design, and implementation.

• 1 Lynch School of Education and Human Development, Boston College, Chestnut Hill, MA, United States
• 2 Graduate School of Education, Stanford University, Stanford, CA, United States
• 3 Department of Business and Economics Education, Johannes Gutenberg University, Mainz, Germany

Enhancing students’ critical thinking (CT) skills is an essential goal of higher education. This article presents a systematic approach to conceptualizing and measuring CT. CT generally comprises the following mental processes: identifying, evaluating, and analyzing a problem; interpreting information; synthesizing evidence; and reporting a conclusion. We further posit that CT also involves dealing with dilemmas involving ambiguity or conflicts among principles and contradictory information. We argue that performance assessment provides the most realistic—and most credible—approach to measuring CT. From this conceptualization and construct definition, we describe one possible framework for building performance assessments of CT with attention to extended performance tasks within the assessment system. The framework is a product of an ongoing, collaborative effort, the International Performance Assessment of Learning (iPAL). The framework comprises four main aspects: (1) The storyline describes a carefully curated version of a complex, real-world situation. (2) The challenge frames the task to be accomplished (3). A portfolio of documents in a range of formats is drawn from multiple sources chosen to have specific characteristics. (4) The scoring rubric comprises a set of scales each linked to a facet of the construct. We discuss a number of use cases, as well as the challenges that arise with the use and valid interpretation of performance assessments. The final section presents elements of the iPAL research program that involve various refinements and extensions of the assessment framework, a number of empirical studies, along with linkages to current work in online reading and information processing.

Introduction

In their mission statements, most colleges declare that a principal goal is to develop students’ higher-order cognitive skills such as critical thinking (CT) and reasoning (e.g., Shavelson, 2010 ; Hyytinen et al., 2019 ). The importance of CT is echoed by business leaders ( Association of American Colleges and Universities [AACU], 2018 ), as well as by college faculty (for curricular analyses in Germany, see e.g., Zlatkin-Troitschanskaia et al., 2018 ). Indeed, in the 2019 administration of the Faculty Survey of Student Engagement (FSSE), 93% of faculty reported that they “very much” or “quite a bit” structure their courses to support student development with respect to thinking critically and analytically. In a listing of 21st century skills, CT was the most highly ranked among FSSE respondents ( Indiana University, 2019 ). Nevertheless, there is considerable evidence that many college students do not develop these skills to a satisfactory standard ( Arum and Roksa, 2011 ; Shavelson et al., 2019 ; Zlatkin-Troitschanskaia et al., 2019 ). This state of affairs represents a serious challenge to higher education – and to society at large.

In view of the importance of CT, as well as evidence of substantial variation in its development during college, its proper measurement is essential to tracking progress in skill development and to providing useful feedback to both teachers and learners. Feedback can help focus students’ attention on key skill areas in need of improvement, and provide insight to teachers on choices of pedagogical strategies and time allocation. Moreover, comparative studies at the program and institutional level can inform higher education leaders and policy makers.

The conceptualization and definition of CT presented here is closely related to models of information processing and online reasoning, the skills that are the focus of this special issue. These two skills are especially germane to the learning environments that college students experience today when much of their academic work is done online. Ideally, students should be capable of more than naïve Internet search, followed by copy-and-paste (e.g., McGrew et al., 2017 ); rather, for example, they should be able to critically evaluate both sources of evidence and the quality of the evidence itself in light of a given purpose ( Leu et al., 2020 ).

In this paper, we present a systematic approach to conceptualizing CT. From that conceptualization and construct definition, we present one possible framework for building performance assessments of CT with particular attention to extended performance tasks within the test environment. The penultimate section discusses some of the challenges that arise with the use and valid interpretation of performance assessment scores. We conclude the paper with a section on future perspectives in an emerging field of research – the iPAL program.

Conceptual Foundations, Definition and Measurement of Critical Thinking

In this section, we briefly review the concept of CT and its definition. In accordance with the principles of evidence-centered design (ECD; Mislevy et al., 2003 ), the conceptualization drives the measurement of the construct; that is, implementation of ECD directly links aspects of the assessment framework to specific facets of the construct. We then argue that performance assessments designed in accordance with such an assessment framework provide the most realistic—and most credible—approach to measuring CT. The section concludes with a sketch of an approach to CT measurement grounded in performance assessment .

Concept and Definition of Critical Thinking

Taxonomies of 21st century skills ( Pellegrino and Hilton, 2012 ) abound, and it is neither surprising that CT appears in most taxonomies of learning, nor that there are many different approaches to defining and operationalizing the construct of CT. There is, however, general agreement that CT is a multifaceted construct ( Liu et al., 2014 ). Liu et al. (2014) identified five key facets of CT: (i) evaluating evidence and the use of evidence; (ii) analyzing arguments; (iii) understanding implications and consequences; (iv) developing sound arguments; and (v) understanding causation and explanation.

There is empirical support for these facets from college faculty. A 2016–2017 survey conducted by the Higher Education Research Institute (HERI) at the University of California, Los Angeles found that a substantial majority of faculty respondents “frequently” encouraged students to: (i) evaluate the quality or reliability of the information they receive; (ii) recognize biases that affect their thinking; (iii) analyze multiple sources of information before coming to a conclusion; and (iv) support their opinions with a logical argument ( Stolzenberg et al., 2019 ).

There is general agreement that CT involves the following mental processes: identifying, evaluating, and analyzing a problem; interpreting information; synthesizing evidence; and reporting a conclusion (e.g., Erwin and Sebrell, 2003 ; Kosslyn and Nelson, 2017 ; Shavelson et al., 2018 ). We further suggest that CT includes dealing with dilemmas of ambiguity or conflict among principles and contradictory information ( Oser and Biedermann, 2020 ).

Importantly, Oser and Biedermann (2020) posit that CT can be manifested at three levels. The first level, Critical Analysis , is the most complex of the three levels. Critical Analysis requires both knowledge in a specific discipline (conceptual) and procedural analytical (deduction, inclusion, etc.) knowledge. The second level is Critical Reflection , which involves more generic skills “… necessary for every responsible member of a society” (p. 90). It is “a basic attitude that must be taken into consideration if (new) information is questioned to be true or false, reliable or not reliable, moral or immoral etc.” (p. 90). To engage in Critical Reflection, one needs not only apply analytic reasoning, but also adopt a reflective stance toward the political, social, and other consequences of choosing a course of action. It also involves analyzing the potential motives of various actors involved in the dilemma of interest. The third level, Critical Alertness , involves questioning one’s own or others’ thinking from a skeptical point of view.

Wheeler and Haertel (1993) categorized higher-order skills, such as CT, into two types: (i) when solving problems and making decisions in professional and everyday life, for instance, related to civic affairs and the environment; and (ii) in situations where various mental processes (e.g., comparing, evaluating, and justifying) are developed through formal instruction, usually in a discipline. Hence, in both settings, individuals must confront situations that typically involve a problematic event, contradictory information, and possibly conflicting principles. Indeed, there is an ongoing debate concerning whether CT should be evaluated using generic or discipline-based assessments ( Nagel et al., 2020 ). Whether CT skills are conceptualized as generic or discipline-specific has implications for how they are assessed and how they are incorporated into the classroom.

In the iPAL project, CT is characterized as a multifaceted construct that comprises conceptualizing, analyzing, drawing inferences or synthesizing information, evaluating claims, and applying the results of these reasoning processes to various purposes (e.g., solve a problem, decide on a course of action, find an answer to a given question or reach a conclusion) ( Shavelson et al., 2019 ). In the course of carrying out a CT task, an individual typically engages in activities such as specifying or clarifying a problem; deciding what information is relevant to the problem; evaluating the trustworthiness of information; avoiding judgmental errors based on “fast thinking”; avoiding biases and stereotypes; recognizing different perspectives and how they can reframe a situation; considering the consequences of alternative courses of actions; and communicating clearly and concisely decisions and actions. The order in which activities are carried out can vary among individuals and the processes can be non-linear and reciprocal.

In this article, we focus on generic CT skills. The importance of these skills derives not only from their utility in academic and professional settings, but also the many situations involving challenging moral and ethical issues – often framed in terms of conflicting principles and/or interests – to which individuals have to apply these skills ( Kegan, 1994 ; Tessier-Lavigne, 2020 ). Conflicts and dilemmas are ubiquitous in the contexts in which adults find themselves: work, family, civil society. Moreover, to remain viable in the global economic environment – one characterized by increased competition and advances in second generation artificial intelligence (AI) – today’s college students will need to continually develop and leverage their CT skills. Ideally, colleges offer a supportive environment in which students can develop and practice effective approaches to reasoning about and acting in learning, professional and everyday situations.

Measurement of Critical Thinking

Critical thinking is a multifaceted construct that poses many challenges to those who would develop relevant and valid assessments. For those interested in current approaches to the measurement of CT that are not the focus of this paper, consult Zlatkin-Troitschanskaia et al. (2018) .

In this paper, we have singled out performance assessment as it offers important advantages to measuring CT. Extant tests of CT typically employ response formats such as forced-choice or short-answer, and scenario-based tasks (for an overview, see Liu et al., 2014 ). They all suffer from moderate to severe construct underrepresentation; that is, they fail to capture important facets of the CT construct such as perspective taking and communication. High fidelity performance tasks are viewed as more authentic in that they provide a problem context and require responses that are more similar to what individuals confront in the real world than what is offered by traditional multiple-choice items ( Messick, 1994 ; Braun, 2019 ). This greater verisimilitude promises higher levels of construct representation and lower levels of construct-irrelevant variance. Such performance tasks have the capacity to measure facets of CT that are imperfectly assessed, if at all, using traditional assessments ( Lane and Stone, 2006 ; Braun, 2019 ; Shavelson et al., 2019 ). However, these assertions must be empirically validated, and the measures should be subjected to psychometric analyses. Evidence of the reliability, validity, and interpretative challenges of performance assessment (PA) are extensively detailed in Davey et al. (2015) .

We adopt the following definition of performance assessment:

A performance assessment (sometimes called a work sample when assessing job performance) … is an activity or set of activities that requires test takers, either individually or in groups, to generate products or performances in response to a complex, most often real-world task. These products and performances provide observable evidence bearing on test takers’ knowledge, skills, and abilities—their competencies—in completing the assessment ( Davey et al., 2015 , p. 10).

A performance assessment typically includes an extended performance task and short constructed-response and selected-response (i.e., multiple-choice) tasks (for examples, see Zlatkin-Troitschanskaia and Shavelson, 2019 ). In this paper, we refer to both individual performance- and constructed-response tasks as performance tasks (PT) (For an example, see Table 1 in section “iPAL Assessment Framework”).

Table 1. The iPAL assessment framework.

An Approach to Performance Assessment of Critical Thinking: The iPAL Program

The approach to CT presented here is the result of ongoing work undertaken by the International Performance Assessment of Learning collaborative (iPAL 1 ). iPAL is an international consortium of volunteers, primarily from academia, who have come together to address the dearth in higher education of research and practice in measuring CT with performance tasks ( Shavelson et al., 2018 ). In this section, we present iPAL’s assessment framework as the basis of measuring CT, with examples along the way.

iPAL Background

The iPAL assessment framework builds on the Council of Aid to Education’s Collegiate Learning Assessment (CLA). The CLA was designed to measure cross-disciplinary, generic competencies, such as CT, analytic reasoning, problem solving, and written communication ( Klein et al., 2007 ; Shavelson, 2010 ). Ideally, each PA contained an extended PT (e.g., examining a range of evidential materials related to the crash of an aircraft) and two short PT’s: one in which students either critique an argument or provide a solution in response to a real-world societal issue.

Motivated by considerations of adequate reliability, in 2012, the CLA was later modified to create the CLA+. The CLA+ includes two subtests: a PT and a 25-item Selected Response Question (SRQ) section. The PT presents a document or problem statement and an assignment based on that document which elicits an open-ended response. The CLA+ added the SRQ section (which is not linked substantively to the PT scenario) to increase the number of student responses to obtain more reliable estimates of performance at the student-level than could be achieved with a single PT ( Zahner, 2013 ; Davey et al., 2015 ).

iPAL Assessment Framework

Methodological foundations.

The iPAL framework evolved from the Collegiate Learning Assessment developed by Klein et al. (2007) . It was also informed by the results from the AHELO pilot study ( Organisation for Economic Co-operation and Development [OECD], 2012 , 2013 ), as well as the KoKoHs research program in Germany (for an overview see, Zlatkin-Troitschanskaia et al., 2017 , 2020 ). The ongoing refinement of the iPAL framework has been guided in part by the principles of Evidence Centered Design (ECD) ( Mislevy et al., 2003 ; Mislevy and Haertel, 2006 ; Haertel and Fujii, 2017 ).

In educational measurement, an assessment framework plays a critical intermediary role between the theoretical formulation of the construct and the development of the assessment instrument containing tasks (or items) intended to elicit evidence with respect to that construct ( Mislevy et al., 2003 ). Builders of the assessment framework draw on the construct theory and operationalize it in a way that provides explicit guidance to PT’s developers. Thus, the framework should reflect the relevant facets of the construct, where relevance is determined by substantive theory or an appropriate alternative such as behavioral samples from real-world situations of interest (criterion-sampling; McClelland, 1973 ), as well as the intended use(s) (for an example, see Shavelson et al., 2019 ). By following the requirements and guidelines embodied in the framework, instrument developers strengthen the claim of construct validity for the instrument ( Messick, 1994 ).

An assessment framework can be specified at different levels of granularity: an assessment battery (“omnibus” assessment, for an example see below), a single performance task, or a specific component of an assessment ( Shavelson, 2010 ; Davey et al., 2015 ). In the iPAL program, a performance assessment comprises one or more extended performance tasks and additional selected-response and short constructed-response items. The focus of the framework specified below is on a single PT intended to elicit evidence with respect to some facets of CT, such as the evaluation of the trustworthiness of the documents provided and the capacity to address conflicts of principles.

From the ECD perspective, an assessment is an instrument for generating information to support an evidentiary argument and, therefore, the intended inferences (claims) must guide each stage of the design process. The construct of interest is operationalized through the Student Model , which represents the target knowledge, skills, and abilities, as well as the relationships among them. The student model should also make explicit the assumptions regarding student competencies in foundational skills or content knowledge. The Task Model specifies the features of the problems or items posed to the respondent, with the goal of eliciting the evidence desired. The assessment framework also describes the collection of task models comprising the instrument, with considerations of construct validity, various psychometric characteristics (e.g., reliability) and practical constraints (e.g., testing time and cost). The student model provides grounds for evidence of validity, especially cognitive validity; namely, that the students are thinking critically in responding to the task(s).

In the present context, the target construct (CT) is the competence of individuals to think critically, which entails solving complex, real-world problems, and clearly communicating their conclusions or recommendations for action based on trustworthy, relevant and unbiased information. The situations, drawn from actual events, are challenging and may arise in many possible settings. In contrast to more reductionist approaches to assessment development, the iPAL approach and framework rests on the assumption that properly addressing these situational demands requires the application of a constellation of CT skills appropriate to the particular task presented (e.g., Shavelson, 2010 , 2013 ). For a PT, the assessment framework must also specify the rubric by which the responses will be evaluated. The rubric must be properly linked to the target construct so that the resulting score profile constitutes evidence that is both relevant and interpretable in terms of the student model (for an example, see Zlatkin-Troitschanskaia et al., 2019 ).

iPAL Task Framework

The iPAL ‘omnibus’ framework comprises four main aspects: A storyline , a challenge , a document library , and a scoring rubric . Table 1 displays these aspects, brief descriptions of each, and the corresponding examples drawn from an iPAL performance assessment (Version adapted from original in Hyytinen and Toom, 2019 ). Storylines are drawn from various domains; for example, the worlds of business, public policy, civics, medicine, and family. They often involve moral and/or ethical considerations. Deriving an appropriate storyline from a real-world situation requires careful consideration of which features are to be kept in toto , which adapted for purposes of the assessment, and which to be discarded. Framing the challenge demands care in wording so that there is minimal ambiguity in what is required of the respondent. The difficulty of the challenge depends, in large part, on the nature and extent of the information provided in the document library , the amount of scaffolding included, as well as the scope of the required response. The amount of information and the scope of the challenge should be commensurate with the amount of time available. As is evident from the table, the characteristics of the documents in the library are intended to elicit responses related to facets of CT. For example, with regard to bias, the information provided is intended to play to judgmental errors due to fast thinking and/or motivational reasoning. Ideally, the situation should accommodate multiple solutions of varying degrees of merit.

The dimensions of the scoring rubric are derived from the Task Model and Student Model ( Mislevy et al., 2003 ) and signal which features are to be extracted from the response and indicate how they are to be evaluated. There should be a direct link between the evaluation of the evidence and the claims that are made with respect to the key features of the task model and student model . More specifically, the task model specifies the various manipulations embodied in the PA and so informs scoring, while the student model specifies the capacities students employ in more or less effectively responding to the tasks. The score scales for each of the five facets of CT (see section “Concept and Definition of Critical Thinking”) can be specified using appropriate behavioral anchors (for examples, see Zlatkin-Troitschanskaia and Shavelson, 2019 ). Of particular importance is the evaluation of the response with respect to the last dimension of the scoring rubric; namely, the overall coherence and persuasiveness of the argument, building on the explicit or implicit characteristics related to the first five dimensions. The scoring process must be monitored carefully to ensure that (trained) raters are judging each response based on the same types of features and evaluation criteria ( Braun, 2019 ) as indicated by interrater agreement coefficients.

The scoring rubric of the iPAL omnibus framework can be modified for specific tasks ( Lane and Stone, 2006 ). This generic rubric helps ensure consistency across rubrics for different storylines. For example, Zlatkin-Troitschanskaia et al. (2019 , p. 473) used the following scoring scheme:

Based on our construct definition of CT and its four dimensions: (D1-Info) recognizing and evaluating information, (D2-Decision) recognizing and evaluating arguments and making decisions, (D3-Conseq) recognizing and evaluating the consequences of decisions, and (D4-Writing), we developed a corresponding analytic dimensional scoring … The students’ performance is evaluated along the four dimensions, which in turn are subdivided into a total of 23 indicators as (sub)categories of CT … For each dimension, we sought detailed evidence in students’ responses for the indicators and scored them on a six-point Likert-type scale. In order to reduce judgment distortions, an elaborate procedure of ‘behaviorally anchored rating scales’ (Smith and Kendall, 1963) was applied by assigning concrete behavioral expectations to certain scale points (Bernardin et al., 1976). To this end, we defined the scale levels by short descriptions of typical behavior and anchored them with concrete examples. … We trained four raters in 1 day using a specially developed training course to evaluate students’ performance along the 23 indicators clustered into four dimensions (for a description of the rater training, see Klotzer, 2018).

Shavelson et al. (2019) examined the interrater agreement of the scoring scheme developed by Zlatkin-Troitschanskaia et al. (2019) and “found that with 23 items and 2 raters the generalizability (“reliability”) coefficient for total scores to be 0.74 (with 4 raters, 0.84)” ( Shavelson et al., 2019 , p. 15). In the study by Zlatkin-Troitschanskaia et al. (2019 , p. 478) three score profiles were identified (low-, middle-, and high-performer) for students. Proper interpretation of such profiles requires care. For example, there may be multiple possible explanations for low scores such as poor CT skills, a lack of a disposition to engage with the challenge, or the two attributes jointly. These alternative explanations for student performance can potentially pose a threat to the evidentiary argument. In this case, auxiliary information may be available to aid in resolving the ambiguity. For example, student responses to selected- and short-constructed-response items in the PA can provide relevant information about the levels of the different skills possessed by the student. When sufficient data are available, the scores can be modeled statistically and/or qualitatively in such a way as to bring them to bear on the technical quality or interpretability of the claims of the assessment: reliability, validity, and utility evidence ( Davey et al., 2015 ; Zlatkin-Troitschanskaia et al., 2019 ). These kinds of concerns are less critical when PT’s are used in classroom settings. The instructor can draw on other sources of evidence, including direct discussion with the student.

Use of iPAL Performance Assessments in Educational Practice: Evidence From Preliminary Validation Studies

The assessment framework described here supports the development of a PT in a general setting. Many modifications are possible and, indeed, desirable. If the PT is to be more deeply embedded in a certain discipline (e.g., economics, law, or medicine), for example, then the framework must specify characteristics of the narrative and the complementary documents as to the breadth and depth of disciplinary knowledge that is represented.

At present, preliminary field trials employing the omnibus framework (i.e., a full set of documents) indicated that 60 min was generally an inadequate amount of time for students to engage with the full set of complementary documents and to craft a complete response to the challenge (for an example, see Shavelson et al., 2019 ). Accordingly, it would be helpful to develop modified frameworks for PT’s that require substantially less time. For an example, see a short performance assessment of civic online reasoning, requiring response times from 10 to 50 min ( Wineburg et al., 2016 ). Such assessment frameworks could be derived from the omnibus framework by focusing on a reduced number of facets of CT, and specifying the characteristics of the complementary documents to be included – or, perhaps, choices among sets of documents. In principle, one could build a ‘family’ of PT’s, each using the same (or nearly the same) storyline and a subset of the full collection of complementary documents.

Paul and Elder (2007) argue that the goal of CT assessments should be to provide faculty with important information about how well their instruction supports the development of students’ CT. In that spirit, the full family of PT’s could represent all facets of the construct while affording instructors and students more specific insights on strengths and weaknesses with respect to particular facets of CT. Moreover, the framework should be expanded to include the design of a set of short answer and/or multiple choice items to accompany the PT. Ideally, these additional items would be based on the same narrative as the PT to collect more nuanced information on students’ precursor skills such as reading comprehension, while enhancing the overall reliability of the assessment. Areas where students are under-prepared could be addressed before, or even in parallel with the development of the focal CT skills. The parallel approach follows the co-requisite model of developmental education. In other settings (e.g., for summative assessment), these complementary items would be administered after the PT to augment the evidence in relation to the various claims. The full PT taking 90 min or more could serve as a capstone assessment.

As we transition from simply delivering paper-based assessments by computer to taking full advantage of the affordances of a digital platform, we should learn from the hard-won lessons of the past so that we can make swifter progress with fewer missteps. In that regard, we must take validity as the touchstone – assessment design, development and deployment must all be tightly linked to the operational definition of the CT construct. Considerations of reliability and practicality come into play with various use cases that highlight different purposes for the assessment (for future perspectives, see next section).

The iPAL assessment framework represents a feasible compromise between commercial, standardized assessments of CT (e.g., Liu et al., 2014 ), on the one hand, and, on the other, freedom for individual faculty to develop assessment tasks according to idiosyncratic models. It imposes a degree of standardization on both task development and scoring, while still allowing some flexibility for faculty to tailor the assessment to meet their unique needs. In so doing, it addresses a key weakness of the AAC&U’s VALUE initiative 2 (retrieved 5/7/2020) that has achieved wide acceptance among United States colleges.

The VALUE initiative has produced generic scoring rubrics for 15 domains including CT, problem-solving and written communication. A rubric for a particular skill domain (e.g., critical thinking) has five to six dimensions with four ordered performance levels for each dimension (1 = lowest, 4 = highest). The performance levels are accompanied by language that is intended to clearly differentiate among levels. 3 Faculty are asked to submit student work products from a senior level course that is intended to yield evidence with respect to student learning outcomes in a particular domain and that, they believe, can elicit performances at the highest level. The collection of work products is then graded by faculty from other institutions who have been trained to apply the rubrics.

A principal difficulty is that there is neither a common framework to guide the design of the challenge, nor any control on task complexity and difficulty. Consequently, there is substantial heterogeneity in the quality and evidential value of the submitted responses. This also causes difficulties with task scoring and inter-rater reliability. Shavelson et al. (2009) discuss some of the problems arising with non-standardized collections of student work.

In this context, one advantage of the iPAL framework is that it can provide valuable guidance and an explicit structure for faculty in developing performance tasks for both instruction and formative assessment. When faculty design assessments, their focus is typically on content coverage rather than other potentially important characteristics, such as the degree of construct representation and the adequacy of their scoring procedures ( Braun, 2019 ).

Concluding Reflections

Challenges to interpretation and implementation.

Performance tasks such as those generated by iPAL are attractive instruments for assessing CT skills (e.g., Shavelson, 2010 ; Shavelson et al., 2019 ). The attraction mainly rests on the assumption that elaborated PT’s are more authentic (direct) and more completely capture facets of the target construct (i.e., possess greater construct representation) than the widely used selected-response tests. However, as Messick (1994) noted authenticity is a “promissory note” that must be redeemed with empirical research. In practice, there are trade-offs among authenticity, construct validity, and psychometric quality such as reliability ( Davey et al., 2015 ).

One reason for Messick (1994) caution is that authenticity does not guarantee construct validity. The latter must be established by drawing on multiple sources of evidence ( American Educational Research Association et al., 2014 ). Following the ECD principles in designing and developing the PT, as well as the associated scoring rubrics, constitutes an important type of evidence. Further, as Leighton (2019) argues, response process data (“cognitive validity”) is needed to validate claims regarding the cognitive complexity of PT’s. Relevant data can be obtained through cognitive laboratory studies involving methods such as think aloud protocols or eye-tracking. Although time-consuming and expensive, such studies can yield not only evidence of validity, but also valuable information to guide refinements of the PT.

Going forward, iPAL PT’s must be subjected to validation studies as recommended in the Standards for Psychological and Educational Testing by American Educational Research Association et al. (2014) . With a particular focus on the criterion “relationships to other variables,” a framework should include assumptions about the theoretically expected relationships among the indicators assessed by the PT, as well as the indicators’ relationships to external variables such as intelligence or prior (task-relevant) knowledge.

Complementing the necessity of evaluating construct validity, there is the need to consider potential sources of construct-irrelevant variance (CIV). One pertains to student motivation, which is typically greater when the stakes are higher. If students are not motivated, then their performance is likely to be impacted by factors unrelated to their (construct-relevant) ability ( Lane and Stone, 2006 ; Braun et al., 2011 ; Shavelson, 2013 ). Differential motivation across groups can also bias comparisons. Student motivation might be enhanced if the PT is administered in the context of a course with the promise of generating useful feedback on students’ skill profiles.

Construct-irrelevant variance can also occur when students are not equally prepared for the format of the PT or fully appreciate the response requirements. This source of CIV could be alleviated by providing students with practice PT’s. Finally, the use of novel forms of documentation, such as those from the Internet, can potentially introduce CIV due to differential familiarity with forms of representation or contents. Interestingly, this suggests that there may be a conflict between enhancing construct representation and reducing CIV.

Another potential source of CIV is related to response evaluation. Even with training, human raters can vary in accuracy and usage of the full score range. In addition, raters may attend to features of responses that are unrelated to the target construct, such as the length of the students’ responses or the frequency of grammatical errors ( Lane and Stone, 2006 ). Some of these sources of variance could be addressed in an online environment, where word processing software could alert students to potential grammatical and spelling errors before they submit their final work product.

Performance tasks generally take longer to administer and are more costly than traditional assessments, making it more difficult to reliably measure student performance ( Messick, 1994 ; Davey et al., 2015 ). Indeed, it is well known that more than one performance task is needed to obtain high reliability ( Shavelson, 2013 ). This is due to both student-task interactions and variability in scoring. Sources of student-task interactions are differential familiarity with the topic ( Hyytinen and Toom, 2019 ) and differential motivation to engage with the task. The level of reliability required, however, depends on the context of use. For use in formative assessment as part of an instructional program, reliability can be lower than use for summative purposes. In the former case, other types of evidence are generally available to support interpretation and guide pedagogical decisions. Further studies are needed to obtain estimates of reliability in typical instructional settings.

With sufficient data, more sophisticated psychometric analyses become possible. One challenge is that the assumption of unidimensionality required for many psychometric models might be untenable for performance tasks ( Davey et al., 2015 ). Davey et al. (2015) provide the example of a mathematics assessment that requires students to demonstrate not only their mathematics skills but also their written communication skills. Although the iPAL framework does not explicitly address students’ reading comprehension and organization skills, students will likely need to call on these abilities to accomplish the task. Moreover, as the operational definition of CT makes evident, the student must not only deploy several skills in responding to the challenge of the PT, but also carry out component tasks in sequence. The former requirement strongly indicates the need for a multi-dimensional IRT model, while the latter suggests that the usual assumption of local item independence may well be problematic ( Lane and Stone, 2006 ). At the same time, the analytic scoring rubric should facilitate the use of latent class analysis to partition data from large groups into meaningful categories ( Zlatkin-Troitschanskaia et al., 2019 ).

Future Perspectives

Although the iPAL consortium has made substantial progress in the assessment of CT, much remains to be done. Further refinement of existing PT’s and their adaptation to different languages and cultures must continue. To this point, there are a number of examples: The refugee crisis PT (cited in Table 1 ) was translated and adapted from Finnish to US English and then to Colombian Spanish. A PT concerning kidney transplants was translated and adapted from German to US English. Finally, two PT’s based on ‘legacy admissions’ to US colleges were translated and adapted to Colombian Spanish.

With respect to data collection, there is a need for sufficient data to support psychometric analysis of student responses, especially the relationships among the different components of the scoring rubric, as this would inform both task development and response evaluation ( Zlatkin-Troitschanskaia et al., 2019 ). In addition, more intensive study of response processes through cognitive laboratories and the like are needed to strengthen the evidential argument for construct validity ( Leighton, 2019 ). We are currently conducting empirical studies, collecting data on both iPAL PT’s and other measures of CT. These studies will provide evidence of convergent and discriminant validity.

At the same time, efforts should be directed at further development to support different ways CT PT’s might be used—i.e., use cases—especially those that call for formative use of PT’s. Incorporating formative assessment into courses can plausibly be expected to improve students’ competency acquisition ( Zlatkin-Troitschanskaia et al., 2017 ). With suitable choices of storylines, appropriate combinations of (modified) PT’s, supplemented by short-answer and multiple-choice items, could be interwoven into ordinary classroom activities. The supplementary items may be completely separate from the PT’s (as is the case with the CLA+), loosely coupled with the PT’s (as in drawing on the same storyline), or tightly linked to the PT’s (as in requiring elaboration of certain components of the response to the PT).

As an alternative to such integration, stand-alone modules could be embedded in courses to yield evidence of students’ generic CT skills. Core curriculum courses or general education courses offer ideal settings for embedding performance assessments. If these assessments were administered to a representative sample of students in each cohort over their years in college, the results would yield important information on the development of CT skills at a population level. For another example, these PA’s could be used to assess the competence profiles of students entering Bachelor’s or graduate-level programs as a basis for more targeted instructional support.

Thus, in considering different use cases for the assessment of CT, it is evident that several modifications of the iPAL omnibus assessment framework are needed. As noted earlier, assessments built according to this framework are demanding with respect to the extensive preliminary work required by a task and the time required to properly complete it. Thus, it would be helpful to have modified versions of the framework, focusing on one or two facets of the CT construct and calling for a smaller number of supplementary documents. The challenge to the student should be suitably reduced.

Some members of the iPAL collaborative have developed PT’s that are embedded in disciplines such as engineering, law and education ( Crump et al., 2019 ; for teacher education examples, see Jeschke et al., 2019 ). These are proving to be of great interest to various stakeholders and further development is likely. Consequently, it is essential that an appropriate assessment framework be established and implemented. It is both a conceptual and an empirical question as to whether a single framework can guide development in different domains.

Performance Assessment in Online Learning Environment

Over the last 15 years, increasing amounts of time in both college and work are spent using computers and other electronic devices. This has led to formulation of models for the new literacies that attempt to capture some key characteristics of these activities. A prominent example is a model proposed by Leu et al. (2020) . The model frames online reading as a process of problem-based inquiry that calls on five practices to occur during online research and comprehension:

1. Reading to identify important questions,

2. Reading to locate information,

3. Reading to critically evaluate information,

4. Reading to synthesize online information, and

5. Reading and writing to communicate online information.

The parallels with the iPAL definition of CT are evident and suggest there may be benefits to closer links between these two lines of research. For example, a report by Leu et al. (2014) describes empirical studies comparing assessments of online reading using either open-ended or multiple-choice response formats.

The iPAL consortium has begun to take advantage of the affordances of the online environment (for examples, see Schmidt et al. and Nagel et al. in this special issue). Most obviously, Supplementary Materials can now include archival photographs, audio recordings, or videos. Additional tasks might include the online search for relevant documents, though this would add considerably to the time demands. This online search could occur within a simulated Internet environment, as is the case for the IEA’s ePIRLS assessment ( Mullis et al., 2017 ).

The prospect of having access to a wealth of materials that can add to task authenticity is exciting. Yet it can also add ambiguity and information overload. Increased authenticity, then, should be weighed against validity concerns and the time required to absorb the content in these materials. Modifications of the design framework and extensive empirical testing will be required to decide on appropriate trade-offs. A related possibility is to employ some of these materials in short-answer (or even selected-response) items that supplement the main PT. Response formats could include highlighting text or using a drag-and-drop menu to construct a response. Students’ responses could be automatically scored, thereby containing costs. With automated scoring, feedback to students and faculty, including suggestions for next steps in strengthening CT skills, could also be provided without adding to faculty workload. Therefore, taking advantage of the online environment to incorporate new types of supplementary documents should be a high priority and, perhaps, to introduce new response formats as well. Finally, further investigation of the overlap between this formulation of CT and the characterization of online reading promulgated by Leu et al. (2020) is a promising direction to pursue.

Data Availability Statement

All datasets generated for this study are included in the article/supplementary material.

Author Contributions

HB wrote the article. RS, OZ-T, and KB were involved in the preparation and revision of the article and co-wrote the manuscript. All authors contributed to the article and approved the submitted version.

This study was funded in part by the Spencer Foundation (Grant No. #201700123).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We would like to thank all the researchers who have participated in the iPAL program.

• ^ https://www.ipal-rd.com/
• ^ https://www.aacu.org/value
• ^ When test results are reported by means of substantively defined categories, the scoring is termed “criterion-referenced”. This is, in contrast to results, reported as percentiles; such scoring is termed “norm-referenced”.

American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for Educational and Psychological Testing. Washington, D.C: American Educational Research Association.

Google Scholar

Arum, R., and Roksa, J. (2011). Academically Adrift: Limited Learning on College Campuses. Chicago, IL: University of Chicago Press.

Association of American Colleges and Universities (n.d.). VALUE: What is value?. Available online at:: https://www.aacu.org/value (accessed May 7, 2020).

Association of American Colleges and Universities [AACU] (2018). Fulfilling the American Dream: Liberal Education and the Future of Work. Available online at:: https://www.aacu.org/research/2018-future-of-work (accessed May 1, 2020).

Braun, H. (2019). Performance assessment and standardization in higher education: a problematic conjunction? Br. J. Educ. Psychol. 89, 429–440. doi: 10.1111/bjep.12274

PubMed Abstract | CrossRef Full Text | Google Scholar

Braun, H. I., Kirsch, I., and Yamoto, K. (2011). An experimental study of the effects of monetary incentives on performance on the 12th grade NAEP reading assessment. Teach. Coll. Rec. 113, 2309–2344.

Crump, N., Sepulveda, C., Fajardo, A., and Aguilera, A. (2019). Systematization of performance tests in critical thinking: an interdisciplinary construction experience. Rev. Estud. Educ. 2, 17–47.

Davey, T., Ferrara, S., Shavelson, R., Holland, P., Webb, N., and Wise, L. (2015). Psychometric Considerations for the Next Generation of Performance Assessment. Washington, DC: Center for K-12 Assessment & Performance Management, Educational Testing Service.

Erwin, T. D., and Sebrell, K. W. (2003). Assessment of critical thinking: ETS’s tasks in critical thinking. J. Gen. Educ. 52, 50–70. doi: 10.1353/jge.2003.0019

CrossRef Full Text | Google Scholar

Haertel, G. D., and Fujii, R. (2017). “Evidence-centered design and postsecondary assessment,” in Handbook on Measurement, Assessment, and Evaluation in Higher Education , 2nd Edn, eds C. Secolsky and D. B. Denison (Abingdon: Routledge), 313–339. doi: 10.4324/9781315709307-26

Hyytinen, H., and Toom, A. (2019). Developing a performance assessment task in the Finnish higher education context: conceptual and empirical insights. Br. J. Educ. Psychol. 89, 551–563. doi: 10.1111/bjep.12283

Hyytinen, H., Toom, A., and Shavelson, R. J. (2019). “Enhancing scientific thinking through the development of critical thinking in higher education,” in Redefining Scientific Thinking for Higher Education: Higher-Order Thinking, Evidence-Based Reasoning and Research Skills , eds M. Murtonen and K. Balloo (London: Palgrave MacMillan).

Indiana University (2019). FSSE 2019 Frequencies: FSSE 2019 Aggregate. Available online at:: http://fsse.indiana.edu/pdf/FSSE_IR_2019/summary_tables/FSSE19_Frequencies_(FSSE_2019).pdf (accessed May 1, 2020).

Jeschke, C., Kuhn, C., Lindmeier, A., Zlatkin-Troitschanskaia, O., Saas, H., and Heinze, A. (2019). Performance assessment to investigate the domain specificity of instructional skills among pre-service and in-service teachers of mathematics and economics. Br. J. Educ. Psychol. 89, 538–550. doi: 10.1111/bjep.12277

Kegan, R. (1994). In Over Our Heads: The Mental Demands of Modern Life. Cambridge, MA: Harvard University Press.

Klein, S., Benjamin, R., Shavelson, R., and Bolus, R. (2007). The collegiate learning assessment: facts and fantasies. Eval. Rev. 31, 415–439. doi: 10.1177/0193841x07303318

Kosslyn, S. M., and Nelson, B. (2017). Building the Intentional University: Minerva and the Future of Higher Education. Cambridge, MAL: The MIT Press.

Lane, S., and Stone, C. A. (2006). “Performance assessment,” in Educational Measurement , 4th Edn, ed. R. L. Brennan (Lanham, MA: Rowman & Littlefield Publishers), 387–432.

Leighton, J. P. (2019). The risk–return trade-off: performance assessments and cognitive validation of inferences. Br. J. Educ. Psychol. 89, 441–455. doi: 10.1111/bjep.12271

Leu, D. J., Kiili, C., Forzani, E., Zawilinski, L., McVerry, J. G., and O’Byrne, W. I. (2020). “The new literacies of online research and comprehension,” in The Concise Encyclopedia of Applied Linguistics , ed. C. A. Chapelle (Oxford: Wiley-Blackwell), 844–852.

Leu, D. J., Kulikowich, J. M., Kennedy, C., and Maykel, C. (2014). “The ORCA Project: designing technology-based assessments for online research,” in Paper Presented at the American Educational Research Annual Meeting , Philadelphia, PA.

Liu, O. L., Frankel, L., and Roohr, K. C. (2014). Assessing critical thinking in higher education: current state and directions for next-generation assessments. ETS Res. Rep. Ser. 1, 1–23. doi: 10.1002/ets2.12009

McClelland, D. C. (1973). Testing for competence rather than for “intelligence.”. Am. Psychol. 28, 1–14. doi: 10.1037/h0034092

McGrew, S., Ortega, T., Breakstone, J., and Wineburg, S. (2017). The challenge that’s bigger than fake news: civic reasoning in a social media environment. Am. Educ. 4, 4-9, 39.

Mejía, A., Mariño, J. P., and Molina, A. (2019). Incorporating perspective analysis into critical thinking performance assessments. Br. J. Educ. Psychol. 89, 456–467. doi: 10.1111/bjep.12297

Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educ. Res. 23, 13–23. doi: 10.3102/0013189x023002013

Mislevy, R. J., Almond, R. G., and Lukas, J. F. (2003). A brief introduction to evidence-centered design. ETS Res. Rep. Ser. 2003, i–29. doi: 10.1002/j.2333-8504.2003.tb01908.x

Mislevy, R. J., and Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educ. Meas. Issues Pract. 25, 6–20. doi: 10.1111/j.1745-3992.2006.00075.x

Mullis, I. V. S., Martin, M. O., Foy, P., and Hooper, M. (2017). ePIRLS 2016 International Results in Online Informational Reading. Available online at:: http://timssandpirls.bc.edu/pirls2016/international-results/ (accessed May 1, 2020).

Nagel, M.-T., Zlatkin-Troitschanskaia, O., Schmidt, S., and Beck, K. (2020). “Performance assessment of generic and domain-specific skills in higher education economics,” in Student Learning in German Higher Education , eds O. Zlatkin-Troitschanskaia, H. A. Pant, M. Toepper, and C. Lautenbach (Berlin: Springer), 281–299. doi: 10.1007/978-3-658-27886-1_14

Organisation for Economic Co-operation and Development [OECD] (2012). AHELO: Feasibility Study Report , Vol. 1. Paris: OECD. Design and implementation.

Organisation for Economic Co-operation and Development [OECD] (2013). AHELO: Feasibility Study Report , Vol. 2. Paris: OECD. Data analysis and national experiences.

Oser, F. K., and Biedermann, H. (2020). “A three-level model for critical thinking: critical alertness, critical reflection, and critical analysis,” in Frontiers and Advances in Positive Learning in the Age of Information (PLATO) , ed. O. Zlatkin-Troitschanskaia (Cham: Springer), 89–106. doi: 10.1007/978-3-030-26578-6_7

Paul, R., and Elder, L. (2007). Consequential validity: using assessment to drive instruction. Found. Crit. Think. 29, 31–40.

Pellegrino, J. W., and Hilton, M. L. (eds) (2012). Education for life and work: Developing Transferable Knowledge and Skills in the 21st Century. Washington DC: National Academies Press.

Shavelson, R. (2010). Measuring College Learning Responsibly: Accountability in a New Era. Redwood City, CA: Stanford University Press.

Shavelson, R. J. (2013). On an approach to testing and modeling competence. Educ. Psychol. 48, 73–86. doi: 10.1080/00461520.2013.779483

Shavelson, R. J., Zlatkin-Troitschanskaia, O., Beck, K., Schmidt, S., and Marino, J. P. (2019). Assessment of university students’ critical thinking: next generation performance assessment. Int. J. Test. 19, 337–362. doi: 10.1080/15305058.2018.1543309

Shavelson, R. J., Zlatkin-Troitschanskaia, O., and Marino, J. P. (2018). “International performance assessment of learning in higher education (iPAL): research and development,” in Assessment of Learning Outcomes in Higher Education: Cross-National Comparisons and Perspectives , eds O. Zlatkin-Troitschanskaia, M. Toepper, H. A. Pant, C. Lautenbach, and C. Kuhn (Berlin: Springer), 193–214. doi: 10.1007/978-3-319-74338-7_10

Shavelson, R. J., Klein, S., and Benjamin, R. (2009). The limitations of portfolios. Inside Higher Educ. Available online at: https://www.insidehighered.com/views/2009/10/16/limitations-portfolios

Stolzenberg, E. B., Eagan, M. K., Zimmerman, H. B., Berdan Lozano, J., Cesar-Davis, N. M., Aragon, M. C., et al. (2019). Undergraduate Teaching Faculty: The HERI Faculty Survey 2016–2017. Los Angeles, CA: UCLA.

Tessier-Lavigne, M. (2020). Putting Ethics at the Heart of Innovation. Stanford, CA: Stanford Magazine.

Wheeler, P., and Haertel, G. D. (1993). Resource Handbook on Performance Assessment and Measurement: A Tool for Students, Practitioners, and Policymakers. Palm Coast, FL: Owl Press.

Wineburg, S., McGrew, S., Breakstone, J., and Ortega, T. (2016). Evaluating Information: The Cornerstone of Civic Online Reasoning. Executive Summary. Stanford, CA: Stanford History Education Group.

Zahner, D. (2013). Reliability and Validity–CLA+. Council for Aid to Education. Available online at:: https://pdfs.semanticscholar.org/91ae/8edfac44bce3bed37d8c9091da01d6db3776.pdf .

Zlatkin-Troitschanskaia, O., and Shavelson, R. J. (2019). Performance assessment of student learning in higher education [Special issue]. Br. J. Educ. Psychol. 89, i–iv, 413–563.

Zlatkin-Troitschanskaia, O., Pant, H. A., Lautenbach, C., Molerov, D., Toepper, M., and Brückner, S. (2017). Modeling and Measuring Competencies in Higher Education: Approaches to Challenges in Higher Education Policy and Practice. Berlin: Springer VS.

Zlatkin-Troitschanskaia, O., Pant, H. A., Toepper, M., and Lautenbach, C. (eds) (2020). Student Learning in German Higher Education: Innovative Measurement Approaches and Research Results. Wiesbaden: Springer.

Zlatkin-Troitschanskaia, O., Shavelson, R. J., and Pant, H. A. (2018). “Assessment of learning outcomes in higher education: international comparisons and perspectives,” in Handbook on Measurement, Assessment, and Evaluation in Higher Education , 2nd Edn, eds C. Secolsky and D. B. Denison (Abingdon: Routledge), 686–697.

Zlatkin-Troitschanskaia, O., Shavelson, R. J., Schmidt, S., and Beck, K. (2019). On the complementarity of holistic and analytic approaches to performance assessment scoring. Br. J. Educ. Psychol. 89, 468–484. doi: 10.1111/bjep.12286

Keywords : critical thinking, performance assessment, assessment framework, scoring rubric, evidence-centered design, 21st century skills, higher education

Citation: Braun HI, Shavelson RJ, Zlatkin-Troitschanskaia O and Borowiec K (2020) Performance Assessment of Critical Thinking: Conceptualization, Design, and Implementation. Front. Educ. 5:156. doi: 10.3389/feduc.2020.00156

Received: 30 May 2020; Accepted: 04 August 2020; Published: 08 September 2020.

Reviewed by:

Copyright © 2020 Braun, Shavelson, Zlatkin-Troitschanskaia and Borowiec. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Henry I. Braun, [email protected]

This article is part of the Research Topic

Assessing Information Processing and Online Reasoning as a Prerequisite for Learning in Higher Education

• How to apply critical thinking in learning

Sometimes your university classes might feel like a maze of information. Consider critical thinking skills like a map that can lead the way.

Why do we need critical thinking?  

Critical thinking is a type of thinking that requires continuous questioning, exploring answers, and making judgments. Critical thinking can help you: 

• analyze information to comprehend more thoroughly
• approach problems systematically, identify root causes, and explore potential solutions 
• make informed decisions by weighing various perspectives 
• promote intellectual curiosity and self-reflection, leading to continuous learning, innovation, and personal development 

What is the process of critical thinking? 

1. understand  .

Critical thinking starts with understanding the content that you are learning.

This step involves clarifying the logic and interrelations of the content by actively engaging with the materials (e.g., text, articles, and research papers). You can take notes, highlight key points, and make connections with prior knowledge to help you engage.

Ask yourself these questions to help you build your understanding:  

• What is the structure?
• What is the main idea of the content?  
• What is the evidence that supports any arguments?
• What is the conclusion?

2. Analyze  

You need to assess the credibility, validity, and relevance of the information presented in the content. Consider the authors’ biases and potential limitations in the evidence. 

Ask yourself questions in terms of why and how:

• What is the supporting evidence?  
• Why do they use it as evidence?   
• How does the data present support the conclusions?  
• What method was used? Was it appropriate?  

 3.  Evaluate   

After analyzing the data and evidence you collected, make your evaluation of the evidence, results, and conclusions made in the content.

Consider the weaknesses and strengths of the ideas presented in the content to make informed decisions or suggest alternative solutions:

• What is the gap between the evidence and the conclusion?  
• What is my position on the subject?  
• What other approaches can I use?  

When do you apply critical thinking and how can you improve these skills?   

1. reading academic texts, articles, and research papers.

• analyze arguments
• assess the credibility and validity of evidence
• consider potential biases presented
• question the assumptions, methodologies, and the way they generate conclusions

2. Writing essays and theses

• demonstrate your understanding of the information, logic of evidence, and position on the topic
• include evidence or examples to support your ideas
• make your standing points clear by presenting information and providing reasons to support your arguments
• address potential counterarguments or opposing viewpoints
• explain why your perspective is more compelling than the opposing viewpoints

3. Attending lectures

• understand the content by previewing, active listening , and taking notes
• analyze your lecturer’s viewpoints by seeking whether sufficient data and resources are provided
• think about whether the ideas presented by the lecturer align with your values and beliefs
• talk about other perspectives with peers in discussions

Related blog posts

• A beginner's guide to successful labs
• A beginner's guide to note-taking
• 5 steps to get the most out of your next reading
• How do you create effective study questions?
• An epic approach to problem-based test questions

Recent blog posts

Blog topics.

• assignments (1)
• Graduate (2)
• Learning support (25)
• note-taking and reading (6)
• organizations (1)
• tests and exams (8)
• time management (3)
• Tips from students (6)
• undergraduate (27)
• university learning (10)

Blog posts by audience

• Current undergraduate students (27)
• Current graduate students (3)
• Future undergraduate students (9)
• Future graduate students (1)

Blog posts archive

• December (1)
• November (6)
• October (8)
• August (10)

Contact the Student Success Office

South Campus Hall, second floor University of Waterloo 519-888-4567 ext. 84410

Immigration Consulting

Book a same-day appointment on Portal  or submit an online inquiry  to receive immigration support.

Request an authorized leave from studies for immigration purposes. 

Quick links

Current student resources

SSO staff links

Employment and volunteer opportunities

• Contact Waterloo
• Maps & Directions
• Accessibility

The University of Waterloo acknowledges that much of our work takes place on the traditional territory of the Neutral, Anishinaabeg and Haudenosaunee peoples. Our main campus is situated on the Haldimand Tract, the land granted to the Six Nations that includes six miles on each side of the Grand River. Our active work toward reconciliation takes place across our campuses through research, learning, teaching, and community building, and is co-ordinated within the Office of Indigenous Relations .

Why Schools Need to Change Yes, We Can Define, Teach, and Assess Critical Thinking Skills

Jeff Heyck-Williams (He, His, Him) Director of the Two Rivers Learning Institute in Washington, DC

Today’s learners face an uncertain present and a rapidly changing future that demand far different skills and knowledge than were needed in the 20th century. We also know so much more about enabling deep, powerful learning than we ever did before. Our collective future depends on how well young people prepare for the challenges and opportunities of 21st-century life.

Critical thinking is a thing. We can define it; we can teach it; and we can assess it.

While the idea of teaching critical thinking has been bandied around in education circles since at least the time of John Dewey, it has taken greater prominence in the education debates with the advent of the term “21st century skills” and discussions of deeper learning. There is increasing agreement among education reformers that critical thinking is an essential ingredient for long-term success for all of our students.

However, there are still those in the education establishment and in the media who argue that critical thinking isn’t really a thing, or that these skills aren’t well defined and, even if they could be defined, they can’t be taught or assessed.

To those naysayers, I have to disagree. Critical thinking is a thing. We can define it; we can teach it; and we can assess it. In fact, as part of a multi-year Assessment for Learning Project , Two Rivers Public Charter School in Washington, D.C., has done just that.

Before I dive into what we have done, I want to acknowledge that some of the criticism has merit.

First, there are those that argue that critical thinking can only exist when students have a vast fund of knowledge. Meaning that a student cannot think critically if they don’t have something substantive about which to think. I agree. Students do need a robust foundation of core content knowledge to effectively think critically. Schools still have a responsibility for building students’ content knowledge.

However, I would argue that students don’t need to wait to think critically until after they have mastered some arbitrary amount of knowledge. They can start building critical thinking skills when they walk in the door. All students come to school with experience and knowledge which they can immediately think critically about. In fact, some of the thinking that they learn to do helps augment and solidify the discipline-specific academic knowledge that they are learning.

The second criticism is that critical thinking skills are always highly contextual. In this argument, the critics make the point that the types of thinking that students do in history is categorically different from the types of thinking students do in science or math. Thus, the idea of teaching broadly defined, content-neutral critical thinking skills is impossible. I agree that there are domain-specific thinking skills that students should learn in each discipline. However, I also believe that there are several generalizable skills that elementary school students can learn that have broad applicability to their academic and social lives. That is what we have done at Two Rivers.

Defining Critical Thinking Skills

We began this work by first defining what we mean by critical thinking. After a review of the literature and looking at the practice at other schools, we identified five constructs that encompass a set of broadly applicable skills: schema development and activation; effective reasoning; creativity and innovation; problem solving; and decision making.

We then created rubrics to provide a concrete vision of what each of these constructs look like in practice. Working with the Stanford Center for Assessment, Learning and Equity (SCALE) , we refined these rubrics to capture clear and discrete skills.

For example, we defined effective reasoning as the skill of creating an evidence-based claim: students need to construct a claim, identify relevant support, link their support to their claim, and identify possible questions or counter claims. Rubrics provide an explicit vision of the skill of effective reasoning for students and teachers. By breaking the rubrics down for different grade bands, we have been able not only to describe what reasoning is but also to delineate how the skills develop in students from preschool through 8th grade.

Before moving on, I want to freely acknowledge that in narrowly defining reasoning as the construction of evidence-based claims we have disregarded some elements of reasoning that students can and should learn. For example, the difference between constructing claims through deductive versus inductive means is not highlighted in our definition. However, by privileging a definition that has broad applicability across disciplines, we are able to gain traction in developing the roots of critical thinking. In this case, to formulate well-supported claims or arguments.

Teaching Critical Thinking Skills

The definitions of critical thinking constructs were only useful to us in as much as they translated into practical skills that teachers could teach and students could learn and use. Consequently, we have found that to teach a set of cognitive skills, we needed thinking routines that defined the regular application of these critical thinking and problem-solving skills across domains. Building on Harvard’s Project Zero Visible Thinking work, we have named routines aligned with each of our constructs.

For example, with the construct of effective reasoning, we aligned the Claim-Support-Question thinking routine to our rubric. Teachers then were able to teach students that whenever they were making an argument, the norm in the class was to use the routine in constructing their claim and support. The flexibility of the routine has allowed us to apply it from preschool through 8th grade and across disciplines from science to economics and from math to literacy.

Kathryn Mancino, a 5th grade teacher at Two Rivers, has deliberately taught three of our thinking routines to students using the anchor charts above. Her charts name the components of each routine and has a place for students to record when they’ve used it and what they have figured out about the routine. By using this structure with a chart that can be added to throughout the year, students see the routines as broadly applicable across disciplines and are able to refine their application over time.

Assessing Critical Thinking Skills

By defining specific constructs of critical thinking and building thinking routines that support their implementation in classrooms, we have operated under the assumption that students are developing skills that they will be able to transfer to other settings. However, we recognized both the importance and the challenge of gathering reliable data to confirm this.

With this in mind, we have developed a series of short performance tasks around novel discipline-neutral contexts in which students can apply the constructs of thinking. Through these tasks, we have been able to provide an opportunity for students to demonstrate their ability to transfer the types of thinking beyond the original classroom setting. Once again, we have worked with SCALE to define tasks where students easily access the content but where the cognitive lift requires them to demonstrate their thinking abilities.

These assessments demonstrate that it is possible to capture meaningful data on students’ critical thinking abilities. They are not intended to be high stakes accountability measures. Instead, they are designed to give students, teachers, and school leaders discrete formative data on hard to measure skills.

While it is clearly difficult, and we have not solved all of the challenges to scaling assessments of critical thinking, we can define, teach, and assess these skills . In fact, knowing how important they are for the economy of the future and our democracy, it is essential that we do.

Jeff Heyck-Williams (He, His, Him)

Director of the two rivers learning institute.

Jeff Heyck-Williams is the director of the Two Rivers Learning Institute and a founder of Two Rivers Public Charter School. He has led work around creating school-wide cultures of mathematics, developing assessments of critical thinking and problem-solving, and supporting project-based learning.

Read More About Why Schools Need to Change

Bring Your Vision for Student Success to Life with NGLC and Bravely

March 13, 2024

For Ethical AI, Listen to Teachers

Jason Wilmot

October 23, 2023

Turning School Libraries into Discipline Centers Is Not the Answer to Disruptive Classroom Behavior

Stephanie McGary

October 4, 2023

• LEARNING SKILLS
• EXAM SKILLS

Search SkillsYouNeed:

Learning Skills:

• A - Z List of Learning Skills
• What is Learning?
• Learning Approaches
• Learning Styles
• 8 Types of Learning Styles
• Understanding Your Preferences to Aid Learning
• Lifelong Learning
• Decisions to Make Before Applying to University
• Top Tips for Surviving Student Life
• Living Online: Education and Learning
• 8 Ways to Embrace Technology-Based Learning Approaches
• Critical Thinking Skills
• Critical Thinking and Fake News
• Understanding and Addressing Conspiracy Theories
• Critical Analysis
• Study Skills

Exam Skills

• Revision Skills
• Revision Skills and Learning Style
• Avoiding Distractions While Revising
• Last Minute Exam Revision Tips
• Top Exam Preparation Tips

Taking Exams

• Avoiding Common Exam Mistakes
• Staying Healthy During Exam Time
• 7 Tips to Boost Your Confidence in Exams

Get the SkillsYouNeed Study Skills eBook

Part of the Skills You Need Guide for Students .

• Writing a Dissertation or Thesis
• Research Methods
• Teaching, Coaching, Mentoring and Counselling
• Employability Skills for Graduates

Subscribe to our FREE newsletter and start improving your life in just 5 minutes a day.

You'll get our 5 free 'One Minute Life Skills' and our weekly newsletter.

We'll never share your email address and you can unsubscribe at any time.

Exams have been a fact of life for many years, and for almost all of us. After a brief period favouring coursework, the pendulum has swung firmly back in favour of exams in many countries. You now need to be able to pass exams to get through school, to graduate from college (and in some cases, to enter it), and to enter many professions.

It is, therefore, essential to develop the skills you need to prepare for, take and pass exams. Fortunately, like any others, these can be learned. This section of Skills You Need provides help and advice to enable you to do so.

Preparing for Exams: Revision Skills

Revision literally means ‘looking again’.

It is, therefore, the process of going over your previous work, as a way to remind yourself of what you have covered.

The Importance of Putting in the Groundwork

It follows from the definition of ‘revision’ that you cannot simply start your studying at the point of starting revision.

The process of passing exams actually starts with your first step into a classroom or lecture theatre, or the first time you open a textbook.

You have to put in the groundwork throughout your course if you are to do well in exams. Unfortunately, there are no shortcuts.

There is more about how to study effectively, including setting up your study space and carving out time for studying, in our pages on Study Skills .

Perhaps the most important part of revision—and often also the most difficult—is simply getting started.

It is easy to allow yourself to get distracted, to decide that you just don’t feel good enough today, or that there’s plenty of time. The best thing to do is just to get on with it. Just getting started will be a huge boost to your confidence.

Once started, the main keys to revision for most people are doing little and often, and making sure you give your brain plenty of variety to keep yourself engaged. In practice, this means:

Not focusing on any subject for too long . Instead, consider changing subjects after 30 minutes or an hour.

Having regular breaks in your studying . Give yourself a five-minute break after 30 minutes, or ten minutes if you have managed to work for an hour. However, be honest with yourself, and don’t let that five minutes stretch into 20 minutes!

Doing plenty of different activities. Don’t just spend all your time reading over your notes. Try lots of different activities and mix them up during your study time. Possible activities include writing down ten bullet points about each topic you have revised, having discussions with friends about particular issues, doing some practice essays or questions, and drawing a mindmap of everything you can remember about a particular topic.

There are more ideas about different ways to revise in our page on Revision Skills .

Remember your Learning Style—and use it when revising

Our page on Learning Styles describes some different models of learning, including Honey and Mumford’s model, and the Visual–Auditory–Kinaesthetic Model based on neuro-linguistic programming.

There is very little strong evidence about the effect of learning styles in education—though this is mostly because it is very hard to design randomised trials.

However, there is little doubt that we all like to learn in slightly different ways. Finding out more about different models, and different ways of learning, will give you more ideas about alternative ways to revise—and that can only be good.

There is more about this in our page on Revisions Skills and Learning Style .

Avoiding Distractions

It is also important to avoid getting distracted while revising.

There are no hard and fast rules about how to manage this, but some useful tips include:

Have a specific place where you work, which is free from the obvious distractions .

Limit your access to technology . If you need your phone or computer to revise, then turn off notifications and disable social media for a few hours.

Keep your revision time limited . It is much easier to keep concentrating if you know that your revision period will last a set time.

There are more ideas for this in our page on Avoiding Distractions while Revising .

Leading Up to Exams: Final Preparations

It is ideal to use the last 24 hours before your exam to consolidate your revision.

Ideally, aim to go over summaries and mindmaps, rather than looking at your full notes again. Concentrate on consolidating your learning: check and confirm what you have learned, rather than trying to cram in any more information.

It’s still not too late

What if you have left all your revision to the last minute? Or perhaps you got the date of your exam wrong, and you are desperately trying to catch up?

Don’t panic.

There is still time to do some work.

If you are facing this situation, it is probably best to focus on just three or four main areas of work. Focus on summarising and learning them—and then hope that they come up in the exam .

Of course if they don’t, you will struggle—but there will almost certainly be an opportunity to retake if necessary, and/or it will be a useful lesson not to leave things to the last minute.

Above all, whether or not you have left your revision to the last minute, DON’T PANIC. You will get more done if you stay calm. Try to avoid anyone else who is getting stressed too—which may mean NOT being in touch with your friends at this stage.

There are more useful tips for the last 24 hours before your exam in our page on Last Minute Exam Revision Tips .

All the advice on this page is summed up in our page on Top Exam Preparation Tips . You may therefore find it a helpful aide memoire to ensure that there is nothing that you have forgotten.

Finally, before you go to bed the night before your exam, make sure that you are fully ready to leave in the morning—and that you know where you are going and when.

Check the location and time of your exam. Get all your pens and any other equipment ready (in a clear pencil case or plastic bag if that is required). Make sure that you have a timer that is NOT your phone, and find your lucky mascot, if you have one. If you need to wear a uniform or any special clothes, get them out and ready.

If you have to drive or cycle, check your car or bike is ready, and has enough fuel/no punctures. If you are using public transport, have you got your travelcard/other means of paying?

Make your own life easy, because you really don’t need to be stressed in the morning.

The day of your exam has finally arrived. The preparation is over, and the time has come.

The most important thing to remember is STAY CALM.

No matter what happens, nothing will be improved if you panic.

It doesn’t matter whether the car won’t start, the exam hall is struck by lightning, or you can’t answer any questions—none of these situations will be improved by panic. What, after all, is the worst thing that can happen? You might fail. If so, there will almost certainly be a chance to retake, or a different door will open.

Here’s a little secret: nobody actually wants anyone to fail an exam.

It’s not good for your school or university, or for the exam boards. They actually want everyone to pass, because then everyone is happy.

Case study: The nightmare finals paper, or when NOT to panic

Jenny entered the exam hall on the second day of her university finals feeling reasonably confident. She had done one exam out of five now, and it had been OK. She knew where the exam room was, and how the process worked. Surely things could only get better?

“You may begin now,” the examiner said, at 9.30 on the dot.

There was a rustle of paper as everyone uncovered their exam paper and started to read the questions. Jenny read through the first page without finding any questions she felt confident about answering, and turned over the paper to read the rest—only to discover that there were no more.

She felt rising panic. She genuinely couldn’t answer any questions! What was she going to do? Should she just leave?

She quelled the panic firmly and reread the questions. This time, she found one that she could write something about. She settled down to plan, and then write, her essay.

After 40 minutes, she had written everything she knew about that topic, regardless of whether it was relevant. She could see other people shaking their heads, and not writing very much. Grimly, she turned to the paper again to identify another question. One student left after an hour, but most of the rest stayed for the full three hours, and kept writing. Afterwards, comparing notes, they all agreed that it had been awful.

However, it turned out that low marks are not a problem when everyone gets them. Zero marks—such as you get if you leave the room without writing anything—are more of an issue.

How to Succeed at Exams

One of the best ways to learn how to manage during exams is to look at what NOT to do: the common mistakes made in exams. Apart from panicking, these include:

Not answering the question

This is usually because you have misread the question, or have prepared a slightly different essay. Always make sure that you read the questions several times, and check your answer back against the question at the end.

Failing to notice the obvious clues

This might include both clues in the question itself (for example, ignoring words like ‘Analyse…’ or ‘illustrating your answer with evidence from x ’. However, it also includes the mark scheme or the number of questions. If you have a question worth 15 points, you will need to give more than a one-sentence answer.

Failing to plan ahead

You need to plan both your time and any essays that you have to write. Take a moment to work out how long you have for each question before you start—and make sure that you don’t take more time than this. If you are writing essays, plan them briefly before you start, to make sure that you have a sensible argument and structure. This will also mean that you might get some credit for your ideas even if you don’t have time to finish your essay.

There are more common mistakes to avoid in our page on Avoiding Common Exam Mistakes . You may also find it helpful to look at our page on Taking Exams , which explains what you should do, as well as what to avoid.

The Importance of Looking After Yourself

During both revision and exams, it is vital that you do not neglect your health.

You will NOT be able to perform at your best unless you look after your mental and physical health.

That means, in particular:

• Getting enough sleep;
• Making sure that you eat well and healthily—which means not living on junk food; and
• Getting at least some fresh air and exercise each day, even if it is only a walk around the block.

There is more about this in our page on Staying Healthy During Exams . You may also find some useful ideas on our page Tips to Boost your Confidence in Exams .

Further Reading from Skills You Need

The Skills You Need Guide for Students

Develop the skills you need to make the most of your time as a student.

Our eBooks are ideal for students at all stages of education, school, college and university. They are full of easy-to-follow practical information that will help you to learn more effectively and get better grades.

A Final Thought

Exam skills, including revising and taking exams, can be learned.

Unfortunately, however, we do not all learn the same way. It is therefore important to try many different approaches to find out what works for you.

Continue to: Revision Skills Taking Exams

See also: Stress Management Effective Reading Study Skills

Programmes & Qualifications

Cambridge international as & a level thinking skills (9694).

• Syllabus overview

Thinking Skills develops a set of transferable skills, including critical thinking, reasoning and problem solving, that students can apply across a wide range of subjects and complex real world issues. 

The syllabus enables students to develop their ability to analyse unfamiliar problems, devise problem solving strategies, and evaluate the diverse ways a problem may be solved. During a Thinking Skills course, students learn to put their personal views aside in favour of examining and evaluating the evidence. Students learn how to make informed and reasoned decisions and construct evidence-based arguments. 

These independent thinking skills build confidence and equip students with a toolkit for tackling complex and unfamiliar subjects, essential for successful progression to higher education or into professional employment.

The syllabus year refers to the year in which the examination will be taken.

• -->2023 - 2025 Syllabus update (PDF, 149KB)
• -->2026 - 2027 Syllabus (PDF, 530KB)

Syllabus support

• -->Support for Thinking Skills (PDF, 858KB)

Important notices

For some subjects, we publish grade descriptions to help understand the level of performance candidates’ grades represent.

We paused the publication of grade descriptions in response to the Covid-19 pandemic and the temporary changes to the awarding standard in 2020, 2021 and 2022.

As the awarding standard has now returned to the pre-pandemic standard, we are working to produce up-to-date grade descriptions for most of our general qualifications. These will be based on the awarding standards in place from June 2023 onwards.

School Support Hub

Teachers at registered Cambridge schools can unlock over 30 000 teaching and learning resources to help plan and deliver Cambridge programmes and qualifications, including Schemes of work, Example candidate responses, Past papers, Specimen paper answers, as well as digital and multimedia resources.

Schemes of work

Example responses, past papers, specimen paper answers.

Register your interest in becoming a Cambridge School

Stay up to date

Sign up for updates about changes to the syllabuses you teach

• Past papers, examiner reports and specimen papers
• Published resources

California Critical Thinking Skills Test (CCTST)

Instructions.

Please click here to view detailed instructions for accessing and completing the California Critical Thinking Skills Test (CCTST)

If you have any questions about the study or the CCTST questionnaire, you are welcome to contact Dr. Jennifer Hill, Director of the Office of Assessment, at (919) 668-1617 or  [email protected] . 

Click here for instructions to begin the California Critical Thinking Skills Test (CCTST)

• Duke's Quality Enhancement Plan (QEP)
• Consultations
• Annual Department Assessment Reporting
• Handbook on Assessment at Duke
• Staff Support for Individual A&S Programs
• Gen. Ed. Assessment
• Assessment Resources & Links
• Policy on Assessment Data Dissemination
• Presentations

Academic Skills

• Academic Skills Home
• Learning Preference
• Identifying and Leveraging your Support Systems
• Critical Thinking Skills

Defining Critical Thinking

Blooms taxonomy, student experience feedback buttons.

• Professional Communication
• Achieving Balance: Structure and schedule
• Time Management
• Overcoming Coursework Challenges
• Taking Ownership of your Success
• Success Tips from your AFA
• Utilizing Faculty Feedback
• ASC Writing Resources Guide This link opens in a new window
• Academic Integrity Basics
• Academic Integrity Violation (AIV) and Avoiding Plagiarism
• Self Plagiarism
• Academic Integrity Checklist
• Turnitin and Draft Coach
• Organization and Format
• Reviewing, Revising, Proofreading and Editing
• NU Library Research Process Guide This link opens in a new window

“Critical thinking relies on content, because you can't navigate masses of information if you have nothing to navigate to.” -Dr. Kathy Hirsh-Pasek, Professor of Psychology, Temple University

One of the most sought-after skills in nearly every workplace is critical thinking (Doyle, 2018, October 30). But what is critical thinking, exactly? Better yet … what does it take to think critically? To some, it is the ability to analyze information objectively and make a reasoned judgment; for others, it simply involves thinking “outside-the-box”. Either way, to think critically is to possess the unique ability to think reflectively and independently in order to make thoughtful decisions (Figliuolo, 2016, August 2). In other words, critical thinking is not just the accumulation of facts and knowledge; rather, it’s a process of approaching whatever is on your mind in order to come up with the best possible conclusion (Patel, 2018, October 24). Figure 1 illustrates the critical thinking process.

Figure 1. Critical thinking process

Three Essential Skills

To think critically, it begins with three essential skills:

• linking ideas,
• structuring arguments, and
• recognizing incongruences.

In order for you to become a better critical thinker, each of the three skills needs to be practiced and applied accordingly. The first skill, linking ideas, involves finding connections between seemly unrelatable, even irrelevant ideas, thoughts, etc. The second skill involves creating structured practical, relevant, and sound arguments. Lastly, to recognize incongruences is to find the real truth by being able to find holes in a theory or argument (MindValley, n.d.).

Food for Thought “No problem can withstand the assault of sustained thinking.” -Voltaire, French philosopher

Six Low-Level Questions

Once you have the three essential skills down, then you can ask yourself six low-level questions that you can use in nearly any situation (TeachThought Staff, 2018, July 29):

• What’s happening? Here, you will need to establish the basics and begin forming questions.
• Why is it important? Ask yourself why the situation at hand is or is not significant.
• What don’t I see? Ask yourself whether or not there is any important information you might be missing.
• How do I know? Ponder on not only how you know what you think you know, but how that thought process was generated.
• Who is saying it? Identify the speaker and their position on the situation, then consider how that position could be influencing that person’s thinking.
• What else? What if? Think of anything else you be considering when making your decision. In addition, ponder the repercussions of what you’ve considered that might change/alter the outcome of your decision.

Food for Thought “Learn to use your brain power. Critical thinking is the key to creative problem solving in business.” -Richard Branson, Entrepreneur

In order to better understand higher-level critical thinking, it helps to be familiar with Bloom’s Taxonomy, a classification of educational objectives and skills that educators establish for their students. In Bloom’s Taxonomy, there are three overarching domains known as KSA: (a) Knowledge [cognitive], (b) Skills [psychomotor], and (c) Attitudes [affective]. This taxonomy of learning behaviors is referred to as “the goals of the learning process.” In other words, after a period of learning, the student will have acquired a new knowledge, skill and/or attitude (Bloom et al., 1956). In this resource, we will focus on the Knowledge (cognitive) domain. According to Bloom et al. (1956), the cognitive domain involves the development of intellectual skills. There are six major categories of the cognitive process (Figure 2), beginning with the development with the simplest skills (e.g., remembering basic facts and concepts), through a learning of procedural patterns and concepts that facilitate the development of intellectual abilities, before eventually moving to the highest, most complex skills (e.g., creation of new or original ideas).

Figure 2. Bloom's Taxonomy

• To further explain, the first level of Bloom’s Taxonomy involves remembering specific information. This includes recalling basic vocabulary, dates, and math facts.
• Moving up the taxonomy, understanding is demonstrated by a student’s ability to comprehend, organize, compare and to verbalize main concepts. At this level, questions require the ability to understand meaning, not just basic facts. For example, a study might be asked to explain the difference between apples and oranges.
• The third level, application, is being able to actually use the new knowledge. Within this level, questions often require the student taking what s/he just learned, then applying it in a different way. For example, the student may be asked to take a list of food items, then select four items to make a healthy breakfast.
• The next level, analysis, involves breaking down information into different parts for a more thorough examination. Here, questions require proven facts (evidence) to support the answer. For example, the student is asked to compare and contrast Republicans to Democrats with regard to their views on supporting or repealing the Affordable Care Act.
• Evaluation, the fifth level, is the ability to make judgments about information by presenting and defending one’s own opinions. It is important to note that at this level, questions don’t necessarily have a right (or wrong) answer. For example, a student may be asked how s/he would handle observing a friend who cheated on a final exam.
• The top of the taxonomy involves the synthesis of new information and compiling it in new ways. It is at this level where more abstract, creative, “outside-the-box” thinking comes into play. For example, a student may be asked to design and construct a robot that can walk a certain distance.

While the first three levels of the taxonomy are important to solidify core knowledge, it is within the last three levels – analysis, evaluation, and creativity – that require critical thinking skills. (Anderson et al., 2001).

Practice Activity

In a study by Gottfried and Shearer (2016, May 26), the authors stated that 62% of adults get their news from social networking sites. In fact, the results show that 70% of Reddit users, 66% of Facebook users, and 59% of Twitter users get their news from one or more of these platforms. According to the study, among these three social networking sites, Facebook had the greatest reach with 67% of American adults using the platform. This suggests that the two-thirds of adults who use Facebook to get their news, which amount to 44% of the general population. Unfortunately, social media platforms don’t go through the stringent review process to which most major news outlets are required in order to be in compliance with Federal Communications Commission (FCC) regulations. Therefore, information can be shared publicly without “fact-checking” to make sure that what’s being shared is truly accurate. With this in mind, one can’t help but ask: What’s the truth versus what isn’t? Better yet … what’s real news and what’s fake?

Your task involves the use of Bloom’s Taxonomy to decipher “fake news” from real news. Using the eight-step infographic on the International Federation of Library Associations and Institutions (IFLA) website (https://www.ifla.org/publications/node/11174) as a guide, review the following news stories to determine which are real and which are fake. Explain your rationale.

1. Strasbourg market attacker ‘pledged allegiance to ISIS’ – source.

2. Lawmakers in California propose a new law called the “Check Your Oxygen Privilege Act”.

3. Four AI-controlled robots kill 29 scientists in Japan.

4. North Korea says it will not denuclearize until the US eliminates ‘nuclear threat’.

5. Two men found living underneath the Calico Mine Ride at Knott’s Berry Farm.

6. Scientists find a brain circuit that could explain seasonal depression.

7. Amazon customer receives 1,700 audio files of a stranger who used Alexa.

8. NFL fines Pittsburgh Steelers $1M each for skipping National Anthem.

9. FBI raids CDC for data on vaccines and autism.

10. Only 60 of 1,566 churches in Houston opened to help Hurricane Harvey victims.

References:

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M.C. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's Taxonomy of Educational Objectives. New York, NY: Pearson, Allyn & Bacon. Bloom, B. (Ed.), Englehart, M., Furst, E., Hill, W., & Krathwohl, D. (1956). Taxonomy of educational objectives, Handbook I: Cognitive domain. New York, NY: McCay. Doyle, A. (2018, October 30). Critical thinking definition, skills, and examples. Retrieved from https://www.thebalancecareers.com/critical-thinking-definition-with-examples-2063745 Figliuolo, M. (2016, August 2). Critical thinking. Retrieved from https://www.lynda.com/Business-Skills-tutorials/Critical-Thinking/424116-2.html Gottfried, J., & Shearer, E. (2016, May 26). News use across social media platforms 2016. Pew Research Center. Retrieved from http://www.journalism.org/2016/05/26/news-use-across-social-media-platforms-2016/ MindValley. (n.d.). How to solve the biggest problems with critical thinking exercises [blog]. Retrieved from https://blog.mindvalley.com/critical-thinking-exercises/# Patel, D. (2018, October 24). 16 characteristics of critical thinkers. Retrieved from https://www.entrepreneur.com/article/321660 TeachThought Staff. (2018, July 29). 6 critical thinking questions for any situation. Retrieved from https://www.teachthought.com/critical-thinking/6-critical-thinking-questions-situation/

Was this resource helpful?

• << Previous: Identifying and Leveraging your Support Systems
• Next: Professional Communication >>
• Last Updated: Mar 22, 2024 7:59 AM
• URL: https://resources.nu.edu/ata/academicskills

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

• We're Hiring!
• Help Center

Examining the Exam: A Critical Look at The California Critical Thinking Skills Test

2005, Science & Education

Related Papers

Peter A Facione

Group norms are provided for the California Critical Thinking Skills Test (CCTST)--College Level, a standardized 34-item multiple-choice test designed &#39;o assess the core critical thinking skills associated with baccalaureate general education. The CCTPT offers three subtests conceptualized in terms of a national Delphi study on critical thinking. These three subtests--analysis, evaluation, and inferencecorrelate strongly with each other and the overall CCTST when used as either a pretest or posttest. Subtests are also offered based on the more traditional division of reasoning into &quot;deductive reasoning&quot; and &quot;inductive reasoning.&quot; These latter two subtests also correlate strongly with each other and the overall CCTST when used as either a pretest or posttest. Statistical analyses, correlations, and recommended percentile rankings for raw scores are presented in nine tables. These norms were developed on the basis of analyses of 1,673 test forms for representat...

Educational Measurement: Issues and Practice

Pamela Moss

Elahe Haghnegahdar

Anthony Petrosky

The diagnostic testing component of the Critical Thinking Project of the Pittsburgh schools is described and a rationale for the project&#39;s particular choice of testing procedures is provided. The purpose of the project was to help students develop skills for thinking critically and communicating critical thought through reading, discussion, and essay writing within the social studies curriculum. The project defined critical thinking as a dynamic process of questioning and reasoning that reflects a trusting, yet skeptical orientation toward the world. Critical thinking skills are interdependent emphasizing both oral and written expression. Because no existing tests suited the project&#39;s conceptualization of critical thinking or met its practical needs, the project developed a testing procedure that asked students to read passages relevant to their social studies curriculum and write essays in response to questions which asked them to do such tasks as evaluate or draw inference...

The eighties witnessed a growing accord that the heart of education lies exactly where traditional advocates of a liberal education always said it was-in the processes of inquiry, learning and thinking rather than in the accumulation of disjointed skills and senescent information. By the decade&#39;s end the movement to infuse the K-12 and post-secondary curricula with critical thinking (CT) had gained remarkable momentum. This success also raised vexing questions: What exactly are those skills and dispositions which characterize CT? What are some effective ways to teach CT? And how can CT, particularly if it becomes a campus-wide, district-wide or statewide requirement, be assessed? When asked by the individual professor or teacher seeking to introduce CT into her own classroom, such questions are difficult enough. But they take on social, fiscal, and political dimensions when asked by campus curriculum committees, school district offices, boards of education, and the educational t...

Tennessee Technological University has been exploring methods of assessing critical thinking skills as part of a performance funding initiative since 2000. Our experiences over the last three and half years provide useful information about both a process for developing an assessment tool and a product for assessing critical thinking skills. Our approach has been to empower our faculty to both identify and evaluate a core set of skills they believe to be an important part of critical thinking in our graduates. Our initial test has demonstrated good face validity and high criterion validity when correlated with scores on the American College Test (ACT) and the California Critical Thinking Skills Test (CCTST).

MARKETING IDENTITY New changes, New challenges. Conference Proceedings from the International Scientific Conference 9th November 2021, Faculty of Mass Media Communication, University of SS. Cyril and Methodius in Trnava, Slovakia,

Norbert Vrabec

There is a considerable diversity in the measurement and testing of critical thinking in terms of the tests used for this purpose and the approaches by which the level of critical thinking can be assessed. In addition, the purpose of its use is essential when developing and using critical thinking tests. Critical thinking is the ability to think clearly and rationally, understand the logical connections between ideas, apply basic logical operations, and avoid cognitive biases. Critical thinking has been the subject of much debate and reflection since early Greek philosophers, such as Plato and Socrates. It is now gaining momentum, especially concerning the spread of disinformation and hybrid threats. The paper deals with the possibilities of various forms of critical thinking testing. The main goal of this research study is a framework structural analysis of standardized assessment tools focused on critical thinking.

International Journal of Educational Leadership Preparation

Toni Szymanski

Ahrash Bissell , Paula Lemons

RELATED TOPICS

•   We're Hiring!
•   Help Center
• Find new research papers in:
• Health Sciences
• Earth Sciences
• Cognitive Science
• Mathematics
• Computer Science
• Academia ©2024

International Study Reveals Measuring and Developing Critical-Thinking Skills as an Essential Best Practice in Higher Education

Opportunities exist for higher education institutions worldwide to increase critical-thinking skills among higher education graduates through explicit instruction, practice, and measurement of the skills employers are most seeking in today’s innovation economy..

NEW YORK, October 18, 2023 | Source: GlobeNewswire

The  Council for Aid to Education, Inc.  (CAE), a leader in designing innovative performance tasks for measurement and instruction of higher-order skills, recently co-authored an article on a six-year international study in the  European Journal of Education Study . Key findings shared in  “Assessing and Developing Critical-Thinking Skills in Higher Education”  include that it is feasible to reliably and validly measure higher-order skills in a cross-cultural context and that assessment of these skills is necessary for colleges and universities to ensure that their programs are graduating students with the skills needed for career success after graduation.

Between 2015 and 2020, 120,000 students from higher education institutions in six different countries — Chile, Finland, Italy, Mexico, the UK, and the US — were administered CAE’s  Collegiate Learning Assessment (CLA+) , a performance-based assessment that measures proficiency with critical thinking, problem solving, and written communication. Analysis of the data show that students entering a higher education program on average performed at the  Developing  mastery level of the test while exiting students on average performed at the  Proficient  mastery level. The amount of growth is relatively small (d = 0.10), but significant. However, half of exiting students perform at the two lowest levels of proficiency, indicating that higher education degrees do not necessarily mean students have gained the higher-order skills needed for innovation-oriented workplaces.

“In response to employer concerns about graduate employability, assessing and developing students’ higher-order skills is an essential component of best practices in higher education,” said Doris Zahner, Ph.D., CAE’s chief academic officer. “The ability to measure these skills in a cross-cultural context addresses a current gap between the skills that higher education graduates possess and the skills that are required by hiring managers for success in the workplace.”

This study reinforces the same findings of  OECD’s 2013 Assessment of Higher Education Learning Outcomes (AHELO) Feasibility Study and is based upon a recently published 2022 OECD report, Does Higher Education Teach Students to Think Critically? . Since this original study, CAE has further improved CLA+ through lessons learned from its implementation, analytical research on the data gathered, and international collaboration.

The research discussed in “Assessing and Developing Critical-Thinking Skills in Higher Education” reinforces the need for policymakers, researchers, and higher education leaders to have valid and reliable internationally comparative assessments of the skills that are needed for today’s knowledge economy. “The results outlined in this report show the power of assessing critical-thinking skills and how such assessments can feed into the higher education policy agenda at the national and international level,” said article co-author Dirk Van Damme, former head of the Centre for Educational Research and Innovation at OECD and current senior research fellow at the Centre for Curriculum Redesign.

CAE, in collaboration with the Finland Ministry of Education and Culture, will continue to study the impact of higher education on the development of critical-thinking skills. Starting in 2023 and continuing through 2025, a cohort of students from 18 Finnish higher education institutions will use CLA+ to measure their growth with critical thinking, adding a longitudinal component to this ongoing research.

To learn more about this study, CAE’s other research, and CAE’s performance-based assessments and critical thinking instruction, visit  cae.org .

About CAE As a nonprofit whose mission is to help improve the academic and career outcomes of secondary and higher education students, CAE is the leader in designing innovative performance tasks for measurement and instruction of higher order skills and within subject areas.

Over the past 20 years, CAE has helped over 825,000 students globally understand and improve their proficiency in critical thinking, problem solving and effective written communication. Additionally, CAE’s subject area assessments have helped millions of K12 students across the US. Supported by best practices in assessment development, administration and psychometrics, CAE’s performance-based assessments include the Collegiate Learning Assessment (CLA+) and College and Career Readiness Assessment (CCRA+). To learn more, please visit  cae.org  and connect with us on  LinkedIn  and   YouTube .

You Might Also Like…

THE AI EDGE:

Women’s History Month Video: Professionals Share How Higher-Order Skills Contribute to Career Success

Black History Month Video: How Higher-Order Skills Drive Career Success

• Study Guides
• Homework Questions

The Role of Education in Fostering Critical Thinking Skills