•  Sign into My Research
  •  Create My Research Account
  • Company Website
  • Our Products
  • About Dissertations
  • Español (España)
  • Support Center

Select language

  • Bahasa Indonesia
  • Português (Brasil)
  • Português (Portugal)

Welcome to My Research!

You may have access to the free features available through My Research. You can save searches, save documents, create alerts and more. Please log in through your library or institution to check if you have access.

Welcome to My Research!

Translate this article into 20 different languages!

If you log in through your library or institution you might have access to this article in multiple languages.

Translate this article into 20 different languages!

Get access to 20+ different citations styles

Styles include MLA, APA, Chicago and many more. This feature may be available for free if you log in through your library or institution.

Get access to 20+ different citations styles

Looking for a PDF of this document?

You may have access to it for free by logging in through your library or institution.

Looking for a PDF of this document?

Want to save this document?

You may have access to different export options including Google Drive and Microsoft OneDrive and citation management tools like RefWorks and EasyBib. Try logging in through your library or institution to get access to these tools.

Want to save this document?

  • Document 1 of 1
  • More like this
  • Scholarly Journal

gamification in education a systematic mapping study

Gamification in Education: A Systematic Mapping Study

No items selected.

Please select one or more items.

Select results items first to use the cite, email, save, and export options

[[missing key: loading-pdf-error]] [[missing key: loading-pdf-link]]

While gamification is gaining ground in business, marketing, corporate management, and wellness initiatives, its application in education is still an emerging trend. This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research results is proposed based on the extracted topics discussed in the reviewed papers. The categories include gamification design principles, game mechanics, context of applying gamification (type of application, educational level, and academic subject), implementation, and evaluation. By mapping the published works to the classification criteria and analyzing them, the study highlights the directions of the currently conducted empirical research on applying gamification to education. It also indicates some major obstacles and needs, such as the need for proper technological support, for controlled studies demonstrating reliable positive or negative results of using specific game elements in particular educational contexts, etc. Although most of the reviewed papers report promising results, more substantial empirical research is needed to determine whether both extrinsic and intrinsic motivation of the learners can be influenced by gamification.

You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer

Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer

Suggested sources

  • About ProQuest
  • Terms of Use
  • Privacy Policy
  • Cookie Policy
  • Material Detail: Gamification in Education: A Systematic Mapping Study

Material Detail

Gamification in education: a systematic mapping study.

While gamification is gaining ground in business, marketing, corporate management, and wellness initiatives, its application in education is still an emerging trend. This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design....

rate this material with 1 stars

  • User Rating
  • Learning Exercises
  • Bookmark Collections   (2) Bookmark Collections
  • Course ePortfolios
  • Accessibility Info
  • Report Broken Link
  • Report as Inappropriate

More about this material

Historically Black Colleges and Universities

Disciplines with similar materials as Gamification in Education: A Systematic Mapping Study

Other materials like gamification in education: a systematic mapping study.

Gamification of e-learning in higher education: a systematic literature review - Smart Learning Environments icon

Full Description

While gamification is gaining ground in business, marketing, corporate management, and wellness initiatives, its application in education is still an emerging trend. This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research results is proposed based on the extracted topics discussed in the reviewed papers. The categories include gamification design principles, game mechanics, context of applying gamification (type of application, educational level, and academic subject), implementation, and evaluation. By mapping the published works to the classification criteria and analyzing them, the study highlights the directions of the currently conducted empirical research on applying gamification to education. It also indicates some major obstacles and needs, such as the need for proper technological support, for controlled studies demonstrating reliable positive or negative results of using specific game elements in particular educational contexts, etc. Although most of the reviewed papers report promising results, more substantial empirical research is needed to determine whether both extrinsic and intrinsic motivation of the learners can be influenced by gamification.

Edit Comment

Edit comment for material Gamification in Education: A Systematic Mapping Study

Delete Comment

This will delete the comment from the database. This operation is not reversible. Are you sure you want to do it?

Report a Broken Link

Thank you for reporting a broken "Go to Material" link in MERLOT to help us maintain a collection of valuable learning materials.

Would you like to be notified when it's fixed?

Do you know the correct URL for the link?

Link Reported as Broken

Link report failed, report an inappropriate material.

If you feel this material is inappropriate for the MERLOT Collection, please click SEND REPORT, and the MERLOT Team will investigate. Thank you!

Material Reported as Inappropriate

Material report failed, comment reported as inappropriate, leaving merlot.

You are being taken to the material on another site. This will open a new window.

Do not show me this again

Rate this Material

rate this material with 1 stars

Know the Author?

If you know the author of Gamification in Education: A Systematic Mapping Study , please help us out by filling out the form below and clicking Send.

Search by ISBN?

It looks like you have entered an ISBN number. Would you like to search using what you have entered as an ISBN number?

Searching for Members?

You entered an email address. Would you like to search for members? Click Yes to continue. If no, materials will be displayed first. You can refine your search with the options on the left of the results page.

  • Corpus ID: 25124586

Gamification in Education: A Systematic Mapping Study

  • D. Dicheva , Christo Dichev , +1 author G. Angelova
  • Published in J. Educ. Technol. Soc. 1 July 2015
  • Education, Computer Science
  • J. Educ. Technol. Soc.

Figures from this paper

figure 1

1,297 Citations

Gamification in education: a passing trend or a genuine potential, gamification at school, application of gamification to blended learning in higher education, gamification of e-learning in higher education: a systematic literature review, a qualitative investigation of student perceptions of game elements in a gamified course, games and gamification in flipped classrooms: a systematic review, role of gamification in classroom teaching: pre-service teachers’ view, gamified flipped classroom as a pedagogical strategy in higher education: from a systematic vision, gamification: an initiative to improve engagement and performance in education, learning through play: gamification model in university-level distance learning, 67 references, key attributes of engagement in a gamified learning environment, an empirical study comparing gamification and social networking on e-learning, casual social games as serious games: the psychology of gamification in undergraduate education and employee training, gamifying learning experiences: practical implications and outcomes, gamification as a tool for increasing the depth of student understanding using a collaborative e-learning environment, gradequest - evaluating the impact of using game design techniques in an undergraduate course, motivational active learning: engaging university students in computer science education, a case study in the gamification of a university-level games development course, gamification in a social learning environment, improving participation and learning with gamification, related papers.

Showing 1 through 3 of 0 Related Papers

gamification in education a systematic mapping study

Published in J. Educ. Technol. Soc. 2015

D. Dicheva Christo Dichev G. Agre G. Angelova

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

  • We're Hiring!
  • Help Center

paper cover thumbnail

Gamification in Education: A Systematic Mapping Study

Profile image of Gennady Agre

Related Papers

Proceedings of the 29th Annual ACM Symposium on Applied Computing - SAC '14

Helena Reis , Simone Borges

gamification in education a systematic mapping study

Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi

Hendra Hendra dinata

Gamification has been widely adopted in many areas, including in the educational context. The students need to be motivated in following the learning process because everyone feels happy to learn if there is no coercion. By presenting something fun and enjoyable, students are expected to be more involved in the learning process, which will achieve better learning outcomes. Gamification is very reliable in bringing fun and pleasure to the learning process for the students. We analyze three items from the previous study; the intention and what the goals are expected, how to design, and the result of gamification in the education context. We found the intentions of gamification adoption in an educational context. They are to increase students' motivation to learn and present an alternative learning method that is more fun and enjoyable. And for the success of this gamification program, a game application can be developed using existing sophisticated technology and by presenting a r...

Violet Murwa , Han-kyung Yun , Yoon Sang

International Journal of Academic Research in Progressive Education and Development

Maryam Mohd Esa

Socialization - A Multidimensional Perspective

Şenay Kocakoyun

Filomena Faiella , Maria Ricciardi

This paper will review the literature on gamification and aim to apply principles of analysis for synthesize existing research, identify issues of controversy, uncover areas that future gamification research should investigate. The paper starts with an introductory paragraph which gives an overview of the topic (i.e., define the concept, identify the characteristic components, discuss about the elements of a gamified experience). Then, the attention is focused on gamified learning, in order to investigate what happens when gamification is introduced in class, especially on student's motivation, engagement, and performances. The last part focuses on the lines of research to be pursued in the area of gamification and suggestions are made regarding those aspects which would benefit most from future research.

Revista Espacios

Julieth Katherin Medina

Gamification refers to the incorporation of typical game elements in contexts that are not games, with an objective to motivate the individual to perform certain tasks. For this reason, numerous academics are putting their efforts into designing gamified strategies for the classroom. This paper maps trends and patterns related to gamification as a strategy in teaching and learning processes. For this purpose, a systematic literature review was conducted, based on the content analysis of 99 documents. The results highlight engagement, motivation, and performance as the principal benefits from adopting gamified tools in the classroom. This research is made up of Quantitative and conceptual work: the most used collection techniques are questionnaires, and the gamified elements focused on are the point scoring system, badges, and leaderboard. These previous reasons motivate a growing trend for the use of gamification both in face-to-face modality and virtual learning platforms, as well as opening new lines of research related to the long-term impact of these strategies and their relation to lifelong learning.

Test Engineering and Management

Jameela Hanoon Umarlebbe , Seriaznita Mat Said

Gamification is a genre of social interaction that concerns those in fields like academia, as well as professionals of business, education, and information technology. However, as a term, it remains hindered as of varied uses and meanings, it has been divided according to its educational usability. It has been dealt with in terms of merits and demerits to validate its usefulness by offering the proof to encourage those specialized in education as well as entertainment. In this paper, a general overview of gamification and in education respectively (i.e. learning and teaching) with a glimpse from empirical studies. Followed by an examining of its contributions for a better improvement in the educational process in general. This articles gives a general description overview on the use of gamification in understanding its applicable usefulness in the field of education due to its feature of edutainment. It outlines gamification in both theory and action, with an emphasis on empirical side in relation with context and purpose and context. Furthermore, it shows that gamification as a conceptualized concept is emerging in the field of education to meet the expected outcomes. A discussion on the probability of the way gamification to be more useful as a subdivision to improve the systems of interaction of user experience by using gamified design. The paper concludes with suggestions of nonstop investigations of gamified applications and its effectiveness.

Mahasen Sehweil

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

RELATED PAPERS

Hasnah Mohamed

Journal of Language and Education

Elena Tikhonova

Educational Research Review

Zamzami Zainuddin

Education and Information Technologies

Zahra Batooli

Pauliina Tuomi

International Journal of Educational Technology in Higher Education

Darina Dicheva

Rechard Lee

SHS Web of Conferences

Natalia Mikhalevich

Educational Psychology Review

Michael Sailer

Panagiotis Zaharias

Ts. Dr. Siti Nurul Mahfuzah Mohamad

  •   We're Hiring!
  •   Help Center
  • Find new research papers in:
  • Health Sciences
  • Earth Sciences
  • Cognitive Science
  • Mathematics
  • Computer Science
  • Academia ©2024

Visualization of Hotspots and Frontiers in Online Gamified Learning----Based on Citespace Knowledge Map Analysis

New citation alert added.

This alert has been successfully added and will be sent to:

You will be notified whenever a record that you have chosen has been cited.

To manage your alert preferences, click on the button below.

New Citation Alert!

Please log in to your account

Information & Contributors

Bibliometrics & citations, index terms.

Human-centered computing

Visualization

Visualization systems and tools

Recommendations

Visual analysis of online learning engagement of student based on citespace.

This study uses CiteSpace to reveal research characteristics and future research trends in online learning engagement of student. The article selected 973 papers on online learning engagement of student by the WOS core database. Through a quantitative ...

Bibliometric Analysis of Instructional Design in Online Education Based on Citespace

With the advancement of education informatization in China, online education has begun to take shape, and the research on online education is increasing year by year. Instructional design is an important part of teaching in online education. In order to ...

Online Gamified Learning Platforms (OGLPs) for Participatory Learning

Nowadays, students, especially whose majors are practical subjects such as tourism and hospitality in tertiary education, are not interested in ways of learning knowledge through classroom learning. Online Gamified Learning Platforms (OGLPs) are ...

Information

Published in.

cover image ACM Other conferences

Association for Computing Machinery

New York, NY, United States

Publication History

Permissions, check for updates.

  • Research-article
  • Refereed limited

Funding Sources

  • Macao Polytechnic University

Contributors

Other metrics, bibliometrics, article metrics.

  • 0 Total Citations
  • 0 Total Downloads
  • Downloads (Last 12 months) 0
  • Downloads (Last 6 weeks) 0

View Options

Login options.

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

View options.

View or Download as a PDF file.

View online with eReader .

HTML Format

View this article in HTML Format.

Share this Publication link

Copying failed.

Share on social media

Affiliations, export citations.

  • Please download or close your previous search result export first before starting a new bulk export. Preview is not available. By clicking download, a status dialog will open to start the export process. The process may take a few minutes but once it finishes a file will be downloadable from your browser. You may continue to browse the DL while the export process is in progress. Download
  • Download citation
  • Copy citation

We are preparing your search results for download ...

We will inform you here when the file is ready.

Your file of search results citations is now ready.

Your search export query has expired. Please try again.

  • Open access
  • Published: 30 August 2024

Comparison of education using the flipped class, gamification and gamification in the flipped learning environment on the performance of nursing students in a client health assessment: a randomized clinical trial

  • Raziyeh Ghafouri 1 ,
  • Vahid Zamanzadeh 1 &
  • Malihe Nasiri 2  

BMC Medical Education volume  24 , Article number:  949 ( 2024 ) Cite this article

Metrics details

Since effective education is one of the main concerns of every society and, in nursing, can lead to the education of successful people, the development of learning and teaching methods with greater effectiveness is one of the educational priorities in every country. The present study aimed to compare the effect of education using the flipped class, gamification and gamification in the flipped learning environment on the performance of nursing students in a client health assessment.

The present study was a Parallel randomized clinical trial study. The participants were 166 nursing students. The clinical trial data was collected from December 14, 2023, to February 20, 2024. The inclusion criteria were nursing students who had passed the first semester, who were willing to participate and install the app on their mobile devices, and who had no experience with the designed application for this study. The participants were allocated to four groups with colored carts. In the first group, teaching was performed via gamification in a flipped learning environment; in the second group, teaching was performed via the gamification method. A flipped class was implemented in the third group. In the fourth group, the usual lecture method was used. The practical performance to assess the physical health assessment with 10 questions using the key-feature questions, along with the satisfaction and self-efficacy of the students, was also checked with questionnaires.

In this study, 166 nursing students, (99 female and 67 male), with an average (standard deviation) age of 21.29 (1.45) years, participated. There was no statistically significant difference in the demographic characteristics of the participants in the four intervention groups ( P  > 0.05). Comparing the results before and after the intervention, the results of the paired t test indicated a significant difference in the satisfaction, learning and self-efficacy of the learners ( P  < 0.001). In the comparison of the four groups, the ANOVA results for the comparison of the average scores of knowledge evaluation and satisfaction after intervention among the four groups indicated a statistically significant difference ( P  < 0.001). When the knowledge evaluation scores of the groups were compared, the scores for gamification in the flipped learning environment were significantly different from the other methods ( P  < 0.05), and there was no significant difference between the scores for the flipped class and lecture methods ( P  = 0.43). According to the ANOVA results, when comparing the satisfaction scores of the groups, the students in the flipped learning environment and gamification groups were more satisfied than the flipped class and lecture groups ( P  < 0.01).

Based on the results of the present research, it can be concluded that teaching methods have an effect on students’ learning and satisfaction. The teaching method has an effect on the satisfaction of the students, and the use of the flipped class method with the use of gamification was associated with more attractiveness and satisfaction in addition to learning. Teachers can improve the effectiveness of education with their creativity, depending on situation, time, cost, and available resources, by using and integrating educational methods.

Peer Review reports

Introduction

Effective education is one of the main concerns of every society [ 1 ]. Because the traditional methods of teaching, learning and management have little effectiveness [ 2 ], multiple learning strategies of active learning and the use of technologies [ 3 , 4 , 5 ], it is helpful to integrate the classroom approach among these methods. The reverse is the use of a playful method [ 6 , 7 ]. The flipped classroom was presented in 2007 by Bergmann and Sams, two chemistry teachers at Woodland Park High School in Colorado (USA). Their goal was to ensure that students who could not attend class for various reasons could proceed at the pace of the course and not be harmed due to not attending class [ 8 ]. Bergmann and Sams videotaped and distributed instructional content and found that this model allowed the teacher to focus more attention on the individual learning needs of each student [ 5 , 8 ].

In 2014, the Flipped Learning Network (FLN) was introduced, in which flipped learning was defined as “an educational approach in which direct instruction is transferred from the group learning dimension to individual learning, and in a dynamic and interactive learning environment, where the instructor guides students in applying concepts and engaging creatively with course content”. The four pillars of flexible environment, learning culture, purposeful content and professional instructor have been described in opposite directions [ 9 , 10 ]. In addition to the ever-increasing complexity of the healthcare environment and the rapid advancement of healthcare technology, a global pandemic (COVID-19) has affected educational structures. The pandemic has caused a global educational movement toward blended learning to meet students’ technological and hands-on learning needs. Indeed, at no time in history has there been such a sudden transition to this type of learning [ 11 ], where the flipped classroom was widely used [ 9 ].

In nursing education, the use of flipped classrooms [ 9 , 12 ] and technologies [ 3 , 5 ] has been emphasized. The results obtained in the systematic review of the effect of the flipped classroom on academic performance in nursing education indicated its positive effect, and the opinions of most students about this method included aspects such as its usefulness, flexibility, greater independence or greater participation [ 13 , 14 , 15 , 16 , 17 , 18 , 19 ]. According to the cognitive bases related to the Bloom’s taxonomy, with the flipped classroom method, the student works in the first stage of the learning process at home, which is the simplest stage, and in the second stage, through active learning with the help of the teacher and classmates, in class time, which is used to increase and empower more [ 20 , 21 ]. In addition, the flipped classroom method has certain advantages over traditional learning. The flipped classroom is student-centered and makes students responsible for their own learning [ 22 ], and its use in nursing has been emphasized in systematic review studies [ 3 , 23 , 24 ].

One of the interactive teaching methods using computers is the gamification method. Gamification in education includes the use of game elements to increase motivation and participation and to involve students in the personal learning process [ 1 , 25 ]. Gamification is an active education method. The gamification system increases the level of engagement and motivation of learners by provoking excitement and creating challenges for them. Additionally, with this method, it is possible to provide an opportunity for testing, and in that test, in addition to creating a challenge, learners are given the opportunity to display their achievements through competition [ 26 ].

Nursing education institutions are obliged to improve the ability of nursing students to make correct clinical judgments through various educational programs and the use of new teaching methods [ 27 , 28 ] so that when nursing students enter the clinic, they can fulfill their role as members of the medical team [ 27 ]. Therefore, it is necessary to carry out more research regarding the identification of effective teaching methods that can improve the attractiveness of education and its satisfaction among nursing students [ 1 , 27 ].

This study addresses the lack of comparative research on the effectiveness of flipped classrooms and gamification in nursing education, an area that has not been sufficiently explored. The advantages of combining education methods are that they can be used together [ 6 , 7 ]. For example, by combining education using the flipped class with gamification, more study time is provided by using the flipped class, and the attractiveness of the method is provided by gamification [ 7 ]. Therefore, considering the attractiveness of the new application that is prepared in a flipped class, the current research was conducted aimed at comparing the effects of education using the flipped class, gamification and gamification in the flipped learning environment on the performance of nursing students in terms of client health assessment.

The present study was a parallel randomized clinical trial research aimed at comparing the effect of education using the flipped class, gamification and gamification in the flipped learning environment on the performance of nursing students in a client health assessment. The clinical trial data was collected from December 14th, 2023, until February 20th, 2024.

Participants

First, in a call, 247 nursing students registered to participate in the study. After checking the entry criteria, 188 people met the entry criteria for the study. The inclusion criteria were nursing students who had passed the first semester, who were willing to participate and install the app on their mobile devices, and who had no experience with the designed application for this study. Exclusion criteria were: miss the mobile and drop out of study, for example, because of transferring, migration or do not like to continue participating in the study. So, 18 students were excluded from study for unwillingness to continue, 2 students because of migration were excluded, and 2 people were excluded for missing their mobile (Fig.  1 ).

figure 1

Study and sampling process

The participants were allocated to four groups with using colored carts. Before sampling, 188 carts in 4 blue, red, black and white colors (from each color, 45 carts) were prepared in one enveloped pocket. After completing the informed consent and pre-test questionnaires, each student took a colored card from the enveloped pocket. Then, with the lottery, it was determined that the participants with the blue card participated in the gamification in a flipped learning environment, the red cart in the gamification, the black cart in the flipped class, and the white cart in the lecture method. The study and sampling process is shown in Fig.  1 .

Intervention

The education course was 4 class in 60 min of health status assessment in 4 weeks. Each group has a classroom weekly. Education content was health assessment and clinical examination courses of the Bachelor of Nursing Education curriculum. Course plan was developed based on the curriculum.

For intervention, the application was designed using the cascade model (initial analysis, system analysis, design, programming, testing (alpha and beta), implementation and modification) [ 29 , 30 ]. In the initial analysis stage, the need or the desired problem, which is the issue of education improvement, is raised, and can technical solutions be provided for it? If there are possible solutions, the practicality is evaluated, and in the analysis of the visual appeal system, the up-to-date information, simple language, and comprehensiveness of the information provided in the educational content are checked. In the design phase, the design of the desired system was written, and a program was written by the programmers according to the initial design of the system.

The educational content of the application was prepared based on the health assessment and clinical examination courses of the Bachelor of Nursing Education Program, approved by an expert panel. The application was designed in two parts: education and scenario-based games. In the education section of the application, the content of the education was presented, and in the scenario base game section, the 10 scenarios of health status assessment and clinical examination were designed based on real situations.

In the scenario base game section of the application, the application was embedded as a game in such a way that the student, at the first, observes the chief compliance of the patient, and they must complete patient examinations and choose the correct answer. If they choose correctly, they will take a green cart, and if they make a mistake, they will take a red cart. They could take 4 green carts in each scenario. A yellow cart was shown when the answer was not incorrect, but it was not an exact answer. In each scenario, they must find the correct nursing diagnosis. They must provide a nursing diagnosis based on the priority of care in the scenario.

The fundamental elements of gamification are mechanics (motivating students through points, budgets and rewards), dynamics (engaging users through stories and narratives), and aesthetics (user experiences from applications about being user-friendly and attractive) [ 31 , 32 , 33 ]. The mechanics element was considered in the application, with green carts in each stage. The dynamic element was considered in the scenarios. The aesthetic element was considered and checked in alpha and beta tests.

In the test phase, the Application was checked for errors, and it was tested for user acceptance in two parts, the alpha and beta tests. In the alpha test, the program was used by the designers (four academic nurses and 4 IT men) as users, and in the beta test, a group of users (20 nursing studentsThe fundamental elements of a flipped class are that the students must read the content before the class and do the assignment in the class. In this study, this element was considered, and the provided content was given to participants at first. The students read content for each class before the class, and they solved the assignment in the class. The provided content for the flipped class group was designed in the PowerPoint files, and for the gamification in the Flipped Learning Environment group was designed in the application.

It was improved based on their opinions, and in the next stage, the approved application by the designer and user was used in this study.

Lecture group

In the Lecture group, the content of the education was held in the lecture method, and in each section, at the end of class, a scenario of the designed was given to the students as an assignment. They must solve it by next week. At the end of the study, four scenarios were performed by the students as assignments in this group.

Flipped class group

In the Flipped class group, the content was prepared in the four voiced PowerPoints and presented them to the students in the first session. Students read the content of each class, and in class they discussed the educational content and solved the scenarios as an assignment. Eight scenarios were discussed by the students as assignments in this group.

Gamification group

In the Gamification group, in each class, after the educational content was presented, the homework was presented, and students played a scenario of application in the class. Four scenarios were performed by the students as assignments in this group.

Gamification in the flipped learning environment group

In the Gamification in the Flipped Learning Environment group, the designed mobile application was presented in the first session of the course. Students must read the content of the session before the class, and in class they discussed the educational content and solved the scenarios as an assignment. Eight scenarios were performed as homework by students in a gamification environment.

Data collection tools

In this study, a questionnaire with 10 key-feature questions (KFQs) was designed by an expert panel of 10 academic nurses. After designing a KFQ questionnaire, its validity and reliability were examined. Validity was confirmed with a content validity ratio (CVR) of 14 expert (academic nurses) and qualitative validity with 7 academic and 7 clinical nurses; reliability was checked by test-retest. The CVR of the questionnaire was 0.96 and was confirmed. All seven academic and seven clinical nurses confirmed the qualitative validity of the questionnaire. The content validity coefficient based on the number of participating professors (at least 10 people) is 0.49 as the minimum acceptable according to the Lauwshe Tables (18, 19) and the necessity of the items of tools was confirmed.

For the test-retest of KFQ questionnaire, 10 nursing students participated. They filled out the questionnaire twice, with an interval of two weeks. The correlation coefficient between their answers was 0.93 with Spearman’s correlation coefficient. The correlation coefficient above 0.7 is good [ 34 , 35 ].

Additionally, education satisfaction was investigated with the Measuring Student Satisfaction Scale from the Student Outcomes Survey [ 27 ], which includes 20 items. The validity of it was confirmed with CVR, and the reliability was checked by Cronbach’s alpha. The CVR of the questionnaire was 0.91 and was confirmed. Cronbach’s alpha was 0.69. Cronbach’s alpha coefficient above 0.7 is good, 0.3–0.7 is good, and less than 0.3 is poor [ 34 , 35 ]. The overall Cronbach’s alpha was appropriate reliability.

The Sherer questionnaire tool was used to assess the self-efficacy of the nursing students [ 36 ]. This tool contains 17 items on a five-point Likert scale. Sherer et al., confirmed the reliability of the questionnaire with Cronbach’s alpha 0.76 [ 36 ]. Also, for this questionnaire, the validity was confirmed with CVR, and the reliability was checked by Cronbach’s alpha. The CVR of the questionnaire was 0.90 and was confirmed. Cronbach’s alpha was 0.45.

Data analysis

The analysis of the research data was performed using the Statistical Package for Social Sciences version 20. The Kolmogorov-Smirnov test was used to assess the normality of the data. Data analysis was performed by using descriptive tests, such as percentage, mean and standard deviation, and statistical tests, such as the chi-square test, paired t test, and ANOVA. In all statistical tests, a significance level was considered less than 0.05.

In the present study, 166 nursing students, 99 women and 67 men, with an average (standard deviation) age of 21.29 (1.45) years, were participated. The demographic characteristics of the participants are shown in Table  1 . The homogeneity of the intervention and control groups was checked with statistical methods, and the results are reported in Table  1 . There was no statistically significant difference in the demographic characteristics of the participants in the groups ( P  > 0.05).

Comparing the results before and after the intervention, the results of the paired t test indicated a significant difference in the satisfaction, learning and self-efficacy of the learners ( P  < 0.001). Table  2 shows the results of paired t tests.

The ANOVA showed that a statistically significant difference between the mean scores of knowledge and satisfaction after intervention in the four groups ( P  < 0.001). The result of the ANOVA was not significant difference between the mean of the self-efficacy after intervention in the four groups ( P  = 0.101).

In the analysis of the groups, there was a significant difference in the comparison of the knowledge evaluation scores, such that there was a significant difference between the average of the gamification methods in the flipped learning environment group and the gamification compared to the inverted class and lecture, considering equal variance ( P  < 0.001). There were significant differences at the 0.05 level between the two gamification methods in the flipped learning environment group and the gamification group ( P  = 0.03). Gamification and flipped classes had no significant difference ( P  = 0.054). There was no significant difference between the two methods of flipped class and lecture ( P  = 0.43).

According to the ANOVA results, when comparing the satisfaction scores of the groups, there was no significant difference between the means of gamification in the flipped learning environment and the gamification method ( P  = 0.49); however, there was a significant difference between the gamification in the flipped learning environment and the gamification with the flipped class and the lecture. Additionally, there were significant differences between the flipped class and the lecture method ( P  < 0.01).

Discussions

This study aimed to compare the effects of the lecture method, flipped class and gamification in a flipped learning environment on the performance of nursing students in assessing the health status of clients. The demographic characteristics of the participants (gender, age, academic semester, grade point average and theory course score) had the same distribution among the four groups, and there was no statistically significant difference ( P  < 0.05).

Comparing the results before and after the training, the results of the paired t test indicated a significant difference in the satisfaction, learning and self-efficacy of the learners ( P  < 0.001). The results indicate that all four teaching methods effectively affected the learning, satisfaction and self-efficacy of students in evaluating the health status of their clients. However, in the comparison of the 4 groups, ANOVA revealed a statistically significant difference ( P  < 0.001). In the analysis comparing the knowledge evaluation scores of the gamification group with those of the other methods group, there were significant differences ( P  < 0.05), and there was no significant difference between the two methods (Flipped class and lecture) ( P  = 0.439). According to the ANOVA results, the satisfaction scores of the groups were greater for the gamification in the flipped learning environment and gamification groups than for the flipped class and lecture groups ( P  < 0.01). The results of the present research indicate that teaching methods have an effect on students’ learning and satisfaction.

Rachayon and his colleagues also used a task-based learning method in combination with digital games in a flipped learning environment to develop students’ English language skills, and their results also indicated the success of combining the above methods [ 7 ]. Muntrikaeo and his colleagues also used a similar model of task-based learning in combination with games in a reversed environment for teaching English, and their findings were also successful [ 6 ]. The results of the current research, which involved the integration of the gamification in the flipped learning environment for teaching health status assessment to nursing students, are similar to those of the above research.

Zou et al., in their systematic review, found that success in the flipped classroom is related to teachers’ creativity in making the classroom interactive, students’ readiness, and the use of technology [ 37 ]. In the present study, the flipped class, along with the use of gamification in the flipped learning environment, increased learner satisfaction and learning. Therefore, their findings are similar to the findings of the present study.

Hernon and his colleagues reported that the use of technology plays a significant role in the development of nursing students’ skills [ 4 ]. Regarding the use of educational applications for health assessment, the results of their research are the same as the current research, and the use of technology not only plays a role in learning but also it has role in education satisfaction. Considering the results of the present study and similar studies, we can conclude that the use of gamification in the flipped learning environment is an interactive teaching method and can be used to improve nursing education. Gamification can increase the attractiveness of education and promote education. If a good application is designed as a flipped enviroment, it provides more time in the classroom for discussion, interaction, and scenario-based education and promotes education satisfaction.

In this study, the satisfaction with education had a significant difference between the groups, but the students’ self-efficacy, despite the significant difference before and after the intervention, did not have a significant difference between the groups. Since all three studied methods were effective in students’ learning and self-efficacy, it can be said that teachers can improve educational effectiveness and satisfaction by using different methods and combining them in educational situations by considering resources and conditions.

The gamification method was associated with higher satisfaction, but it requires more resources, equipment, and skilled personnel. The flipped class method requires fewer resources, is more cost-effective, and provides more time for practice and group discussion. By combining these two methods, the advantages of both can be used, which is confirmed by the results of the present study. It seems that the upside-down environment provides a good opportunity for life-long training, including the promotion of interaction and teamwork, and along with other methods, it is also associated with more effectiveness and benefits.

In this study, knowledge and satisfaction of education had significant differences between groups, but students’ self-efficacy had not significant difference between groups. Maybe it was due to the fact that we participated in the second and third semesters of nursing students, and the interactive skills of students were not assessed. So, the researchers recommended that more research be conducted with the aim of investigating interactive and communication skills using gamification in a flipped environment.

Therefore, this method is helpful in nursing education as well as other medical fields. It is suggested that this method could be combined with other educational methods, such as task-based and team-based methods, to develop the possibility of developing team-based education and task-based education. Integrated gamification methods in the flipped learning environment with mobile applications have greater attractiveness and satisfaction with effective education, and with the use of appropriate applications, it is necessary to create a sense of competition and learning. But, in this study, the interactive skills of students were not assessed. Finally it is emphasized that teachers can improve the effectiveness of education with their creativity, depending on situation, time, cost, and available resources, by using and integrating educational methods.

The teaching method has an effect on students’ satisfaction with the teaching method, and the use of gamification in the flipped learning environment is more effective than the flipped class method, gamification, and the lecture method. Based on the results of the present research, it can be concluded that teaching methods have an effect on students’ learning and satisfaction. The teaching method has an effect on the satisfaction of the students, and the use of the flipped class method with the use of gamification was associated with more attractiveness and satisfaction in addition to learning. Teachers can improve the effectiveness of education with their creativity, depending on situation, time, cost, and available resources, by using and integrating educational methods.

Limitations

Not installing the program on IOS phones made it impossible for these users to use the application and drop out study, so we recommended that designed application for android and IOS. The ability of the professor to teach with the method of gamification in the flipped learning environment and his mastery of the application are necessary to provide necessary training to the teachers regarding the above methods.

Integrated gamification methods in the flipped learning environment with mobile applications have greater attractiveness and satisfaction. But, in this study, the interactive skills of students were not assessed. So the researchers recommended that more research be conducted with the aim of investigating interactive and communication skills using the gamification method in an upside-down environment.

Data availability

Data is provided within the manuscript or supplementary information files.

Khaledi A, Ghafouri R, Anboohi SZ, Nasiri M, Ta’atizadeh M. Comparison of gamification and role-playing education on nursing students’ cardiopulmonary resuscitation self-efficacy. BMC Med Educ. 2024;24(1):1–6.

Article   Google Scholar  

Pellegrino JL, Vance J, Asselin N. The Value of songs for Teaching and Learning Cardiopulmonary Resuscitation (CPR) competencies: a systematic review. Cureus. 2021;13(5).

Chi M, Wang N, Wu Q, Cheng M, Zhu C, Wang X, et al. editors. Implementation of the flipped Classroom combined with problem-based learning in a medical nursing course: a Quasi-experimental Design. Healthcare: MDPI; 2022.

Google Scholar  

Hernon O, McSharry E, MacLaren I, Carr PJ. The use of educational technology in teaching and assessing clinical psychomotor skills in nursing and midwifery education: a state-of-the-art literature review. J Prof Nurs. 2023;45:35–50.

River J, Currie J, Crawford T, Betihavas V, Randall S. A systematic review examining the effectiveness of blending technology with team-based learning. Nurse Educ Today. 2016;45:185–92.

Muntrikaeo K, Poonpon K. The effects of Task-based instruction using online Language games in a flipped learning environment (TGF) on English oral communication ability of Thai secondary students. Engl Lang Teach. 2022;15(3):9–21.

Rachayon S, Soontornwipast K. The effects of task-based instruction using a digital game in a flipped learning environment on English oral communication ability of Thai undergraduate nursing students. Engl Lang Teach. 2019;12(7):12–32.

Bergmann J, Sams A. Flip your classroom: Reach every student in every class every day. International society for technology in education; 2012.

Barbour C, Schuessler JB. A preliminary framework to guide implementation of the flipped Classroom Method in nursing education. Nurse Educ Pract. 2019;34:36–42.

Talbert R, Mor-Avi A. A space for learning: an analysis of research on active learning spaces. Heliyon. 2019;5(12).

Jowsey T, Foster G, Cooper-Ioelu P, Jacobs S. Blended learning via distance in pre-registration nursing education: a scoping review. Nurse Educ Pract. 2020;44:102775.

Blegur J, Ma’mun A, Mahendra A, Mahardika IMS, Tlonaen ZA. Bibliometric analysis of micro-teaching model research trends in 2013–2023. J Innov Educational Cult Res. 2023;4(3):523–33.

Yun S, Min S. A study on learning immersion, online class satisfaction, and perceived academic achievement of flip-learning online classes. J Surv Fisheries Sci. 2023;10(4S):432–41.

Sullivan JM. Flipping the classroom: an innovative approach to graduate nursing education. J Prof Nurs. 2022;38:40–4.

Ng EKL. Student engagement in flipped classroom in nursing education: an integrative review. Nurse Educ Pract. 2023:103585.

Kazeminia M, Salehi L, Khosravipour M, Rajati F. Investigation flipped classroom effectiveness in teaching anatomy: a systematic review. J Prof Nurs. 2022;42:15–25.

Özbay Ö, Çınar S. Effectiveness of flipped classroom teaching models in nursing education: a systematic review. Nurse Educ Today. 2021;102:104922.

Betihavas V, Bridgman H, Kornhaber R, Cross M. The evidence for ‘flipping out’: a systematic review of the flipped classroom in nursing education. Nurse Educ Today. 2016;38:15–21.

Tan C, Yue W-G, Fu Y. Effectiveness of flipped classrooms in nursing education: systematic review and meta-analysis. Chin Nurs Res. 2017;4(4):192–200.

Sari NARM, Winarto, Wu T-T, editors. Exemplifying Formative Assessment in Flipped Classroom Learning: The Notion of Bloom’s Taxonomy. International Conference on Innovative Technologies and Learning; 2022: Springer.

SivaKumar A. Augmenting the flipped classroom experience by integrating revised Bloom’s taxonomy: a faculty perspective. Rev Educ. 2023;11(1):e3388.

Merrett CG. Analysis of flipped Classroom techniques and Case Study Based Learning in an introduction to Engineering materials Course. Adv Eng Educ. 2023;11:2–29.

Banks L, Kay R. Exploring flipped classrooms in undergraduate nursing and health science: a systematic review. Nurse Educ Pract. 2022:103417.

Sezer TA, Esenay FI. Impact of flipped classroom approach on undergraduate nursing student’s critical thinking skills. J Prof Nurs. 2022;42:201–8.

Nevin CR, Westfall AO, Rodriguez JM, Dempsey DM, Cherrington A, Roy B, et al. Gamification as a tool for enhancing graduate medical education. Postgrad Med J. 2014;90(1070):685–93.

Verkuyl M, Romaniuk D, Atack L, Mastrilli P. Virtual gaming simulation for nursing education: an experiment. Clin Simul Nurs. 2017;13(5):238–44.

Jang K, Kim SH, Oh JY, Mun JY. Effectiveness of self-re-learning using video recordings of advanced life support on nursing students’ knowledge, self-efficacy, and skills performance. BMC Nurs. 2021;20(1):1–10.

Roel S, Bjørk IT. Comparing nursing student competence in CPR before and after a pedagogical intervention. Nursing Research and Practice. 2020;2020.

Ali WNAW, Yahaya WAJW, Waterfall -ADDIE, Model. An Integration of Software Development Model and Instructional Systems Design in Developing a Digital Video Learning Application. 2023.

Rodríguez S, Sanz AM, Llano G, Navarro A, Parra-Lara LG, Krystosik AR, et al. Acceptability and usability of a mobile application for management and surveillance of vector-borne diseases in Colombia: an implementation study. PLoS ONE. 2020;15(5):e0233269.

Govender T, Arnedo-Moreno J, editors. A survey on gamification elements in mobile language-learning applications. Eighth international conference on technological ecosystems for enhancing multiculturality; 2020.

Landers RN, Armstrong MB, Collmus AB. How to use game elements to enhance learning: Applications of the theory of gamified learning. Serious Games and Edutainment Applications: Volume II. 2017:457 – 83.

Toda AM, Klock AC, Oliveira W, Palomino PT, Rodrigues L, Shi L, et al. Analysing gamification elements in educational environments using an existing Gamification taxonomy. Smart Learn Environ. 2019;6(1):1–14.

Kellar SP, Kelvin EA. Munro’s statistical methods for health care research. Wolters Kluwer Health/Lippincott Williams & Wilkins; 2013.

Polit DF, Yang F. Measurement and the measurement of change: a primer for the health professions. Wolters Kluwer Health; 2015.

Sherer M, Adams CH. Construct validation of the self-efficacy scale. Psychol Rep. 1983;53(3):899–902.

Zou D, Luo S, Xie H, Hwang G-J. A systematic review of research on flipped language classrooms: theoretical foundations, learning activities, tools, research topics and findings. Comput Assist Lang Learn. 2022;35(8):1811–37.

Download references

Acknowledgements

The authors also wish to thank all the participants and those who helped us in carrying out the research especially all the staffs of Department of Medical Surgical Nursing of School of Nursing & Midwifery of Shahid Beheshti University of Medical Sciences.

The authors received no specific funding for this work.

Author information

Authors and affiliations.

Department of Medical Surgical Nursing, School of Nursing & Midwifery, Shahid Beheshti University of Medical Sciences, Vali-Asr Avenue, Cross of Vali-Asr Avenue and Hashemi Rafsanjani (Neiaiesh) Highway, Opposite to Rajaee Heart Hospital, Tehran, Iran

Raziyeh Ghafouri & Vahid Zamanzadeh

Department of Basic Sciences, School of Nursing & Midwifery, Shahid Beheshti University of Medical Sciences, Tehran, Iran

Malihe Nasiri

You can also search for this author in PubMed   Google Scholar

Contributions

VZ and RG formulates the research question that represents the systematic review objective. VZ and RG provide proposal and reports. RG collected the data. MN: Data analysis. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Raziyeh Ghafouri .

Ethics declarations

Ethics approval and consent to participate.

This study was approved by the ethics committee of Shahid Beheshti University of Medical Science (IR.SBMU.PHARMACY.REC.1402.152), and all methods were carried out in accordance with the research ethical codes of the Iran National Committee for Ethics in Biomedical Research. The authors guarantee that they have followed the ethical principles stated in the Declaration of Helsinki (to protect the life, health, dignity, integrity, right to self-determination, privacy, and confidentiality of personal information of research subjects) in all stages of the research. This is the online certificate of the research ethical code: https://ethics.research.ac.ir/ProposalCertificateEn.php?id=404003&Print=true&NoPrintHeader=true&NoPrintFooter=true&NoPrintPageBorder=true&LetterPrint=true . This study was registered in the Iranian Registry of Clinical Trials ( https://irct.behdasht.gov.ir ) on 14/12/2023, with the IRCT ID: IRCT20210131050189N7. To observe ethical considerations, School of Nursing & Midwifery of Shahid Beheshti University of Medical Sciences agreed to participate in the study; the research goals and procedures were elucidated to the participants, the participants were assured of information anonymity and confidentiality, and informed written consent was obtained from each participant and documented. They participated in the study voluntarily and could leave the study at any stage.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary material 2, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Ghafouri, R., Zamanzadeh, V. & Nasiri, M. Comparison of education using the flipped class, gamification and gamification in the flipped learning environment on the performance of nursing students in a client health assessment: a randomized clinical trial. BMC Med Educ 24 , 949 (2024). https://doi.org/10.1186/s12909-024-05966-2

Download citation

Received : 15 March 2024

Accepted : 28 August 2024

Published : 30 August 2024

DOI : https://doi.org/10.1186/s12909-024-05966-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Flipped classroom
  • Gamification, flipped learning environment
  • Mobile application

BMC Medical Education

ISSN: 1472-6920

gamification in education a systematic mapping study

Gamification in education: a systematic mapping study

Citation metadata, document controls, main content.

While gamification is gaining ground in business, marketing, corporate management, and wellness initiatives, its application in education is still an emerging trend. This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research results is proposed based on the extracted topics discussed in the reviewed papers. The categories include gamification design principles, game mechanics, context of applying gamification (type of application, educational level, and academic subject), implementation, and evaluation. By mapping the published works to the classification criteria and analyzing them, the study highlights the directions of the currently conducted empirical research on applying gamification to education. It also indicates some major obstacles and needs, such as the need for proper technological support, for controlled studies demonstrating reliable positive or negative results of using specific game elements in particular educational contexts, etc. Although most of the reviewed papers report promising results, more substantial empirical research is needed to determine whether both extrinsic and intrinsic motivation of the learners can be influenced by gamification.

Gamification in education, Game design elements, Systematic mapping study, Literature review

Introduction

Traditional schooling is perceived as ineffective and boring by many students. Although teachers continuously seek novel instructional approaches, it is largely agreed that today's schools face major problems around student motivation and engagement (Lee & Hammer, 2011). The use of educational games as learning tools is a promising approach due to the games' abilities to teach and the fact that they reinforce not only knowledge but also important skills such as problem-solving, collaboration, and communication. Games have remarkable motivational power; they utilize a number of mechanisms to encourage people to engage with them, often without any reward, just for the joy of playing and the possibility to win. Creating a highly engaging, full-blown instructional game however is difficult, time consuming, and costly (Kapp, 2012a), while typically targeting only a single set of learning objectives as chosen by the game designer. In addition, their effective classroom adoption requires certain technical infrastructure and appropriate pedagogical integration. As opposed to using elaborate games requiring a large amount of design and development efforts, the "gamification" approach suggests using game thinking and game design elements to improve learners' engagement and motivation.

Gamification, defined by Deterding et al. (2011) as the use of game design elements in non-game contexts, is a fairly new and rapidly growing field. The concept of gamification is different from that of an educational or serious game. While the latter describes the design of full-fledged games for non-entertainment purposes, "gamified" applications merely employ elements of games. The term "gamification" is quite recent: According to (Deterding et al., 2011) its first documented use is in 2008 but it did not see widespread adoption before the second half of 2010. Nevertheless, the concept itself is not new. For example, badges and ranks have been long used in the military, in the early Soviet era, game elements were used by the Soviet Union leaders as a substitute for monetary incentives for performing at work, etc.

In recent years gamification has seen rapid adoption in business, marketing, corporate management, and wellness and ecology initiatives. This is driven by its potential to shape users' behavior in a desirable direction. Loyalty programs such as the frequent-flyer programs, Foursquare, and Nike+ are often given as examples of successful gamified mass-market products. Stackoverflow.com provides another example in which users' reputations increase as they answer questions and receive votes for their answers. Online education sites such as codeacademy.com and khanacademy.org use game elements to better engage users. The more courses and lessons that users complete, the more badges they earn. Sites like eBay and Fitocracy use game elements to keep people engaged and to encourage friendly competition between users.

Gamification is still rising in popularity. According to Gartner's Hype Cycle (Gartner, 2013), a research methodology that outlines an emerging technology's viability for commercial success, gamification is at the peak of the Hype Cycle in 2013, with an expectation for reaching the productivity plateau in five to ten years. This position, however, mainly reflects its use in business contexts. The penetration of the gamification trend in educational settings seems to be still climbing up to the top, as indicated by the amount and annual distribution of the reviewed works.

This paper presents the results of a study of the published works on the application of gamification to education, which aims to shed light on the tendencies and emerging practices in this area. There are few literature reviews on gamification (see Xu, 2012; Hamari, Koivisto, & Sarsa, 2014; Nah, Zeng, Telaprolu, Ayyappa, & Eschenbrenner, 2014), with only the last one focusing on education. This study differs from the latter by presenting a thematic analysis instead of narrative summaries that focus on a qualitative review.

Systematic mapping study design

The main research questions behind this study were: "What educational contexts has gamification been applied to?" and "What game elements have been used in gamifying educational systems?" We used a systematic mapping design for the study. Systematic mapping studies are similar to systematic reviews, except that they employ broader inclusion criteria and are intended to map out topics rather than synthesize study results. A systematic mapping study provides a categorical structure for classifying the published research reports and results. The study presented here covers the existing work in the field of gamification in education: articles and conference papers published and indexed until June 30, 2014. The recency of the interest in conducting research on this topic is demonstrated by the distribution of the studied papers by year of publication, presented in Figure 1.

Inclusion, search, and screening

The inclusion criterion for the papers was to discuss explicitly the use of game elements in educational contexts. Note that motivation is a very central and fundamental topic in education (different from other contexts of application of gamification), and a lot of research has been done on it. Also, techniques such as feedback, ordering learning tasks by their complexity, personalization, etc., are as fundamentally essential for games as they are for education. Therefore, from an educational point of view, it would be unnatural to consider them as "game mechanisms" making their way to education. There is substantial motivation-related research, for example, on pedagogical methods such as inquiry-based learning, psychological research on intrinsic and extrinsic motivation, and self-regulation (see, for example, Deci & Ryan, 1985; Lei, 2010), on motivation for participation in social networks (see, for example, Vassileva, 2012), or technological approaches, such as course sequencing (see, for example, Brusilovsky & Vassileva, 2003), or adaptive learning systems (see, for example, Brusilovsky, 1999), etc. Consequently, papers presenting research on such topics (although related to principles and techniques considered by the traditional computer game theorists as game elements) are not included in this study. We are targeting a more holistic approach to the use of game design elements in education and consider them from the perspective of gamification: Can their game-like implementation motivate learners and enrich the educational experiences?

gamification in education a systematic mapping study

Categorization criteria

In order to answer the research questions, we performed a concept-centric review focusing on categories related to the context of use and game elements employed for gamification of education. The review of the papers provided us with information allowing the classification of the current research and work in the field along the following dimensions:

* Game elements

* Context: type of application

* Context: education level

* Context: academic subject

* Implementation

* Reported results from evaluation

With regard to the categorization of the game elements, we first surveyed the existing seminal, conceptual, and literature-review publications on gamification (not included in the 34 papers reporting empirical research). However, we discovered that there is not a commonly agreed classification of game design elements. For example, the popular game element "badges" is considered as a game interface design pattern in (Deterding et al., 2011), a game mechanic in (Zichermann & Cunningham, 2011), a game dynamic in (Iosup & Epema, 2014), a motivational affordance in (Hamari, Koivisto, & Sarsa, 2014), and a game component (a specific instantiation of mechanics or dynamics) in (Werbach & Hunter, 2012). Nevertheless, all authors define the game design elements at several levels of abstraction. For example, Zichermann and Cunningham (2011), following traditional computer game theorists, categorize game elements into mechanics, dynamics, and aesthetics. Mechanics define the way games (as systems) convert specific inputs into specific outputs. Dynamics guide how players and the game mechanics interact during the game. Aesthetics refer to the way the game mechanics and dynamics interact with the game designer's artistry, to produce cultural and emotional outcomes. Differently, Deterding et al. (2011) categorize game design elements at five levels of abstraction. Ordered from concrete to abstract, these are: interface design patterns; game design patterns or game mechanics; game design principles, heuristics or "lenses"; conceptual models of game design units; and game design methods and design processes.

For the purpose of reviewing the use of game elements in gamified educational contexts, we use a two-level framework. The first level combines the first two levels of Deterding's classification and, as most of the authors in the field, we refer to it as game mechanics. We further combine Levels 3 and 4 of Deterding's classification (game design principles and conceptual models) and call them educational gamification design principles. We use the term gamification design principles instead of game design principles to stress the fact that a number of these are not specific to games. In the education domain, some have been used in instructional systems as long as those have existed. These two categories roughly correspond to the first two components of the framework in (Zichermann & Cunningham, 2011). The last Deterding's category "game design methods and processes," as well as Zichermann's "aesthetics," are essential for the game elements' implementation but are not relevant to this mapping study.

To further identify the second level of the classification structure, we collected game mechanics and game design dynamics, patterns, and principles used in the 34 reviewed case studies on using gamification in education. We identified the use of the following game mechanics: points, badges, levels, progress bars, leaderboards, virtual currency, and avatars. Point systems manage the acquisition and spending of points that quantify user performance. Badges are given for special achievements. Based on the received points and badges, users are ranked on leaderboards that reflect their performance in comparison to other users. Levels show the user's expertise and progress and where the player is in the game. Progress bars provide a percentage-based graphical representation of the players' progress. Virtual currency is used for purchasing in-game (virtual) goods.

Table 1 below presents the identified educational gamification design principles with, where appropriate, the game mechanics typically used to implement them. For each principle, corresponding references are presented. Some of the listed educational gamification design principles are fundamental and always present in educational systems but may need to be adapted to fit the gamification paradigm. For example, the feedback should be immediate or with shortened cycles (not as in the current educational practices). Others have been used individually and sporadically by some instructors but still need re-thinking in light of gamification, and some are new design elements borrowed from video games.

Each of the 34 papers presenting empirical studies was evaluated to examine which of these defined categorization criteria were discussed.

Mapping study results

This section describes the distribution of published work on each classification criterion. As proposed above, the criterion of game elements is divided into two: gamification design principles and game mechanics.

Gamification design principles. Figure 2 shows the number of papers discussing each of the identified educational gamification design principles (see Table 1).

gamification in education a systematic mapping study

The principle "freedom to fail" presumes no penalties on poor task performance and typically includes allowing students to revise and re-submit assignments (e.g., Haaranen, Ihantola, Hakulinen, & Korhonen, 2014; Berkling & Thomas, 2013; de Byl & Hooper, 2013; Hentenryck & Coffrin, 2014) or re-take quizzes (O'Donovan, Gain, & Marais, 2013). Although this principle is perhaps one of the most controversial for applying in a conventional classroom, there are no empirical studies carrying out specifically its controlled evaluation.

Social engagement includes individual and team competitions (e.g., O'Donovan et al., 2013; Li, Grossman, & Fitzmaurice, 2014), taking part in group "guild" learning activities and work on team projects (e.g., Mak, 2013; Caton & Greenhill, 2013; Mitchell, Danino, & May, 2013; Burkey, Anastasio, & Suresh, 2013), cooperation and interaction with other students (e.g., Giannetto et al., 2013; Landers & Callan, 2011), etc.

Only six studies were found to investigate the impact of the use of a single game technique: one of a leaderboard (Hentenryck & Coffrin, 2014) and all the others of badges (Anderson, Huttenlocher, Kleinberg, & Leskovec, 2014; Hakulinen & Auvinen, 2014; Haaranen, Ihantola, Hakulinen, & Korhonen, 2014; Denny, 2013; Abramovich, Schunn, & Higashi, 2013). Only one study was identified to evaluate the effect of different type of game elements (badges) on different type of learners (Abramovich et al., 2013).

Game mechanics. Figure 3 shows the number of papers reporting the use of each of the identified game mechanisms. It confirms that the most popular game mechanisms are points, badges, and leaderboards.

gamification in education a systematic mapping study

The goal of this study was to review the directions and tendencies of the conducted research on the application of gamification to education and, more specifically, to shed light on the context of application and game elements used. Concerning the limitations of the review, as we stated, the selection criteria included only papers that clearly studied the effects of implementation of game elements in educational contexts. Similarly to (Hamari, Koivisto, & Sarsa, 2014), we excluded research on topics conceptually or theoretically close to gamification (such as intrinsic motivations) or with similar measured outcomes, and papers discussing similar topics but with different terms. Thus, this review provides a fresh, in-depth look on the empirical research being done particularly on the topic of gamification in education.

The study revealed that there are many publications on the use of gamification in education but the majority describe only some game mechanisms and dynamics and re-iterate their possible use in educational context, while true empirical research on the effectiveness of incorporating game elements in learning environments is still scarce. In addition, most of the empirical studies do not include a proper evaluation, which makes it difficult to conduct a metaanalysis of the results of these studies and speculate on general reasons for their successes or negative results. While the mapping study identifies some emerging tendencies in utilizing certain configurations of game mechanics and gamification design principles, their effect in learning context remains to be demonstrated in practice.

Although proper evaluation is mostly missing, the majority of the authors of the reviewed papers share the opinion that gamification has the potential to improve learning if it is well designed and used correctly. Therefore, more substantial empirical research is needed to investigate, in particular, the motivating effects of using single game elements in specific educational contexts and for particular types of learners. This would inform instructors who are interested in gamifying their courses and help them in deciding what game elements to use in their specific context.

gamification in education a systematic mapping study

Abramovich, S., Schunn, C., & Higashi, R. (2013). Are badges useful in education? It depends upon the type of badge and expertise of learner. Educational Technology Research and Development, 61, 217-232.

Akpolat, B. S., & Slany, W. (2014). Enhancing software engineering student team engagement in a high-intensity extreme programming course using gamification. In A. Bollin, E. Hochmuller, R. Mittermeir, T. Cowling, & R. LeBlanc (Eds.), Proceedings of 27th IEEE Conference on Software Engineering Education and Training (pp. 149-153). Klagenfurt, Austria: IEEE.

Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. In C. W. Chung, A. Broder, K. Shim, & T. Suel (Eds.), Proceedings of 23rdInternational Conference on World Wide Web (WWW'14) (pp. 687-698). Seoul, Korea: ACM.

gamification in education a systematic mapping study

Dominguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernandez-Sanz, L., Pages, C., & Martinez-Herraiz, J. J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380-392.

Gartner. (2013, August 19). Gartner's 2013 Hype Cycle for Emerging Technologies Maps Out Evolving Relationship Between Humans and Machines. Gartner. Retrieved June 1, 2014, from http://www.gartner.com/newsroom/id/2575515

Giannetto, D., Chao, J., & Fontana, A. (2013). Gamification in a social learning environment. Informing Science and Information Technology, 10, 195-207.

Gibbons, T. E. (2013). COR: A new course framework based on elements of game design. In W. D. Armitage (Ed.), Proceedings of 14th Annual Conference in Information Technology Education (SIGITE) (pp. 77-82). Orlando, FL: ACM.

Goehle, G. (2013). Gamification and web-based homework. Primus, 23(3), 234-246.

Gordon, N., Brayshaw, M., & Grey, S. (2013). Maximising gain for minimal pain: Utilising natural game mechanics. Innovations in Teaching & Learning in Information and Computer Sciences, 12(1), 27-38.

Haaranen, L., Ihantola, P., Hakulinen, L., & Korhonen, A. (2014). How (not) to introduce badges to online exercises. In J. Dougherty, & K. Nagel (Ed.), Special Interest Group on Computer Science Education 2014 (pp. 33-38). Atlanta, GA: ACM.

Hakulinen, L., & Auvinen, T. (2014). The effect of gamification on students with different achievement goal orientations. In B. Aris & A. Selamat (Eds.), Proceedings of Conference on Learning and Teaching in Computing and Engineering (LaTiCE 2014) (pp. 47-54). doi:10.1109/LaTiCE.2014.10

Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? A literature review of empirical studies on gamification. In R. Sprague et al. (Eds.), Proceedings of 47th Hawaii International Conference on System Sciences (pp. 3025-3034). doi:10.1109/HICSS.2014.649

Hentenryck, P. V., & Coffrin, C. (2014). Teaching creative problem solving in a MOOC. In J. Dougherty, & K. Nagel (Eds.), Special Interest Group on Computer Science Education 2014 (pp. 677-682). Atlanta, GA: ACM.

Holman, C., Aguilar, S., & Fishman, B. (2013). GradeCraft: what can we learn from a game-inspired learning management system?. In D. Suthers, & K. Verbert (Eds.), Proceedings of Third International Conference on Learning Analytics and Knowledge (pp. 260-264). Leuven, Belgium: ACM.

Iosup, A., & Epema, D. (2014). An experience report on using gamification in technical higher education. In J. Dougherty, & K. Nagel (Eds.), Special Interest Group on Computer Science Education 2014 (pp. 27-32). doi: 10.1145/2538862.2538899

Kapp, K. (2012a). Games, gamification, and the quest for learner engagement. T+D, 66(6), 64-68. Retrieved March 1, 2014 from https://www.td.org/Publications/Magazines/TD/TD-Archive/2012/06/ Games-Gamification-and-the-Quest-for-Learner-Engagement.

Kapp, K. (2012b). The gamification of learning and instruction: Game-based methods and strategies for training and education. San Francisco, cA: Pfeiffer.

Landers, R., & Callan, R. (2011). Casual social games as serious games: The psychology of gamification in undergraduate education and employee training. In M. Oikonomou, & L. C. Jain (Eds.), Serious games and edutainment applications (pp. 399-424). Surrey, UK: Springer.

Lee, J., & Hammer, J. (2011). Gamification in education: What, how, why bother? Academic Exchange Quarterly, 15(2), 146.

Lei, S. A. (2010). Intrinsic and extrinsic motivation: Evaluating benefits and drawbacks from college instructors' perspectives. Journal of Instructional Psychology, 37(2), 153-160.

Leong, B., & Luo, Y. (2011). Application of game mechanics to improve student engagement. In Proceedings of International Conference on Teaching and Learning in Higher Education. doi: 10.1.1.368.1256

Li, W., Grossman, T., & Fitzmaurice, G. (2014). CADament: A gamified multiplayer software tutorial system. In M. Jones, P. Palanque, A. Schmidt, & T. Grossman (Eds.), Proceedings of Conference on Human Factors in Computing Systems of the ACM Special Interest Group on Computer-Human Interaction (pp. 3369-3378). Toronto, Canada: ACM.

Mak, H. W. (2013). The gamification of college lectures at the University of Michigan. Retrieved June 1, 2014, from http://www.gamification.co/2013/02/08/the-gamification-of-college-lectures-at-the-university-of-michigan/

Mitchell, N., Danino, N., & May, L. (2013). Motivation and manipulation: A gamification approach to influencing undergraduate attitudes in computing. In P. Escudeiro, & C. de Carvalho (Eds.), Proceedings of European Conference on Game-Based Learning (pp. 394-400). Porto, Portugal: ACPI.

Morrison, B. B., & DiSalvo, B. (2014). Khan academy gamifies computer science. In J. D. Dougherty, & K. Nagel (Eds.), Special Interest Group on Computer Science Education (SIGCSE '14) (pp. 39-44). Atlanta, GA: ACM.

Nah, F. F. H., Zeng, Q., Telaprolu, V. R., Ayyappa, A. P., & Eschenbrenner, B. (2014). Gamification of education: A review of literature. In F. H. H. Nah (Ed.), Proceedings of 1st International Conference on Human-Computer Interaction in Business (pp. 401-409). Crete, Greece: LNCS Springer.

O'Donovan, S., Gain, J., & Marais, P. (2013). A case study in the gamification of a university-level games development course. Proceedings of South African Institute for Computer Scientists and Information Technologists Conference (pp. 245-251). doi:10.1145/2513456.2513469

Pirker, J., Riffnaller-Schiefer, M., & Gutl, C. (2014). Motivational active learning: Engaging university students in computer science education. In A. Cajander et al. (Ed.), Proceedings of 19th Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE '14) (pp. 297-302). Uppsala, Sweden: ACM.

Simoes, J., Redondo, R. D., & Vilas, A. F. (2013). A Social gamification framework for a K-6 learning platform. Computers in Human Behavior, 29(2), 345-353.

Thomas, C., & Berkling, K. (2013). Redesign of a gamified software engineering course. Proceedings of International Conference on Interactive Collaborative Learning (pp. 778-786). doi:10.1109/ICL.2013.6644707

Todor, V., & Pitica, D. (2013). The Gamification of the study of electronics in dedicated e-learning platforms. Proceedings of IEEE 36th International Spring Seminar on Electronics Technology, (pp. 428-431). doi:10.1109/ISSE.2013.6648287

gamification in education a systematic mapping study

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • PMC11340951

Logo of plosone

Menstrual hygiene management interventions and their effects on schoolgirls’ menstrual hygiene experiences in low and middle countries: A systematic review

Balem Demtsu Betsu

1 Department of Midwifery, College of Health Sciences, Mekelle University, Mekelle, Ethiopia

Araya Abrha Medhanyie

2 School of Public Health, College of Health Sciences, Mekelle University, Mekelle, Ethiopia

Tesfay Gebregzabher Gebrehiwet

L. lewis wall.

3 Department of Anthropology, College of Arts and Sciences, Washington University in St. Louis, St. Louis, MO, United States of America

4 Department of Obstetrics & Gynecology, Washington University in St. Louis, St. Louis, MO, United States of America

5 Department of Obstetrics & Gynecology, Ayder Comprehensive Specialized Hospital, College of Health Sciences, Mekelle University, Mekelle, Ethiopia

Associated Data

data are all contained within the manuscript and/or Supporting Information files.

Inadequate menstrual hygiene management can result in physical, social, psychological, and educational challenges for schoolgirls. To address these issues, researchers have conducted intervention studies, but the impact on school attendance has varied. This review has systematically collected and evaluated evidence about the effects of menstrual hygiene interventions on schoolgirls.

A systematic search of the literature was done and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA statement). Both peer-reviewed journals and gray literature were searched using PubMed and Google Scholar. The search included individual, or cluster randomized controlled trials, and quasi-experimental studies, and covered the period from the date of indexing until January 3, 2023.

A review of sixteen trial studies showed that menstrual hygiene interventions have a positive effect on schoolgirls’ school attendance, performance, and dropout rates, as well as on their menstrual knowledge, attitudes, practices, and emotional well-being. There was a low to medium risk of bias in most of the studies. Additionally, the literature overlooked the impact of interventions that involve parental and male engagement, interventions correcting community misperceptions about menstruation, and the impact of infrastructure improvements on water, sanitation, and hygiene.

Interventions aimed at improving menstrual hygiene management can enhance schoolgirls’ educational outcomes, and can improve their menstrual knowledge, attitudes, and practices by helping them manage their periods more effectively. Most interventions have focused on the provision of menstrual products and menstrual education but have neglected improvements in the physical environment at home and school and the social norms surrounding menstruation. Trial studies should take a holistic approach that considers the total socio-cultural environment in which menstrual hygiene management takes place, thus enabling stakeholders and policymakers to develop sustainable, long-term solutions to these problems.

Introduction

Menstrual hygiene management (MHM) is defined as “women and adolescent girls using a clean menstrual management material to absorb or collect menstrual blood that can be changed in privacy as often as necessary for the duration of a menstrual period, using soap and water for washing the body as required, and having access to safe and convenient facilities to dispose of used menstrual management materials” [ 1 ]. Sommer et al. also added that menstruators should understand the menstrual cycle and be able to manage it comfortably and confidently [ 2 ].

Globally, over 50% of females are of reproductive age, and 500 million lack adequate menstrual hygiene facilities [ 3 – 5 ]. Many girls reach menarche without adequate knowledge or the skills to manage menstruation hygienically [ 6 – 9 ]. More than half (52%) of adolescent girls in Ethiopia have never received any information about menstrual hygiene [ 10 ], because of religious taboos, socio-cultural misinformation, and inadequate menstrual supplies and facilities, which leads to fear, confusion, and lack of confidence when menarche occurs [ 11 – 15 ].

Challenges related to menstrual hygiene have been found to contribute to absenteeism, poor academic performance, and school dropout among girls [ 16 – 19 ]. In Sub-Saharan Africa, a significant proportion of girls (50%-70%) miss school for 1.6–2.1 days per month due to menstruation, and more than half of girls in Ethiopia miss school during their periods [ 18 , 20 ]. Menstrual hygiene challenges also have negative impacts on health, psychosocial well-being, economic opportunities, and gender equality [ 21 – 26 ]. These challenges include insufficient knowledge about menstruation; inadequate access to water, sanitation, and hygiene services; lack of adequate hygiene materials; and social norms unsupportive of those who menstruate [ 27 – 29 ].

Several programs and global initiatives, such as the ‘MHM in Ten Agenda’, are being implemented to enhance menstrual hygiene management among schoolgirls [ 30 ]. These programs have utilized various interventions including the provision of menstrual hygiene products and supplies, improved water sanitation and hygiene facilities, as well as increased health education.

Studies assessing the effect of these interventions on girls’ school attendance, performance, physical and psychosocial wellbeing, and their knowledge and attitudes toward menstrual hygiene management indicated varying results. Some studies have shown positive effects on school attendance, whereas others have demonstrated no effect [ 31 – 34 ].

One of the largest intervention studies assessing the effects of improved menstrual hygiene management on school attendance in the Tigray Region of Ethiopia, conducted during the 2015–2016 school year, demonstrated 24% fewer school absences among girls compared to boys and showed that student sex was not a predictor of school absence during a similar time-period during the previous academic year [ 35 ].

Before the search date of January 3, 2023, various systematic reviews were conducted to assess the impact of menstrual hygiene management interventions on schoolgirls. However, these reviews had different population intervention control outcome and time (PICOT) criteria, and some included studies that used cross-sectional research methods [ 9 , 21 , 22 , 36 ]. This review specifically focuses on schoolgirls and includes up-to-date intervention studies, which distinguishes it from earlier reviews in terms of time, context, and population.

This review appraises and synthesizes the current evidence on the effects of menstrual hygiene management interventions on girls’ school attendance, school performance, and school dropout, as well as their effects on emotional well-being, menstrual knowledge, attitudes, and menstrual hygiene practices.

Materials and methods

Study design.

We conducted the review in accordance with the reporting guidelines described in the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement [ 37 ].

Author’s positionality

I (the first author) am a woman, a feminist, and an advocate for girls’ education. I am currently pursuing a PhD in public health. I am from Ethiopia, one of the countries studied in this paper. This gives me first-hand experience of what it is like to be a menstruating schoolgirl in an LMIC. However, I am an outsider to the other countries studied in this paper, which may leave room for bias or misunderstandings in the interpretation of results. In this systematic review, the researcher’s standpoint influences the research approach and findings. This study advocates accessible menstrual hygiene resources and aims to address the stigma surrounding menstruation. The conclusions are based on this perspective, and readers are encouraged to take this into account when interpreting the findings.

Inclusion criteria

We included studies in this review based on the following criteria: participants, interventions and comparators, outcomes of interest, and type of study (study design) (PICOT) [ 38 ].

Participants

The search was limited to studies that measured outcomes on schoolgirls because the objective of the review was to evaluate how menstrual hygiene management intervention programs impact schoolgirls’ attendance, academic performance, or dropout rates.

Interventions and setting

The menstrual hygiene management interventions can be categorized as interventions involving menstrual education and/or the provision of menstrual supplies.

  • Menstrual education interventions include providing menstrual hygiene management information, puberty and reproductive health-related information, and training on the use of menstrual hygiene supplies.
  • Menstrual supply interventions include providing menstrual hygiene materials and supplies as well as upgrading water and sanitation facilities. Menstrual hygiene materials are products used to absorb menstrual flow, such as pads, cloths, tampons, or cups. Menstrual supplies include soap and detergent, underwear, and analgesic medications for menstrual cramps. Menstrual facilities include toilets and water infrastructure, as well as private spaces for washing, changing, drying, and disposing of menstrual materials [ 27 , 39 ].

Schoolgirls who did not receive any of the interventions listed above.

School attendance, school performance, school dropout, emotional wellbeing, knowledge, attitudes, and menstrual hygiene practices.

Type of study design

Studies included individual, or cluster randomized controlled trials and quasi-experimental or non-randomized controlled trials.

Publication type

We included peer-reviewed journal articles and gray literature

Exclusion criteria

We excluded studies not available in the English language and conference abstracts.

Source of information and search strategy

We retrieved data from PubMed and Google Scholar databases using a mix of medical subject headings (MeSH) and relevant keywords from the date of indexing to January 3, 2023 ( Table 1 ). Citation lists and hand searches were done to locate additional citations. We limited the language to English. The search was re-run shortly before the final analysis.

“adolescent girls” OR “college students” OR “university student” OR “schoolgirls” OR youth OR ladies OR puberty OR feminine OR gender OR parents OR mothers OR fathers OR community
hygiene OR sanitizer OR sanitary OR sanitation OR washing OR soap OR “menstrual cup” OR “menstrual tampon” OR napkin OR pad OR products OR technology OR training OR “latrine access” OR toilet OR bathroom OR “menstrual hygiene” OR “Personal hygiene” OR “sanitation facilities” OR WASH OR “water supply” OR “water access” OR “water source” OR absorb OR absorbent OR “health education” OR “menstrual management” OR intervention
“control group” OR homemade OR “worn out” OR rag OR cloth
catamenia OR menarche OR menstruation OR menses OR “menstrual blood” OR “menstrual flow” OR “menstrual fluid” OR “menstrual period”
absenteeism OR absent OR “academic performance” OR “school attainment” OR “school attendance” OR “school dropout” OR “school missing” OR “academic failure” OR vocation OR distract OR anxiety OR shame OR ashamed OR bullying OR mock OR embarrassment OR fear OR fearful OR distress” OR “isolation” OR “harassment” OR “intimidation” OR “confused” OR “depress OR confidence OR empower OR “menstrual health” OR “menstrual knowledge” OR “menstrual attitude” OR “menstrual practice” OR “movement restriction” OR “quality of life” OR wellbeing OR “reproductive health” OR psychology OR “mental health” OR psychosocial OR secrecy OR “self-esteem” OR shame OR empower OR understanding OR worries OR worry OR upset OR infection
Search #1 and Search #2 and Search #3 and Search #4 and Search #5
Filters used: English language, Human

Data management and selection process

We imported the identified, eligible studies into EndNote version X5, a specific software program for managing bibliographic data. Two independent researchers reviewed the data to double-check the title and abstracts against the eligibility criteria. Studies that the two reviewers agreed upon were subjected to full-text review. Any dispute was settled by a third reviewer and consensus was sought by discussion. Full-text articles of the potentially relevant studies were then screened for the final inclusion if they met eligibility criteria.

Data extraction process

A data extraction spreadsheet was prepared, and two reviewers extracted data manually. The spreadsheet was populated with the variables pertaining to the research question. From each study the following data were extracted; 1) Author name, 2) Year of publication, 3) Location, 4) Study design, 5) Population, 6) Sample size, 7) Duration of intervention, 8) Outcome measurement time, 9) Description of intervention, 10) Mode of intervention, and 11) Outcome of interest.

Risk of bias in individual studies

Two authors assessed the retrieved articles for quality and potential risk of bias using the Joanna Briggs Institute (JBI) critical appraisal assessment tools for Randomized Controlled Trials and Quasi-Experimental Studies/non-randomized experimental studies [ 40 ]. The studies that scored above half of the scored value of the tools were considered for minimum risk of bias and included in the review.

Data synthesis

We summarized data using tables, and narrative synthesis to include the type of intervention performed, characteristics of the target population, type of outcome, and a summary of the findings.

Sixteen trial studies that assessed the effect of menstrual hygiene management interventions on schoolgirls’ attendance, school performance, and school dropout, as well as emotional wellbeing and menstrual hygiene knowledge, attitudes, and practices were reviewed. This included 15 peer-reviewed articles and one article in the gray literature ( S1 Fig ). The studies represented a total of 17, 910 schoolgirls, 4,612 mothers, and 4,500 fathers/guardians from Ethiopia, Kenya, Nigeria, Ghana, Uganda, Iran, Nepal, Bangladesh, and Indonesia. The studies analyzed schoolgirls aged 9 to 25 years with a sample size that ranged from 60–8,839. The studies involved menstruating, pre-menarchal, and dysmenorrhea-affected schoolgirls, as well as parents ( Table 2 ).

Author name, year, and locationStudy designPopulation (P)and Sample size (SS)Duration of intervention (DOI)
and Outcome measurement time (OMT)
Intervention Description (DI) and mode of intervention (MOI)Outcome of interest
Abedian et al. 2011
Mashhad, Iran [ ]
Randomized controlled trial 19–25-year-old Dysmenorrheic University girls

Planed SS: 209
Actual SS: 165 (Peer-led education group n = 54; Health provider-led education group n = 50; Control group n = 61)
At baseline and two consecutive menstrual cycles (approximated to two months)
Immediately after intervention
: self-care education
Arm 1: received health provider-led self-care education
Arm 2: received peer-led self-care education
: Small group discussions about self-care education held by health providers and peer educators
• The mean score of menstrual knowledge significantly increased in both groups compared to the control group (the peer-led self-care group increased by 2.1 times and health-provider 2.5 times)
• Negative concepts of mean menstrual attitude decreased in the peer-led self-care education group (56.6 vs. 40.2, p = 0.009) more than the health-provider-led self-care education group (56.9 vs. 48.3, p = 0.035).
• The severity of dysmenorrhea decreased between the intervention arms and control arm but not significantly between the intervention groups
Agbede et al.
2021 Ogun State, Nigeria [ ]
Quasi-experimental 10–19-year-old rural school adolescent girls
: 120
(30 in each of 4 study arms)
4 weeks (number and length of sessions not indicated)
Immediately post-intervention (at 4 weeks) and 6 weeks follow-up
Health education related to menstrual hygiene practice
• Arm 1: peer-led education intervention
• Arm 2: parent-led intervention
• Arm 3: a combination of both
• Arm 4: Placebo
Menstrual hygiene practices of the three intervention arms have significantly improved both in the 4 (immediate post-intervention) and in the 6 week follow-up.
• While the third arm (combination of peer and parent recorded the highest mean score of practice
Austrian et al. 2019 Kenya [ ]Cluster-randomized controlled trial
(With Four arms)
10–21-year-old girls
: 3,276 schoolgirls
: 25 sessions each lasting for 65–95 minutes for 18 months(Weekly in 2017 and every two weeks in 2018)
after 18 months (immediately after completion of the intervention)

Arm 1: No intervention
Arm 2: Disposable sanitary pad
Arm 3: Reproductive health education
Arm 4: sanitary pad and reproductive health education
The sanitary pad and education include: one pack of Nia Teen disposable sanitary pads distributed monthly with pairs of underwear provided once per term
The reproductive health education includes puberty, gender, gender, power, and rights, being true to yourself
:
Trained facilitators provided facilitated health education (FHE) and distribution of health magazine developed by ZanaAfrica based on the UNESCO International Technical Guidance on Sexuality Education incorporating gender and power in sexuality and HIV education
• Provision of Pads improved menstrual hygiene management
• RH education led to improved SRH knowledge, self-efficacy, gender norms, and attitudes toward menstruation
• The combined intervention had stronger impacts on reducing shame/stigma around menstruation
• None of the interventions had an impact on education outcomes like school attendance and enrolment for the subsequent grade
Babapour et al. 2022
Sari, northern Iran [ ]
Quasi-experimental non-randomized controlled trial 11th-grade single students with regular menstruation

(30 in each of the three arms)
Six, one-hour sessions twice a week in WhatsApp messenger.
Not indicated
: The education sessions included: menstruation and menstrual disorders including PMS and measures to alleviate, life skills, female reproductive system
• Arm 1: received education from peers
• Arm 2: received education from a healthcare provider
• Arm 3: is the control group

• Education is held using WhatsApp messenger
• All three groups received routine school counseling.
• Education providers individually uploaded a pre-prepared audio files with the related PowerPoint file in each session and allowed participants to ask questions. At the end of each session, the healthcare provider/peer asked questions about the topics and motivated to participate in the discussion.
Premenstrual syndrome (PMS)
• PMS score decreased in the intervention groups compared to the control group.
• The effect size in the education by a health care provider group (Partial Eta Squared = 0.82, p < 0.0001) was more than the education by peers’ group (Partial Eta Squared = 0.67, p < 0.0001).
: General health and premenstrual dysphoric disorder
• The mean score of general health (a measure of emotional distress) significantly decreased in the education group by peers (Cohen’s d = 0.25, p<0.0001) and education by health care provider group Cohen’sd = 0.37, p<0.0001) compared with the control group.
• The intervention did not significantly reduce the frequency of premenstrual dysphoric disorder among the two intervention groups as compared to the control group (p>0.050).
Belay et al.
2020 Tigray Ethiopia [ ]
Quasi-experimental Grade 7–12 students
8,839 Students in 15 intervention schools
: one academic year
immediately post-intervention
Menstrual education provided to boys and girls
• Girls were provided with menstrual hygiene kits containing four locally produced, reusable menstrual pads and two pairs of underwear.
: School-based distribution of a booklet called Growth and Changes, written in English and Tigrinya (the local language).
• Students are encouraged to take the booklet home with them to share with their families.
• Additional oral instruction was provided on-site by project staff from Mekelle University
• Interactive question-and-answer sessions
• Distribution of 12 211 pamphlets
• Distribution of menstrual kit
• Demonstration of how to use sanitary pads for girls
Girls had 24% fewer absences as compared to the control arm during the post-intervention period.
Blake et al. 2017; Oromia Ethiopia [ ]Cluster-randomized study
triangulated with a qualitative approach
Grade 6 &7 schoolgirls
636
Puberty book provided to the girls for 4 weeks
Four weeks after the distribution of the book (no follow-up in between)
The Ethiopian version of the girl’s puberty book Growth and Changes.
The book targeted girls aged 10 to 14 years, covering puberty education, menstruation and menstrual hygiene management; and culturally tailored stories.
Book delivered to the study participants to read them.
The intervention had a positive effect on:
• The girls’ knowledge about menstruation with effect size of 0.6 (medium effect size
• Post-intervention, girls in the intervention group were less likely to indicate that they felt fear regarding menstruation (OR = 0.70, 95% CI = [0.51, 0.95]) or shame (OR = 0.61, 95% CI = [0.38, 0.96]) than girls in the control group.
Fakhri et al. 2013
Mazandaran province, Iran [ ]
Quasi-experimental
(Non-randomized controlled cluster trial
14 -18-year-old-girls with
low socio-economic status from
urban and rural public high schools
689 (349 intervention group and 349 control group)
: (20 hrs.) 10 sessions of 2 hr. each
(Not indicated for how long)
At the end of the education intervention
• Training about:
• personal health and hygiene during Menstruation• Significance of adolescence, physical and emotional changes during adolescence,• Pubertal and menstruation health and premenstrual syndrome : Intervention provided by the Youth and School Health Department to the intervention arm
• especially bathing and genital hygiene improved (61.6% in the experimental group compared with 49.3% in the control group engaged in usual bathing during menstruation (p = 0.002))
• was also significantly related to menstrual health.
Nyadoy et al. 2022 Uganda [ ]Randomized Controlled Trial primary school adolescent girls who reached menarche
60 (30 control and 30 intervention group
One-hour session twice a week, after classes for six weeks
Outcome assessed immediately after the intervention ended
Menstrual health management storying and gamification
: Storying involved Senior Women Teachers and other invited role models sharing stories about the facts and myths of menstruation and menstrual hygiene management. The games involved competitive ball games such as soccer, netball, and rope work
• Girls in the treatment group (t = 8.498, df = 29, p < .05) obtained significantly higher scores (in four courses, English language, Mathematics, Integrated Science, and Social Studies) than those in the control group
• The experiment group reported positive attitudes and expressed feelings of liberation from fear of boys during menstruation,
Oster et al. 2011
Chitwan District, Nepal [ ]
Randomized controlled trial Grade 7 and 8 schoolgirls
(25 girls assigned to treatment group from each school)
198
: One school-year intervention
Outcome assessed immediately after the intervention
Menstrual cup branded as Moon-cup
Treatment girls and their mothers were provided with menstrual cups and instructions on how to use them.
Girls were provided with a booklet of time diaries that included a menstrual calendar on which they were to note the start and end date of their period in each month.
The menstrual cup does not significantly increase school attendance
Paul Montgomery 2012
Ghana [ ]
Non-randomized- controlled trial 12–18-year-old schoolgirls
120
Five months
: At the third and fifth month (at the end of the intervention)
Provision of one pair of underwear and twelve pads per month for the duration of the study with instruction and demonstrations on how to use and dispose of the sanitary pads.Puberty educational about the development of secondary sex characteristics, menstruation, pregnancy, hygiene, and menses managementArm-1: Pads + puberty educationArm-2: Puberty educationArm-3: Control
➢ Trained research assistants provided puberty education
➢ All participants received a daily calendar, pencil, and sharpener to record their menstrual cycles
(pad + education): school attendance improved significantly among participants, (lambda 0.824, F = 3.760, p, .001)
education only resulted in a similar school attendance level (M = 91.26, SD = 7.82) all of which were higher than control (M = 84.48, SD = 12.39). The effect size, partial eta-squared, was 0.094.
Paul Montgomery et al. 2016
Uganda [ ]
Cluster Quasi-Randomized Controlled Trial Grade 3–5 schoolgirls
356 pre and post-menarcheal girls) from 8 rural schools
Single session of puberty education and two times of pad distribution and soap (one sachet, 45gram (18 months apart)
The education session lasted for 1.25hrs
: two years later
provision of reusable pad and Puberty education about menstruation, early pregnancy, life skills, prevention of HIV, strategies for avoiding sexual assault, healthy relationships, and friendship formation and goal setting.
puberty education
provided with reusable pad 3 pairs of underwear, one sachet, and 45 grams of soap with which to wash the pads.
puberty education and reusable sanitary pad
A control condition
• Control schools had 17.1% (95%CI: 8.7–25.5) greater drop in school attendance than those in any intervention school
• No psychosocial change was observed among the study arms
Phillips-Howard et al. 2016
Gem
District Kenya [ ]
Cluster randomized
controlled feasibility study
open-level RCT
: 14–16 years old girls (with no precluding disability) who experience at least three menses
:
3165
(644 analyzed) from
30 rural primary schools
15 months
at the end of the follow-up (intervention)
Girls in all arms received puberty and hygiene training; hand-washing soap; and pencils for calendar completion.
received one menstrual cup with written and verbal instructions on how to insert and clean
eceived 16 disposable pads and relevant instructions.
Control
: Nurses provided menstrual product-specific training from study nurses after enrolment
• Cups or pads did not reduce school dropout (control = 8.0%, cups = 11.2%, pads = 10.2%)
• This could not be analyzed because self-reported school absences were very rarely reported.
• : Lowered prevalence of C. trachomatis and T. vaginalis but not N. gonorrhea. The greatest impact was among girls who had been exposed to intervention for at least 9 months or 12 months.
• Prevalence of all STIs at the end-line survey was 7.7% in the control arm versus 4.3% in the pooled cups +pads arms
• : Bacterial vaginosis was lower in the cup arm (not significant), but not in the pad arm.
• : No case reported
Rezaei, et al. 2022
Iran [ ]
Quasi-experimental study 13–16- year-old high school students and their mothers

: 111 (56 students and 55 mothers)
: 112 (58 students and 57 mothers)
Not indicated
: Immediately after intervention and three months later
Educational intervention based on the PRECEDE model provided.
Adolescence, puberty, menstrual cycle, abnormal signs, and common problems associated with menstruation, menstrual health, exercise, nutrition, mobility, and pain control in menstruation
The education was provided in 3 sessions of two hours each using lecture, face-to-face discussion, and question/answer methods for students and mothers in the intervention arm
• The mean score of menstrual health behavior was significantly higher in the intervention group than in the control group, immediately (P < 0.001), and three months after intervention (P = 0.02)
• Mothers’ knowledge, attitude, and practice regarding menstrual health behaviors were significant reinforcing factors among the intervention group compared to the control group
Setyowati et al.2019
Indonesia [ ]
quasi-experimental
pre and post-test with a control group design
9-12-year-old schoolgirls who had not yet experienced menarche
174 girls
: Not indicated
Not indicated
Booklet containing information about preparation for menarche, reproductive organs, physical changes during adolescence, problems during menstruation and how to deal with it, and menstrual hygiene
:
Distribution of booklet to the intervention group
• Increased menstrual knowledge (OR = 45.1; 95% CI: 13.8–148.1)
• Positive emotional response (OR = 12.7; 95% CI: 5.6–28.5)
• Positive attitude towards menstruation (OR = 12.4; 95% CI: 5.8–26.6)
Sol et al. 2017 Bangladesh [ ]Cluster randomized impact evaluation Junior secondary school girls
planned SS: 3862 girls
Actual SS: 2127
(595 treatment-1, 570, treatment-2 and 962 control group)
4,500 mothers/guardians and 4,500 fathers/guardians attended the Household education sessions
At least twice a month from 2017–2019
Two years later (after the intervention)
Construction and maintenance of menstrual health-friendly toilet facilities at school. Incorporating puberty- and menstrual health modules in the school curriculum,A 2-day session to increase menstrual health knowledge and understanding of the benefits of safe menstrual hygiene was produced for parents /guardians schools receiving a school program schools receiving a school program combined with a targeted household program (‘combined program’) control schools
An extensive campaign to familiarize teachers, students, and parents, next to festivities, Group discussions, essay writing competitions, and screening of a TV-shows and extracurricular activities
educational outcomes, psychosocial outcomes, and empowerment of adolescent girls.
• Absence rates in treatment schools are significantly lower than in the control schools (no significant difference between the school program and combined program schools)
• School dropout was reduced in both treatment groups as compared to controls
:
• Increase in the knowledge of girls about menstruation and menstrual health (on both treatment arms
• Lowered restrictive beliefs surrounding the mobility of girls on their menses. (On both treatment arms)
• More likely to get permission to go to the toilet when they ask their teacher
• No treatment effects on teasing during menstruation
Wilson et al. 2014
Rural Kenya [ ]
Cluster randomized control Schoolgirls
302
(143 intervention and 159 control)
One session
: One month after intervention
Training on how to make a reusable sanitary pad and provision of equipment to make three reusable pads.
• rovide printed hand-out, as a reminder on how to make the pad and instructions about washing and drying, risk of infection or irritation of damp or poorly washed pad; with suggested ways to dry the pad outside and avoid embarrassment.
• Did not include general menstrual health education to evaluate the mere effect of pad use
: training and provision of handout
• The mean number of days of school missed decreased or stayed constant among the treatment group while schools in the control group either stayed constant or increased

The menstrual education components of the studies included puberty education, training on making reusable pads, distribution of books, magazines, posters, pamphlets, and menstrual calendars, as well as the incorporation of menstrual health topics into the school curriculum. Information was also shared through WhatsApp, face-to-face discussions, TV shows, festivals, essay competitions, storytelling, gamification, and question-and-answer sessions. These interventions were provided by trained individuals, including trained peer educators, teachers, research assistants, healthcare providers, and parents [ 31 , 32 , 34 , 35 , 41 , 42 , 44 – 46 , 49 – 52 ]. The menstrual supply interventions included the provision of disposable and reusable pads, underwear, menstrual cups, soap, or detergent to wash menstrual pads, and the installation or improvement of water, sanitation, and hygiene (WASH) facilities ( Table 2 ).

The reported trials evaluated several outcomes of interest, including school attendance, school dropout, and academic performance, as well as menstrual hygiene knowledge, attitudes, and practices, physical health, and emotional health including menstruation-related fear, shame, and stigma, as well as social attitudes regarding expected gender-related behavior (gender norms). Montgomery et al. suggested using school attendance and dropout rates as a proxy indicator of academic performance [ 32 ]. Some trials relied on self-reported/recorded attendance, which may have introduced recall bias, while others cross-checked attendance records [ 32 , 35 , 48 , 51 ] (Tables ​ (Tables3 3 and ​ and4). 4 ). The trial by Sol et al. cross-checked attendance of the school record with survey data using spot checks [ 50 ]. Official school attendance records were supplemented by individual diaries filled out by the schoolgirls in one of the trials [ 34 ]. Moreover, despite the presence of a standardized menstrual attitude questionnaire that can be validated contextually [ 53 ], some trials used non-standardized evaluation tools developed by specific researchers [ 31 , 42 , 45 , 52 ]. Causation is difficult to determine in some studies because the sample size was quite small [as few as 60 participants [ 46 ]].

JBI Critical Appraisal Checklist for Quasi-Experimental StudiesAgbede CO
2021
Babapour et al. 2022Belay et al. 2020Chiou et al 2007Darabi 2022Fakhri 2012Paul Montgomery 2012Paul Montgomery et al 2016Rezaei 2022Scott 2009Setyowati et al. 2019Yilmaz 2019
1. Is it clear in the study what is the “cause” and what is the “effect” (i.e., there is no confusion about which variable comes first)?YesYesYesNoYesYesNoYesYesNoYesYes
2. Were the participants included in any comparisons similar?YesUnYesYesUnYesYesYesYesUnYesNo
3. Were the participants included in any comparisons receiving similar treatment/care, other than the exposure or intervention of interest?UnYesUnNoUnYesYesYesYesYesYesUn
4. Was there a control group?YesYesYesYesYesYesYesYesYesYesYesYes
5. Were there multiple measurements of the outcome both pre and post-intervention/exposure?YesYesYesYesYesYesYesYesYesYesYesNo
6. Was follow-up complete and if not, were differences between groups in terms of their follow-up adequately described and analyzed?YesYesUnUnUnUnNoYesUnUnUnUn
7. Were the outcomes of participants included in any comparisons measured in the same way?YesYesYesYesUnYesYesYesYesYesYesUn
8. Were outcomes measured in a reliable way?YesYesYesYesYesYesYesYesYesUnYesYes
9. Was appropriate statistical analysis used?UnYesYesUnUnYesUnYesYesUnYesYes
787448698484
JBI Critical Appraisal Checklist for RCTAbedian et al. 2011Alexander et al. 2018Austrian et al. 2019Blake et al. 2017Djalalinia 2012Kokiwar 2020Mbizvo 1997Mohammadzadeh et al 2002Nyadoy et al. 2022Oster 2011Phillips-Howard 2016Sol et al. 2017Wilson, et al. 2014
1. Was true randomization used for the assignment of participants to treatment groups?YesYesYesYesYesYesNoYesYesYesYesYesYes
2. Was allocation to treatment groups concealed?UnUnUnUnUnUnUnUnUnUnNoUnNo
3. Were treatment groups similar at the baseline?YesNoYesUnYesUnNoYesYesYesYesYesYes
4. Were participants blind to treatment assignment?UnUnUnNoUnUnUnUnUnUnNoUnNo
5. Were those delivering treatment blind to treatment assignment?UnNoNoNoUnNoUnUnUnNoNoUnUn
6. Were outcomes assessors blind to treatment assignment?UnUnNoUnUnUnUnNoUnNoYesUnNo
7. Were treatment groups treated identically other than the intervention of interest?YesYesYesYesUnUnYesUnYesYesYesYesYes
8. Was follow-up complete and if not, were differences between groups in terms of their follow-up adequately described and analyzed?UnUnUnYesUnNoYesYesYesYesYesYesYes
9. Were participants analyzed in the groups to which they were randomized?YesYesYesYesUnNoYesYesYesYesYesYesYes
10. Were outcomes measured in the same way for treatment groups?YesUnYesYesUnYesYesYesYesYesYesYesYes
11. Were outcomes measured in a reliable way?YesYesYesUnUnNoNoYesYesYesYesYesYes
12. Was appropriate statistical analysis used?YesYesYesYesUnYesNoUnYesUnYesYesYes
13. Was the trial design appropriate, and any deviations from the standard RCT design (individual randomization, parallel groups) accounted for in the conduct and analysis of the trial?YesYesYesYesUnYesYesUnYesYesYesYesYes
86872456981099

Montgomery et al. carried out a study on peri-urban schools that were comparable, but they also incorporated a remote rural site lacking experience in using sanitary pads, with no access to electricity and unpaved roads. This may have affected baseline similarity and intervention fidelity, making it harder to determine the intervention’s actual effects [ 32 ]. In some studies, only a single-session educational intervention was provided, and only half of the girls attended the educational session in the study by Montgomery et al. [ 47 , 51 ]. Some studies did not provide information on the follow-up or dropout rates among the study groups [ 31 , 35 , 41 , 43 , 49 ], while others achieved a statistically significant improvement in school attendance and school performance using small sample sizes [ 32 , 46 ]. Blinding with respect to outcomes is crucial in reducing bias in experimental studies, but it is sometimes impractical to blind study participants, intervention providers, and assessors. This may lead to exaggerated intervention-effect estimates and performance bias [ 54 ]. Despite this, there are ongoing controversies concerning the advantage of blinding in clinical trials [ 55 – 57 ]. Outcome assessors, laboratory staff, and statisticians were blinded in only two trials [ 48 , 50 ].

The effect of menstrual hygiene management interventions on

Schoolgirls’ school attendance, performance, and dropout.

Of the trials that evaluated the effect of menstrual hygiene management interventions on school attendance, performance, and dropout, six studies reported that the intervention had a positive effect [ 32 , 35 , 46 , 47 , 50 , 51 ] while the remaining three studies found no significant effect [ 34 , 43 , 48 ].

Implementing pad and education interventions together increased school attendance by almost 6 days per term, equivalent to 9% of a girls’ school year. The study also showed that puberty education alone improved school attendance levels five months after intervention [ 32 ].

Belay et al. carried out an intervention at 15 schools (5 rural and 10 urban) involving 8,839 students, both male and female. All students received an educational intervention concerning menstruation and the female students also received four reusable pads and two pairs of regular underwear. School attendance was analyzed before and after the intervention and compared with attendance data from the prior school year. After the intervention, girls had 24% fewer school absences than boys and student sex was not a predictor of school absence during a similar time period during the previous academic year [ 35 ]. In another study, providing reusable pads, soap, and puberty education; training on making reusable sanitary pads and providing the equipment necessary to make pads resulted in decreased school absenteeism compared to controls [ 47 ].

School and household-based menstrual hygiene management interventions implemented in 148 schools involving 2,127 schoolgirls showed reduced school absences and dropout rates. The interventions included the integration of menstrual health education into the school curriculum and building/maintaining water, sanitation, and hygiene (WASH) infrastructure at schools. The provision of household interventions to improve parents’ knowledge didn’t show significant differences between the household-based and school-based intervention arms [ 50 ] ( Table 2 ).

On the other hand, three trials showed that school-based interventions did not affect school attendance or dropout. According to Phillips-Howard et al. providing either menstrual pads or cups did not reduce school dropout (control = 8.0%, cups = 11.2%, pads = 10.2%), though the finding should be taken with caution because of a nearly 40% loss-to-follow-up. Likewise, in this study school absenteeism was not analyzed because it was rarely reported [ 48 ]. The trial by Oster et al. found that providing menstrual cups to girls did not significantly increase school attendance [ 34 ]. This is congruent with the study by Austrian et al. that found no significant effect on school attendance after the provision of disposable sanitary pads and reproductive health education [ 43 ] ( Table 2 ).

Menstrual knowledge, attitude, menstrual hygiene practice, and emotional wellbeing

Studies have shown that both menstrual education and menstrual hygiene supply interventions have a positive effect on menstrual hygiene-related knowledge, attitudes, and practices among schoolgirls ( Table 5 ). These interventions help reduce menstrual-related shame, stigma, fear and also increase self-efficacy and promote open discussion about menstruation [ 31 , 41 – 43 , 45 , 46 , 49 , 50 , 52 ]. In Ethiopia, a trial by Blake et al. found that distributing puberty books to schoolgirls improved their menstrual knowledge and attitudes towards menstruation and reduced menstrual shame and fear [ 45 ]. The interventions had a significant effect on menstrual hygiene management practices such as increasing bathing during menstruation [ 31 , 43 ] ( Table 2 ). The impact of menstrual hygiene interventions on lower genital tract infections was assessed in one trial. Though non-significant, there was a lower prevalence of lower genital tract infections among the pooled menstrual cup plus sanitary pad arms, as compared to non-intervention arms [ 48 ] ( Table 2 ).

AuthorType of interventionMeasured outcomes
School attendanceSchool performanceSchool dropoutMenstrual knowledgeMenstrual
attitude
Menstrual
Practice
Emotional wellbeingPhysical health
Abedian et al. 2011 Mashhad, Iran [ ]Self-care education
Agbede et al 2021 Ogun State, Nigeria [ ]Health education related to menstrual hygiene practice
Austrian et al. 2019, Kenya [ ]Disposable sanitary pad; reproductive health education; sanitary pad plus reproductive health education
Babapour et al. 2022 Sari, Northern Iran [ ]Education delivered by peers and by healthcare provider
Belay et al. 2020 Tigray, Ethiopia [ ]Provision of menstrual education
Blake et al. 2017 Oromia, Ethiopia [ ]Delivery of puberty book (Growth and Changes)
Fakhri et al. 2013 Mazandaran province, Iran [ ]Providing puberty and menstrual education
Nyadoy et al. 2022 Uganda [ ]Menstrual health management story letting and games
Oster et al. 2011 Chitwan District, Nepal [ ]Delivering menstrual cup
Paul Montgomery 2012 Ghana [ ]Delivering disposable pads and puberty education
Paul Montgomery et al. 2016 Uganda [ ]Provision of reusable pads and puberty education
Phillips-Howard et al. 2016 Gem
District, Kenya [ ]
Delivering puberty and hygiene training; hand-washing soap; and pencils for calendar completion
Rezaei, et al. 2022 Iran [ ]Provision of adolescence, puberty, and menstrual education
Setyowati et al.2019 Indonesia [ ]Provision of a booklet about preparation for menarche, reproductive organs, and physical changes during adolescence
Sol et al. 2017 Bangladesh [ ]Construction and maintenance of menstrual health-friendly toilet facilities at school. Incorporating puberty- and menstrual hygiene modules into the school curriculum
Wilson et al. 2014 Rural Kenya [ ]Training on how to make a reusable sanitary pad and provision of equipment to make three reusable pads

Key : 0 = No Impact, + = Positive Impact

This review included trial studies that implemented different types of menstrual hygiene management interventions using diverse delivery strategies, different types of intervention providers, and different durations of intervention. School attendance, school performance, school dropout, menstrual hygiene knowledge, attitudes, and practices, and aspects of emotional health related to menstruation such as menstrual stigma and shame were outcomes of interest.

Six trial studies indicated a positive effect of interventions on school attendance, school dropout rates, and schoolgirls’ academic performance [ 32 , 35 , 46 , 47 , 50 , 51 ]. However, most of the studies had low to moderate levels of bias (Tables ​ (Tables3 3 and ​ and4). 4 ). School attendance is usually documented by schoolteachers or by using self-reported diaries, but this method may not provide data accurate enough to reach firm conclusions. In addition, school attendance alone may not be predictive of the academic performance of schoolgirls. Betsu et al. found that a girl’s physical presence in a classroom did not necessarily correlate with her mental presence or paying attention [ 58 ]. Moreover, mood swings and severe premenstrual symptoms resulting from hormonal changes during menstruation impact paying attention [ 59 ]. Additional indicators such as formal educational achievement, school participation, and enrollment in the succeeding grades of school might provide a more robust picture of schoolgirls’ academic achievement and continuing access to education. The trial by Nyadoy et al. showed improved academic scores after telling stories and playing games about menstrual hygiene management in the intervention arm; however, the outcome was measured only 6 weeks after the baseline assessment, and the small sample size makes it difficult to draw firm conclusions [ 46 ].

On the other hand, some studies have found interventions to have no effect, including the studies that evaluate menstrual cups [ 34 , 43 , 48 ]. Despite being a potentially viable intervention, many people falsely believe that menstrual cups can cause loss of virginity and reduced fertility [ 60 ]. Furthermore, menstrual cups may be difficult to clean effectively whenever water supplies are inadequate. This may influence the results of interventions using this device. Studies reporting positive effects, or no intervention effect may suffer from different forms of bias, posing challenges for policymakers and stakeholders looking for evidence-based menstrual hygiene interventions.

The systematic review by Chandra-Mouli et al. highlighted the importance of providing accurate biological information to menstruating girls. In most cases, girls receive most of their information from their mothers, but schoolgirls also seek menstrual information and support from older siblings, and their peers. All of these sources, and particularly their mothers, may be significant sources of menstrual misinformation [ 17 , 58 ]. There is a great need to improve community knowledge of the biology of menstruation, but despite this fact, mothers as a group are generally not targeted for improved education. In most of the studies we reviewed, premenarchal schoolgirls, in particular, receive insufficient education concerning menstruation, leaving them unprepared for the biological changes associated with menarche and contributing to their frustration, bewilderment, and anxiety when menstruation begins [ 61 ].

For schoolgirls to manage menstruation safely and comfortably, they need supportive social norms in the community as well as a welcoming environment both at home and at school. Interventions that improve parental involvement in menstrual hygiene management and that also target community sources of menstrual misinformation are generally lacking in the literature. The study by Sol et al. that engaged parents found a positive effect on menstrual hygiene management and school attendance [ 50 ]. Another study by Agbede et al. looking at the combined effect of peer and parent educational interventions had the highest mean score of menstrual hygiene management practice among its study arms [ 42 ].

Discussing menstruation with male family members (including, and perhaps especially, fathers) is another challenge faced by schoolgirls [ 62 ]. Approximately 13% of Tanzanian girls have encountered period teasing, while over 80% expressed fear of being teased, particularly by male classmates. This results in reduced school attendance, participation, and concentration in class [ 63 ]. Another article exploring the beliefs and attitudes boys and men hold about menstruation revealed that men generally have more negative attitudes towards menstruation and view it as debilitating and requiring secrecy. However, these attitudes may soften as men age and gain more knowledge and experience with menstruation [ 64 ]. Certain religious texts can be interpreted to associate menstruation with impurity and uncleanliness, which leads to menstrual restrictions, shame, and taboos in some cultures [ 65 ]. Many of these challenges are unaddressed by most of the menstrual intervention studies. A qualitative investigation by Betsu et al. indicated that many school teachers support attitudes promoting menstrual secrecy by their comments in class concerning menstrual hygiene, saying things like “drying reusable pads in a hidden place is helpful to prevent Michi , ” a folk-ailment believed by many locals in Ethiopia to be caused by the exposure of used or washed menstrual pads to sunlight [ 58 ]. Those who provide menstrual hygiene education and interventions should be aware of common cultural misperceptions regarding menstruation that exist in their communities. Better training of the teachers who provide classroom instruction concerning menstruation is also needed.

The review has certain limitations. Many of the studies that were included in this review relied on self-reported menstrual knowledge, attitude, and practices, as well as potentially inaccurate school attendance records, which could lead to over- or under-estimation of the findings due to poor recording of school attendance, social desirability bias and recall bias. Most of the studies reviewed did not address the impact of water, sanitation, and hygiene interventions or other community-based interventions on menstrual hygiene management. The review consisted of trials that used different interventions and methods of measuring outcomes and included a wide range of ages (9–25 years). These variations make it challenging to compare the studies with one another and to capture accurately the impact of menstrual hygiene interventions on the outcomes of interest. All relevant studies may not have been captured for this review due to limitations in the search strategies and limiting the studies reviewed to those in English. Most of the literature about menstrual hygiene management, especially in low- and middle-income countries, doesn’t adequately address the needs of people who identify as gender-nonconforming. Since gender-diverse persons make up such a small percentage of the population, it can be assumed that most of the academic literature on MHM is written from the perspective of cis women. This exclusion may affect menstrual hygiene needs and experiences of transgender, non-binary, and other gender-varied individuals [ 66 ]. There was a paucity of randomized controlled trials and quasi-randomized controlled trials, and this may have biased the resulting literature. As a result, conclusions concerning the effectiveness of menstrual hygiene interventions should be interpreted with caution.

The review also has several strengths, providing an extensive summary of English-language evidence. It offers valuable insights by presenting a comprehensive review of English-language trial studies that evaluate the effect of menstrual hygiene management interventions on various aspects of schoolgirls’ lives. With a large sample size from multiple countries, the study covers a broad range of interventions, including puberty education, distribution of menstrual supplies, and integration of menstrual health topics into school curriculums. The findings not only underscore the positive effects of these interventions, such as increased school attendance and enhanced menstrual hygiene knowledge and attitudes but also shed light on the challenges and limitations observed in certain studies. This review will also have a great contribution to identifying research gaps for further studies.

The results of this review have several implications for practice in the field of menstrual hygiene management. It highlights the need for comprehensive and accurate education about menstruation, not only for girls but also for their parents, teachers, and communities. This education should address misconceptions, and cultural taboos, and provide information on appropriate menstrual hygiene practices. This can be implemented by incorporating menstrual hygiene management into school curriculum and training; providing access to affordable and hygienic menstrual products; ensuring adequate water and sanitation facilities and creating supportive environments that reduce stigma and shame associated with menstruation.

The findings of this review have important policy implications. Governments and policymakers should prioritize menstrual hygiene as a public health issue and develop policies and guidelines to meet the needs of menstruating girls including affordable menstrual products, proper hygiene facilities, education about menstruation, and access to healthcare services for managing menstrual health. It is also crucial to address cultural beliefs and misconceptions surrounding menstruation through awareness campaigns and community engagement. Adequate funding should be allocated to ensure the effective implementation and monitoring of these policies to ensure that all girls have access to menstrual hygiene facilities and education.

While this review provides valuable insights into the effectiveness of menstrual hygiene management interventions, there are several areas that require further research. Future studies should aim to overcome the limitations identified in this review, such as biases and small sample sizes. Longitudinal studies with larger sample sizes are needed to assess the long-term impact of menstrual hygiene management interventions on school attendance, academic performance, and emotional well-being. Additionally, more research is needed to explore the effectiveness of different delivery strategies and intervention providers. It would also be beneficial to investigate the cultural and social factors that influence menstrual hygiene practices and develop interventions that address these specific contexts. Overall, future research should focus on generating robust evidence to inform the development of evidence-based interventions and policies in the field of menstrual hygiene management.

Menstrual hygiene management interventions can have a positive impact on schoolgirls’ attendance, reducing dropout rates, and improving their school performance and emotional health. Moreover, such interventions can improve knowledge, attitudes, and practices pertaining to menstruation and its management. A holistic approach that includes accurate menstrual education, better access to hygiene products, improved water, sanitation, and hygiene facilities; and greater engagement of parents, religious and community leaders is likely to make the greatest impact in this area. Of crucial importance is treating all who menstruate with the respect they deserve and reducing the stigmatization and shame that often surrounds this biological process.

It is also important to standardize the interventions used as well as the tools used to measure outcomes if such programs are to be evaluated properly. This will help to identify best practices and improve the overall effectiveness of the menstrual hygiene interventions used. Organizing large randomized clinical trials to address these issues in a well-structured manner would be extremely useful in moving our knowledge forward on how to improve menstrual hygiene among schoolgirls in low- and middle-income countries.

Supporting information

S1 checklist, s1 protocol, funding statement.

The author(s) received no specific funding for this work.

Data Availability

  • PLoS One. 2024; 19(8): e0302523.

Decision Letter 0

PONE-D-23-35026Menstrual hygiene management interventions and their effects on schoolgirls’ menstrual hygiene experiences in low and middle countries: A systematic reviewPLOS ONE

Dear Dr. Betsu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Both reviewers have expressed some minor points which should be easy to address.

Please submit your revised manuscript by Jan 19 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at  gro.solp@enosolp . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Alison Parker

Academic Editor

Journal requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf .

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ ".

3. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate ""supporting information"" files".

4. Please remove your figures from within your manuscript file, leaving only the individual TIFF/EPS image files, uploaded separately. These will be automatically included in the reviewers’ PDF.".

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: N/A

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I would encourage the authors to tighten the piece prior to publication in two ways. First, the nature of the search seems to have translated into several important studies escaping capture as part of the dataset. This is not fatal; it is the nature of the searches the authors chose to run. But I think the authors will want to cabin their conclusions as being only as good as the data the searches yielded, acknowledging that other work that did not fit the authors' relatively narrow criteria were therefore excluded. Second, I think the authors would be well-served to address the linguistic challenges in talking about "women and girls" and "menstrual hygiene," when those terms have been made much more complicated by excellent work in this field. The authors gesture at this by the use of the term "menstruand" (which I found jarring and out of synch with most other scholarship in the field," but they never address the issue head-on.

Reviewer #2: General

Much is written in passive voice – active voice would be preferable. Occasionally you use ‘we’ – you should pick one narrative style and stick to it.

I don’t think it’s necessary to have the acronyms listed since there are only two (unless this is a requirement of the journal then please ignore me). You haven’t included PICOT.

There are times when you spell out MHM and others when you use the acronym – be consistent and use the acronym throughout

The paper should recognise that it isn’t just cisgender women who menstruate but potentially also transgender men, non-binary and other gender diverse persons. The term ‘menstruator’ could be used instead of women and girls to be inclusive.

I think it would be helpful if you stated the countries where studies present different evidence else you might fall into making sweeping generalising comments. For example lines 88-89.

You’ve used WASH as an acronym and spelled out but haven’t introduced it as an acronym – please revise

You could consider adding a positionality statement at the beginning of the paper.

Why were no studies in any Ethiopian languages selected?

‘intervention’ seems like a rather broad keyword

MHM definition – could point out that depending on the materials used somewhere to wash and dry reusable materials is also necessary. Could also mention the access to and ability to wash and dry underwear is also a necessity.

Lines 84-87 its clearer written as: More than half (52 %) of adolescent girls in Ethiopia

have never received any information about menstrual hygiene due to socio-cultural

87 misinformation, religious taboos, and inadequate menstrual supplies and facilities, which leads to fear, confusion, and lack of confidence when menarche occurs (11-15).

Line 93 – what is meant by gender empowerment exactly? Vague phrase it might be interesting to unpack it.

111-112 you use the word review a lot

Good justification for the work.

I wonder if it would produce, more results if you googled gender neutral terms like ‘menstruator’ – it could be written as a limitation if you didn’t do this.

The systematic review following PRISMA is clearly and transparently described. Having three reviewers to judge papers against the outlined eligibility criteria reduces bias.

Line 175 - I don’t think mode of intervention needs an explanation.

The search strategy is well documented and comprehensive

Data bases and other sources of information are specified

The process of study selection is clearly outlined.

The process of data extraction is well documented

The key characteristics of included studies is clearly presented.

The studies were rigorously assessed for risk of bias using the Joanna Briggs Institute critical appraisal assessment tools

Line 192-193 - I think you mean Saudi Arabia, not Saudi Riyadh

From like 251 – have you listed all of the education components because saying they ‘included things such as…’ makes it seem that the list is not exhaustive but it seems to be that way. And perhaps it should be if not too long to include each component.

Line 279 - Good and transparent analysis of intervention fidelity

Interesting discussion on blinding.

Line 305 – et al is repeated

Table 2 and 3 – could we have colour code for severity of bias?

Table 4 – reduce space between lines so table is less spread out – its currently across 13 pages

Table 4 – expand acronyms

Table 5 – I assume the 0 means no impact and + means positive impact but you need to dd this key somewhere. It would be clearer if you also did a colour i.e. green for positive effect , yellow for neutral. It would also look better if the symbols were in the centre of the square. Table 5 – could you add the type of intervention into the summary table and group similar types of intervention together?

370 – was the not paying attention due to hormonal fluctuations or worry and concern about not being able to manage their period?

An important narrative I feel is missing more on which there is a growing body of literature on is the role of men/boys/non-menstruators is upholding stigma/teasing etc. you touch upon this in lines 405-406 but feel some more literature on how non-menstruators act as a barrier could be added in.

407 – careful not to generalise all religious beliefs be specific.

Implications

447-449 – be more specific – state the unmet needs

Seems like the conclusion is the first instance apart from the title where you mention low and middle income countries… why would this not be an issue in high income countries? The United Kingdom is currently going through a cost of living crises where people are in hygiene poverty – unable to buy basic hygiene items like menstrual pads. Ref - https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0255001&utm_source=miragenews&utm_medium=miragenews&utm_campaign=news

Furthermore – Saudi Arabia is one of the countries studied, which is a high income country.

Is categorising countries by their economic status quite western and neoliberal?

6. PLOS authors have the option to publish the peer review history of their article ( what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: No

Reviewer #2:  Yes:  Georgia Hales

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool,  https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at  gro.solp@serugif . Please note that Supporting Information files do not need this step.

Author response to Decision Letter 0

17 Jan 2024

To Reviewer 1

• Dear reviewer, the conclusion provided in the manuscript is yielded from the findings (literatures reviewed). The findings evidenced that the interventions can enhance schoolgirls' educational outcomes, and can improve their menstrual knowledge, attitudes, and practices by helping them manage their periods more effectively.

• We used the term “Menstruant” not “menstruand” may be it is editorial error. The use of women and girl is more dominant in WASH sectors. While menstruants is emerging form gender inclusive perspective, hence, in the write up we tried to balance the use of the terms. However our search clearly identified literatures that assessed the effect of menstrual interventions on “school girls”.

To Reviewer 2

Authors’ response

• We have converted passive voice to active voice in most of the relevant sections.

• Acronyms have been spelled out and made consistent in the current version.

• Although "Menstruants" is a gender inclusive term, the primary objective is to assess its effect on “school girls” and we had to be specific to these group of study participants. Moreover, the studies we have reviewed mostly used the term "Schoolgirls," "Girls," and "Women". For this reason, we maintained the terms. However, in the write up section we have also considered “menstruants”

• The findings are form different low and middle income countries, and citation is in place ( line 89)

• The academic and research language for Ethiopia is English. So, there is no study conducted using Ethiopian language and which is not included.

• We have included positionality statement under the method section on the current version (line 128)

“Intervention" is preceded by "menstrual hygiene management" and expressed as “menstrual hygiene management interventions” to be more specific, (lines 27 and 34)

Authors’ Response: Agreed, we utilized the standard definitions, and employing operational definitions may provide further assistance.

Lines 84-87 its clearer written as: More than half (52%) of adolescent girls in Ethiopia have never received any information about menstrual hygiene due to socio-cultural

The issue is fixed accordingly: (line 86-89)

• “More than half (52 %) of adolescent girls in Ethiopia have never received any information about menstrual hygiene (10), due to religious taboos, socio-cultural misinformation, and inadequate menstrual supplies and facilities, which leads to fear, confusion, and lack of confidence when menarche occurs (11-15).”

• “gender empowerment” modified to “gender equality” ( line 93)

• In fact, we purposefully limited our search terms to be gender-specific to highlight the impact the interventions on schoolgirls, but it is still valued concern because it may have limited searching relevant literature. We have included it on the limitation section of the manuscript

Authors’ Response

Written as “Mode of intervention” only (Line 200, in the modified version)

• Saudi Arabiya is excluded from the analysis as it is one of the high income countries. And modification is made on the manuscript accordingly ( Line 215)

From line 251 – have you listed all of the education components because saying they ‘included things such as…’ makes it seem that the list is not exhaustive, but it seems to be that way. And perhaps it should be if not too long to include each component.

Modified as “The menstrual education components of the studies included; puberty education, training on…” (line 239)

Authors’ response: Amendment made (the repeated et al is deleted/ line 295)

Table 2 and 3 – could we have color code for severity of bias?

Authors’ response: Color code is given accordingly

Authors’ response: Resolved (line space of the table is reduced)

Table 5 – I assume the 0 means no impact and + means positive impact but you need to add this key somewhere. It would be clearer if you also did a colour i.e. green for positive effect, yellow for neutral. It would also look better if the symbols were in the centre of the square. Table 5 – could you add the type of intervention into the summary table and group similar types of intervention together?

• Acronyms are expand on the heading section

• Key is provided for Table-4 on line 337

Authors’ response: lack of attention in education could be attributed by both the hormonal fluctuations and worry about not being able to manage their period. We have added additional literatures to illustrate it. (Line 353)

Authors’ Response: Noted and we have added more details as follows

“One article exploring the beliefs and attitudes boys and men hold about menstruation revealed that men generally have more negative attitudes towards menstruation and view it as debilitating and requiring secrecy. However, these attitudes may soften as men age and gain more knowledge and experience with menstruation” (line 390)

407 – careful not to generalize all religious beliefs be specific.

Authors’ response: Addressed in line 394 as “most religious beliefs”, to avoid generalization.

Authors’ Response: specified on the current version on line 435-439

“Governments and policymakers should prioritize menstrual hygiene as a public health issue and develop policies and guidelines to meet the needs of menstruating girls including affordable menstrual products, proper hygiene facilities, education about menstruation, and access to healthcare services for managing menstrual health.”

Seems like the conclusion is the first instance apart from the title where you mention low- and middle-income countries… why would this not be an issue in high income countries? The United Kingdom is currently going through a cost-of-living crises where people are in hygiene poverty – unable to buy basic hygiene items like menstrual pads. Ref - https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0255001&utm_source=miragenews&utm_medium=miragenews&utm_campaign=news

Is categorizing countries by their economic status quite western and neoliberal?

� Menstrual hygiene management is indeed an issue that affects individuals in both high-income and low-income countries. In high-income countries, access to menstrual products and facilities for proper hygiene may be more readily available (as compared to low income countries), but issues such as stigma and access to education about menstrual hygiene persist. In low-income countries, the challenges may include limited access to sanitary products, clean water, and sanitation facilities, as well as social stigma and inadequate education about menstrual health. Therefore, addressing menstrual hygiene management is an important aspect of promoting gender equality and ensuring the well-being of individuals across different socioeconomic contexts.

� We have used the World Bank classification of countries based on economic status and we have excluded the finding from Saudi Arabia.

� Categorization is made by income level ( world bank)

Submitted filename: Response to Reviewers .docx

Decision Letter 1

29 Jan 2024

PONE-D-23-35026R1Menstrual hygiene management interventions and their effects on schoolgirls’ menstrual hygiene experiences in low and middle countries: A systematic reviewPLOS ONE

Thanks for doing a good job with the first round of comments.   I'm afraid both reviewers have some further things for you to address but I think these should be pretty straightforward now. Please submit your revised manuscript by Mar 14 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at  gro.solp@enosolp . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: (No Response)

2. Is the manuscript technically sound, and do the data support the conclusions?

3. Has the statistical analysis been performed appropriately and rigorously?

4. Have the authors made all data underlying the findings in their manuscript fully available?

5. Is the manuscript presented in an intelligible fashion and written in standard English?

6. Review Comments to the Author

Reviewer #1: Line 24: uses passive voice

Line 32: “Accordingly” doesn’t flow from previous sentence

Line 35: “However” is clunky here.

Line 82: You use the word “menstruants” without explaining this word choice. This absolutely needs to be addressed. It is not widely accepted (by two different “camps” for different reasons). It is jarring and merits context. If you believe that this is the term that is emerging, you should at least cite to some authority for that, because I don’t think there is consensus/agreement that many readers will have heard it before (“menstruator” is much more common in significant literature).

Lines 84-89: You definitely need to explain your focus on women and girls. Your response to the reviewers makes clear that it is because that is what the studies you survey are studying…but this does not come through in your paper. The reader is still left wondering why you are focusing on *girls* (but then again, are you focused just on girls? In fact, later in the paper, such as at Lines 296-98, you do cite studies involving boys). This needs to be clarified.

Lines 95-96: I don’t think the average reader will understand what you mean by “weak enabling environments”’

Line 111: comma missing

Line 114: reviews “were conducted” (passive voice) by WHOM?

Lines 143-145: Here you talk about limiting your search to studies in which the participants were schoolgirls only. Is this accurate? See comment above re Lined 296-98. Perhaps I am misunderstanding.

Line 148: Punctuation missing?

Lines 149, 152, 160: Colon not necessary?

Line 165: Unnecessary comma

Line 210: Do you mean “findings” (plural)?

Line 212: Are “menstrual interventions” the same as “menstrual hygiene management interventions” discussed on Line 146?

Line 254: Passive voice

Line 258: Odd initial cap for “School”

Lines 272-73: Awkward and difficult to follow sentence.

Line 298: Were these period underwear or regular underwear?

Lines 300-302: Run-on sentence.

Line 464: Instead of talking about “menstruating girls and women,” might this be an appropriate place to talk about “all who menstruate,” notwithstanding your focus?

Line 466: Queer theory would ask us to look rigorously at the word “normal.” I think you mean “involuntary” or “inevitable” (or perhaps drop the adjective entirely).

Reviewer #2: Dear authors,

Thanks for the effort you’ve put in to addressing my comments. I feel like the paper has now avoided a couple of easy pitfalls. The information in the tables is also now much easier for the reader to digest – thanks for this. There are just a few things I’m not sure were fully addressed; perhaps I did not explain myself very well so here I elucidate:

I understand the want to just focus on one particular group (schoolgirls). However, I raised this point as it is often gender diverse persons who are left out and not represented in this type of data collection, which is something that needs to change if the research is to remain relevant going forwards. I appreciate the mention of menstruators – it’s important as a limitation if anything to explain the data set is solely focused on cisgender girls and women.

Largely you give the country where the reference is from but not all the time. It’s important to do this consistently in order to avoid making generalisation about all low-income countries.

I’m happy to see the inclusion of the positionality statement – it adds transparency. Something I was looking for was mention of the country/countries the authors are from. There adds incongruence if the authors were from a high-income country say but are commenting on low income countries. How does where the authors are from impact the direction of the study or interpretation of results?

That’s a shame that you’ve now had to exclude Saudi Arabia. I hope my point that menstrual health is a global issue that impacts high-income countries was taken not to diminish the lack of access in lower income countries but to highlight it’s not just an issue in low-income countries and that there are inequalities within countries as well as between them.

Great that you’ve added in some literature regarding men/boys/non-menstruators however the point that I wanted to get at was that it can be these groups that also act as a barrier to schoolgirls’ attendance through teasing or shaming.

I don’t think changing the line to ‘most religious beliefs’ avoids generalisation either… this is a sensitive point and I understand what you’re getting at… but I think what you’re saying could be misinterpreted. Religion is interpreted and enacted differently across the world. For example in the UK, I don’t think many Christians would feel stigma towards menstruation because of what is written in the Bible. But I understand that other cultures might. What you can say instead which is factually true is that in certain religious texts menstruation is presented as making the menstruator impure or unclean. I would be particular about using the exact wording – so much of religious text is down to interpretation.

I feel that for this work to be relevant, contemporary, and self-aware, the authors should take a little more time to contemplate these last points. It would also be good to have a statement from the authors on why this paper is important and what new contribution to the discussions on MHM it brings.

Many thanks,

7. PLOS authors have the option to publish the peer review history of their article ( what does this mean? ). If published, this will include your full peer review and any attached files.

Author response to Decision Letter 1

Reviewer #1:

Line 24: uses passive voice

Authors ‘Response

Dear reviewers I agree with comments in line #24

The statement in line# 24 is replaced with active voice, “To address these issues, researchers have conducted intervention studies, but the impact on school attendance has varied”

I agree with comment of the reviewer, the statement in line 32 is paraphrased as

“Review of sixteen trial studies showed that menstrual hygiene interventions have a positive effect on schoolgirls' school attendance, performance, and dropout rates, as well as on their menstrual knowledge, attitudes, practices, and emotional well-being.”

The comment is well taken and “However” in line # 34 is omitted and the sentences is rephrased as “There was a low to medium risk of bias in the most of the studies.”

I agree with point raised and it is valued concern. Hence the word “menstruants” in line 82 is replaced with “menstruators” as per the recommendation

The comment is well accepted. The reason for focusing on schoolgirls is now explained in line 419-426 as follows, to make it clear to the reader.

“Most of the literature about menstrual hygiene management, especially in low- and middle-income counties, don’t adequately address the needs of people who identify as gender-nonconforming. Menstrual discourses, are frequently written from the perspective of a cis woman, highlighting only the menstrual experiences of adolescent girls and cis women. This exclusion may affect menstrual hygiene needs and experiences of transgender, non-binary, and other gender varied individuals”

This review investigated how involving males (boys, fathers, or parents) in interventions might improve schoolgirls' experiences. We included intervention studies targeting these male groups alongside traditional MHM interventions. This broadens the range of interventions studied, but the outcome/impact must be measured specifically on schoolgirls.

The comment is well accepted. In the old version we explained the word “weak enabling environments”’ using the list of challenges that came after it . i.e. “Insufficient knowledge about menstruation, inadequate access to water, sanitation and hygiene services, lack of adequate hygiene materials, and social norms unsupportive of those who menstruate”

But if it creates confusion for readers, the already listed challenges are more descriptive and we have omitted the phrase “weak enabling environment” to avoid ambiguity to the reader

Authors ‘Response .

This is well taken and Comma is used in line #110 “2015-2016 school year, demonstrated”

Dear reviewer, we have included the list of 4 citations which helps to address the potential question about “who conducted the review?”. The 4 citations in line 116 can address this concern than listing the name of the authors who did the review.

Dear reviewer, your understanding is correct. The statement is rephrased to “

The search was limited to studies that measured outcomes on schoolgirls because the objective of the review was to evaluate how menstrual hygiene management intervention programs impact schoolgirls' attendance, academic performance, or dropout rates. ” The study aimed to evaluate the effects of intervention programs on school attendance, performance, and dropout rates of schoolgirls, as clearly stated in lines 144-145. Therefore, while the intervention may involve parents, the community, and males, the outcomes must be assessed specifically for schoolgirls. We have included studies that involved parents or males in the intervention, with the actual outcomes measured for the schoolgirls. Additionally, we used terms such as fathers, mothers, community, and parents as search terms to encompass various types of interventions.

This is well noted punctuation is in place now, “supplies.”

Well noted and accepted, the colon in line 149 and 152 is removed and we kept the colon in line 159 and we deleted the word “includes” to make appropriate use of colon

Well accepted, comma in line 165 is removed the statement is written as “we excluded studies not available in the English language and conference abstracts.”

This is noted, line 208 in this version, is changed into plural “a summary of the findings”

Yes, it is the same and line 210 is corrected as “Sixteen trial studies that assessed the effect of menstrual hygiene management interventions…”

Dear reviewer the comment is accepted, the statement in line 252 is changed into active voice as follows

“Montgomery et al. suggested that using school attendance and dropout rates as a proxy indicator of academic performance”

This is accepted. Line 256 Changed from Official School attendance� Official school attendance

The comment is well accepted. The statement in line 270-272 which was “Montgomery et al. conducted study on comparable peri-urban schools but included one remote rural site without experience in using sanitary pads that had no electricity, and no paved roads.”is rephrased as follows:

“Montgomery et al. carried out study on peri-urban schools that were comparable, but they also incorporated a remote rural site lacking experience in using sanitary pads, with no access to electricity and unpaved roads.”

Dear reviewer, fortunately I physically knew the underwear’s provided in this specific intervention and they are normal/regular underwear’s and the term “ regular” is added ( line 297-298)

Well noted and accepted. The statement in line 297-299 “School attendance (data collected prospectively on-site by team researchers) was analyzed before and after the intervention and also compared with attendance data from the prior school year”

Is amended as

“School attendance was analyzed before and after the intervention and also compared with attendance data from the prior school year”

Line 464: Instead of talking about “menstruating girls and women,” might this be an appropriate place to talk about “all who menstruate,” notwithstanding your focus

Dear reviewer this comment is accepted. “Menstruating girls and women “is replaced with “all who menstruate” on the current version ( line # 470)

Line 466: Queer theory would ask us to look rigorously at the word “normal.” I think you mean “involuntary” or “inevitable” (or perhaps drop the adjective entirely) (line # 474).

Well Noted, the word “Normal” is dropped from line # 471

Reviewer #2: Dear authors,

The following paragraph would explain the limitation, which is placed in line # 416-421

“Most of the literature about menstrual hygiene management, especially in low- and middle-income counties, don’t adequately address the needs of people who identify as gender-nonconforming. Menstrual hygiene issues, are frequently written from the perspective of a cis woman, highlighting only the menstrual experiences of adolescent girls and cis women. This exclusion may affect menstrual hygiene needs and experiences of transgender, non-binary, and other gender varied individuals.”

Largely you give the country where the reference is from but not all the time. It’s important to do this consistently in order to avoid making generalization about all low-income countries.

The input is considered and included the countries where the citation exists, but country was not included mainly on table 5

Dear reviewer this is well accepted. The following statement is added the statement “I am from Ethiopia one of the low-income countries” in line 130 to indicate the principal investigator is from low income country.

Dear reviewer, issues of menstrual poverty and inequity are global challenges. It is widely recognized that individuals who menstruate in high-income countries encounter various challenges, although the severity and nature of these challenges may vary from LMIC. Our initial focus for the review was on addressing issues in low and middle-income countries. And we wrongly classified Saudi Arabia as LMIC and include it in the review process. However, this does not imply that menstrual hygiene management is not an issue in high income countries. Your feedback in the previous review highlighted the inclusion of one high-income country, Saudi Arabia, in the review. This was an important observation. It would not be appropriate to include a high-income country when the review is intended to focus on LMICs. This was the sole reason for its exclusion.

Dear reviewer the comment is well received. The following statement is included in line #389-392 on the current version which may address the concern about the effect of teasing by boys on school attendance and participation.

“Approximately 13% of Tanzanian girls have encountered period teasing, while over 80% expressed fear of being teased, particularly by male classmates. This results in reduced school attendance, participation, and concertation in class.”

I don’t think changing the line to ‘most religious beliefs’ avoids generalization either… this is a sensitive point or I understand what you’re getting at… but I think what you’re saying could be misinterpreted. Religion is interpreted and enacted differently across the world. For example in the UK, I don’t think many Christians would feel stigma towards menstruation because of what is written in the Bible. But I understand that other cultures might. What you can say instead which is factually true is that in certain religious texts menstruation is presented as making the menstruator impure or unclean. I would be particular about using the exact wording – so much of religious text is down to interpretation.

This is well accepted and the statement “Menstrual restrictions and cultural taboos are often rooted in most religious beliefs and untrue cultural assumptions” Is replaced with following statement on the current version (line #395-397)

“In certain religious texts, menstruation is often framed as making the menstruator impure or unclean, leading to menstrual restrictions, shame, and taboos”

The contribution of the study to the discussion on MHM is highlighted as follows in the strength section (line #425-434)

The review also has several strengths, providing an extensive summary of English-language evidence. It offers valuable insights by presenting a comprehensive review of English-language trial studies that evaluate the effect of menstrual hygiene management interventions on various aspects of schoolgirls' lives. With a large sample size from multiple countries, the study covers a broad range of interventions, including puberty education, distribution of menstrual supplies, and integration of menstrual health topics into school curriculums. The findings not only underscore the positive effects of these interventions, such as increased school attendance and enhanced menstrual hygiene knowledge and attitudes, but also shed light on the challenges and limitations observed in certain studies. This review will also have great contribution in identifying research gaps for further studies.

Submitted filename: Response to reviweres.docx

Decision Letter 2

18 Mar 2024

PONE-D-23-35026R2Menstrual hygiene management interventions and their effects on schoolgirls’ menstrual hygiene experiences in low and middle countries: A systematic reviewPLOS ONE

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.  There are just a few more minor points to address, as well as the need to check the grammar further.

Please submit your revised manuscript by May 02 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at  gro.solp@enosolp . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Reviewer #1: All comments have been addressed

Reviewer #1: N/A

Reviewer #1: I implore the authors to run their manuscript through a grammar-checking program (Grammarly, Paperpal, anything) or Chat GPT to improve the grammar and punctuation, especially in the first three pages. The authors have nicely addressed the substantive comments and have responded to specific grammatical errors pointed out by the reviewers. The manuscript still needs to be gone through line by line because parts of it are not well-edited. I do not consider it a good use of my professional time to provide a third round of input pointing out grammatical errors that could be addressed readily by the authors.

Reviewer #2: Thanks for addressing the comments. There are just a couple more tiny things to address and then I’m happy for the work to be published.

1. ‘frequently written from the perspective of a cis woman’ – although I completely agree with this perhaps it requires a reference? Maybe you could explain why you know this to be true as I’m not sure you’d actually be able to find a reference. You could say ‘Since gender-diverse persons make up such a small percentage of the population, it can be assumed that the vast majority of academic literature on MHM is written from the perspective of cis women’. Maybe I’m being unnecessarily pedantic here.

2. I think you would do well to read around the purpose of positionality statements and this would help to inform how to write one. I wasn’t looking for you just to state that you are Ethiopian but how that background and identity shapes and influences the research. For example something like: I am a woman (?) who comes from Ethiopia, which is one of the countries studied in this paper. This gives me first-hand experience of what it’s like to be a menstruating schoolgirl in an LMIC. However, I am an outsider to the other countries studied in this paper, which may leave room for bias or misunderstandings in the interpretation of results’. Something like this.

3. Perhaps I’m being too cautious but I still believe this could be interpreted as offensive to some readers ‘In certain religious texts, menstruation is often framed as making the menstruator impure or unclean, leading to menstrual restrictions, shame, and taboos’. To reiterate, so much religious text is down to interpretation and this is what can cause the issues of negative views towards menstruation, not necessarily the words in the text itself. I don’t know if you’re religious or not but this would be an instance where your positionality affects how you interpret data. For example, I’m not religious and therefore don’t understand or have association to any religious texts. I gave a lecture on MHM making the exact same point as you that religious texts e.g. The Quran says that menstruation is impure. This was of course from a translation from Arabic into English where meaning can get lost anyway. A Muslim student put their hand up to explain that this was a very negative interpretation of the text and that it doesn’t mean impure in a dirty way as was interpreted. I think it would be inoffensive but still make the same point to say ‘certain religious texts can be interpreted to associate menstruation with impurity and uncleanliness, which leads to menstrual restrictions, shame, and taboos in some cultures’ you need a reference for this as well.

Author response to Decision Letter 2

31 Mar 2024

Response to Reviewers

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict-of-interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

________________________________________

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #1: N/A

Reviewer #1: I implore the authors to run their manuscript through a grammar-checking program (Grammarly, Paperpal, anything) or Chat GPT to improve the grammar and punctuation, especially in the first three pages. The authors have nicely addressed the substantive comments and have responded to specific grammatical errors pointed out by the reviewers. The manuscript still needs to be gone through line by line because parts of it are not well-edited. I do not consider it a good use of my professional time to provide a third round of input pointing out grammatical errors that could be addressed readily by the authors.

Authors’ Response:

Dear reviewer, this is valued concern. The necessary grammar and spelling errors are fixed throughout the document on the current version manuscript.

Reviewer #2: Thanks for addressing the comments. There are just a couple tinier things to address and then I’m happy for the work to be published.

Dear reviewer this comment is valued and is addressed as follows in line # 415 and the statement is replaced with the recommended way of rephrasing.

‘Since gender-diverse persons make up such a small percentage of the population, it can be assumed that most of the academic literature on MHM is written from the perspective of cis women’.

2. I think you would do well to read around the purpose of positionality statements and this would help to inform how to write one. I wasn’t looking for you just to state that you are Ethiopian but how that background and identity shapes and influences the research. For example, something like: I am a woman (?) who comes from Ethiopia, which is one of the countries studied in this paper. This gives me first-hand experience of what it’s like to be a menstruating schoolgirl in an LMIC. However, I am an outsider to the other countries studied in this paper, which may leave room for bias or misunderstandings in the interpretation of results. Something like this.

Dear reviewer the comment is well noted and the positionality statement in line #128-136, is rephrased as;

“I (the first author) am a woman, a feminist, and an advocate for girls' education. I am currently pursuing a PhD in public health. I am from Ethiopia, which is one of the countries studied in this paper. This gives me first-hand experience of what it’s like to be a menstruating schoolgirl in an LMIC. However, I am an outsider to the other countries studied in this paper, which may leave room for bias or misunderstandings in the interpretation of results. In this systematic review, the researcher's standpoint influences the research approach and findings. This study advocates for accessible menstrual hygiene resources and aims to address the stigma surrounding menstruation. The conclusions are based on this perspective, and readers are encouraged to take this into account when interpreting the findings.”

3. Perhaps I’m being too cautious, but I still believe this could be interpreted as offensive to some readers ‘In certain religious texts, menstruation is often framed as making the menstruator impure or unclean, leading to menstrual restrictions, shame, and taboos’. To reiterate, so much religious text is down to interpretation, and this is what can cause the issues of negative views towards menstruation, not necessarily the words in the text itself. I don’t know if you’re religious or not, but this would be an instance where your positionality affects how you interpret data. For example, I’m not religious and therefore don’t understand or have association to any religious texts. I gave a lecture on MHM making the exact same point as you that religious texts e.g. The Quran says that menstruation is impure. This was of course from a translation from Arabic into English where meaning can get lost anyway. A Muslim student put their hand up to explain that this was a very negative interpretation of the text and that it doesn’t mean impure in a dirty way as was interpreted. I think it would be inoffensive but still make the same point to say ‘Certain religious texts can be interpreted to associate menstruation with impurity and uncleanliness, which leads to menstrual restrictions, shame, and taboos in some cultures’ you need a reference for this as well.

Dear reviewers I agree with comments. The statement in line Line #392-94: “In certain religious texts, menstruation is often framed as making the menstruator impure or unclean, leading to menstrual restrictions, shame, and taboos”

Is replaced with

‘Certain religious texts can be interpreted to associate menstruation with impurity and uncleanliness, which leads to menstrual restrictions, shame, and taboos in some cultures. And reference is cited.

Submitted filename: Response to Reviewers.docx

Decision Letter 3

PONE-D-23-35026R3

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at gro.solp@gnillibrohtua .

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact gro.solp@sserpeno .

Additional Editor Comments (optional):

Acceptance letter

14 Jun 2024

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact gro.solp@sserpeno .

If we can help with anything else, please email us at gro.solp@eracremotsuc .

Thank you for submitting your work to PLOS ONE and supporting open access.

PLOS ONE Editorial Office Staff

on behalf of

Dr. Alison Parker

gamification in education a systematic mapping study

A bibliometric analysis on artificial intelligence in mathematics education

  • Prawidi Wisnu Subroto Universitas Muhammadiyah Tangerang Indonesia
  • Maulana Malik Universiti Sultan Zainal Abidin Malaysia
  • Aji Raditya Universitas Muhammadiyah Tangerang Indonesia
  • Nisvu Nanda Saputra Universitas Muhammadiyah Tangerang Indonesia

The research on artificial intelligence in mathematics education has attracted much attention from researchers since the last decade. This study aims to provide holistic information about artificial intelligence in mathematics education research using bibliometric analysis. Data for the analysis were extracted from the Scopus database from 1986 – 2023. The analysis, conducted using R-packages (Bibliometrix) and VOSviewer software, identifies the relevant nations, affiliations, journals, articles, and keywords on artificial intelligence in mathematics education research. The study reveals that 565 documents have been published in 354 journals, with an average annual growth rate of 11.27%. These documents, on average, have received 14.61 citations each. The research field has engaged a total of 1,847 authors, with an average of 3.26 authors contributing to each document. Additionally, 17.17% of these publications involved international co-authorship, indicating a moderate level of global collaboration. Our findings reveal a growing interest in using artificial intelligence as an educational tools and methods, particularly in the United States and China, which lead in publication output and citations. The analysis also reveals emerging trends and research gaps. The keywords such as "virtual reality," "sustainable development," and "COVID-19" reflect recent research focus on artificial intelligence in mathematics education research. Meanwhile, the keywords such as "mathematical literacy," “assessment,” and "gamification" identified as underexplored areas, suggesting potential opportunities for future research on artificial intelligence in mathematics education research.

Aria, M., & Cuccurullo, C. (2017). bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007

Baker, R.S.J.d., Corbett, A.T., Roll, I. et al. (2008). Developing a generalizable detector of when students game the system. User Model User-Adap Inter 18, 287–314. https://doi.org/10.1007/s11257-007-9045-6

Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017). Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education: A Meta-Analysis. Review of Educational Research, 87(2), 309–344. https://doi.org/10.3102/0034654316670999

Bray, A., & Tangney, B. (2017). Technology usage in mathematics education research – A systematic review of recent trends. Computers and Education, 114, 255–273. https://doi.org/10.1016/j.compedu.2017.07.004

Chen, C.-J., & Liu, P.-L. (2007). Personalized Computer-Assisted Mathematics Problem-Solving Program and Its Impact on Taiwanese Students. Journal of Computers in Mathematics and Science Teaching, 26(2), 105–121. https://www.learntechlib.org/p/21809

Chen, D., Liu, Z., Luo, Z., Webber, M., & Chen, J. (2016). Bibliometric and visualized analysis of emergy research. Ecological Engineering, 90, 285–293. https://doi.org/10.1016/j.ecoleng.2016.01.026

Chen, X., Xie, H., Zou, D., & Hwang, G. J. (2020). Application and theory gaps during the rise of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1(July), 100002. https://doi.org/10.1016/j.caeai.2020.100002

Chih-Ming, C., & Ying-You, L. (2020). Developing a computer-mediated communication competence forecasting model based on learning behavior features. Computers and Education: Artificial Intelligence, 1(August), 100004. https://doi.org/10.1016/j.caeai.2020.100004

Christopoulos, A., & Sprangers, P. (2021). Integration of educational technology during the Covid-19 pandemic: An analysis of teacher and student receptions. Cogent Education, 8(1). https://doi.org/10.1080/2331186X.2021.1964690

Civil, M., & Bernier, E. (2019). Exploring Images of Parental Participation in Mathematics Education: Challenges and Possibilities. Urban Parents’ Perspectives on Children’s Mathematics Learning and Issues of Equity in Mathematics Education, January 2015, 309–330. https://doi.org/10.4324/9780203764152-6

Craig, S. D., Hu, X., Graesser, A. C., Bargagliotti, A. E., Sterbinsky, A., Cheney, K. R., & Okwumabua, T. (2013). The impact of a technology-based mathematics after-school program using ALEKS on student’s knowledge and behaviors. Computers & Education, 68, 495–504. https://doi.org/10.1016/j.compedu.2013.06.010

del Olmo-Muñoz, J., González-Calero, J. A., Diago, P. D., Arnau, D., & Arevalillo-Herráez, M. (2023). Intelligent tutoring systems for word problem solving in COVID-19 days: could they have been (part of) the solution? ZDM - Mathematics Education, 55(1), 35–48. https://doi.org/10.1007/s11858-022-01396-w

Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133(March), 285–296. https://doi.org/10.1016/j.jbusres.2021.04.070

Giannos, P., & Delardas, O. (2023). Performance of ChatGPT on UK Standardized Admission Tests: Insights from the BMAT, TMUA, LNAT, and TSA Examinations. JMIR Medical Education, 9. https://doi.org/10.2196/47737

Gu, Z., Meng, F., & Farrukh, M. (2021). Mapping the Research on Knowledge Transfer: A Scientometrics Approach. IEEE Access, 9, 34647–34659. https://doi.org/10.1109/ACCESS.2021.3061576

Gunel, K., & Asliyan, R. (2009). Determining difficulty of questions in intelligent tutoring. The Turkish Online Journal of Educational Technology - TOJET, 8(3), 14–22. https://files.eric.ed.gov/fulltext/EJ859488.pdf

Hammadi, S. S., Majeed, B. H., & Hassan, A. K. (2023). Impact of Deep Learning Strategy in Mathematics Achievement and Practical Intelligence among High School Students. International Journal of Emerging Technologies in Learning, 18(6), 42–52. https://doi.org/10.3991/ijet.v18i06.38615

Heffernan, N. T., & Heffernan, C. L. (2014). The ASSISTments ecosystem: Building a platform that brings scientists and teachers together for minimally invasive research on human learning and teaching. International Journal of Artificial Intelligence in Education, 24(4), 470–497. https://doi.org/10.1007/s40593-014-0024-x

Huang, X., Craig, S. D., Xie, J., Graesser, A., & Hu, X. (2016). Intelligent tutoring systems work as a math gap reducer in 6th grade after-school program. Learning and Individual Differences, 47, 258–265. https://doi.org/10.1016/j.lindif.2016.01.012

Hwang, G.-J., & Tu, Y.-F. (2021). Roles and Research Trends of Artificial Intelligence in Mathematics Education: A Bibliometric Mapping Analysis and Systematic Review. Mathematics, 9(6), 584. https://doi.org/10.3390/math9060584

Hwang, G. J., Sung, H. Y., Chang, S. C., & Huang, X. C. (2020). A fuzzy expert system-based adaptive learning approach to improving students’ learning performances by considering affective and cognitive factors. Computers and Education: Artificial Intelligence, 1(July), 100003. https://doi.org/10.1016/j.caeai.2020.100003

Jeong, J. S., & González-Gómez, D. (2020). A web-based tool framing a collective method for optimizing the location of a renewable energy facility and its possible application to sustainable STEM education. Journal of Cleaner Production, 251. https://doi.org/10.1016/j.jclepro.2019.119747

King, S., Boyer, J., Bell, T., & Estapa, A. (2022). An Automated Virtual Reality Training System for Teacher-Student Interaction: A Randomized Controlled Trial. JMIR Serious Games, 10(4). https://doi.org/10.2196/41097

Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018. https://doi.org/10.1007/s10639-022-11177-3

Li, Y., Wang, K., Xiao, Y., Froyd, J. E., & Nite, S. B. (2020). Research and trends in STEM education: a systematic analysis of publicly funded projects. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00213-8

Özyurt, Ö., Özyurt, H., Baki, A., & Güven, B. (2013). Integration into mathematics classrooms of an adaptive and intelligent individualized e-learning environment: Implementation and evaluation of UZWEBMAT. Computers in Human Behavior, 29(3), 726–738. https://doi.org/10.1016/j.chb.2012.11.013

Paras, J. (2001). Crisis in mathematics education. Student failure: challenges and possibilities. South African Journal of Higher Education, 15(3), 66–73. https://doi.org/10.4314/sajhe.v15i3.25327

Pareto, L. A. (2014). Teachable Agent Game Engaging Primary School Children to Learn Arithmetic Concepts and Reasoning. Int J Artif Intell Educ 24, 251–283. https://doi.org/10.1007/s40593-014-0018-8

Park, I., & Yoon, B. (2018). Identifying promising research frontiers of pattern recognition through bibliometric analysis. Sustainability (Switzerland), 10(11). https://doi.org/10.3390/su10114055

Rebolledo-Mendez, G., Huerta-Pacheco, N. S., Baker, R. S., & du Boulay, B. (2022). Meta-Affective Behaviour within an Intelligent Tutoring System for Mathematics. International Journal of Artificial Intelligence in Education, 32(1), 174–195. https://doi.org/10.1007/s40593-021-00247-1

Saha, S., Park, C., Knapik, S., Guo, J., Huang, O., & Liu, W. K. (2023). Deep Learning Discrete Calculus (DLDC): a family of discrete numerical methods by universal approximation for STEM education to frontier research. Computational Mechanics, 72(2), 311–331. https://doi.org/10.1007/s00466-023-02292-0

Salmi, H. S., Thuneberg, H., & Bogner, F. X. (2023). Is there deep learning on Mars? STEAM education in an inquiry-based out-of-school setting. Interactive Learning Environments, 31(2), 1173–1185. https://doi.org/10.1080/10494820.2020.1823856

Sayed, W. S., Noeman, A. M., Abdellatif, A., Abdelrazek, M., Badawy, M. G., Hamed, A., & El-Tantawy, S. (2023). AI-based adaptive personalized content presentation and exercises navigation for an effective and engaging E-learning platform. Multimedia Tools and Applications, 82(3), 3303–3333. https://doi.org/10.1007/s11042-022-13076-8

Song, P., & Wang, X. (2020). A bibliometric analysis of worldwide educational artificial intelligence research development in recent twenty years. Asia Pacific Education Review, 21(3), 473–486. https://doi.org/10.1007/s12564-020-09640-2

Suwarno, S., Ibrahim, N., & Chaeruman, U. A. (2021). Mapping Scientific Research on Hypermedia Learning Technology Using Scopus Database: A Bibliometric Approach. Library Philosophy and Practice, 2021, 1–20.

Talan, T. (2021). Artificial Intelligence in Education: A Bibliometric Study. International Journal of Research in Education and Science, 7(3), 822–837. https://doi.org/10.46328/ijres.2409

van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3

Wang, S., Christensen, C., Cui, W., Tong, R., Yarnall, L., Shear, L., & Feng, M. (2023). When adaptive learning is effective learning: comparison of an adaptive learning system to teacher-led instruction. Interactive Learning Environments, 31(2), 793–803. https://doi.org/10.1080/10494820.2020.1808794

Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2(January), 100008. https://doi.org/10.1016/j.caeai.2021.100008

Zupic, I., & Čater, T. (2014). Bibliometric Methods in Management and Organization. Organizational Research Methods, 18(3), 429–472. https://doi.org/10.1177/1094428114562629

gamification in education a systematic mapping study

How to Cite

Copyright (c) 2024 Prawidi Wisnu Subroto, Maulana Malik, Aji Raditya, Nisvu Nanda Saputra

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License .

Siderbarmenu

Journal information.

  Editorial Board   Reviewers   Focus and Scope   Indexing and Abstracting   Journal History   Author Index

Information for Author

  Author Guidelines   Peer Review Proccess   Publication Ethics   Copyright Notice   Privacy Statement   Manuscript Submission   Journal Business Model   Digital Archiving   Open Access Policy   Sponsorships

  Template of Manuscript   Cover Letter   Response to Reviewer Form

Journal Metrics

Author's Country Acceptance Rate Scopus Citation Google Scholar Citation Dimensions Citation Cited Score (3 year) Visitor's Country

gamification in education a systematic mapping study

Recommended Tools

gamification in education a systematic mapping study

In Collaboration With

gamification in education a systematic mapping study

Management Address:

Department of Mathematics Education, Universitas Muhammadiyah Surakarta Pabelan, Kartasura, Kab. Sukoharjo, 57169 Provinsi Jawa Tengah, Indonesia

Publisher Address:

Email: [email protected]

Social Media:

Creative Commons License

COMMENTS

  1. Gamification in Education: A Systematic Mapping Study

    inclusion criteria and are intended to map out topics rather than synthesize study results. A systematic mapping study provides a categorical structure for classifying the published research reports and results. The study presented here covers the existing work in the field of gamification in education: articles and conference papers published and

  2. Gamification in Education: A Systematic Mapping Study

    Gamification in education, Game design elements, Syste matic mapping study, Literature r eview Introduction Traditional schoolin g is perceived as ineffecti ve and boring by many students.

  3. Gamification in Education: A Systematic Mapping Study

    A study of the published works on the application of gamification to education aims to shed light on the tendencies and emerging practices in this area by presenting a thematic analysis instead of narrative summaries that focus on a qualitative review. Introduction Traditional schooling is perceived as ineffective and boring by many students. Although teachers continuously seek novel ...

  4. Gamification in Education: A Systematic Mapping

    This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research ...

  5. Gamification in Education: A Systematic Mapping Study

    Gamification in Education: A Systematic Mapping Study. While gamification is gaining ground in business, marketing, corporate management, and wellness initiatives, its application in education is still an emerging trend. This article presents a study of the published empirical research on the application of gamification to education.

  6. Gamification in Education: A Systematic Mapping Study

    Keywords Gamification in education, Game design elements, Systematic mapping study, Literature review Introduction Traditional schooling is perceived as ineffective and boring by many students. Although teachers continuously seek novel instructional approaches, it is largely agreed that today's schools face major problems around student ...

  7. Gamification in Education: Why, Where, When, and How?—A Systematic

    The aim of the present study is to summarize the studies previously conducted on the use of gamification in education through a systematic literature review. When the studies conducted in 2000-2021 were examined, four main dimensions came to the fore: (i) the aim of gamification studies, (ii) the learning fields where gamification studies ...

  8. Effects of Gamification on Students' Learning: A Systematic Mapping Study

    Gamification is defined as the use of game elements in non-game game contexts for the. purpose of improving learning outcomes (Deterding, Khaled, Nacke & Dixon, 2011). It. also refers to game ...

  9. Main gamification concepts: A systematic mapping study

    Our systematic mapping study, and the systematic mapping process that we propose, may be replicated in future studies, and not only in the so relevant scientific domain of gamification. ... Gamification in Education and Business, Springer International Publishing (2015), pp. 1-20. Crossref View in Scopus Google Scholar. Nolan and McBride, 2014.

  10. Gamification in Education: A Systematic Mapping Study

    This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research ...

  11. On the Pre-Perception of Gamification and Game-Based Learning in Higher

    We do note that a study by Menando and Arnab (Denden et al., 2021) has revealed that some effects of gender and personality may cause differences on students' perception of gamification in education. While our systematic mapping found no correlation between such perceptions and their impact on the effectiveness of the gamification ...

  12. Gamification in Education: A Systematic Mapping Study

    Gamification in Education: A Systematic Mapping Study. A study of the published works on the application of gamification to education aims to shed light on the tendencies and emerging practices in this area by presenting a thematic analysis instead of narrative summaries that focus on a qualitative review. Expand.

  13. Publication trends in gamification: A systematic mapping study

    A systematic mapping study classifies and structures a field of interest in research by categorizing publications and analyzing their publication trends [11]. Additionally, ... Applying gamification in the education is also an important part of the gamification domain, games for health and serious games in general being acknowledged, but much ...

  14. A systematic mapping on gamification applied to education

    As a first step towards bridging this gap, we carried out a systematic mapping to synthesize an overview of the area. We went through 357 papers on gamification. Among them, 48 were related to education and only 26 met the criteria for inclusion and exclusion of articles defined in this study.

  15. Gamification in Education: A Systematic Mapping Study

    Gamification is very reliable in bringing fun and pleasure to the learning process for the students. We analyze three items from the previous study; the intention and what the goals are expected, how to design, and the result of gamification in the education context. We found the intentions of gamification adoption in an educational context.

  16. A Systematic Mapping Study on Gamification Applications for

    To better understand and explore gamification in CSO education, a deeper analysis of current gamification applications is needed. This research outlines and conducts a methodical, comprehen-sive literature review using the Systematic Mapping Study pro-cess to identify implemented and evaluated GAs in undergraduate CSO education.

  17. Visualization of Hotspots and Frontiers in Online Gamified Learning

    This study employs bibliometrics and visual analysis methods to visualize the data of 1,425 documents related to online gamified learning from the Web of Science core database. Through co-occurrence, co-citation, and high-frequency word analysis of the literature data, this study summarises the research hotspots and frontier trends in this field.

  18. A Systematic Mapping on Gamification Applied to Education

    A systematic mapping study was conducted. The systematic search yielded 3,698 hits, from which we identified 289 unique papers. These papers were reviewed by the first author based on inclusion ...

  19. Gamification and Serious Games in Orthopedic Education: A Systematic

    Gamification and serious games have successfully been used in surgical specialties to improve technical skills related to systematic procedures. However, the use of gamified education material has remained limited in orthopedic residency training. The objective of this systematic review is to summarize the current use, development, and future directions of gamification for developing ...

  20. Comparison of education using the flipped class, gamification and

    Since effective education is one of the main concerns of every society and, in nursing, can lead to the education of successful people, the development of learning and teaching methods with greater effectiveness is one of the educational priorities in every country. The present study aimed to compare the effect of education using the flipped class, gamification and gamification in the flipped ...

  21. Gamification in education: a systematic mapping study

    This article presents a study of the published empirical research on the application of gamification to education. The study is limited to papers that discuss explicitly the effects of using game elements in specific educational contexts. It employs a systematic mapping design. Accordingly, a categorical structure for classifying the research ...

  22. Menstrual hygiene management interventions and their effects on

    In this systematic review, the researcher's standpoint influences the research approach and findings. This study advocates accessible menstrual hygiene resources and aims to address the stigma surrounding menstruation. The conclusions are based on this perspective, and readers are encouraged to take this into account when interpreting the ...

  23. PDF Gamification in Education: A Systematic Mapping Study

    Gamification in education, Game design elements, Systematic mapping study, Literature review Introduction Traditional schooling is perceived as ineffective and boring by many students.

  24. A bibliometric analysis on artificial intelligence in mathematics education

    The research on artificial intelligence in mathematics education has attracted much attention from researchers since the last decade. This study aims to provide holistic information about artificial intelligence in mathematics education research using bibliometric analysis. Data for the analysis were extracted from the Scopus database from 1986 - 2023.