Baker Rodrigo Ocumpaugh Monitoring Protocol

{{Short description|Sampling method for field observations}}

The Baker Rodrigo Ocumpaugh Monitoring Protocol (BROMP) is a momentary time-sampling method for quantitative field observations such as those used in classroom observation. BROMP was originally developed by Ryan S. Baker to study student engagement in online learning.{{cite conference | url = http://dl.acm.org/citation.cfm?id=985741 | title = Off-task behavior in the cognitive tutor classroom: when students game the system | last1 = Baker | first1 = Ryan | last2 = Corbett | first2 = Albert | last3 = Koedinger | first3 = Kenneth | last4 = Wagner | first4 = Angela | date = 2004 | publisher = Association for Computing Machinery | book-title = Proceedings of the International Conference on Computer-Human Interaction | pages = 383–3gf90 }} Afterwards, it was adapted for use in the Philippines by Ma. Mercedes Rodrigo, and to study student emotion.{{cite conference | url = http://dl.acm.org/citation.cfm?id=1563629 | title = Affect and Usage Choices in Simulation Problem Solving Environments | last1 = Rodrigo| first1 = Mercedes | date = 2007 | publisher = IOS Press | book-title = Proceedings of the International Conference on Artificial Intelligence in Education | pages = 145–152 }} It was systematized by Jaclyn Ocumpaugh in two coding manuals, the first in 2012,{{cite book |last1 = Ocumpaugh |first1= Jaclyn | last2 = Baker | first2 = Ryan | last3 = Rodrigo | first3 = Mercedes | date= 2012 |title= Baker-Rodrigo Observation Method Protocol (BROMP) 1.0. Training Manual version 1.0. |url= http://www.columbia.edu/~rsb2162/BROMP%20QFO%20Training%20Manual%201.0.pdf |publisher= EdLab}} and the second in 2015.{{cite book |last1 = Ocumpaugh |first1= Jaclyn | last2 = Baker | first2 = Ryan | last3 = Rodrigo | first3 = Mercedes | date= 2015 |title= Baker Rodrigo Ocumpaugh Monitoring Protocol (BROMP) 2.0 Technical and Training Manual. |url= http://www.columbia.edu/~rsb2162/BROMP.pdf |publisher= EdLab}} It was adapted for use in India by Chokanath Hymavathy and Viola Krishnamani.{{cite conference | title = Analyzing learner engagement to enhance the teaching-learning experience | last1 = Hymavathy | first1 = Chokanath | last2 = Krishnamani | first2 = Viola | last3 = Sumathi | first3 = C.P. | date = 2014 | publisher = IEEE | book-title = Proceedings of the International Conference on MOOC, Innovation and Technology in Education (MITE) | pages = 67–70 | doi = 10.1109/MITE.2014.7020243 }} It has also been adapted for use in informal science education settings.{{cite web|url=http://www.tc.columbia.edu/international-and-transcultural-studies/international-and-comparative-education/program-news/ |title=Program News |author= |access-date=15 February 2015 |url-status=dead |archive-url=https://web.archive.org/web/20150927114515/http://www.tc.columbia.edu/international-and-transcultural-studies/international-and-comparative-education/program-news/ |archive-date=27 September 2015 }} Since its development, BROMP has been used in over 50 published scientific articles, by researchers at several universities.

As a momentary time-sampling method for classroom observation, a BROMP observer records students' emotions and behavior according to a pre-defined coding schema. BROMP observers view different students in turn, and take notes using an Android app that records data.{{cite conference | url = http://dl.acm.org/citation.cfm?id=2775480 | title = HART: the human affect recording tool | last1 = Ocumpaugh | first1 = Jaclyn | last2 = Baker | first2 = Ryan | last3 = Rodrigo | first3 = Mercedes | last4 = Salvi| first4 = Aatish | last5 = van Velsen | first5 = Martin | last6 = Aghababyan | first6 = Ani | last7 = Martin | first7 = Taylor |date = 2015 | publisher = Association for Computing Machinery | book-title = Proceedings of the 33rd International Conference on the Design of Communication }} This app synchronizes with an internet time server. BROMP observations are carried out by field observers trained and certified through a multi-day training process; according to a 2020 book chapter, there are around 150 BROMP-certified coders in 6 countries.{{cite book |last1=Baker |first1=Ryan |last2=Ocumpaugh |first2=Jaclyn |last3=Andres |first3=Juliana |editor-last=Feldman |editor-first=Robert |title=Learning Science: Theory, Research, and Practice |publisher=McGraw-Hill |date=2020 |pages=127–156 |chapter=BROMP Quantitative Field Observations: A Review |chapter-url=https://www.upenn.edu/learninganalytics/ryanbaker/BROMPbookchapter.pdf |name-list-style=amp}} Training methods involve both training in coding affect and engagement, and training in observing students non-obtrusively. It is distinguished from other coding systems for emotion, such as Facial Action Coding System, by its use of holistic coding methods.

BROMP has been used with several coding schemes. According to the 2015 coding manual, the most common coding scheme, the "PSLC" scheme (named after the Pittsburgh Science of Learning Center), consists of:

class="wikitable sortable"
Behavior	Affect
On task	Boredom
On-task Conversation	Confusion
Off-task	Frustration
Gaming the system	Engaged Concentration
Other	Other

BROMP has been used to collect data for the development of automated detectors of student engagement and affect for commercial systems such as Cognitive Tutor.{{cite conference | url = http://eric.ed.gov/?id=ED537205 | title = Towards Sensor-Free Affect Detection in Cognitive Tutor Algebra | last1 = Baker | first1 = Ryan |date = 2012 | publisher = International Educational Data Mining Society | book-title = Proceedings of the International Conference on Educational Data Mining | pages= 126–133 }} It has also been used to study and refine commercial products such as Reasoning Mind.{{cite journal | title = Incorporating Effective e-Learning Principles to Improve Student Engagement in Middle-School Mathematics | last1 = Mulqueeny| first1 = Kevin | last2 = Kostyuk | first2 = Victor | last3 = Baker | first3 = Ryan | last4 = Ocumpaugh | first4 = Jaclyn | date = 2015 | journal= International Journal of STEM Education | volume= 2 |issue= 15 |doi= 10.1186/s40594-015-0028-6| doi-access = free }}

Though originally developed for studying online learning, BROMP is now used for research in traditional classrooms as well. BROMP was used by the Chennai Corporation to study the engagement of children in classes using different teacher practices. It has also been used in informal science education, as part of the instructional design and refinement practices of the Black Rock Forest.{{cite web |url= http://blackrockforest.org/about-1 |title= About Black Rock Forest Consortium |author= |access-date= 17 November 2015}}

A database of publicly released BROMP data, the [https://osf.io/6zu2j/ BROMPpository], is available for research use.