Business and Management INK

Does Your Data Suffer from Common Method Variance?

March 25, 2022 4611
Four vertical bars of various shades of blue
Check your attitude … (Image: areif_munandar/Pixabay)

In this post, authors Brian K. Miller and Marcia J. Simmering reflect on their recent research article, Attitude Toward the Color Blue:  An Ideal Marker Variable,” published in Organizational Research Methods.

We wanted to help researchers resolve the age-old question of determining if their data suffered from common method variance (CMV) which is the tendency for the relationship between variables collected at one time, from one source, via one method to have artificially inflated correlations. 

This paper is based off of a conference paper by Brian that was presented in 2008. In that paper, a scale designed to be unrelated to anything else in the data set was developed called Attitude Toward the Color Blue (ATCB). Unbeknownst to Brian, he had created an ideal marker variable that others started to find useful. Since then, Brian has had many requests to use the items, which was confirmation that this variable had real value to researchers. Several years ago, Marcia co-authored a paper in Organizational Research Methods that found that of all the ideal marker variables being used, that ATCB likely performed well. Brian reached out to Marcia, and together we planned a full-blown multi-sample scale development paper to refine the ATCB scale. 

Brian K. Miller, left, and Marcia J. Simmering Dickerson

The biggest challenge for Brian was cracking the secret Mplus code used to test the very complicated models as part of the CFA Marker Technique and to not lose track of the steps in the process for each sample in the paper. For Marcia the challenge was helping reviewers and peers understand that most other so-called ideal marker variables were far from ideal and that the world truly needed a real ideal marker variable. 

We painstakingly demonstrated the best practices in scale development procedures and we verified many useful features of the scale. We hope that any researcher who collects cross-sectional same-source data uses our items, downloads our thoroughly annotated Mplus code, and tests whether their data suffers from CMV. Having this ideal marker variable and the code to run the CFA Marker Technique should go a long way in helping other researchers verify that their data is free from CMV.

We think that everything a researcher would want to know about the scale is in the paper, even why we chose blue over other colors! We sincerely thank Dr. Louis Tay, the action editor, and the anonymous reviewers at ORM who helped us along the way and pushed us to explore ideas that we wouldn’t have addressed if not for their insight.

In a research world where it seems that all of the good ideas have been examined already, new scholars should bounce their ideas off of lay persons, not just other academics. Oh, and find good co-authors too!  Being able to collaborate with someone whose skillset complements yours, who you trust, and who you enjoy working with, makes it easier to publish.

The most influential paper that Brian read was: Simmering et al. (2015).  “Marker variable choice, reporting, and interpretation in the detection of common method variance:  A review and demonstration” in Organizational Research Methods.

The most influential paper that Marcia read was: Aguinis et al. (2020). “Best-practice recommendations for producers, evaluators, and users of methodological literature reviews.” Organizational Research Methods.

Dr. Brian Miller is a Professor in the Department of Management at Texas State University, San Marcos. Dr. Marcia Simmering Dickerson is the Francis Mangham Endowed Professor in the Department of Management at Louisiana Tech University.

View all posts by Brian K. Miller and Marcia Simmering

Related Articles

The Role of Place in Sustainability
Business and Management INK
October 28, 2024

The Role of Place in Sustainability

Read Now
Turning to Glitter in Management Studies – Why We Should Take ‘Unserious’ Glitter Serious to Understand New Management Practices
Business and Management INK
October 24, 2024

Turning to Glitter in Management Studies – Why We Should Take ‘Unserious’ Glitter Serious to Understand New Management Practices

Read Now
Exploring the ‘Publish or Perish’ Mentality and its Impact on Research Paper Retractions
Research
October 10, 2024

Exploring the ‘Publish or Perish’ Mentality and its Impact on Research Paper Retractions

Read Now
Utilizing Academic-Practitioner Partnering for Societal Impact
Business and Management INK
September 17, 2024

Utilizing Academic-Practitioner Partnering for Societal Impact

Read Now
Trippin’ Forward: Management Research and the Development of Psychedelics

Trippin’ Forward: Management Research and the Development of Psychedelics

Charlie Smith reflects on his interest in psychedelic research, the topic of his research article, “Psychedelics, Psychedelic-Assisted Therapy and Employees’ Wellbeing,” published in Journal of Management Inquiry.

Read Now
Using Ethnography to Explore Entrepreneurial Extracurricular Activities

Using Ethnography to Explore Entrepreneurial Extracurricular Activities

Co-authors Birgitte Wraae and Nicolai Nybye reflect on the inspiration behind their research article, “Learning to Be “Me,” “the Team,” and “the Company” Through Entrepreneurial Extracurricular Activities: An Ethnographic Approach,” published in Entrepreneurship Education and Pedagogy.

Read Now
The Future of Business is Interdisciplinary 

The Future of Business is Interdisciplinary 

By actively collaborating with industry, developing interdisciplinary programs and investing in hands-on learning opportunities, business schools can equip graduates with the specific skills and experiences that employers are seeking.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Newest
Oldest Most Voted
Inline Feedbacks
View all comments