RegisterSign in
ViewPDF
- Access throughyour institution
Article preview
- Abstract
- Introduction
- Section snippets
- References (70)
- Recommended articles (6)
International Journal of Information Management
Available online 20 January 2023
, 102625
In Press, Corrected Proof
What are Corrected Proof articles?Author links open overlay panel
Abstract
Cross-sectional data is pervasive in information systems (IS) research. This editorial reviews cross-sectional studies, summarizes their strengths and limitations, and derives use cases of when cross-sectional data is and is not useful in answering research questions. We raise concerns about assertions of temporal causality using data collected employing cross-sectional methods with no temporal order, which makes cause and effect difficult to establish. Based on our discussion of research using cross-sectional data and its limitations, we offer four recommendations for when and how to use such data: (1) improve credibility by reporting research in detail and transparently, (2) ensure appropriate sampling, (3) take configurational perspectives, and (4) integrate cross-sectional data into mixed- or multi-method designs. By doing so, we help IS researchers position and use cross-sectional studies appropriately within their methodological repertoire.
Introduction
In order to prepare a tasty dish, a chef needs a clear and good recipe, carefully selected ingredients, and a well-equipped kitchen. The dish’s flavor and presentation depend on the chef attending to all three elements of its preparation – following all the proper steps, using high quality ingredients with good flavor, and having all the tools needed to prepare the meal. If the chef skips a step, uses low-quality ingredients, or lacks an essential tool, the dish may well be a failure.
Good research is analogous to cooking. Studies are grounded in clear and solid theory, analyze meaningful data (sets), and apply research methods properly. Numerous Information systems (IS) researchers provide careful guidance on how to develop theory (e.g., contextualization; Hong et al., 2014), advice on how to gather data (Straub, 1989), and when to apply research methods (e.g., qualitative comparative analysis; Mattke et al., 2022; Mattke et al., 2021; Pappas & Woodside, 2021) that can help scholars develop compelling explanations for real-world phenomena. However, if scholars fail to pay sufficient attention to how well different aspects of the research align, e.g., with the research questions and data method, researchers risk overstating conclusions or drawing incorrect inferences.
Data sets are the least elaborated element in IS research. Scholars often fail to sufficiently explain the implications of the data collection technique on theory testing or formally test whether their data meets the quality thresholds needed to conduct analysis. As a result, scholars sometimes rely on sub-optimal data, overuse one form of data collection, or make greater inferences than the data support, an especially great danger with regard to cross-sectional data.
A casual review of research published in major IS journals reveals the pervasiveness of using cross-sectional data. In the International Journal of Information Management (IJIM), for example, more than 85 % of papers published from 2020 to 2022 employ a cross-sectional research design. Editors-in-chief of various journals across different subject disciplines have raised concerns about overusing any one form of data collection (Dwivedi, Hughes, Cheung, et al., 2022). One common mistake is using cross-sectional data inappropriately to answer research questions that implicitly or explicitly point to temporal causality (Bono & McNamara, 2011). Consider a research question exploring whether and how beliefs and intentions shape behaviors. Cross-sectional survey data cannot be analyzed to establish causal relationships, but rather only associations between concepts. Temporal causality between beliefs, intentions, and behavior and how variance in beliefs and intentions relate to behavior can be better proven using multi-wave data (Kim, 2009, Kim and Malhotra, 2005).
Since the great majority of IS research attempts to establish temporal causality (e.g., focuses on cause-effect relationships) or assesses how temporal causality evolves over time, and since most recent IS research analyzes cross-sectional data, it is valuable to review the use of cross-sectional data in IS research. In this editorial, we assert the need in IS research to employ multiple research designs, such as collecting data from the same people in two (Shirish et al., 2021) or more (Adamovic, 2022) waves or using experiments to establish causality (Fink, 2022). While cross-sectional data can be analyzed to demonstrate associations between concepts, causality and cause-effect relationships can be demonstrated effectively using research designs that allow for the temporal ordering of variables.
This editorial provides an overview of cross-sectional studies, presents the strengths and weaknesses of using such data, and provides recommendations for conducting cross-sectional research, thus contributing to IS theory and practice. We hope that this critical review of the use of cross-sectional data in IS research will stimulate a broader conversation about data collection practices.
Section snippets
A brief overview of cross-sectional studies
A cross-sectional study, also known as a prevalence or transverse study, uses a snapshot of participants’ beliefs, behaviors, or other variables of interest of a study population (e.g., a group of individuals or organizations) at a specified point in time (Grimes and Schulz, 2002, Hua and David, 2008) to examine research questions (see Fig. 1).
Descriptive and analytical approaches are commonly used in cross-sectional studies (Kesmodel, 2018, Wang and Cheng, 2020). Descriptive cross-sectional
Strengths, limitations, and use cases of cross-sectional studies
Each cross-sectional approach has strengths and limitations (Fig. 2). We pair these strengths and limitations to offer guidance on when using cross-sectional data is or is not appropriate.
Recommendations for conducting rigorous cross-sectional research
We offer four recommendations to ensure that cross-sectional data is used appropriately (see Table 2).
The first recommendation points to the need for detailed and transparent research reporting. Such reporting includes disclosing the use of cross-sectional data (e.g., in the abstract), formulating appropriate objectives (e.g., referring to relevant practical or theoretical problems), specifying method and findings (e.g., how to reduce biases or handling missing values, providing descriptive
Elusive causality and cross-sectional data
While causality is difficult to establish in purely cross-sectional studies, this does not imply these studies cannot contribute to making a case for causality. As mentioned above, causality requires temporal precedence, covariation, and control of third variables. While the first condition is not met, covariation can easily be established. Similarly, using covariates in multivariate analysis can control for third-variable effects. Even path modeling techniques, like SEM, offer structural
Concluding remarks
Many IS research papers use cross-sectional designs to gather data. While cross-sectional design’s benefits can explain its frequent use (e.g., inexpensive, efficient data collection), it has significant shortcomings, including, among others, the difficulty of deriving cause-effect relationships, the non-existence of a temporal order between the collected variables, and the limited ability to test temporal causality. To realize the benefits of cross-sectional design, we recommend that
References (70)
- X. Wang et al.Cross-sectional studies: Strengths, weaknesses, and recommendations
CHEST Journal
(2020)
- A. Shirish et al.Switching to online learning during COVID-19: Theorizing the role of IT mindfulness and techno eustress for facilitating productivity and creativity in student learning
International Journal of Information Management
(2021)
- T. Ryan et al.Who uses Facebook? An investigation into the relationship between the Big Five, shyness, narcissism, loneliness, and Facebook usage
Computers in Human Behavior
(2011)
- M.M. Queiroz et al.Blockchain adoption challenges in supply chain: An empirical investigation of the main drivers in India and the USA(Video) 6. Cross sectional studies
International Journal of Information Management
(2019)
- I.O. Pappas et al.Fuzzy-set qualitative comparative analysis (fsQCA): Guidelines for research practice in information systems and marketing
International Journal of Information Management
(2021)
- M.J. Mortenson et al.A computational literature review of the technology acceptance model
International Journal of Information Management
(2016)
- P.B. Lowry et al.“Cargo Cult” science in traditional organization and information systems survey research: A case for using nontraditional methods of data collection, including Mechanical Turk and online panels
The Journal of Strategic Information Systems
(2016)
- R. JuncoComparing actual and self-reported measures of Facebook use
Computers in Human Behavior
(2013)
- W. Hui et al.A reporting guideline for IS survey research
Decision Support Systems
(2019)
- C.V. Helliar et al.Permissionless and permissioned blockchain diffusion
International Journal of Information Management
(2020)
International Journal of Information Management
(2018)
The Lancet
(2002)
International Journal of Information Management
(2022)
International Journal of Information Management
(2022)
International Journal of Information Management
(2022)
International Journal of Information Management
(2022)
Study designs: Part 2 - Descriptive studies
Perspectives in Clinical Research
(2019)
Sample size determination and statistical power analysis in PLS using R: An annotated tutorial
Communications of the Association for Information Systems
(2015)
A spotlight on cross-sectional research: Addressing the issues of confounding and adjustment
International Journal of Healthcare Management
(2021)
Preregistration of information systems research
Communications of the Association for Information Systems
(2021)
Publishing in AMJ —Part 2: Research design
Academy of Management Journal
(2011)
Editor's comments: Advancing research transparency at MIS quarterly: A pluralistic approach
When constructs become obsolete: A systematic approach to evaluating and updating constructs for information systems research
MIS Quarterly
(2022)
Research commentary—Generalizability of information systems research using student subjects - A reflection on our practices and recommendations for future research
Information Systems Research
(2012)
Multivariate dependencies
(2014)
Cross-sectional design
A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. Doctoral dissertation
(1986)
Bias
Journal of Epidemiology and Community Health
(2004)
The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies
Annals of Internal Medicine
(2007)
Why and how online experiments can benefit information systems research
Journal of the Association for Information Systems
(2022)
Belief, attitude, intention and behavior: An introduction to theory and research
(1975)
PLS, small sample size, and statistical power in MIS research
Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06)
(2006)
The complexity of establishing causality in a digital environment: an eye to the future
Journal of Information Technology Case and Application Research
(2020)
Avoiding bias in observational studies: Part 8 in a series of articles on evaluation of scientific publications
Deutsches Arzteblatt International
(2009)
Cited by (0)
Recommended articles (6)
Research article
Psychological barriers of using wearable devices by seniors: A mixed-methods studyComputers in Human Behavior, Volume 141, 2023, Article 107615
Wearable devices have several benefits for the fast-growing senior adult population. However, the adoption rate of these devices by seniors is low and our understanding of their attitudes and behaviors is limited. This study explored the psychological barriers that influenced seniors' attitudes and intentions to use wearable devices by conducting mixed-methods research. Forty four members of the senior population were interviewed prior to and subsequent to using wearable devices. Next, a quantitative study was conducted using an online survey with 321 valid responses to confirm the qualitative study's findings. The results showed that perceived complexity and uncertainty were the most significant barriers that negatively impacted seniors' attitudes about their decisions to use wearable devices. Surprisingly, the results showed that perceived disability positively impacted seniors' attitudes about using wearable devices. These results provide interesting implications for both theory and practice.
Research article
Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practiceInternational Journal of Information Management, Volume 69, 2023, Article 102615
(Video) Week 5 : CROSS SECTIONAL STUDIESMicrotask gig workers (MGWs) rely on digital platforms to arrange work agreements with requesters to complete well-defined microtasks. Many MGWs use an electronic network of practice (ENP) to facilitate information sharing about desirable and undesirable microtasks. This study uses social capital theory to theorize how social capital’s dimensions – structural, cognitive, and relational – shape the development of uncertainty-reducing and individualized-skill benefits. Based on survey data from 436 Amazon Mechanical Turk (MTurk) workers, the findings demonstrate that unique social capital dimensions affect specific ENP benefits. Understanding the communication style of an ENP (i.e., cognitive social capital) positively influences the uncertainty-reducing benefits of microtask information quality (MIQ) related to MTurk work. Combined with expectations of reciprocity and trust in ENP members (i.e., relational social capital), MIQ shapes microtask opportunity recognition (MOR), whereby individual MGWs identify opportunities to complete financially beneficial microtasks. The present study demonstrates that contextual factors, based on the coopetive nature of microtask ENPs, affect the interrelated structure of social capital theory and its underlying dimensions. Lastly, post hoc findings demonstrate the influence of MOR on MGWs’ financial performance, challenging previously held assumptions about the role of MIQ within the microtask literature.
Research article
Is digital transformation threatened? A systematic literature review of the factors influencing firms’ digital transformation and internationalizationJournal of Business Research, Volume 157, 2023, Article 113546
Digital transformation has a significant impact on firm internationalization. This paper aims to provide a systematic literature review to analyze two decades of literature on key issues related to digital transformation at the individual, firm, and macro (international) levels and its impact on firms’ internationalization process. We show the impact of human (soft side) and non-human components (i.e., knowledge, leadership, digital servitization, technological) of digital transformation that can either allow or threaten it and their impact on firms’ internationalization. In addition, our findings show that digital transformation can positively and negatively impact firm internationalization at the individual, firm, and macro levels. Moreover, we review the existing theories related to digital transformation and internationalization and identify the current gaps in these theories. Finally, we provide directions for future research to address these gaps.
Research article
A conceptual model of feedback mechanisms in adjusted affordances – Insights from usage of a mental mobile health applicationInternational Journal of Information Management, Volume 69, 2023, Article 102597
Affordance theory provides one of the most prominent lenses through which the socio-technical aspects of a system’s use can be investigated and understood. In this context, the literature has proposed that perceived and actualized affordances may be adjusted over time. Yet, how the adjustment of affordances occurs has not been explained in detail. Thus, in this article, we develop a conceptual model of feedback mechanisms that includes a more explicit description of how affordances are perceived by users, whether actualized and adjusted. With the model, we introduce the central concept of a generative base, out of which affordance perceptions emerge and which can be updated through affordance actualizations. With this base, we integrate mental model (MM) theory to explain better the differing perceptions before and after actor–artifact interactions. Our conceptual model is illustrated and specified using an empirical case of the mental mobile health (mHealth) app “Between The Lines” in Germany. In this study, we conducted 40 interviews in two rounds with 20 teenage app users. Our results show that the users’ perceptions of mHealth affordances become adjusted and hence change over time due to experiencing the actualization process, which may lead to an update of the generative base, including the user’s MM.
Research article
Supply chain management professionals’ proficiency in big data analytics: Antecedents and impact on performanceTransportation Research Part E: Logistics and Transportation Review, Volume 169, 2023, Article 102972
While big data analytics (BDA) carries great potential for supply chain management (SCM), actual advanced applications of these approaches are still limited in practice. Within this context, we seek to identify what can foster an SCM professional’s proficient use of BDA, and define BDA proficiency as an individual’s ability to effectively use BDA. Grounding our research in the theoretical framework of technology acceptance, we consider perceived ease of use, perceived usefulness, attitude toward, and behavioral intention to use BDA as potential influential antecedents. Using primary survey data from 212 SCM professionals, we find that all but one of these hypothesized relationships are confirmed among the sample. This offers valuable insight on how to drive the intention of SCM professionals to use BDA, which serves as a foundation to become proficient in it. In addition, we hypothesize about the impact of BDA proficiency on generating business value in terms of both quality and cost performance, two important outcome variables in SCM research. While the impact on cost performance is confirmed, the impact on quality performance is non-significant, bringing greater clarity to the differentiated performance impacts of BDA proficiency. When further scrutinizing these links to performance under the moderating effect of environmental competitiveness, we not only find the impact of BDA proficiency on cost performance to be greater under higher levels of environmental competitiveness, but also that under such greater levels the link from BDA proficiency to quality performance becomes significant. Overall, our research provides insight not only into what can foster an SCM professional’s BDA proficiency, but also into its impact on performance under various levels of environmental competitiveness.
Research article
Analysing the adoption barriers of low-carbon operations: A step forward for achieving net-zero emissionsResources Policy, Volume 80, 2023, Article 103256
In November 2021, the 26th United Nations Climate Change Conference (COP26) was held in Glasgow, UK, the global leaders from nearly 200 countries stressed taking immediate action on the climate issue and how to ensure global net-zero emissions by 2030. It is possible to accelerate the transition to low-carbon energy systems, the present study seeks to identify and analyse key barriers to Low Carbon Operations (LCO) in emerging economies. A critical literature review was undertaken to recognise the barriers linked to the adoption of LCO. To validate these barriers, an empirical study with a dataset of 127 respondents from the Indian automobile industry was conducted. The validated barriers were analysed using Best Worst Method (BWM) and Decision-Making Trial and Evaluation Laboratory (DEMATEL) techniques. BWM is used to determine the priority ranking of barriers, while the DEMATEL method is employed to elucidate the cause-effect inter-relationships among the listed barriers. The results suggest that ‘Economic’ is the most influential category of barriers followed by ‘Infrastructure’ and ‘Operational’. The results also show that the barriers ‘Economic’, ‘Environmental’, ‘Infrastructure’ and ‘Organizational Governance’ belong to the cause group. Some significant managerial implications are recommended to overcome these barriers and to assist firms in the successful adoption of LCO and achieving net-zero emissions. The work was carried out in the automotive industry in India but provides findings that may have wider applicability in other developing countries and beyond.
(Video) Epidemiological Studies - made easy!
© 2023 Elsevier Ltd. All rights reserved.
FAQs
What is cross-sectional research used for? ›
Cross-sectional designs are used for population-based surveys and to assess the prevalence of diseases in clinic-based samples. These studies can usually be conducted relatively faster and are inexpensive. They may be conducted either before planning a cohort study or a baseline in a cohort study.
Is a cross-sectional study a case study? ›Cross sectional studies are used to determine prevalence. They are relatively quick and easy but do not permit distinction between cause and effect. Case controlled studies compare groups retrospectively. They seek to identify possible predictors of outcome and are useful for studying rare diseases or outcomes.
What is a cross-sectional research study quizlet? ›Cross-sectional research involves using different groups of people who differ in the variable of interest but share other characteristics, such as socioeconomic status, educational background, and ethnicity. Cohort. investigate the causes of disease, establishing links between risk factors and health outcomes.
What type of research is a cross-sectional observational study? ›A cross-sectional study is a type of observational research that analyzes data of variables collected at one given point in time across a sample population or a pre-defined subset. This study type is also known as cross-sectional analysis, transverse study, or prevalence study.
What is the purpose of cross sectional studies quizlet? ›Cross sectional studies represent a "snap shot" in time. What can cross sectional studies be used for? To seek associations and to generate and test hypotheses.
What is the main goal of cross-sectional surveys quizlet? ›The goal of a cross-sectional survey is to measure the proportion of a population with a particular exposure or disease.
How do you identify a cross-sectional study? ›In a cross-sectional study you collect data from a population at a specific point in time; in a longitudinal study you repeatedly collect data from the same sample over an extended period of time.
What is an example of a cross-sectional study? ›For example, a cross-sectional study might be used to determine if exposure to specific risk factors might correlate with particular outcomes. A researcher might collect cross-sectional data on past smoking habits and current diagnoses of lung cancer, for example.
What is the main strength of a cross-sectional study? ›The main strength of cross-sectional studies is that they are relatively quick and inexpensive to conduct. They are the best way to determine the prevalence and can study the associations of multiple exposures and outcomes.
What is cross-sectional area simple definition? ›The cross-sectional area is the area of a two-dimensional shape that is obtained when a three-dimensional object - such as a cylinder - is sliced perpendicular to some specified axis at a point. For example, the cross-section of a cylinder - when sliced parallel to its base - is a circle.
Which of the following best describes cross-sectional research? ›
Which of the following best describes cross-sectional research? Groups of different aged people are compared across time.
What is cross-sectional data type? ›Cross-sectional data, or a cross section of a study population, in statistics and econometrics, is a type of data collected by observing many subjects (such as individuals, firms, countries, or regions) at the one point or period of time. The analysis might also have no regard to differences in time.
What is cross-sectional view? ›: a view or drawing that shows what the inside of something looks like after a cut has been made across it. [count]
Is cross-sectional research Qualitative or quantitative? ›An analytical cross-sectional study is a type of quantitative, non-experimental research design. These studies seek to "gather data from a group of subjects at only one point in time" (Schmidt & Brown, 2019, p. 206).
What are the advantages of using a cross-sectional research study quizlet? ›- The advantage of cross-sectional studies is that it can compare different population groups at a single point in time. This means it allows researchers to compare many different variables at the same time.
Which of the following is true of a cross-sectional study quizlet? ›Which of the following is true of cross-sectional research? It compares people of different ages at the same point in time.
What is a key feature of a cross-sectional study quizlet? ›A key feature of a cross-sectional study is that: A cross-sectional study or survey provides a snapshot of the health of a population, so it assesses prevalence rather than incidence. As a result, it is not as useful as a cohort or case-control study for analytic epidemiology.
What questions does a cross-sectional study answer? ›Cross-sectional study designs are useful when: Answering questions about the incidence or prevalence of a condition, belief or situation. Establishing what the norm is for a specific demographic at a specific time.
What are two strengths of the cross-sectional design? ›4. Strengths and weaknesses of cross-sectional studies. Relatively quick and easy to conduct (no long periods of follow-up). Data on all variables is only collected once.
Which study uses a cross-sectional design? ›Cross-sectional studies are often used in developmental psychology, but this method is also used in many other areas, including social science and education.
What is a cross-sectional study an example of? ›
Cross-sectional research studies are a type of descriptive research that provides information from groups. Because it is a snapshot of a moment in time, this type of research cannot be used to define cause and effect relationships between variables.