Effective Learning During COVID-19: Multilevel Covariates Matching and Propensity Score Matching

Siying Guo, Jianxuan Liu, Qiu Wang

Research output: Contribution to journalArticlepeer-review

Abstract

In large-scale observational data with a hierarchical structure, both clusters and interventions often have more than two levels. Popular methods in the binary treatment literature do not naturally extend to the hierarchical multilevel treatment case. For example, most K-12 and universities have moved to an unprecedented hybrid learning module during the COVID-19 pandemic where learning modes include hybrid and fully remote learning, while students were clustered within a class and school region. It is challenging to evaluate the effectiveness of the learning outcomes of the multilevel treatments in a hierarchically data structured. In this paper, we study a covariates matching method and develop a generalized propensity score matching method to reduce the bias of estimation in the intervention effect. We also propose simple algorithms to assess the covariates balance for each approach. We examine the finite sample performance of the methods via simulation studies and apply the proposed methods to analyze the effectiveness of learning modes during the COVID-19 pandemic.

Original languageEnglish (US)
JournalAnnals of Data Science
DOIs
StateAccepted/In press - 2022

Keywords

  • COVID-19
  • Generalized propensity score
  • Matching
  • Multilevel hybrid learning
  • Potential outcome

ASJC Scopus subject areas

  • Computer Science Applications
  • Artificial Intelligence
  • Statistics, Probability and Uncertainty
  • Business, Management and Accounting (miscellaneous)

Fingerprint

Dive into the research topics of 'Effective Learning During COVID-19: Multilevel Covariates Matching and Propensity Score Matching'. Together they form a unique fingerprint.

Cite this