The emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic in 2019 has led to a global health crisis. Mutations of the SARS-CoV-2 genome have impeded the development of effective therapeutics and vaccines against SARS-CoV-2. Natural products are important for discovering therapeutics to treat the 2019 coronavirus disease (COVID-19). In the present study, we investigated the antiviral activity of herbal drug extracts from Polygala Root, Areca, and Quercus Bark and natural compounds derived from herbal drug such as baicalin and glabridin, with IC 50 values of 9.5 µg/ml, 1.2 µg/ml, 5.4 µg/ml, 8.8 µM, and 2.5 µM, respectively, against SARS CoV-2 infection in vitro. Certain herbal drug extracts and natural compounds were found to inhibit viral RNA levels and infectious titers of SARS-CoV-2 in a dose-dependent manner. Furthermore, viral protein analyses showed that herbal drug extracts and natural compounds effectively inhibited SARS-CoV-2 in the various entry treatments. Our study revealed that three herbal drugs are good candidates for further in vivo and clinical studies.