The discovery of drug-like molecules that bind pockets in proteins that are not present in crystallographic structures yet exert allosteric control over activity has generated great interest in designing pharmaceuticals that exploit allosteric effects. However, there have only been a small number of successes, so the therapeutic potential of these pockets—called hidden allosteric sites—remains unclear. One challenge for assessing their utility is that rational drug design approaches require foreknowledge of the target site, but most hidden allosteric sites are only discovered when a small molecule is found to stabilize them. We present a means of decoupling the identification of hidden allosteric sites from the discovery of drugs that bind them by drawing on new developments in Markov state modeling that provide unprecedented access to microsecond- to millisecond-timescale fluctuations of a protein’s structure. Visualizing these fluctuations allows us to identify potential hidden allosteric sites, which we then test via thiol labeling experiments. Application of these methods reveals multiple hidden allosteric sites in an important antibiotic target—TEM-1 β-lactamase. This result supports the hypothesis that there are many as yet undiscovered hidden allosteric sites and suggests our methodology can identify such sites, providing a starting point for future drug design efforts. More generally, our results demonstrate the power of using Markov state models to guide experiments. Significance Rational drug design efforts typically focus on identifying inhibitors that bind to protein active sites. Pockets that are not present in crystallographic structures yet can exert allosteric (i.e., long-range) control over distant active sites present an exciting alternative. However, identifying these hidden allosteric sites is extremely challenging because one usually has to simultaneously find a small molecule that binds to and stabilizes the open conformation of the pocket. Here, we present a means of combining advances in computer modeling—using Markov state models to capture long timescale dynamics—with biophysical experiments to identify hidden allosteric sites without requiring the simultaneous discovery of drug-like compounds that bind them. Using this technology, we discover multiple hidden allosteric sites in a single protein.