Estimating an earthquake's magnitude and location may not be necessary to predict shaking in real time; instead, wavefield‐based approaches predict shaking with few assumptions about the seismic source. Here, we introduce GRAph Prediction of Earthquake Shaking (GRAPES), a deep learning model trained to characterize and propagate earthquake shaking across a seismic network. We show that GRAPES’ internal activations, which we call “seismic vectors”, correspond to the arrival of distinct seismic phases. GRAPES builds upon recent deep learning models applied to earthquake early warning by allowing for continuous ground motion prediction with seismic networks of all sizes. While trained on earthquakes recorded in Japan, we show that GRAPES, without modification, outperforms the ShakeAlert earthquake early warning system on the 2019 M7.1 Ridgecrest, CA earthquake. Plain Language Summary Have you ever heard something through the grapevine? It often takes you by surprise to hear a message from someone other than the original source. You might have felt an earthquake in a similar way: experiencing shaking (the message) at your location rather than movement along a fault (the source). We apply grapevine‐style communication to earthquake early warning (EEW). The goal of EEW is to warn people to prepare for earthquake shaking before damaging seismic waves arrive at their location. We build on recent work that used deep learning and large earthquake data sets to predict earthquake shaking. We developed a deep learning algorithm called GRAPES which predicts shaking in a manner similar to a game of seismic telephone: when a seismic sensor detects shaking, it sends a message to its neighboring sensors, warning them to expect shaking soon. These sensors then pass on the message to their more distant neighbors along the grapevine. We show that the messages GRAPES learned to send between sensors are like seismic status updates: “I'm seeing this type of seismic wave right now”. We applied GRAPES to the 2019 M7.1 Ridgecrest, CA earthquake and it predicted shaking accurately and quickly. Key Points A deep learning network trained to predict ground motion learned an internal representation of the seismic wavefield Individual neurons within the network activate with the arrival of P waves, S waves, surface waves, coda waves, and ambient noise While trained on earthquakes in Japan, the model generalizes well to predicting ground motions for the 2019 Ridgecrest, CA earthquake