Purpose Prior reports on the location and sizes of brain metastases almost entirely focus on patients with primary breast and pulmonary cancer. This is the first study comparing multiple other types of cancer that metastasize to the brain. Methods This monocentric retrospective study includes 369 untreated patients with 3313 intraaxial brain metastases. Following semi-manual segmentation of metastases on post-contrast T1WI, cumulative spatial probability distribution maps of brain metastases were created for the whole group and for all primary tumors. Furthermore, mixed effects logistic regression model analysis was performed to determine if the primary tumor, patient age, and patient sex influence lesion location. Results The cerebellum as location of brain metastases was proportionally overrepresented. Breast and pulmonary cancer caused higher number of brain metastases to what would normally be expected. Multivariate analyses revealed a significant accumulation of brain metastases from skin cancer in a frontal and from breast and gastrointestinal cancer in a cerebellar location. Conclusion Distribution of brain metastases is very heterogeneous for the distinct primaries, possibly reflecting the diversity of mechanisms involved in brain metastases formation. In daily clinical practice distribution patters may be beneficial to predict the primary cancer site, if unknown.