Background There is a research gap regarding safety concerns of patients at the end of life. The aim of this study was, therefore, to explore whether patients under specialist community palliative care feel safe at home and which factors affect the perceived safety. Furthermore, we investigated if perception of safety is associated with different aspects of subsequent care. Methods Using a standardized questionnaire, a cross-sectional survey was conducted among 100 specialist community palliative care patients. Logistic regression was used to examine the strength of the association between clinical and socio-demographic variables and the perception of safety. After a 6-month follow-up period, we analyzed differences in various care-related outcomes between patients with unaffected and impaired perceptions of safety. Results In our study, one in five patients receiving specialist community palliative care expressed safety concerns. Subdomains of safety that were reported most frequently were physical disability (60%), physical symptoms (30%), psychological symptoms (26%), and side effects/complications of drug therapy (19%). Of the participants surveyed after the initial COVID-19 lockdown, 35.1% reported that they felt their safety had been adversely affected by the pandemic. Compromised safety perception was associated with higher levels of palliative care-related problems, and proximity to death. Conclusions Our study uncovered relevant safety concerns of palliative care patients receiving specialist community palliative care. The insights gained into patient-reported problems may help healthcare professionals to identify situations where patients feel unsafe. Further research should address primary and secondary prevention measures to improve the quality of end-of-life care in the home environment.