Neuroticism has been shown to act as an important risk factor for major depressive disorder (MDD). Genetic and neuroimaging research has independently revealed biological correlates of neurotic personality including cortical alterations in brain regions of high relevance for affective disorders. Here we investigated the influence of a polygenic score for neuroticism (PGS) on cortical brain structure in a joint discovery sample of n = 746 healthy controls (HC) and n = 268 MDD patients. Findings were validated in an independent replication sample (n = 341 HC and n = 263 MDD). Subgroup analyses stratified for case-control status and analyses of associations between neurotic phenotype and cortical measures were carried out. PGS for neuroticism was significantly associated with a decreased cortical surface area of the inferior parietal cortex, the precuneus, the rostral cingulate cortex and the inferior frontal gyrus in the discovery sample. Similar associations between PGS and surface area of the inferior parietal cortex and the precuneus were demonstrated in the replication sample. Subgroup analyses revealed negative associations in the latter regions between PGS and surface area in both HC and MDD subjects. Neurotic phenotype was negatively correlated with surface area in similar cortical regions including the inferior parietal cortex and the precuneus. No significant associations between PGS and cortical thickness were detected. The morphometric overlap of associations between both PGS and neurotic phenotype in similar cortical regions closely related to internally focused cognition points to the potential relevance of genetically shaped cortical alterations in the development of neuroticism.