The Park Grass experiment (PGE) in the UK has been ongoing since 1856. Its purpose is to study the response of biological communities to the long-term treatments and associated changes in soil parameters, particularly soil pH. In this study, soil samples were collected across pH gradient (pH 3.6–7) and a range of fertilizers (nitrogen as ammonium sulfate, nitrogen as sodium nitrate, phosphorous) to evaluate the effects nutrients have on soil parameters and microbial community structure. Illumina 16S ribosomal RNA (rRNA) amplicon sequencing was used to determine the relative abundances and diversity of bacterial and archaeal taxa. Relationships between treatments, measured soil parameters, and microbial communities were evaluated. Clostridium, Bacteroides, Bradyrhizobium, Mycobacterium, Ruminococcus, Paenibacillus, and Rhodoplanes were the most abundant genera found at the PGE. The main soil parameter that determined microbial composition, diversity, and biomass in the PGE soil was pH. The most probable mechanism of the pH impact on microbial community may include mediation of nutrient availability in the soil. Addition of nitrogen to the PGE plots as ammonium sulfate decreases soil pH through increased nitrification, which causes buildup of soil carbon, and hence increases C/N ratio. Plant species richness and plant productivity did not reveal significant relationships with microbial diversity; however, plant species richness was positively correlated with soil microbial biomass. Plants responded to the nitrogen treatments with an increase in productivity and a decrease in the species richness.