Emission reduction in buildings is essential to combat climate change. However, current strategies failed to balance development and emissions reduction goals. This paper selects a public building in China and simulates its initial energy consumption and carbon emissions. Then it establishes a multi-objective optimization model to explore cost-effective and emission-reduction strategies, considering photovoltaic and ground-source-heat-pump (GSHP) systems. Finally, NSGA-Ⅱ is used to solve, and sensitivity analysis is carried out. Results show that: (1) Energy consumed by the air conditioning system is the largest in January for heating and in July for cooling, validating the accuracy of the energy simulation model. (2) Economic efficiency and emission reduction effect are better when photovoltaic and GSHP systems are implemented simultaneously. (3) Electricity price, initial investment cost, annual solar peak hours, and the proportion of shallow geothermal energy significantly impact carbon emissions and cost. (4) The photovoltaic and power grid substitution ratio will exceed 8% every five years, and all substitutions will be completed in 2050. After adopting the GSHP system, the complete replacement will be advanced to 2045. Setting subsidies significantly shortens the payback period of investment and ensures firms’ economic benefits. In summary, using photovoltaic and shallow geothermal energy is conducive to reducing emissions and saving costs in the long term.