Previous atomistic simulations and experiments have attributed size effects in the elastic modulus of Ag nanowires to surface energy effects inherent to metallic surfaces. However, differences in experimental and computational trends analyzed here imply that other factors are controlling experimentally observed modulus changes. This study utilizes atomistic simulations to determine how strongly nanowire geometry and surface structure influence nanowire elastic modulus. The results demonstrate that although these factors do influence the elastic modulus of Ag nanowires to some extent, they alone are insufficient to explain current experimental trends in nanowire modulus with decreasing dimensional scale. Future work needs to be done to determine whether other factors, such as surface contaminants or oxide layers, contribute to the experimentally observed elastic modulus increase.