High tumor mutational burden (TMB-H) is correlated with enhanced objective response rate (ORR) and progression-free survival (PFS) for certain cancers receiving immunotherapy. This study aimed to investigate the safety and efficacy of toripalimab, a humanized programmed death-1 (PD-1) antibody, in advanced gastric cancer (AGC), and the predictive survival benefit of TMB and PD-L1. We reported on the AGC cohort of phase Ib/II trial evaluating the safety and activity of toripalimab in patients with AGC, oesophageal squamous cell carcinoma, nasopharyngeal carcinoma and head and neck squamous cell carcinoma. In cohort 1, 58 chemo-refractory AGC patients received toripalimab (3 mg/kg d1, Q2W) as a monotherapy. In cohort 2, 18 chemotherapy-naive AGC patients received toripalimab (360 mg d1, Q3W) with oxaliplatin 130 mg/m2 qd, d1, capecitabine 1000 mg/m2 b.i.d., d1–d14, Q3W as first-line treatment. Primary end point was ORR. Biomarkers such as PD-L1 and TMB were evaluated for correlation with clinical efficacy. In cohort 1, the ORR was 12.1% and the disease control rate (DCR) was 39.7%. Median PFS was 1.9 months and median OS was 4.8 months. The TMB-H group showed significant superior OS than the TMB-L group 14.6 versus 4.0 months, HR = 0.48 (96% CI 0.24–0.96), P = 0.038, while PD-L1 overexpression did not correlate with significant survival benefit. A 77.6% of patients experienced at least one treatment-related adverse event (TRAE), and 22.4% of patients experienced a grade 3 or higher TRAE. In cohort 2, the ORR was 66.7% and the DCR was 88.9%. A 94.4% of patients experienced at least one TRAE and 38.9% of patients experienced grade 3 or higher TRAEs. Toripalimab has demonstrated a manageable safety profile and promising antitumor activity in AGC patients, especially in combination with XELOX. High TMB may be a predictive marker for OS of AGC patients receiving toripalimab as a single agent. ClinicalTrials.gov NCT02915432.