Immune-related adverse events (irAEs) are induced by immune checkpoint inhibitors (ICIs). Liver is one of the main target organs which irAEs occur and we investigated the influence of liver dysfunction on prognosis of patients after ICIs. From July 2014 to December 2018, 188 patients with diverse cancers who received ICIs (nivolumab or pembrolizumab) were enrolled. Twenty-nine patients experienced liver dysfunction of any grades after ICIs. Progression-free survival (PFS) was significantly shorter in the liver dysfunction-positive group than in the liver dysfunction-negative group, and a similar result was obtained for Overall survival (OS). Multiple logistic regression analysis revealed liver metastasis and alanine aminotransferase before ICIs were associated with a higher incidence of liver dysfunction after ICIs. Regardless of liver metastasis, PFS and OS were significantly shorter in the liver dysfunction-positive group. In conclusion, this study suggests liver dysfunction is associated with poor prognosis in patients after ICIs with diverse cancers.