Immunosuppressive treatment in patients with rheumatic diseases can maintain disease remission but also increase risk of infection. Their response to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) vaccination is frequently blunted. In this study we evaluated the effect of immunosuppression exposure on humoral and T cell immune responses to SARS-CoV-2 infection and vaccination in two distinct cohorts of patients; one during acute SARS-CoV-2 infection and 3 months later during convalescence, and another prior to SARS-CoV-2 vaccination, with follow up sampling 6 weeks after vaccination. Results were compared between rituximab-exposed (in previous 6 months), immunosuppression-exposed (in previous 3 months), and non-immunosuppressed groups. The immune cell phenotype was defined by flow cytometry and ELISA. Antigen specific T cell responses were estimated using a whole blood stimulation interferon-γ release assay. A focused post-vaccine assessment of rituximab-treated patients using high dimensional spectral cytometry was conducted. Acute SARS-CoV-2 infection was characterised by T cell lymphopenia, and a reduction in NK cells and naïve CD4 and CD8 cells, without any significant differences between immunosuppressed and non-immunosuppressed patient groups. Conversely, activated CD4 and CD8 cell counts increased in non-immunosuppressed patients with acute SARS-CoV-2 infection but this response was blunted in the presence of immunosuppression. In rituximab-treated patients, antigen-specific T cell responses were preserved in SARS-CoV-2 vaccination, but patients were unable to mount an appropriate humoral response.