Gas surrounding high-redshift galaxies has been studied through observations of absorption line systems toward background quasars for decades. However, it has proven difficult to identify and characterize the galaxies associated with these absorbers due to the intrinsic faintness of the galaxies compared with the quasars at optical wavelengths. Using the Atacama Large Millimeter/Submillimeter Array, we report on detections of C ii 158-μm line and dust-continuum emission from two galaxies associated with two such absorbers at a redshift of z ~ 4. Our results indicate that the hosts of these high-metallicity absorbers have physical properties similar to massive star-forming galaxies and are embedded in enriched neutral hydrogen gas reservoirs that extend well beyond the star-forming interstellar medium of these galaxies.