Autophagy modulates the degradation and recycling of intracellular materials and contributes to male gametophyte development and male fertility in plants. However, whether autophagy participates in seed development remains largely unknown. Here, we demonstrate that autophagy is crucial for timely programmed cell death (PCD) in the integumentary tapetum, the counterpart of anther tapetum, influencing embryo pattern formation and seed viability. Inhibition of autophagy resulted in delayed PCD of the integumentary tapetum and defects in embryo patterning. Cell-type-specific restoration of autophagic activities revealed that the integumentary tapetum plays a non-autonomous role in embryo patterning. Furthermore, high-throughput, comprehensive lipidomic analyzes uncovered an unexpected seed-developmental-stage-dependent role of autophagy in seed lipid metabolism: it contributes to triacylglycerol degradation before fertilization and to triacylglycerol biosynthesis after fertilization. This study highlights the critical role of autophagy in regulating timely integumentary tapetum PCD and reveals its significance in seed lipid metabolism and viability.