Noncatalytic carbohydrate binding modules (CBMs) have been demonstrated to play various roles with cognate catalytic domains. However, for polysaccharide lyases (PLs), the roles of CBMs remain mostly unknown. AlyB is a multidomain alginate lyase that contains CBM32 and a PL7 catalytic domain. The AlyB structure determined herein reveals a noncanonical alpha helix linker between CBM32 and the catalytic domain. More interestingly, CBM32 and the linker does not significantly enhance the catalytic activity but rather specifies that trisaccharides are predominant in the degradation products. Detailed mutagenesis, biochemical and cocrystallization analyses show “weak but important” CBM32 interactions with alginate oligosaccharides. In combination with molecular modeling, we propose that the CBM32 domain serves as a “pivot point” during the trisaccharide release process. Collectively, this work demonstrates a novel role of CBMs in the activity of the appended PL domain and provides a new avenue for the well-defined generation of alginate oligosaccharides by taking advantage of associated CBMs. •A unique alpha helix linker between CBMs and the catalytic domain was discovered.•CBM32 and the helix linker are responsible for the preferred trisaccharide products.•CBM32 forms “weak but important” interactions with alginate oligosaccharide.•CBM32 serves as a “pivot point” during the trisaccharide release process.