Taiwan Mandarin, one of the more syllable-timed dialects of Mandarin, has fewer unstressed syllables than Standard Mandarin. Acoustic analyses show that the supposedly unstressed syllables—neutral-tone syllables—in Taiwan Mandarin behave differently from those of Standard Mandarin. Unlike Standard Mandarin, these syllables do not raise their pitch after Tone 3. They have a distinct static mid-low pitch target and the target is implemented with a stronger articulatory strength. Moreover, acoustic analyses demonstrate that not all of these “unstressed syllables” are unstressed. The phonetic evidence suggests that these neutral-tone syllables should be analyzed as unaccented rather than unstressed in Taiwan Mandarin. These unaccented syllables are only lexically marked, and their pitch is neutralized into a mid-low tone. This study sheds light on how rhythm can affect stress and accent in a lexical tone language.