This volume consists of original contributions by participants of the workshops on Mathematical Foundations of Speech Processing and Natural Language Modeling, held in the Fall of 2000 at the Institute for Mathematics and Its Applications as part of its "Mathematics in Multimedia" year-long program. Topics include language modeling, prosody, acoustic-phonetic modeling, and statistical methodology.