In mathematics, the focus is often on finding interesting constructions for various mathematical problems. I will discuss how tools that "search in language space" can significantly reduce the amount of effort mathematicians need to invest to test their ideas and find good constructions for various problems. We will briefly look at different ways we can think about this search, look at a few examples, and figure out which of these setups is right for the problems you care about.