Novel materials have enabled industries and technologies: LEDs, electric motors and batteries. Their development is glacially slow, often taking decades. How do we speed up materials discovery using ML and AI tools. This talk will break down the extreme data challenges of materials discovery. How do we best gain information from 10 or less data points? How do we do that efficiently while accepting that science operates in an exceptionally complex and high-dimensional space? How do we take the correct sequence of decisions that maximise the synthesis outcome for a novel material? How do we bring as much of this complexity 'in-distribution'? The talk will discuss both traditional ML, LLM-based, and mixed approaches with a holistic view on materials discovery.