We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.
We are a dynamic, collaborative team passionate about AI and its potential to transform society.
Our diverse workforce thrives in competitive environments and is committed to driving innovation.
Our teams are distributed between Europe, North America, Asia and the Middle East.
We are creative, low-ego and team-spirited.
About the RoleAs a Research Engineer, GPU performance, you will sit at the heart of that spectrum: your low-level work directly determines how fast our frontier models can be trained and served.
Working hand-in-hand with Research Scientists, you'll make every GPU count.
Mistral AI is hiring an expert in pushing large language model's GPU utilization and performance to their limits.
In this role, you will own the performance of our models end-to-end: writing the low-level code that extracts the maximum capacity from high-end hardware, and rethinking model architectures so they run efficiently at scale.
What You Will DoDevelop low-level code that takes full advantage of high-end GPUs and maxes out their capacity — from custom kernels to memory-layout and communication optimisations.
Rethink parts of the generative model architecture to make them more suitable for efficient inference, in collaboration with Research Scientists.
Integrate low-level efficient code into a high-level MLOps framework, so that optimisations benefit every training run and deployment rather than a single experiment.
Profile, benchmark and squeeze performance out of large-scale training and inference on thousands of GPUs.
Model LLM execution on various GPUs with high fidelity to assess hardware usage and build serving performance estimate.