Navigating the Fragmented World of Machine Learning Compilers
Machine Learning and AI have taken over the world, with LLMs diffusing into our software development toolchains, search engines, travel planners and almost every facet of our lives. Being a compiler engineer, however, my curiosity has been taken over by how these so-called “models” are being deployed in software. Our traditional software compiler toolchains would involve an average programming language containing arithmetic, functions, recursion/loops, and other control flow instructions and various optimisation passes to lower the high-level languages into an assembly language like x86 or ARM instruction sets. During the 60s, this world was also incredibly fragmented, with several competing and non-standard instruction sets until Intel won.

