Fractile

About the Company

Fractile is building chips to run large language models two orders of magnitude faster. Existing hardware is good for training LLMs, but very poorly suited to subsequent inference of the trained model, which is increasingly the dominant workload. A network’s weights need to be moved onto a chip once per word generated, and this movement takes a few hundred times longer than the subsequent computations themselves. Fractile’s revolutionary approach to fusing computation with memory eliminates this bottleneck, and can scale to allow running the world’s largest models at a global scale.

Listed Jobs

Company Name

Fractile

Job Title

Sr ML Runtime Engineer

Job Description

Job Title: Senior Machine Learning Runtime Engineer Role Summary: Design, develop, and maintain high‑performance Rust runtime for AI acceleration hardware, integrating with major ML frameworks (PyTorch, vLLM, SGLang). Collaborate with hardware, lower‑level software, and ML teams under a hardware‑software co‑design methodology to deliver fast inference pipelines. Expectations: Deliver production‑ready runtime components, validate performance against hardware specifications, and continuously improve scalability and reliability. Drive technical ownership in a fast‑paced, cross‑functional environment. Key Responsibilities: - Build and extend Rust runtime for AI acceleration devices. - Integrate runtime with open‑source ML ecosystems (PyTorch, vLLM, SGLang). - Collaborate with hardware, firmware, and software teams to align runtime design with accelerator architecture. - Benchmark and optimize inference workloads, ensuring target performance metrics. - Participate in code reviews, design discussions, and maintain high code quality. - Troubleshoot runtime issues across development, staging, and production environments. Required Skills: - Proficiency in Rust and Python. - Experience with ML software ecosystem projects (PyTorch, vLLM, SGLang, or similar). - Strong understanding of modern ML inference workloads and deployment challenges. - Familiarity with industry‑standard development tools (CI/CD, version control, testing frameworks). - Ability to work collaboratively in interdisciplinary teams and take ownership of complex problems. Required Education & Certifications: - Bachelor’s or Master’s degree in Computer Science, Electrical/Electronics Engineering, Mathematics, Physics, or related field. - Minimum 5 years of industry experience in software engineering focused on machine learning systems. (No specific certifications required.)

London, United kingdom

On site

Mid level

18-11-2025

Company Name

Fractile

Job Title

Senior Software Engineer

Job Description

Job title: Senior Software Engineer Role Summary: Lead the design and implementation of systems software for high‑performance AI accelerator hardware, including firmware, board/rack management, device drivers, runtime libraries, and security modules, in a close hardware‑software co‑design environment. Expectations: Deliver robust, high‑performance components on schedule, own feature sets, maintain code quality, mentor juniors, and drive continuous improvement in a fast‑paced setting. Key Responsibilities: - Design, program, and test board/rack management tools and low‑level firmware for AI accelerators. - Implement device drivers, runtime libraries, and security software in C/C++. - Collaborate with hardware engineers, ML specialists, and system architects on co‑design decisions. - Develop, maintain, and automate build, test, and deployment pipelines. - Conduct code reviews, produce technical documentation, and troubleshoot production issues. - Participate in architecture, performance analysis, and system optimization activities. Required Skills: - Strong C/C++ programming with industry tools (CMake, Git, Valgrind, GDB). - Proven experience building systems software for data‑center or comparable environments. - Deep knowledge of low‑level hardware interfaces (PCIe, DMA, power management). - Exposure to firmware development and security fundamentals. - Ability to craft and maintain scripts (Python, Bash) for build and automation. - Excellent communication and cross‑functional collaboration skills. - Familiarity with Rust, GPU/ML accelerator concepts, and startup‑style team dynamics is a plus. Required Education & Certifications: - Bachelor’s or higher degree in Computer Science, Electrical/Electronic Engineering, Physics, Mathematics, or related field. - Minimum 3+ years of industry experience in systems or software engineering for data‑center or complex hardware platforms.

Bristol, United kingdom

On site

Senior

10-12-2025