AI/ML Software Engineer

The Role:

Join the SiFive AI/ML Software Team to build the high-performance stack for Next-Gen AI. We are seeking engineers to optimize and deploy LLMs and Generative AI models on RISC-V architectures, spanning from compiler infrastructure to distributed runtime systems.

Responsibilities:

• Compiler Infrastructure: Develop and maintain MLIR/IREE/Triton compiler stacks; optimize end-to-end (e2e) LLM performance and contribute to relevant open-source communities.
• Runtime Systems: Design and implement single/multi-device scheduling and memory management layers; define hardware-software interfaces for high-throughput AI workloads.
• Model Infrastructure: Implement model sharding and distribution strategies; lead the integration between high-level frameworks (e.g., PyTorch) and hardware backends.
• Performance Optimization: Analyze and profile AI models to identify bottlenecks; develop high-performance kernels leveraging RISC-V Vector (RVV) and custom ISA extensions.
• Co-design: Collaborate with hardware architects to influence the design of future AI accelerators and microarchitectures.

Requirements

• Education: Master’s or PhD in Computer Science, Applied Mathematics, or a related field.
• Programming: Strong proficiency in C++ and Python.
• Domain Expertise: Solid understanding of AI/ML models (LLMs, Diffusion, Transformers) and their deployment challenges.
• Technical Track (One or more of the following):
• • Experience with compiler frameworks like MLIR, IREE, LLVM, or Triton.
  • Background in system programming, memory management, or multi-device orchestration.
  • Knowledge of distributed computing, model parallelism, or tensor sharding.

Preferred Qualifications

• Experience with AI/ML frameworks like PyTorch, ONNX Runtime, or TF/TFLite.
• Familiarity with distributed training/inference and collective communications.
• Active contributions to open-source AI/ML or compiler projects.
• Experience in low-level performance tuning or MLPerf benchmarking.

If you want to do incredible work and be challenged by exciting, truly innovative projects that will test the boundaries of your skills and creativity, then SiFive is the place for you!  Be proud of your work.  Do things better.  Join SiFive.