Senior Software Engineer- AI Frameworks
Microsoft
- Location
- United States
- Workplace
- —
- Employment
- Full Time
- Salary
- —
Posted 2d ago
Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations. Build automation and observability that detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding. Drive scoped projects from problem definition through deployment, balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact. Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions. Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers. Bachelor's Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience. Expertise in GPU or equivalent accelerator programming and kernel optimization using CUDA, Triton, or comparable technologies. Experience using profiling and benchmarking to deliver measurable performance improvements, with an understanding of memory hierarchy, parallel execution, synchronization, and hardware utilization. Familiarity with vLLM, SGLang, or equivalent inference frameworks, including their model execution, scheduling, batching, and KV-cache mechanisms. Demonstrated technical ownership and cross-team collaboration, including independently delivering complex engineering changes into production. Ability to use AI-assisted development tools effectively while maintaining sound engineering judgment and accountability for correctness, performance, and maintainability
Skills
- C++
- Python
- CUDA
- Triton
- vLLM
Similar roles
Lead Software Engineer - City
Okc · Oklahoma City, OK, United States · USD 40–60/hr · today
Senior Software Engineer
Redwood Materials · remote · Nevada · USD 180,000–237,500/yr · today
Embedded Software Engineer – Power Electronics, Energy Storage
Redwood Materials · San Francisco, California, United States · USD 180,000–237,500/yr · today
Senior Software Engineer (Reston or Cambridge)
Akamai · United States · USD 121,400–218,600/yr · today
Software Engineer
Realtor.com Careers · Austin · today
Software Engineer - ML/Computer Vision (Battery Sorting)
Redwood Materials · McCarran, NV · San Francisco, California, United States · USD 152,500–200,000/yr · today