Senior AI Engineer
Raylu Ai- Location
- NYC
- Workplace
- Onsite
- Employment
- Full Time
- Salary
- USD 165–250/hr
Posted 10mo ago
Position Summary
We’re hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability—so agents do real work safely, quickly, and repeatedly.
What we’re looking for
- Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
- Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
- LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
- Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
- Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.
Responsibilities
- Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
- Create safety, cost, and latency controls; build dashboards and alerts for reliability.
- Partner with product/design to invent new interaction patterns and ship them fast.
- Document patterns and mentor engineers on best practices for LLM-powered features.
Nice to have
- Experience with workflow engines (e.g., Temporal), comfort in full stack engineering
Logistics
- Compensation: $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
- Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
- Benefits:
- Generous health, dental, and vision insurance
- 401k with 3% automatic contribution (no vesting)
- Paid Lunches
- Wellness and Citi Bike benefit
Skills
- LLM
- Temporal
More jobs at Raylu Ai
All 7Full Stack Product Engineer
Raylu Ai · NYC · USD 150–200/hr · 8mo ago
Senior Product Designer (Founding Designer)
Raylu Ai · NYC · USD 165–250/hr · 10mo ago
Senior Data Engineer
Raylu Ai · NYC · USD 165–250/hr · 10mo ago
Senior Full Stack Product Engineer
Raylu Ai · NYC · USD 165–250/hr · 10mo ago
Senior Frontend Engineer
Raylu Ai · NYC · USD 165–250/hr · 10mo ago
Similar roles
Senior Software Engineer
Redwood Materials · remote · Nevada · USD 180,000–237,500/yr · today
Embedded Software Engineer – Power Electronics, Energy Storage
Redwood Materials · San Francisco, California, United States · USD 180,000–237,500/yr · today
Software Engineer - ML/Computer Vision (Battery Sorting)
Redwood Materials · McCarran, NV · San Francisco, California, United States · USD 152,500–200,000/yr · today
Principal Software Engineer, Core Infrastructure
Oracle · Nashville, TN, United States · today
Senior Software Engineer
Advantest · Lake Forest, CA, United States · today
Senior Frontend Engineer, Ads Creative
Reddit · US · USD 190,800–267,100/yr · today