Staff Applied AI Product Engineer

Carrum Health

Posted 4mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Architect and integrate LLM-driven features into core platform
Build robust RAG pipelines, select foundation models, iterate on prompts
Design 'glue' to turn model intelligence into reliable product features
Implement monitoring and observability for AI services
Collaborate with clinical experts to validate model outputs
Establish patterns for building 'smart products', model evaluation, latency, cost management
Champion Responsible AI by operationalizing fairness checks, bias detection, safety guardrails

10+ years of software development experience, most senior engineer on team
2+ years of dedicated professional experience architecting production-grade applications with LLMs
Experience with RAG pipelines and vector databases (e.g., pgvector, Pinecone)
Experience working in a web application environment (Ruby on Rails, Python)
Experience designing systems and exposing AI logic via performant APIs
Comfortable working with DevOps to design and configure Terraform for AI infrastructure
Experience handling deadlines, keeping many balls in the air, and prioritizing work

Experience with fine-tuning and model optimization techniques
Experience with AI developer productivity tools (e.g., Cursor, GitHub Copilot)
Comfortable with SQL and data modeling
Experience going from 0 to 1, finding creative ways to use AI to launch new products quickly

Skills