Sr Software Engineer, AI Platform

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems
Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance
Develop observability for model quality, latency, cost, drift, safety, and customer impact
Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products
Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization
Define reusable standards for AI quality, monitoring, safety, and operational readiness

Bachelor's degree in Computer Science, Software Engineering, AI/ML, or related field with 5+ years of experience, or Master's degree with 2+ years
Experience evaluating, deploying, or monitoring production AI systems
Strong Python and data engineering skills
Experience with offline/online evaluation, data quality, model monitoring, or observability systems
Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails
Strong communication skills and ability to set standards across teams

Experience with LLM-as-judge, agent tracing, multimodal evals, golden datasets, or automated regression suites
Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud or similar tooling
Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes
Experience supporting computer vision, GenAI, recommendation, or edge AI products
Experience building developer platforms or internal AI tooling

Skills