AI Operations Engineer

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Develop and deploy AI-powered solutions using LLMs and automation frameworks
Integrate AI into existing business systems and engineering tooling
Build workflows for document generation, data extraction, and knowledge retrieval
Test and benchmark AI models against accuracy, latency, cost, and safety criteria
Support model risk assessments and maintain internal model routing
Build dashboards and reporting for AI/LLM spend and cost anomalies
Provision, credential, and de-provision AI agent access
Support deployment, versioning, monitoring, and retirement of agents
Design and deliver company-wide AI training programs
Create playbooks, guides, and reusable components for AI adoption

Experience building with modern AI/ML tools and frameworks
Experience building and consuming APIs and developing data pipelines
Working knowledge of cloud infrastructure (AWS, GCP, or Azure)
Experience comparing and evaluating AI models across providers
Comfort working with usage and billing data for cost visibility
Ability to translate business and engineering workflows into technical solutions
Experience integrating business systems and engineering/developer tooling
Experience creating training materials for mixed audiences
Understanding of data privacy, security, and compliance considerations
Experience implementing safeguards in AI systems including identity and access controls

Skills