JobHabor

Sr. Cloud Infrastructure Engineer (AI & LLM Platforms)

Q6 Cyber

Location
REMOTE
Workplace
Remote
Employment
Full Time
Salary
Apply on the employer’s site

Posted 2mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Responsibilities

  • Guide AI architecture for leveraging AI tools with data stores
  • Integrate AI tools into existing systems with other teams
  • Design, deploy, and maintain MCP servers for LLM interaction
  • Build and orchestrate sandboxed environments for AI agents
  • Develop and manage infrastructure for internal RAG pipeline
  • Deploy LLM-related tools using Kubernetes and IaC
  • Implement guardrails for data privacy in LLM workflows

Requirements

  • 5+ years of experience in DevOps, Platform Engineering, or SRE
  • 1-2 years specifically focused on AI/ML infrastructure
  • Proven track record of building production-grade RAG pipelines or LLM-integrated applications
  • Experience in 'day zero' environments with evolving tools and protocols
  • Deep understanding of LLM security implications (prompt injection, data leakage, secure tool execution)
  • Experience working with substantial datasets (over 1bn objects, dozens or hundreds of TBs)
  • Bachelor's degree or equivalent in computer science or related field
  • Expertise in Python
  • Experience with TypeScript/Node.js for MCP development
  • Experience with Go
  • Experience with AWS/GCP/Azure
  • Experience with Kubernetes
  • Experience with Terraform
  • Experience with Helm
  • Experience with LangChain
  • Experience with LlamaIndex
  • Experience with LangGraph
  • Experience with Pinecone, Milvus, Qdrant, or pgvector
  • Experience with Apache Kafka/Pulsar
  • Experience with Elasticsearch/OpenSearch
  • Experience with traditional SQL RDBMS
  • Experience with Model Context Protocol (MCP)
  • Experience with REST/gRPC

Skills

  • AWS
  • GCP
  • Azure
  • Kubernetes
  • Terraform
  • Helm
  • LangChain
  • LlamaIndex
  • LangGraph
  • Pinecone
  • Milvus
  • Qdrant
  • pgvector
  • Apache Kafka
  • Pulsar
  • Elasticsearch
  • OpenSearch
  • SQL
  • Python
  • TypeScript
  • Node.js
  • Go
  • MCP
  • REST
  • gRPC

Similar roles