Software Engineer, AI Platform

Software Engineer, AI Platform

About Aalyria

Aalyria is a leading technology company that supplies laser communications technology and temporospatial software-defined networking platforms to the aerospace industry. With technology acquired from Google, Aalyria is at the forefront of innovation in satellite and airborne mesh networks, as well as cislunar and deep-space communications. We are revolutionizing the orchestration and management of planetary mesh networks using any radio or optical spectrum, any orbit, and any hardware across land, sea, air, and space.

Role Overview

Aalyria is hiring a software engineer to build the AI layer of our engineering organization. This is fundamentally a building role where you will design, ship, and operate internal AI products and platform services, such as chat and agent interfaces, retrieval over our code and docs, AI-integrated developer workflows, sandboxed execution environments, on top of our existing cloud infrastructure (GCP, GKE, Vertex AI, GitLab).

We operate in a regulated environment (CMMC, DoD Impact Levels, FedRAMP), and that shapes the work. Your job is to work with our security and compliance director, ask the right questions, extract the real constraints, and then engineer systems that deliver the maximum utility to our engineers while staying inside the boundary.

The integrations you build need care and feeding

they must keep working, keep improving, and remain auditable. You will own them end to end.

Key Responsibilities

Illustrative, not exhaustive.

You will help define this roadmap

Internal AI chat and agent platform

deploy and extend an open-source frontend (e.g., LibreChat, Open WebUI) backed by our existing Vertex AI models and any future inference infrastructure, with SSO, access policy, and the integrations that make it actually useful, RAG and MCP servers tied to our GitLab repos and internal docs, code execution (Code Interpreter-style), and internal tool access.

AI-native SWE workflows in GitLab

agents that generate merge requests, respond to review comments, and iterate, so engineers can drive AI work entirely through the review interface they already use.

Sandboxes for AI development, with humans and hardware in the loop: isolated, policy-enforced environments where agents (and the engineers supervising them) can safely run code, access repos, and use tools — extending to infrastructure that lets AI safely interact with real hardware in our lab environments.

AI observability and cost tracking

request-level telemetry, usage analytics, and cost attribution across all model usage, so we know how AI is being used internally and what it's worth.

Additionally, you will be responsible for

Identifying, building, and maintaining LLM-powered systems across engineering and operations workflows, prioritizing leverage over coverage.

The design and build of agentic systems and internal

AI applications

multi-step pipelines, tool-using agents, retrieval-augmented systems, and internal-facing apps that put model capabilities in front of the right people.

Owning the AI gateway layer

model routing, credential management, access policy, and request-level telemetry across all model usage.

Operating what you ship

monitoring, upgrades, incident response, and continuous improvement of the AI stack.

Partnering with the security/compliance director to understand boundary requirements (CUI handling, data residency, provider selection, audit logging) and translate them into system design, building guardrails in at design time, not as afterthoughts. You bring the engineering; they bring the framework.

Contributing the technical substance (architecture, data-flow diagrams, logging evidence) that supports compliance documentation owned by the security team.

Serving as the organization's internal expert on applied

AI tooling

stay current on the ecosystem, evaluate new capabilities, and translate them into concrete proposals.

Reporting periodically to leadership on friction points and opportunities — informing decisions rather than driving adoption targets.

Required Qualifications

Strong software engineering fundamentals

Several years building, shipping, and operating production software. Fluency in at least one of Python, Go, or TypeScript, plus Terraform. We are an infrastructure-as-code company, and infrastructure here is written, reviewed, and shipped like software. Comfort with API design, testing, code review, and owning services in production.

Hands-on experience building LLM-powered systems

retrieval pipelines, tool use / MCP, agent orchestration, prompt and context management, and evaluating whether any of it actually works.

Product sense for internal tooling

experience deploying, extending, and integrating open-source applications (chat frontends, gateways, dev tools) rather than building everything from scratch, with a strong instinct for build vs. configure vs. wait.

Developer-platform integration experience

working with Git-hosting APIs, webhooks, and CI/CD to embed AI into the workflows engineers already live in.

Cloud and Kubernetes engineering

you build and operate the infrastructure your systems run on yourself, such as containers, Helm, Terraform, GKE, and/or IAM. The platform team reviews your changes the way any senior engineer reviews a colleague's work; they don't implement your designs for you.

Sandboxing and isolation literacy

understanding of how to safely run model-generated code and constrain agent access (containers, network policy, least-privilege credentials).

Effective in a regulated environment

not compliance expertise, but the ability to elicit constraints from security stakeholders, ask the right questions, design within hard boundaries, and build systems whose behavior is observable and auditable by construction.

Clear written communication

Specifically for technical and executive audiences, including candid assessments of what is not working.

High autonomy

you will define your own roadmap from a clear mandate and validate it directly with the teams you serve.

Preferred Qualifications

Prior work in CMMC, DoD IL, FedRAMP, or NIST 800-171 environments — especially running AI/LLM workloads inside such a boundary.

Self-hosted inference experience

vLLM/TGI/similar, GPU provisioning and utilization, open-weight model deployment.

Experience with LLM gateway/proxy layers (e.g., LiteLLM or equivalent) and per-team cost attribution.

Hardware-in-the-loop or lab-automation experience

test benches, device access control, or safely bridging software systems to physical equipment.

Familiarity with DLP concepts as they apply at the model/API layer.

GCP specifically (Vertex AI, GKE, IAP, Artifact Registry); Bazel or other hermetic build systems.

Observability stack experience (OpenTelemetry, Grafana/Loki/Mimir/Tempo or similar).

What We Offer

Innovative Environment

Work at a cutting-edge company shaping the future of aerospace communications.

Impactful Work

Directly contribute to critical national security programs and initiatives.

Growth Opportunities

Expand your career with opportunities for professional development and advancement.

Inclusive Culture

Be part of a collaborative, supportive, and inclusive workplace where your contributions matter.

Flexibility

Flexible working arrangements including hybrid remote/in-office schedules.

Compensation and Equity

Competitive salary, comprehensive benefits (401(k), dental, vision, health, life insurance), paid time off, and equity options.

ITAR/EAR Requirements

This position involves access to export-controlled information. To comply with U.S. government export regulations, applicants must meet one of the following criteria:

(A) Qualify as a U.S.

person, which includes

U.S. citizen or national

U.S. lawful permanent resident (green card holder)

Refugee under 8 U.S.C. 1157

Asylee under 8 U.S.C. 1158

(B) Be eligible to access export-controlled information without requiring an export authorization.

(C) Be eligible and reasonably likely to obtain the necessary export authorization from the appropriate U.S. government agency.

The company reserves the right to decline pursuing an export licensing process for legitimate business-related reasons.

Equal Opportunity Employer Statement

Aalyria is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), national origin, age, disability status, genetic information, protected veteran status, or any other characteristic protected by law. Qualified applicants from all backgrounds are encouraged to apply.

The pay range for this role is

185,000 - 215,000 USD per year (Remote (San Francisco Bay Area))