Senior Forge AI Engineer

Senior Forge AI Engineer @ Citeline | Jobright.ai

Senior Forge AI Engineer jobs in United States

Overview

Company

This job has closed.

APPLY to similar jobs

Citeline · 2 weeks ago

Senior Forge AI Engineer

United States

Full-time

Remote

Senior Level

6+ years exp

Norstella is a global life sciences data and AI solutions platform focused on improving access to life-saving therapies. The Senior Forge AI Engineer will build and operate Forge, a greenfield agentic platform, across orchestration, multi-agent coordination, MCP integrations, RAG pipelines, evaluation, observability, and safety. The role focuses on making non-deterministic AI systems reliable, secure, and production-ready in a regulated industry.

Big DataBiotechnologyEnterprise SoftwareHealthcareInformation TechnologyPharmaceuticalPublishingSaaSAnalyticsBusiness IntelligenceClinical TrialsHealth CareInformation Services

Responsibilities

Design and build agents across the Forge chain — orchestration, tool-use surfaces, MCP server integrations, prompt and RAG pipelines — and set the agentic design patterns the team ships against

Own multi-agent coordination architecture

inter-agent trust boundaries, message schema contracts, partial failure handling, and recovery across the agent graph

Build and evolve the MCP server layer — tool schema design, capability contracts, versioning — so Forge's tool-use surface is well-defined and safe to extend

Design agent memory and state management

context window strategy, long-term memory integration, state persistence across complex multi-step workflows

Own agent quality end-to-end

eval harnesses, behavioral benchmarks, continuous evaluation pipelines, and the acceptance criteria that gate every agent release

Instrument agent-specific observability — token tracing, tool-call chain logging, cost attribution per run — so the platform is debuggable and defensible

Build safe-by-design primitives

least-privilege tool-use, PII/PHI handling, structured output validation, red-team partnership with Security

Qualification

Agentic AI SystemsLLM-Powered SystemsAgentic FrameworksMCP ServersTool-Use API DesignAgent Memory ArchitecturesPythonTypeScriptPrompt EngineeringFunction CallingMulti-Step OrchestrationRetrieval-Augmented Generation (RAG)Vector DatabasesLLM EvaluationAI/ML Safety EngineeringOWASP LLM Top 10Prompt Injection DefensesAdversarial Agent Testing

Required

6+ years of software engineering experience, with at least 2 years building and operating LLM-powered or agentic systems in production — systems that ran, failed, and got fixed

Production experience with at least one agentic framework (LangGraph, CrewAI, Autogen, Semantic Kernel, MCP, or comparable) and a clear understanding of the trade-offs each introduces

Hands-on experience authoring MCP servers or designing tool-use APIs with explicit capability contracts and versioning

Experience with agent memory architectures — context management, long-term memory stores, state persistence across multi-step workflows

Strong fundamentals in Python and/or TypeScript; able to own production agent code from design through operation

Proficient in prompt engineering, tool/function calling, and multi-step orchestration — and fluent in the failure modes of non-deterministic systems

Working knowledge of RAG patterns, vector databases, and LLM evaluation methodologies applied to production agent outputs

Working knowledge of AI/ML safety engineering

OWASP LLM Top 10, prompt injection defenses, RAG hardening, adversarial agent testing

Preferred

Pharma, life sciences, or healthcare data experience is a plus — not a requirement

Company

Citeline

Clinical trial and drug development intelligence for pharma and medtech.

Founded in 1996

New York, New York, USA

501-1000 employees

https://citeline.com

Funding

Current Stage

Late Stage

Total Funding

unknown

2022-11-01Acquired

Leadership Team

Christopher Crucitti

Chief Revenue Officer (CRO)

Company data provided by crunchbase