[Remote] AI Engineer

Note

The job is a remote job and is open to candidates in USA. Charity Navigator is an independent nonprofit evaluator that provides data and ratings on more than 245,000 nonprofits. The AI Engineer will build and ship production LLM-powered and agentic features that improve how users search, compare, and understand nonprofit profiles, while developing retrieval, evaluation, monitoring, and safety infrastructure.

Responsibilities

• Build and ship production LLM-powered and agentic features - prompt orchestration, tool calling, embeddings, structured outputs - favoring reusable components over one-off solutions
• Build API Integrations, MCP servers, and retrieval-augmented generation (RAG) workflows that connect our existing data systems to vector search, so that AI features surface and explain our published ratings data accurately and cite the source of each figure
• Build and run evaluation infrastructure - prompt regression tests, LLM-as-a-judge evaluations, synthetic datasets - that catch feature quality regressions before users do
• Monitor AI features in production. Track accuracy, latency, token cost, and hallucination rates, then debug and tune prompts based on what you find
• Implement runtime safety and reliability guardrails that keep AI outputs within quality, compliance, and operational bounds
• Research and recommend orchestration frameworks, vector stores, and model providers, weighing cost and operational burden against speed. Final build-versus-buy calls are made jointly with the VP of Engineering
• Work directly with non-technical stakeholders to scope problems and give them honest assessments of what AI can and cannot do
• Evaluate emerging models and tools, use AI-assisted development extensively, and help raise team engineering standards through code review

Skills

• 2-3+ years building or deploying machine learning models or AI-driven applications
• Bachelor's degree in Computer Science, Engineering, AI/ML, or a related field, or a relevant certificate program. Demonstrated technical proficiency and relevant industry experience will be considered in lieu of a formal degree
• Python and ML fundamentals. 2+ years of Python, professional or substantial project-based experience, with a solid grasp of core machine learning concepts and API integration
• LLM and agentic systems. Hands-on experience with foundation model providers (Anthropic, OpenAI, and similar), prompt engineering, and agentic patterns - using orchestration frameworks such as LangChain or LlamaIndex, or integration standards such as the Model Context Protocol
• Retrieval and data integration. Practical experience querying and tuning a vector database (pgvector, OpenSearch, or similar) for RAG applications
• Cloud deployment of application code via serverless or containerized patterns, AWS required
• Scrum or other Agile development experience
• Cloud, Gen AI, or machine learning certifications, such as AWS Certified Generative AI Developer, Certified Machine Learning, or Solutions Architect
• This position is fully remote within the United States, requiring a quiet, professional home setup for video collaboration
• Occasional travel to team retreats or key strategic meetings may be required
• Only candidates who are legally authorized to work in the United States (and currently residing in the US) should apply
• Managed cloud AI services, such as Amazon Bedrock, are preferred

Benefits

• Fully remote within the United States
• Computer provided
• Health, Dental, and Vision Insurance (including coverage for dependents)
• Life & Disability Insurance
• 20 vacation days, 10 sick days, 11 paid holidays in your first year
• Retirement savings with up to 3% match of base salary
• Flexible spending and dependent care accounts

Company Overview

• Charity Navigator is the U.S. independent charity evaluator that rates the financial health, accountability, and transparency of charities. It was founded in 2001, and is headquartered in Glen Rock, New Jersey, USA, with a workforce of 11-50 employees. Its website is http://www.charitynavigator.org.