Lead Gen-AI Engineer

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online and mobile channels, and are recognised for our leadership in the application of agile and lean delivery methods to assure delivery. We have offices in Australia, India, South Africa, the UK, the EU and the USA.

This role involves working in teams that use modern agile technical practices - including continuous integration and deployment and fast feedback loops - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way.

Responsibilities

• As a Gen AI Engineer, you will be responsible for designing, testing, and deploying GenAI solutions that leverage LLMs and related technologies. You’ll work on solutions that incorporate prompt engineering, model evaluation, retrieval-augmented generation (RAG), and continuous performance monitoring, all while adhering to best practices in software engineering. This role blends data science, data engineering, and MLOps expertise, with a focus on making AI solutions reliable and production-ready.

Required Skills

Solution Prototyping & Testing

Rapidly test various models and approaches to determine the best fit for the project without extensive over-investment. Stay updated on LLM advancements (e.g., GPT-3.5 to GPT-4).

Prompt Engineering

Write, test, and refine prompts, including creating effective prompt chains and managing prompt versions for optimal results.

Model & Prompt Evaluation

Analyze model and prompt performance to ensure reliability. Develop robust testing methodologies, incorporating training and test sets for thorough evaluation.

Performance Monitoring

Build pipelines to monitor model responses and track performance metrics in production for ongoing optimization.

RAG Architecture Implementation

Design and maintain retrieval-augmented generation (RAG) architectures. Work with data pipelines, vector databases, and search algorithms. Manage document chunking and embedding selection for optimal context window usage.

Data Extraction

Extract data from various sources (e.g., PDF files) as part of the RAG process.

Software Development Best Practices

Employ CI/CD, test-driven development, and sound architectural principles in all GenAI solutions.

Evaluation Scripts & Load Testing

Develop tests for the random nature of LLM outputs and conduct load testing to ensure system robustness, even when reliant on third-party APIs.

ETL & Traditional Data Management

Build data pipelines to manage and integrate traditional relational data where necessary.