Articles Topics Resources About Work With Me Contact
Services

A second pair of eyes on your AI feature.

I help teams test and evaluate AI features before they ship — chatbots, assistants, classification models, anything with an LLM behind it — so you catch the awkward, risky or plain wrong answers before your users do.

Every engagement starts with a short call — no fixed packages, scoped to what you're actually shipping.

How it works

From a short call to a finished report.

No price list up front — projects vary too much for that. What you do get is a clear process, start to finish.

01

A short call

Tell me what you're building and what's worrying you about it. No cost, no commitment.

02

Scope & quote

Based on that call, I scope the work and send a clear quote — what's tested, what you get, and when.

03

Testing & reporting

The hands-on work, detailed below — testing your feature and writing it up so your team can act on it.

04

Delivery & follow-up

You get the findings, and I'm around for follow-up questions once you've had time to read them.

Step 03 · Where I start

Test Analysis

Before anything gets written up, it needs to be properly tested. This is the hands-on part — working through your AI feature the way a real user (or someone trying to break it) would.

01

Functional & accuracy testing

Does the AI actually do what it's supposed to, across realistic prompts and the inputs your users will genuinely send?

02

Consistency & drift checks

Same question, different day — does the answer still hold up, or does it quietly drift?

03

Bias & fairness testing

How does the model behave across different inputs, names, and contexts? Where does it treat people inconsistently?

04

Safety & adversarial testing

Prompt injection, jailbreak attempts, data leakage — the things a user shouldn't be able to pull off, but might try.

05

Edge-case exploration

The odd, unexpected inputs nobody thought to test — usually exactly where the real problems hide.

Step 03 · What you get

Reporting

Testing without clear reporting is just testing. Everything above gets written up so your team — technical or not — knows exactly what to do with it.

01

Finding reports

Each issue written so a non-technical stakeholder understands the risk, not just the technical detail.

02

Test summary reports

What was tested, what passed, what didn't, and what to prioritise first.

03

Test strategy & charters

A clear plan for what gets tested and why, scoped to your feature before testing even starts.

04

Compliance-aware notes

Where it's relevant, findings mapped against frameworks like the UK FCA's AI principles.

Ways to work together

Three shapes this usually takes.

Still not fixed prices — scope and timeline decide that — but a sense of what each kind of engagement looks like.

~1–2 weeks

One-off Evaluation

A thorough pass before you ship. One feature, one findings report, one clear answer on whether it's ready.

Good fit if: you have something close to launch and need a second opinion before it goes out.

Scoped to your build

Launch Support

Testing alongside your iterations as a feature gets built out, through to launch — not bolted on at the end.

Good fit if: you're actively building and want testing built into the process as you go.

Monthly

Ongoing Partner

Regular testing and reporting on a standing basis — working like part of your team, not a one-off hire.

Good fit if: you ship AI features often and want testing as a standing part of how you work.

Before you ask

A few things people usually want to know.

How much does this cost?+

Every project is scoped individually — feature size, risk level and timeline all matter. After the first call, you get a clear quote before any work starts. No surprise invoices.

How long does it take?+

A one-off evaluation usually runs 1–2 weeks. Launch support and ongoing work are scoped to your own release schedule, not a fixed clock.

Do you work remotely?+

Yes — fully remote, based in London and working UK hours. Most of this happens over a call and shared documents.

What kinds of AI features do you test?+

Chatbots, assistants, classification models — anything with an LLM or ML model behind it that your users interact with directly.

Have an AI feature that needs testing?

A few quick details help me reply with something useful, not a generic "tell me more."

Replies within one working day. No cost or commitment for this first message.