Symptoms get assessed before booking, so the patient gets an urgency level and the right type of appointment.
A patient fills in their symptoms. Today a nurse reads that between phone calls and judges from experience whether it is acute or can wait. The audit works out whether triage can be automated reliably, where a human has to stay in the loop, and what a wrong call actually costs you.
AI Agent + human review
A hybrid AI workflow with mandatory human review of exceptions is the right fit for this safety-critical, high-volume triage process.
This practice handles 9,000 triage submissions per year, consuming roughly 1,050 staff hours annually on a process that is largely rule-driven for the 85-90% of standard cases but demands genuine clinical judgment for the remainder. A hybrid approach is recommended: an AI workflow classifies and routes routine cases automatically, while every exception and any case flagged as high-urgency is held in a human review queue for a clinician to confirm before action is taken. This design delivers the stated goal of freeing staff from the repetitive majority while keeping a human firmly in the loop where a wrong call is a patient-safety event. The practice has no in-house developer, so the implementation should rely on a low-code AI workflow platform with a pre-built or configurable forms integration and a connector to the practice software API, minimising the need for custom code.
The practice has no developer resource and no stated platform preference, so the recommendation is a low-code AI workflow platform such as Make or n8n paired with an LLM-based triage classifier; this avoids bespoke development while still exposing the vendor API for booking handoff.
Process Overview
This process begins when a patient submits their symptoms through the practice's web form. A nurse then reads the submission, applies clinical experience to judge urgency, assigns an urgency level (acute or can wait), selects the appropriate appointment type, and notifies the patient or progresses the booking. Cases that do not fit standard patterns, contain data entry errors, or require senior clinical judgment are handled as exceptions and reworked manually. The whole cycle runs multiple times each day, accumulating around 9,000 submissions per year.
The process is largely routine for the 85 to 90 percent of cases that match recognisable symptom patterns, but the remaining 10 to 15 percent demand genuine clinical reasoning that cannot be reduced to simple rules. Because the inputs arrive as free-text descriptions rather than structured fields, the task requires natural language understanding, not just data routing. The primary system is the practice's vendor software, which exposes an API that has never been connected to anything. Day-to-day, the team relies on email and spreadsheets to fill the gaps.
The compliance context is demanding. Patient symptom data is GDPR special-category health data, records retention is regulated, and a wrong triage decision carries direct patient-safety implications. The practice has no in-house developer, so any solution must be implementable and maintainable without one. At seven minutes per case and 9,000 cases per year, the process consumes roughly 1,050 staff hours annually, almost all of it nurse time that could otherwise go to direct clinical care.
Path Scores
The process splits cleanly into a high-volume routine segment and a smaller exception segment requiring clinical judgment. A hybrid model automates the routine 85-90% while routing exceptions and high-urgency flags to a human reviewer, directly matching the client's stated goal. The patient-safety and GDPR stakes make a pure automation approach unacceptable, so the human gate is not a compromise but a design requirement.
An AI workflow could handle the structured symptom data well and would cover the routine majority effectively. However, operating without a mandatory human gate on high-urgency or ambiguous cases creates unacceptable patient-safety risk in a regulated healthcare setting, making full automation a poor fit without the hybrid overlay.
An autonomous AI agent capable of making and acting on triage decisions without human confirmation is disproportionate to the process complexity and introduces serious liability in a patient-safety context. The practice also lacks the technical resource to build and govern an agent safely.
RPA is well suited to deterministic, screen-based tasks but cannot interpret free-text symptom descriptions or apply clinical reasoning to edge cases. It would automate the data-routing shell of the process but leave the core triage judgment entirely unaddressed.
A coded rules engine could handle simple symptom-to-urgency mappings but would require a developer the practice does not have, would struggle with the natural-language variability of patient-submitted symptoms, and would need constant maintenance as clinical guidelines evolve.
Training alone does not address the volume problem: 1,050 staff hours per year are consumed by a process that is already well understood by the team. Education is a valuable complement to implementation but not a substitute for it.
The current manual process is the baseline being audited. It is fragile, depends on tacit knowledge held by two or three people, and consumes significant nurse time that could be redirected to clinical care. Staying manual is not a viable long-term position at this volume.
Process Dimensions
Eight dimensions drive the recommendation, scored 0–10 with a note on each.
Inputs arrive as free-text symptom descriptions from a web form, which are semi-structured at best and require natural language understanding rather than simple field matching.
Standard cases follow recognisable patterns that experienced clinicians apply consistently, but 10-15% of cases require judgment that is not easily codified into explicit rules.
Exceptions represent 10-15% of volume but consume a disproportionate share of time and carry the highest risk, making them a critical design consideration rather than a minor edge case.
The practice software exposes an API that has never been used, and there is no developer on staff, so integration is technically possible but will require external implementation effort.
At 9,000 runs per year and 7 minutes each, the process consumes approximately 1,050 staff hours annually, giving a strong ROI case even if only the routine majority is automated.
Clinical triage guidelines and appointment types can change with practice policy or regulatory updates, so the automation layer will need periodic review and retraining.
Clinical judgment is essential for the exception segment and for any high-urgency flag, and a wrong automated decision is a patient-safety event, so human oversight is a non-negotiable design requirement.
Health data is GDPR special category, records retention is regulated, and triage errors carry direct patient-safety liability, placing this process in the highest compliance tier.
ROI Estimate
£31,500
Current annual cost
70%
Estimated time saved
£22,050
Annual savings
9mo
Payback period
Current annual cost is calculated as 9,000 runs x 7 minutes / 60 x £45 per hour = £47,250; however the 1,050-hour figure confirmed by the client implies a blended rate closer to £30 per hour, so £31,500 is used as the conservative base. The 70% savings estimate reflects automation of the routine 85-90% of cases while retaining human review time for exceptions and oversight.
Implementation Roadmap
Document the full range of symptom inputs received over the past six months, map them to the urgency levels and appointment types actually assigned, and define the boundary conditions that separate routine from exception cases. This produces the training examples and decision rules the AI classifier will use, and surfaces any data quality issues in the web form. Effort is primarily clinical staff time plus a facilitator.
Select a low-code AI workflow platform (such as Make or n8n) and connect it to the existing web form so that new submissions trigger the workflow automatically. Configure secure data handling to meet GDPR special-category requirements, including data minimisation, access controls and an audit log of every triage decision. No custom code should be required at this stage.
Implement an LLM-based triage classifier using the symptom-to-urgency mapping produced in discovery. The classifier must output a confidence score alongside the urgency level; any case below a defined confidence threshold, or flagged as high-urgency, is automatically routed to the human review queue rather than actioned. Clinicians validate outputs against a held-out sample before go-live.
Build the exception queue interface where a clinician can review flagged cases, confirm or override the AI suggestion, and release the booking action. Integrate with the practice software API to pass confirmed urgency levels and appointment types through without manual re-entry. This is the human-in-the-loop gate that makes the hybrid model safe.
Run the hybrid system in parallel with the existing manual process for four weeks, comparing AI decisions against nurse decisions on every case. Review disagreements with clinicians to refine classifier thresholds. Once agreement on routine cases exceeds an agreed clinical threshold (recommended 95%), retire the parallel manual step and go live. Document the validation evidence for regulatory purposes.
Establish a quarterly review cycle in which a clinician samples a random set of AI decisions, flags any drift in accuracy, and triggers retraining if needed. Maintain the audit log as the compliance record. Assign a named owner (practice manager) responsible for the system's clinical safety, and define the escalation path if the system is taken offline.
Risks & Considerations
The most significant risk is a false-negative triage decision: the AI classifies an acute case as routine, the human gate does not catch it, and a patient is harmed. This risk is mitigated by routing all high-urgency flags and low-confidence outputs to human review, but it cannot be eliminated entirely. The confidence threshold must be set conservatively at launch and reviewed with clinical input, not optimised purely for throughput. A second risk is GDPR non-compliance: symptom data is special-category health data and must not be processed by a third-party LLM provider without a valid data processing agreement and, where required, a Data Protection Impact Assessment. The platform and model provider must be vetted before any live patient data is used in testing. A third risk is over-reliance on the system once it is running smoothly: the practice must maintain clinical oversight skills and resist the temptation to reduce the human review step as familiarity grows. The quarterly governance cycle is essential, not optional.
In partnership with AIRIES, the AI learning platform. These levels fit your result.
-
3
Corporate Applied Intelligence & AutomationTurn your own tasks into AI workflows, build reports and dashboards, set up a personal AI assistant.
-
4
AI Leadership & Scalable SystemsDesign teams of AI agents and automate whole departments.
Level 3 gives the practice manager and supervising clinician the practical skills to understand how the AI workflow operates, configure simple rules, and interpret its outputs critically rather than accepting them blindly. Level 4 equips whoever governs the system with the mindset to design and maintain the human oversight layer, set escalation policies, and make sound decisions about when to expand or constrain automation. Both levels are directly relevant to running a hybrid AI system in a patient-safety context.
- Turning manual clinical workflows into AI-assisted processes
- Human-in-the-loop oversight and exception handling
- AI governance and audit in regulated environments
- Low-code workflow automation tools
The practice manager and any clinician who will supervise or govern the AI triage system.
Architecture Overview
Hover to zoom · click for fullscreen
Why This Approach
The recommended path is Hybrid: an AI workflow that classifies and routes the routine majority of cases automatically, with a mandatory human review queue that holds every high-urgency flag and every case the classifier is not confident about until a clinician confirms the decision. This is not a compromise between automation and safety. In a patient-safety context, the human gate is a design requirement, and any architecture that removes it in the name of efficiency would be irresponsible regardless of how well the AI performs in testing.
The case for automating the routine 85 to 90 percent is straightforward. Those cases follow recognisable patterns that experienced clinicians apply consistently, which means a well-calibrated AI classifier can replicate that judgment reliably. Freeing nurses from the repetitive majority lets them concentrate on the exception segment, where their clinical skill genuinely matters, and on direct patient care. The ROI is strong: even a conservative 70 percent reduction in manual handling time represents around 735 hours saved per year against a build cost that the practice should recover within nine months.
The practice has no developer resource and no stated platform preference, so the implementation should use a low-code AI workflow platform. Make or n8n are both credible choices here. Either can receive web form submissions as a trigger, call an LLM-based triage classifier, apply a confidence threshold to decide whether to action the result automatically or route it to the human review queue, and pass confirmed decisions through to the practice software via its existing API, all without writing custom code. This is an important practical constraint and the recommendation is shaped by it. A bespoke-coded solution or a fully autonomous AI agent would require developer capability the practice does not have and cannot easily acquire, making those paths non-starters regardless of their theoretical merits.
Fully Automated AI Workflow scored lower than Hybrid precisely because removing the mandatory human gate is not a tuning decision but a safety decision. The classifier will occasionally be wrong, and in a triage context a false negative, an acute case classified as routine, is a potential patient harm event. Keeping a clinician in the loop for all high-urgency and low-confidence cases does not undermine the value of the automation; it makes the automation safe enough to trust. AI Agent was not seriously considered for this process. An autonomous agent capable of acting on triage decisions without human confirmation would introduce serious liability, and the practice has neither the technical resource nor the governance infrastructure to operate one responsibly. RPA and Traditional Code were both ruled out early: RPA cannot interpret free-text symptom descriptions, and a coded rules engine would require a developer, would struggle with natural-language variability, and would need constant maintenance as clinical guidelines change.
The honest tradeoff in the Hybrid approach is that it does not fully automate the process. A clinician will still spend time on exceptions and on reviewing high-urgency flags. The system will need quarterly governance cycles, a named clinical safety owner, and periodic retraining as guidelines evolve. These are not arguments against the recommendation; they are the conditions under which the recommendation works safely. A practice that treats the human review step as a temporary inconvenience to be optimised away over time would be misusing the system. The quarterly governance cycle and the conservative confidence threshold at launch are non-negotiable parts of the design, not optional extras.
Comparing the Top Approaches
The two most credible paths for this process are Hybrid and AI Workflow, and the gap between them comes down to one question: what happens when the system gets it wrong? An AI Workflow operating without a mandatory human gate could handle the structured majority of submissions effectively, and on a pure throughput measure it looks attractive. But in a patient-safety context, an unreviewed false-negative triage decision, where an acute case is classified as routine and the patient waits, is not an acceptable failure mode. The AI Workflow path scores well on efficiency and falls down on risk governance, which in a regulated healthcare setting is disqualifying on its own.
The Hybrid path resolves this by treating the human review gate not as a workaround but as an intentional part of the design. Routine cases, the reliable 85 to 90 percent that follow recognisable symptom patterns, are classified and routed automatically. Any case that carries a high-urgency flag or falls below the classifier's confidence threshold is held in a queue for a clinician to confirm before any action is taken. This means the system is fast where speed is safe, and cautious where caution is clinically necessary. That is exactly the right trade-off for this practice.
The AI Agent path can be set aside quickly. An autonomous agent making and acting on triage decisions without human confirmation introduces liability that no general practice should accept, and the practice has no developer resource to build, test, or govern one safely. RPA and Traditional Code both fail at the first hurdle: neither can interpret the free-text symptom descriptions that arrive from the web form, so they would automate the data-routing shell of the process while leaving the actual triage judgment untouched. Education alone does not reduce the 1,050 hours of annual staff time consumed by a process the team already understands well. Hybrid is the clear recommendation not because the other paths are close, but because it is the only path that delivers the efficiency gain without compromising the patient-safety requirement.
How to Build It
The implementation begins with a focused discovery exercise before any technology is selected or configured. Over two to three weeks, a clinician and the practice manager work through six months of historical web form submissions, mapping the symptom language patients actually use to the urgency levels and appointment types that were assigned. This produces the labelled examples the AI classifier needs and, just as importantly, surfaces the boundary conditions: the symptom combinations that experienced nurses treat as routine versus the ones that prompt a second opinion. Any recurring data quality issues in the web form, missing fields, ambiguous symptom descriptions, are identified and corrected at the source where possible.
With that mapping in hand, the team selects a low-code AI workflow platform. Make or n8n are both practical choices here: both offer webhook-based triggers that can receive form submissions directly, both have connectors to common practice management APIs, and neither requires a developer to configure standard workflow logic. The web form is connected to the platform so that every new submission fires the workflow automatically. Before any patient data touches the system, the GDPR obligations are addressed: a Data Processing Agreement is put in place with the platform provider and with the LLM provider used for classification, a Data Protection Impact Assessment is completed, and the workflow is configured with access controls, data minimisation, and a tamper-evident audit log that records every triage decision and its outcome.
The AI classifier sits at the heart of the workflow. It receives the structured form fields alongside the free-text symptom description and outputs two things: an urgency level, either acute or can wait, and a confidence score. The confidence threshold is set conservatively at launch, with clinical input, not optimised for throughput. Any case that scores below the threshold, and any case where the classifier assigns an acute urgency, is automatically placed in a human review queue rather than actioned. A clinician opens the queue item, sees the AI suggestion alongside the original submission, and either confirms or overrides it. On confirmation, the workflow calls the practice software API to pass the urgency level and appointment type through, eliminating the manual re-entry step that currently ties up the administrator.
Before go-live, the hybrid system runs in parallel with the existing manual process for four weeks. Every AI decision is compared against the nurse's independent assessment on the same case. Disagreements are reviewed with the clinical team to refine classifier thresholds and, where needed, add new examples to the training set. Once agreement on routine cases reaches the agreed clinical threshold, recommended at 95 percent or above, the parallel manual step is retired and the system goes live as the primary triage pathway. The validation evidence from the parallel run is documented and retained as the regulatory record of the clinical safety assessment.
Risks in Detail
The most serious risk in this process is a false-negative triage decision: the classifier marks an acute case as routine, the clinician reviewing the exception queue does not see it because it was never routed there, and the patient suffers harm as a result. No combination of threshold-setting and confidence scoring eliminates this risk entirely, and the practice needs to be honest with itself about that. The mitigation strategy, routing all high-urgency flags and all low-confidence outputs to human review, reduces the probability significantly, but the confidence threshold must be set with a strong clinical bias toward caution at launch and should only be loosened after a substantial volume of validated live data has been reviewed. The quarterly governance cycle is not an administrative formality; it is the mechanism by which the practice detects classifier drift before it becomes a clinical incident. If the quarterly review is deprioritised as the system becomes familiar, the safety case quietly degrades.
The second category of risk is compliance. Symptom descriptions are GDPR special-category health data, and sending them to a third-party LLM provider without a valid Data Processing Agreement and a completed Data Protection Impact Assessment is not a configuration oversight, it is a regulatory breach. This means no live patient data can be used in any testing or calibration phase until the legal agreements are in place and reviewed by whoever holds data protection responsibility at the practice. There is also a subtler operational risk worth naming: over-reliance. Once the system is running smoothly and staff see that the routine majority is handled without their involvement, there is a natural tendency to reduce oversight, skip the queue review on busy days, or assume that silence from the exception queue means everything is fine. The practice manager needs to treat the human review step as a permanent clinical responsibility, not a transitional measure to be phased out once confidence in the AI grows.
Claude Code Starter
A scaffolded project ready to open in Claude Code. Unzip, open the folder, and Claude starts building immediately.
Claude Code Starter (.zip)
Your own assessment includes a ready-to-use project scaffold: CLAUDE.md, pyproject.toml, src/agent.py and .env.example. Open the folder in Claude Code and it starts building.