AI services / 06

AI track · Generative AI Systems

Generate with a source trail.

We design generative applications that can find the right material, transform it for a clear purpose, show where it came from, and involve people when the answer needs judgement.

Generation is one component. The useful system also needs sources, retrieval, instructions, permissions, checks, interfaces, evaluation, and owners.

Source ledger / 01
01 / material
S1Policy

The governing route, owner, and permitted exceptions.

S2Guide

The operational steps and context required for the task.

S3Record

The current state relevant to this request and this user.

01

Retrieve

Select relevant material.

02

Compose

Transform for the task.

03

Check

Verify support and route.

03 / response

The requested process starts with a documented review, followed by the appropriate owner decision and a recorded outcome.

S1 · policyS3 · guide
Find → compose → checkAnswer linked to permitted material

01 System anatomy

The model is one component.

Dependable generation comes from the system around the model: source preparation, retrieval, instructions, permissions, evaluation, interface, feedback, and operations.

Generative model

Compose

Produces language, structure, media, or code from the context it receives.

01

Knowledge

Content, metadata, versions, ownership, and retention rules prepared for use.

02

Retrieval

Search, filtering, ranking, context assembly, and permission-aware selection.

03

Instructions

Task boundaries, output structure, tools, tone, refusal, and escalation rules.

04

Verification

Source support, required fields, policy checks, and deterministic validation where possible.

05

Experience

The input, output, citations, edits, review, feedback, and handoff people actually use.

06

Operations

Logs, evaluation sets, versions, monitoring, incidents, change control, and accountable owners.

02 Where it helps

Choose the transformation before choosing the model.

01
Answer

Knowledge assistants

Find and synthesize information across permitted organisational material while exposing useful source context.

Useful when

People repeatedly search across complex, changing knowledge.

02
Transform

Content workflows

Summarize, restructure, classify, localize, or adapt material for a defined format, channel, and review process.

Useful when

The source is known but producing each usable version is repetitive.

03
Draft

Specialist copilots

Prepare first drafts, comparisons, briefs, responses, or structured records for a person to inspect and complete.

Useful when

Expert judgement remains essential but assembly consumes attention.

04
Extract

Document intelligence

Read mixed documents and convert relevant content into structured data, routed cases, or review-ready summaries.

Useful when

Important information arrives in documents rather than clean fields.

05
Create

Generative product features

Add context-aware language, image, audio, code, or mixed-media generation inside a larger product experience.

Useful when

Generation serves a specific user job rather than existing as a standalone novelty.

06
Orchestrate

Multi-step generation

Combine retrieval, tools, rules, generation, validation, and human checkpoints across a bounded sequence.

Useful when

A useful result requires more than one prompt and one response.

03 Grounding architecture

The answer should be able
to find its way home.

Grounding connects a request to selected, permitted information before generation. It reduces unsupported output, improves traceability, and gives reviewers material they can inspect.

  1. 01

    Source

    Identify permitted, useful material and its owner.

  2. 02

    Prepare

    Clean, split, enrich, version, and index the material.

  3. 03

    Retrieve

    Select context relevant to the request and access level.

  4. 04

    Compose

    Generate within the task, structure, and instruction boundary.

  5. 05

    Check

    Test support, required fields, policy, and uncertainty.

  6. 06

    Deliver

    Present sources, controls, edits, and the correct next action.

Grounding does not make generated output automatically correct. Retrieval quality, source quality, permissions, task instructions, model behaviour, and the review route still need explicit evaluation.

04 Source ledger

Evidence is part of the interface.

A source trail should help a person understand what material shaped the output, whether it is current, and where to inspect the original.

S1

Process policy

Current governing route and the named decision owner.

Used for

Supports the required first step and owner.

S2

Operating guide

Ordered actions, required context, and normal handoffs.

Used for

Supports the sequence described in the answer.

S3

Access context

The material and fields this person is allowed to use.

Used for

Limits what can enter the generated context.

S4

Exceptions note

Cases that need specialist review or a different route.

Used for

Supports the escalation rather than an invented answer.

Output assembled from selected material.

The interface can expose document, section, revision, date, and access context according to the use case.

05 Control plane

Control what enters, what leaves, and who decides.

01Permit

Access and privacy

Filter sources, fields, tools, and outputs according to identity, purpose, and policy.

  • Permission-aware retrieval
  • Sensitive-data handling
  • Retention and logging
02Bound

Instructions and refusal

Define the task, acceptable evidence, prohibited behaviour, and when the system should stop.

  • Task boundary
  • Structured output
  • Abstention route
03Verify

Quality and safety checks

Use evaluation, rules, source support, schemas, and domain review to inspect behaviour.

  • Test set and rubric
  • Deterministic checks
  • Specialist review
04Own

Human decision and change

Keep approval, correction, escalation, incident response, and future changes accountable.

  • Review authority
  • Feedback capture
  • Release ownership

06 Possible scope

From an early feasibility question to an operating generative product, the scope follows the decisions and risks around the use case.

01

Use-case framing

Define the user, task, source, desired output, unacceptable output, owner, and measure of usefulness.

Task and risk briefUser and workflow mapSuccess criteriaFeasibility questions
02

Knowledge and data readiness

Audit sources, permissions, quality, versions, metadata, gaps, retention, and access paths.

Source inventoryPermission modelContent quality viewReadiness recommendation
03

Prototype and retrieval

Build a focused end-to-end slice and compare retrieval, context, instruction, and model approaches.

Working prototypeRetrieval baselinePrompt and schema designInitial evaluation set
04

Experience and workflow

Design inputs, progress, output, citations, edits, review, feedback, escalation, and tool connections.

Interaction designSource experienceHuman review routeIntegration contract
05

Evaluation and safeguards

Test representative tasks, edge cases, unsupported answers, access, refusal, usefulness, and operational behaviour.

Evaluation suiteQuality rubricSafety controlsLaunch thresholds
06

Production and operations

Deploy the service with observability, versions, budgets, incident routes, change control, and accountable owners.

Production systemMonitoring and logsRunbook and release processHandover

07 How we work

Start with a task. Earn the complexity.

01

Frame the task

Observe the real work, define the useful transformation, and state what the system must never guess.

Task brief
02

Audit the material

Inspect source quality, access, ownership, freshness, structure, and retrieval constraints.

Source map
03

Build a thin slice

Connect one representative task from input through grounded output and human review.

Prototype
04

Evaluate the behaviour

Test ordinary, difficult, adversarial, incomplete, and out-of-scope examples against a written rubric.

Evidence
05

Operate deliberately

Launch with observability, cost controls, feedback, incident response, versions, and a change owner.

Operating model

08 In practice

A knowledge answer with somewhere to stand.

A grounded internal assistant can help someone navigate governed organisational knowledge while keeping the original material, access rules, and human decision visible.

Question

What steps apply before this request can proceed?

Task rule

Answer only from accessible material. Name uncertainty and route the final decision to its owner.

Grounded answer

Begin with the documented review and gather the required context. The designated owner then decides whether the request can proceed. If the request falls outside the documented route, send it for specialist review rather than inferring a new process.

S1 · Process policyS2 · Owner guideS4 · Exceptions

Source

Permission-aware organisational knowledge.

Output

Answer with inspectable references.

Human role

Interpret context and own the decision.

Fallback

Escalate when the route is not supported.

09 Evaluation

Test behaviour, not demo polish.

01

Retrieval

Did the system find the material needed for this task?

Curated questions, source relevance, coverage, and miss analysis.

02

Groundedness

Are material claims supported by the selected sources?

Claim-to-source review, unsupported statement checks, and citation inspection.

03

Usefulness

Does the output help the user complete the intended task?

Task rubric, expert review, comparison with the current workflow, and user research.

04

Instruction control

Does the system follow structure, boundary, refusal, and escalation rules?

Representative, incomplete, conflicting, and adversarial examples.

05

Permissions

Can the system avoid retrieving or revealing material outside the user’s access?

Role and field tests, isolation checks, logging review, and red-team scenarios.

06

Operations

Can the team observe failures, costs, latency, versions, and changing behaviour?

Dashboards, traces, alerts, runbooks, ownership, and release evidence.

11 Questions

Practical answers about grounding, models, data, evaluation, privacy, and the path to production.

A generative AI system uses a model to produce or transform language, images, audio, code, structured data, or other content. A production system also includes the sources, retrieval, instructions, permissions, checks, interfaces, integrations, evaluation, monitoring, and human responsibilities needed for a defined use case.

Grounding means providing the model with selected context relevant to the current task, often retrieved from controlled sources. It can improve relevance and traceability, but it does not guarantee correctness. Source quality, retrieval, instructions, model behaviour, and verification still need testing.

Not necessarily. Many useful systems begin with strong task design, retrieval, structured prompts, tool use, deterministic checks, and evaluation. Fine-tuning may help when repeated behaviour, format, style, or specialised patterns cannot be achieved reliably through simpler methods. The decision should follow evidence from the task.

Potentially, when access, processing, retention, provider terms, permissions, sensitive data, and deployment choices are reviewed for the organisation and use case. Retrieval should respect the user’s access and avoid placing unnecessary material in model context or logs.

We narrow the task, improve source quality and retrieval, require source-linked answers, use structured outputs, add deterministic checks where possible, teach the system to abstain, route high-impact work to people, and evaluate unsupported output. These measures reduce risk but do not make every output true.

Yes. Review, edit, comparison, citation inspection, approval, rejection, escalation, and feedback can be designed into the experience. The appropriate level depends on impact, reversibility, user expertise, and whether the output leaves the organisation.

We compare task quality, context needs, modalities, tool use, structured output, latency, cost, deployment options, data terms, region, reliability, safety controls, and portability. The best choice can differ across tasks, and the surrounding architecture should avoid unnecessary lock-in.

Yes. A useful prototype tests one representative task end to end: source access, retrieval, generation, output experience, review, evaluation, and operational constraints. It should finish with evidence and limitations, not only a polished demonstration.

Bring the material.
We’ll map the system.

Show us what people need to produce or understand, which sources they can use, and what cannot be guessed. We will help define a useful first slice and the evidence needed to trust it.

studio@quirkydock.com · working internationally · CET