Private AI and Cloud AI

CDIA can run its AI work in two ways. Both use the same evidence controls, the same citations and the same honesty rules. The choice is about where the AI reasoning happens, and you can change it at any time.

In both cases your documents are stored and prepared on your computer. Import, text extraction, OCR of scanned pages, indexing, evidence gathering and the Investigation Review all run locally. Opening a citation opens a file from your disk. With Private AI nothing leaves the machine. With Cloud AI, relevant prepared evidence may be sent to your provider while CDIA prepares and reads material for your question, as well as when it writes the answer; the Investigation Review then controls what goes into the final answer.

Cloud AI

With Cloud AI, CDIA sends prepared material for your question to a leading AI provider (OpenAI) over your own account key, while it prepares and reads material as well as when it writes the answer. That material is:

  • the selected evidence extracts, with document names and page numbers;
  • recent questions and answers from the same investigation, where relevant;
  • your question or drafting instruction.

What is not sent:

  • your original document files;
  • your complete project. It is never sent automatically;
  • anything you untick in the Investigation Review is left out of the final answer (unticking cannot recall material already processed during preparation);
  • anything outside your source selection.

If you ask CDIA to analyse one particular document in depth, the text CDIA needs from that document may be sent for that task. The “What is sent to Cloud AI?” button in the setup and settings dialogs shows the current explanation and cost guidance.

What you need. An API key from the provider. This is a pay-as-you-go developer key, separate from a chat subscription such as ChatGPT. CDIA’s guided setup walks you through creating the key, pasting it in and testing the connection. The key is stored in the Windows credential store, not in a settings file, and CDIA Technologies never receives it.

What it costs. You pay the provider directly for what you use. Typical requests cost pence. There is no CDIA charge for Cloud AI beyond your subscription.

Why choose it. Cloud AI gives the strongest analysis and drafting. For large investigations it can review the evidence in stages and bring the strands together, with the scope note still accounting for what was considered. Setup takes a few minutes and there is no model download.

When it is not appropriate. When your professional, contractual or regulatory obligations mean the material must not be transmitted to a third-party service, even as extracts under your own key. Use Private AI for that matter.

Private AI

With Private AI, everything runs on your computer using a free local AI runtime (LM Studio). The first time you choose it, CDIA runs a one-time managed setup: it checks for the runtime, starts it, downloads the AI model and prepares it. If the runtime is not installed, CDIA opens its download page and continues once you have installed it. You do not configure the runtime yourself.

What you need.

  • A one-time model download of several gigabytes.
  • A reasonably modern computer. At least 16 GB of memory is recommended, and ideally a dedicated graphics card; Private AI works without one but is slow, and large investigations may not fit.
  • An internet connection for the one-time download. After that, Private AI itself needs no connection, although CDIA still validates your licence online from time to time (it can run for up to 30 days between checks).

What it costs. Nothing beyond your CDIA subscription. The runtime and the model are free to use.

Why choose it. Private AI is the right choice when material must not leave the machine. Nothing from your project is transmitted to any AI provider.

What to expect. Private AI’s analysis and drafting are serviceable but noticeably less strong than Cloud AI’s. It has a smaller working capacity, so some very large investigations that Cloud AI can handle in stages will not fit. When that happens CDIA tells you before anything is generated, so you can narrow the selection, rather than trimming the evidence silently.

Side by side

Cloud AIPrivate AI
Documents stored and preparedOn your computerOn your computer
Evidence gathering and reviewOn your computerOn your computer
AI reasoning and draftingProvider’s service, your own keyYour computer
What leaves the machinePrepared extracts for the task, your question, recent Q&A where relevantNothing
SetupCreate an API key, paste, test. A few minutesOne-time model download of several GB, guided
Running costPence per request, paid to the providerNone
Quality of analysis and draftingStrongestServiceable, noticeably less strong
Large investigationsHandled in stagesSome will not fit; CDIA tells you
Internet needed for AIYesOnly for the one-time download (CDIA’s periodic licence check still needs a connection)
Recommended memoryStandard Windows PC, 8 GB or more16 GB or more, ideally a dedicated graphics card

Switching between them

Tools > AI Settings shows which AI is selected, the model in use where CDIA knows it, and whether Private AI could run on this computer. Switching is an execution choice only. Your project, prepared evidence, investigation and citations are untouched.

You can use Cloud AI on one matter and Private AI on another. The evidence controls are identical in both.

Questions people ask

Does CDIA Technologies see my documents or my questions? No. CDIA Technologies runs no AI service. With Cloud AI the transmission is between your computer and the provider under your key. With Private AI nothing is transmitted. The only thing CDIA sends to CDIA Technologies is the licence check: your licence email and an anonymous machine identifier.

Can I see what is sent? The “What is sent to Cloud AI?” button describes what is transmitted. The Investigation Review lists the prepared evidence before the final answer is written and lets you untick items so they are left out of that answer. Relevant evidence may already have been sent during preparation and reading; if material must not leave the machine at all, use Private AI.

Does the provider train on my data? That is governed by the provider’s terms for API use, not by CDIA. Check the provider’s current API data-use terms when you create your key.

Is Private AI accurate enough for professional work? For finding, listing and cited factual answers, yes, because those parts are governed by CDIA rather than by the model. For Advice and longer drafts, expect a more limited result and review accordingly. CDIA says this in the product too.