Insights & guides
AI EXPLAINED

Browser AI or cloud AI? Start with the task.

Browser AI runs a downloaded language model on your team’s devices. This on-device AI uses local hardware; cloud AI uses hosted infrastructure. Choose by the task, target devices and where data may go.

CompareInspect the resultsAssess my workflow

Published guide · Results from a private educational experiment

What could on-device AI change?

Fewer prompt uploads

Local generation can keep prompts off model servers. Check every tool and data flow.

Less network dependence

Possible after packaging the app, runtime and model for offline use. Connected tools may still need the network.

Fewer cloud inference calls

Local generation can replace some API calls. Count downloads, devices, engineering and maintenance in the total cost.

Start with one small, inspectable job.

Three candidates to evaluate. These human-reviewed drafts are not implemented in this trial. Keep approved, minimal source material beside each answer.

Test the actual build. Our hotel trial uses text-only Qwen3.5 0.8B and 2B browser builds. Official model-card capabilities do not automatically carry over. [2][3]

CRM handover
Input
Approved account notes with unnecessary personal data removed.
Draft
A draft handover summary.
Human check
A person verifies facts, open questions and next steps against the notes.
ERP maintenance checklist
Input
Recorded observations and an approved maintenance procedure.
Draft
A draft checklist.
Human check
A technician verifies every step; the draft cannot complete a repair or clear a hold.
Staff guidance
Input
An approved internal procedure excerpt.
Draft
A draft answer with its source.
Human check
A staff member verifies the guidance and refers unresolved questions to the procedure owner.

Browser AI or cloud AI: the practical differences.

Compare the actual product. Models, tools and limits vary. These are architectural differences, not a quality ranking. [1][4][5]

Execution

Browser AI
Downloaded weights run on your device.
Hosted AI
Requests are processed on hosted infrastructure.

Device

Browser AI
Browser, GPU and memory constrain what fits.
Hosted AI
Your device need not hold the hosted model.

Capabilities

Browser AI
Test the specific browser build and its tools.
Hosted AI
May include larger models and integrated tools; plan-dependent.

Data boundary

Browser AI
Can avoid prompt uploads; check the whole app.
Hosted AI
Inputs leave your device; review terms and connected tools.

Cost

Browser AI
Account for downloads, devices, delivery and maintenance.
Hosted AI
Compare free or paid tiers, limits and integration costs.

A fast reply is not a verified answer.

Fast on our test computer. Across six short English runs, text began appearing 0.45–0.86 seconds after generation started. This excludes model loading and includes incorrect answers.

Reading the source still mattered. In one run, the 2B model called the supplied time and temperature missing. We narrowed the starters to temperatures and the next check. This remains an educational experiment.

Language needs its own evaluation. Four Arabic trials also omitted required facts or added unsupported claims. The English results do not validate an Arabic workflow.

One recorded answer, with its source.

A selected English response from the 0.8B model on 21 October 2026. This is a static record, not a live chat or an accuracy claim.

Model
Qwen3.5 0.8B
Question
What are the recorded temperature and target for room 301?
Recorded answer
Temperature is 28°C and target is 22°C.
Inspect the complete synthetic source

Synthetic room-301 maintenance record (not live). Room: 301. Status: Held. Observed at: 09:00 +04:00. Temperature: 28°C. Target: 22°C. Repair completion: not recorded. Post-repair observation: not recorded. Required next check: record a new observation after repair. This record does not authorize room release. Owner, completion time and booking details: not provided.

How we tested—and what this does not establish

One computer, 20 responses. The evaluation covered 16 English and four Arabic runs on 21 October 2026: Apple M4 Pro, 24 GiB, Chromium 154, WebGPU. The reported timings cover six fresh English conversations: temperatures, missing details and next check, once per model. They establish no phone performance, internet download speed or accuracy rate.

The whole configuration affects the result. The trial used Qwen3.5 0.8B and 2B in MLC q4f16_1 builds with WebLLM 0.2.86. Quantization, the runtime, prompts and generation settings can all affect answers; these observations do not isolate model size as the cause.

How browser inference works.

The browser executes an already-trained model. WebLLM uses WebGPU to run its calculations on compatible graphics hardware. Opening the page does not train a new model. [1]

Where does the answer come from?
  1. Download

    Public model files

    Weights are numerical values learned during training.

    From the host
  2. Load

    Your browser + GPU

    A runtime prepares the model on your device.

    On your device
  3. Generate

    Your prompt → a draft

    The model generates text from the supplied context.

    On your device

Downloads use the network. Generation stays local; connected tools have separate data flows.

Why pay for a subscription?

Capacity and tools are part of the product. Hosted plans can add models, research, coding and connected tools. Paid differences depend on features and usage limits; some features are free. [4][5]

Teams also need an operating environment. Business offerings can include shared workspaces, administration, permissions and billing. A downloaded model does not supply those services by itself. [6]

Local changes the trade-offs.

Check the target devices. This WebLLM trial needs WebGPU, compatible hardware and enough memory. A desktop result does not establish phone performance. [7]

Downloads and storage matter. Files use bandwidth; inference uses device resources. Browser storage can be cleared or evicted, requiring another download. [8]

Before you choose.

Can browser AI work offline after downloading?

Only if the application, runtime and model files are available offline, and required tools do not need the network. Cached weights alone are insufficient. [1][8]

Is local AI automatically private?

No. Local inference can avoid sending prompts to a model server, but uploads, analytics and connected tools can create other data flows. Check the complete application. [1]

Can a local LLM replace a subscription?

Possibly for bounded tasks. Test your devices and languages. A local model does not automatically replace hosted capacity, tools, administration or support. [4][5][6]

Can I run AI on my phone?

Some native apps run models on the phone. Browser inference has different compatibility and memory limits. Our trial was measured on a desktop only; phone quality, speed, memory and battery behavior remain unverified. [9][7]

Sources and scope

Sources checked 21 October 2026. Comparisons are GTC’s interpretation. Vendor descriptions do not establish prototype quality or business results. Features can change.

  1. MLC · How WebLLM runs in a browser
  2. Qwen · Qwen3.5-0.8B model card
  3. Qwen · Qwen3.5-2B model card
  4. OpenAI · ChatGPT plans and capabilities
  5. Anthropic · Claude plans and capabilities
  6. OpenAI · ChatGPT Business
  7. MDN · WebGPU browser and device requirements
  8. MDN · Browser storage and eviction
  9. AnythingLLM · Android app and model options
  10. Google web.dev · Choose an AI platform

Keep exploring