Browser AI or cloud AI? Start with the task.
Browser AI runs a downloaded language model on your team’s devices. This on-device AI uses local hardware; cloud AI uses hosted infrastructure. Choose by the task, target devices and where data may go.
Published guide · Results from a private educational experiment
What could on-device AI change?
Fewer prompt uploads
Local generation can keep prompts off model servers. Check every tool and data flow.
Less network dependence
Possible after packaging the app, runtime and model for offline use. Connected tools may still need the network.
Fewer cloud inference calls
Local generation can replace some API calls. Count downloads, devices, engineering and maintenance in the total cost.
Start with one small, inspectable job.
Three candidates to evaluate. These human-reviewed drafts are not implemented in this trial. Keep approved, minimal source material beside each answer.
Test the actual build. Our hotel trial uses text-only Qwen3.5 0.8B and 2B browser builds. Official model-card capabilities do not automatically carry over. [2][3]
CRM handover
- Input
- Approved account notes with unnecessary personal data removed.
- Draft
- A draft handover summary.
- Human check
- A person verifies facts, open questions and next steps against the notes.
ERP maintenance checklist
- Input
- Recorded observations and an approved maintenance procedure.
- Draft
- A draft checklist.
- Human check
- A technician verifies every step; the draft cannot complete a repair or clear a hold.
Staff guidance
- Input
- An approved internal procedure excerpt.
- Draft
- A draft answer with its source.
- Human check
- A staff member verifies the guidance and refers unresolved questions to the procedure owner.
Browser AI or cloud AI: the practical differences.
Compare the actual product. Models, tools and limits vary. These are architectural differences, not a quality ranking. [1][4][5]
Execution
- Browser AI
- Downloaded weights run on your device.
- Hosted AI
- Requests are processed on hosted infrastructure.
Device
- Browser AI
- Browser, GPU and memory constrain what fits.
- Hosted AI
- Your device need not hold the hosted model.
Capabilities
- Browser AI
- Test the specific browser build and its tools.
- Hosted AI
- May include larger models and integrated tools; plan-dependent.
Data boundary
- Browser AI
- Can avoid prompt uploads; check the whole app.
- Hosted AI
- Inputs leave your device; review terms and connected tools.
Cost
- Browser AI
- Account for downloads, devices, delivery and maintenance.
- Hosted AI
- Compare free or paid tiers, limits and integration costs.
A fast reply is not a verified answer.
Fast on our test computer. Across six short English runs, text began appearing 0.45–0.86 seconds after generation started. This excludes model loading and includes incorrect answers.
Reading the source still mattered. In one run, the 2B model called the supplied time and temperature missing. We narrowed the starters to temperatures and the next check. This remains an educational experiment.
Language needs its own evaluation. Four Arabic trials also omitted required facts or added unsupported claims. The English results do not validate an Arabic workflow.
One recorded answer, with its source.
A selected English response from the 0.8B model on 21 October 2026. This is a static record, not a live chat or an accuracy claim.
- Model
- Qwen3.5 0.8B
- Question
- What are the recorded temperature and target for room 301?
- Recorded answer
- Temperature is 28°C and target is 22°C.
Inspect the complete synthetic source
Synthetic room-301 maintenance record (not live). Room: 301. Status: Held. Observed at: 09:00 +04:00. Temperature: 28°C. Target: 22°C. Repair completion: not recorded. Post-repair observation: not recorded. Required next check: record a new observation after repair. This record does not authorize room release. Owner, completion time and booking details: not provided.
How we tested—and what this does not establish
One computer, 20 responses. The evaluation covered 16 English and four Arabic runs on 21 October 2026: Apple M4 Pro, 24 GiB, Chromium 154, WebGPU. The reported timings cover six fresh English conversations: temperatures, missing details and next check, once per model. They establish no phone performance, internet download speed or accuracy rate.
The whole configuration affects the result. The trial used Qwen3.5 0.8B and 2B in MLC q4f16_1 builds with WebLLM 0.2.86. Quantization, the runtime, prompts and generation settings can all affect answers; these observations do not isolate model size as the cause.
How browser inference works.
The browser executes an already-trained model. WebLLM uses WebGPU to run its calculations on compatible graphics hardware. Opening the page does not train a new model. [1]
- Download
Public model files
Weights are numerical values learned during training.
From the host - Load
Your browser + GPU
A runtime prepares the model on your device.
On your device - Generate
Your prompt → a draft
The model generates text from the supplied context.
On your device
Downloads use the network. Generation stays local; connected tools have separate data flows.
Why pay for a subscription?
Capacity and tools are part of the product. Hosted plans can add models, research, coding and connected tools. Paid differences depend on features and usage limits; some features are free. [4][5]
Teams also need an operating environment. Business offerings can include shared workspaces, administration, permissions and billing. A downloaded model does not supply those services by itself. [6]
Local changes the trade-offs.
Check the target devices. This WebLLM trial needs WebGPU, compatible hardware and enough memory. A desktop result does not establish phone performance. [7]
Downloads and storage matter. Files use bandwidth; inference uses device resources. Browser storage can be cleared or evicted, requiring another download. [8]
Before you choose.
Can browser AI work offline after downloading?
Is local AI automatically private?
No. Local inference can avoid sending prompts to a model server, but uploads, analytics and connected tools can create other data flows. Check the complete application. [1]
Can a local LLM replace a subscription?
Sources and scope
Sources checked 21 October 2026. Comparisons are GTC’s interpretation. Vendor descriptions do not establish prototype quality or business results. Features can change.
- MLC · How WebLLM runs in a browser
- Qwen · Qwen3.5-0.8B model card
- Qwen · Qwen3.5-2B model card
- OpenAI · ChatGPT plans and capabilities
- Anthropic · Claude plans and capabilities
- OpenAI · ChatGPT Business
- MDN · WebGPU browser and device requirements
- MDN · Browser storage and eviction
- AnythingLLM · Android app and model options
- Google web.dev · Choose an AI platform