What is On-Device AI?
ListAIse offers two AI modes: Cloud AI (default) and On-Device AI. Cloud AI sends the request to a remote service for processing. On-Device AI uses the installed local model for supported tasks and keeps that request on your phone.
Cloud AI
- No storage needed
- Always up-to-date model
- Requires internet
- Data processed remotely
On-Device AI
- 100% private
- Works fully offline
- Instant after warm-up
- Requires 3 to 4 GB of storage
Which AI am I using right now?
How to Enable On-Device AI
Select On-Device AI in Settings, then download the model. The model remains on your device after installation.
Open App Settings
Navigate to AI Provider
Select On-Device AI
Wait for Download
You're ready
Wi-Fi recommended
First-Run Warm-Up
The first time you use On-Device AI after launching the app, the model needs to load into memory. This is called the warm-up. It only happens once per app session.
First request may take up to 60 seconds
What you'll see during warm-up
Loading sheet appears
Model ready
Proactive warm-up
On-Device Voice Transcription
On-Device AI includes a separate model for voice transcription: Whisper, running locally via a compact on-device implementation. This means your voice never leaves your phone, including for transcription.
Whisper On-Device
The Whisper model handles speech-to-text entirely on your device. Once installed, voice input works without an internet connection, including in stores with poor signal.
Setting up on-device voice
Tap the microphone icon
Install the voice model
Download completes
Model sizes
Privacy and offline use
On-Device AI keeps supported requests local and can run without a connection after the models are installed.
Local processing
Your grocery lists, voice recordings, and recipe content never leave your device. Third-party servers do not process this data.
Fully Offline
AI features work in supermarket basements, rural areas, parking garages, and anywhere with poor or no connectivity.
No network round trip
After the initial warm-up, requests are processed locally without waiting for a server response.
You're in Control
You decide which AI handles your data. Switch between Cloud and On-Device anytime from Settings. Your preference persists across sessions.
Device Requirements
On-Device AI runs large neural network models, so it requires available storage space and a modern device processor.
| Model | Purpose | Size |
|---|---|---|
| Gemma 4 | Recipe analysis, AI features | 3.1 GB to 4.4 GB |
| Whisper | Voice transcription | About 600 MB to 1.5 GB |
Storage tip
Fallback Behavior
If On-Device AI encounters an error (model loading failed, not enough memory, etc.), ListAIse never silently falls back to cloud AI. You always stay in control.
When local AI fails, you choose
- Use cloud this time processes this request through Cloud AI without changing your AI provider setting.
- Cancel stops the request without sending the data.
Cloud fallback requires confirmation
Best Practices
Choose the mode that fits your connection, storage, and processing preference.
Use On-Device AI when…
- • You're shopping in areas with poor connectivity
- • You're privacy-conscious and don't want any data leaving your device
- • You use voice input frequently and want offline transcription
- • You want instant responses without network delays
Use Cloud AI when…
- • Your device has limited storage (under 5 GB free)
- • You're on a newer device that hasn't warmed up the model yet
- • You want to conserve device RAM during heavy multitasking
First session tip
Use these guides in ListAIse
Download the app to follow the steps on this page.
Was this page helpful?
Your feedback helps us decide what to improve next.