Access Local LLMs on Mobile Devices

Triplo AI now allows users to access Local LLMs directly from mobile devices. This feature is available with all PRO multiple device licenses. To utilize this functionality, users must ensure they have the following client versions installed:

Triplo AI for Desktop: Version 5.0.0 or higher
Triplo AI for Mobile: Version 3.4.0 or higher

System Requirements

While larger LLMs require powerful computers with GPUs and significant VRAM and RAM, simpler, smaller models can run on more modest machines, such as a Pentium i5 with 16GB or 32GB of RAM. It is essential to choose a model that matches your machine's specifications.

Getting Started

To make the most of this feature, follow these steps:

1. Install Required Software

Download and install either Ollama or LMStudio.

2. Download Models

Access and download models from:
- Ollama Models
- LMStudio Models
Recommendation: Start with smaller models like Gemma 3 4B or Granite 3.2 2B.

3. Activate Server Options

Ollama: run the following command in your computer's Terminal: "ollama serve"
LMStudio: press CTRL+R. then enable the "Serve on Local Network" option under Developer Mode / Settings.

4. Copy Server URLs

Ollama: Default URL is https://127.0.0.1:11434 (shown in the terminal).
LMStudio: URL is http://192.168.5.215:1234 (found under the Developer tab in the Developer Logs section).

5. Configure Triplo AI Desktop

In Triplo AI Desktop, go to Settings and click on "Local LLM Settings" (the second icon next to the Licensing title).
Paste the copied URL into the "Local LLM Provider URL" field and enable the "Enable Local LLM" option.

6. Check Available Models

The models installed on your Local LLM Provider will appear in the "Local LLM Models" list.

7. Share Access with Mobile Devices

To share access to the Local LLMs running on your Desktop with mobile devices under your Triplo AI License:
- Toggle on the "Share access with mobile devices" option.
- Copy the "Encryption key."

8. Configure Triplo AI Mobile

On the Triplo AI Mobile client, navigate to Settings (gear icon at the top left).

9. Enable Shared LLMs

Enable the Shared LLMs option (the last item on the list) and click its Settings icon (gear icon on the right).

10. Select LLM Device

Select the LLM device you wish to use (if you have multiple devices serving models to your Triplo AI license).

11. Paste Encryption Key

Paste the same Encryption key from your Desktop (copied in step 7).

12. Access Local Models

The models running locally on your Desktop will now be accessible on your Mobile device, providing you with direct and secure (encrypted) access via Triplo AI Mobile.

Supercharge Your Productivity with Triplo AI

Unlock the ultimate AI-powered productivity tool with Triplo AI, your all-in-one virtual assistant designed to streamline your daily tasks and boost efficiency. Triplo AI offers real-time assistance, content generation, smart prompts, and translations, making it the perfect solution for students, researchers, writers, and business professionals. Seamlessly integrate Triplo AI with your desktop or mobile device to generate emails, social media posts, code snippets, and more, all while breaking down language barriers with context-aware translations. Experience the future of productivity and transform your workflow with Triplo AI.

Try it risk-free today and see how it can save you time and effort.

Your AI assistant everywhere