Here’s how to install this portable AI USB. It works 100% offline, is fully portable, leaves zero traces on the host system, and supports Ollama, Llama 3, other LLMs, and both Windows and Mac. You can find all the details on the GitHub repository. To get started, download the ZIP file by going to Code and selecting Download ZIP. Once the file has been downloaded, select Show in Folder and copy the files to a USB drive. It is recommended to use a USB drive with at least 16GB of storage. Before doing anything else, it is highly recommended to format the USB drive. Please note that this will delete all files on the drive. Use exFAT as the file system so the USB can be used on both Windows and Mac. Open the ZIP file using WinRAR and extract all files directly to the USB drive. Make sure the files are placed directly on the USB drive and not inside an additional folder. Once this is done, run install.bat and press any key to continue.

The available AI models will now be displayed. Nemo Mix is approximately 7GB, Dolphin is approximately 4.9GB and is an uncensored model, while Mistral is a good option for coding tasks. Other available models include Qwen, Llama, and Phi. Choose the model that best fits your requirements, type its number, and press Enter. Since the download size can be quite large, this process may take some time. After the model is downloaded, the AI engine will also be downloaded. If a manual action is required, follow the instructions accordingly. The official AnythingLLM installer will open, and you must change the installation path to your USB drive, for example, Your_Drive:\AnythingLLM. Once the installation is complete, allow any required permissions and wait for the interface to load. Click on Open Assistant, and later you can use Ctrl + / to access it quickly. AnythingLLM is now ready to use completely offline. You can ask questions directly, adjust text size, manage memory settings, and select different AI models from the Chat Settings menu. Additional models can be downloaded whenever needed. And that’s how portable AI can be run directly from a USB drive.

Thank you very much.