Laptop running a local AI model offline, amber illustration

AI Tip: Inkling 2 Mini Runs a Capable AI Model on Your Own Laptop

Most AI help runs in the cloud. You send a question to a distant server and wait for the answer. On November 20, Thinking Machines Lab released Inkling 2 Mini, an open model built to run on a PC you own, even with the internet off.

What changed

  • Small enough for a laptop: the model uses about 20 GB of memory. Thinking Machines says it runs on any Mac with at least 32 GB of RAM through Ollama, and quantized versions for Windows and Linux PCs are available through llama.cpp.
  • Open weights: the files are published under the Apache 2.0 license, so you can download the model and run it yourself. No account and no per-question fee.
  • A different way to think: instead of adding more layers, the model runs its middle layers three times for each word it writes. The lab says that extra pass helps on coding and multi-step tasks.
  • Tested offline: the team ran it on a MacBook Pro in airplane mode during a flight, where it built a playable flight simulator in a few minutes.

Try it like this

  1. Check your memory first. You want 32 GB of RAM or more. On Windows, open Task Manager, click Performance, then Memory to see what you have.
  2. Install Ollama from ollama.com. It is the simplest way to run local models at home.
  3. Download Inkling 2 Mini inside Ollama and ask it a few questions you already know the answers to. That tells you quickly whether it is useful for your work.
  4. Try it offline. Turn Wi-Fi off and ask again. If it still answers, you are running AI with no cloud involved.

Good to know

  • Benchmarks are the maker’s own: Thinking Machines says the model leads open models under 100 billion parameters on coding tests such as DeepSWE v1.1. Independent testing is still early, so treat the numbers as a starting point.
  • Know the weak spots: the lab says the model is weaker on long back-and-forth chats and on questions that need a lot of stored facts. It does better when it can use search and tools.
  • 20 GB is still a big download: make sure you have free drive space before you start.

Source: Thinking Machines Lab, Introducing Inkling 2 Mini (Nov. 20, 2026) and VentureBeat coverage

The tip: before you pay for another cloud AI plan, check whether your PC can run a free local model. If you have 32 GB of RAM, you may already own the hardware.

Filed under: Computer Tips