A Powerful AI Model That Fits On A Laptop
Thinking Machines Lab has released Inkling 2 Mini as a small open model that can run on a laptop instead of a large data center. The model has 26.4 billion parameters in total but only a small share is active for each word it produces. Its key idea is a looped design that runs the same middle layers three times for every token. That reuse gives it more reasoning power without a much larger model. The team says it performs strongly on coding and tool use tasks for its size. The download is about 20 gigabytes and it can run on Macs with at least 32 gigabytes of memory. It is also available for other local systems such as DGX Spark. The release shows that capable AI can now live on a personal computer.