Articles tagged: local LLM

8 articles

Local models

GPU Management: Why Idle GPUs Are the New Grounded Aircraft

In local AI deployments, idle GPUs mirror grounded aircraft: they consume capital, occupy space, and depreciate without yielding returns....

Jul 31, 202611 min
AI agents

AI Agents Explained: What Is a ReAct Loop and How Does It Work?

The ReAct loop combines reasoning and acting to enable AI agents to solve complex tasks iteratively. By alternating between thought, actio...

Jul 4, 20268 min
AI agents

From Local LLM to Tool-Using Agent

Learn how to transform a local large language model into a powerful agent by integrating external tools like web search, APIs, and code ex...

Jun 26, 20268 min
AI tools

An LLM as Arbiter in RAG Retrieval: Picking the Right Candidate with Reasons

Explore how to use an LLM as an intelligent arbiter to select the best document from RAG retrieval candidates, enhancing accuracy with con...

Jun 26, 20268 min
Local models

We Got Local Models to Triage the OpenClaw Repo for FREE!*

Discover how we used local AI models to automate issue triage on the OpenClaw repository at zero cost, enhancing efficiency and reducing m...

Jun 23, 20266 min
AI tools

Shipping huggingface_hub every week with AI, open tools, and a human in the loop

Discover how the huggingface_hub library is released weekly using AI for code review and open tools for automation, while keeping a human...

Jun 23, 20267 min
Local models

Run a Local LLM with OpenClaw on Your Mac Mini

Learn how to install and run OpenClaw on a Mac Mini for private, offline AI inference. Step-by-step guide covers setup, model loading, and...

Jun 16, 20266 min
AI agents

GPU Time-Slicing for Concurrent LLM Agents on Kubernetes

Learn how GPU time-slicing enables concurrent LLM agents on Kubernetes, maximizing GPU utilization and reducing costs. This article covers...

Jun 14, 20266 min