Show HN: An Autonomous Agent That Runs on Open Source Local LLMs

Nuggt is an open-source autonomous agent platform designed to run on local LLMs, specifically leveraging WizardCoder 15B in 4-bit quantized form. The project aims to democratize access to autonomous agents by eliminating dependency on expensive cloud-based APIs. It enables developers to run fully autonomous agents on consumer hardware using open-source models.

Key Points

• •Runs on WizardCoder 15B 4-bit quantized LLM for efficient local execution
• •Eliminates cloud API dependencies and associated costs for autonomous agent deployment
• •Designed for accessibility—enables developers to run agents on standard hardware
• •Open-source project focused on democratizing autonomous agent technology
• •Supports local-first architecture for privacy and control over agent behavior
• •4-bit quantization reduces memory footprint while maintaining model performance
• •Enables offline autonomous agent operation without internet connectivity requirements

Workflow Diagram

Concepts