Files
python-sdk/pkg/hanzo
zeekay 88854e11e8 refactor: Rename cluster to node and add router management
- Renamed 'cluster' terminology to 'node' throughout codebase for clarity
- Added new 'hanzo router' command for managing LLM proxy server
- Added zsh shell tool with automatic shell detection (prefers zsh over bash)
- Fixed REPL to use cloud mode by default to avoid local server dependency
- Updated chat command to try router (port 4000) before local node (port 8000)
- Added comprehensive Grok documentation to README
- Created NODE_COMPATIBILITY.md documenting integration with desktop app and network

BREAKING CHANGE: 'hanzo cluster' commands now use 'hanzo node' - old commands still work via aliases

Key changes:
- hanzo node start/stop/status - manage local AI nodes
- hanzo router start/stop/status - manage LLM proxy router
- hanzo node worker - manage node workers (formerly cluster nodes)
- Zsh is now default shell when available
- Router runs on port 4000, nodes on port 8000
- Full compatibility with Hanzo desktop app and network layer
2025-09-06 03:27:43 -05:00
..

Hanzo AI - Complete AI Infrastructure Platform

The main SDK for the Hanzo AI ecosystem, providing unified access to all Hanzo tools and services.

Installation

# Install base package with CLI
pip install hanzo

# Install with all components
pip install hanzo[all]

# Install specific components
pip install hanzo[ai]      # AI SDK (same as standalone hanzoai package)
pip install hanzo[router]  # LLM gateway router (replaces litellm)
pip install hanzo[mcp]     # Model Context Protocol server
pip install hanzo[agents]  # Agent runtime and orchestration
pip install hanzo[repl]    # Interactive REPL with AI chat

Features

  • Unified LLM Gateway: Use hanzo.router instead of litellm for 100+ LLM providers
  • MCP Integration: Full Model Context Protocol support for AI tools
  • Agent Runtime: Build and deploy AI agents with the agent framework
  • Interactive REPL: Chat with AI models directly from the command line
  • Complete SDK: Import all Hanzo components from a single package

Quick Start

Command Line

# Main CLI
hanzo --help

# Start MCP server
hanzo-mcp

# Interactive AI chat
hanzo-ai
hanzo-chat

# REPL interface
hanzo-repl

Python SDK

import hanzo

# Use router for LLM calls (replaces litellm)
from hanzo import router
response = router.completion(
    model="gpt-4",
    messages=[{"role": "user", "content": "Hello!"}]
)

# Use agents
from hanzo import Agent, Network
agent = Agent(name="assistant")

# Use MCP tools
from hanzo import Tool, MCPServer

# Access AI SDK
from hanzo import Client
client = Client(api_key="...")

Components

  • hanzo.router: Unified LLM gateway (replaces litellm)
  • hanzo.mcp: Model Context Protocol server and tools
  • hanzo.agents: Agent runtime and orchestration
  • hanzo.memory: Memory systems for agents
  • hanzo.Client: Main AI SDK client

Documentation