mirror of
https://github.com/hanzoai/python-sdk.git
synced 2026-10-23 20:23:00 +00:00
zeekay
a4d4dda458
- Fix import sort issues in hanzo package (8 I001 violations) - Make test_agent_tool_no_warnings more robust by only checking for pydantic-specific deprecation warnings, not all deprecation warnings which may come from unrelated packages in CI environment.
Hanzo CLI and Orchestration Tools
Core CLI and orchestration tools for the Hanzo AI platform.
Installation
pip install hanzo
Features
- Interactive Chat: Chat with AI models through CLI
- Node Management: Run local AI inference nodes
- Router Control: Manage LLM proxy router
- REPL Interface: Interactive Python REPL with AI
- Batch Orchestration: Orchestrate multiple AI tasks
- Memory Management: Persistent conversation memory
Usage
CLI Commands
# Interactive chat
hanzo chat
# Use specific model
hanzo chat --model gpt-4
# Use router (local proxy)
hanzo chat --router
# Use cloud API
hanzo chat --cloud
Node Management
# Start local node
hanzo node start
# Check status
hanzo node status
# List available models
hanzo node models
# Load specific model
hanzo node load llama2:7b
# Stop node
hanzo node stop
Router Management
# Start router proxy
hanzo router start
# Check router status
hanzo router status
# List available models
hanzo router models
# View configuration
hanzo router config
# Stop router
hanzo router stop
Interactive REPL
# Start REPL
hanzo repl
# In REPL:
> /help # Show help
> /models # List models
> /model gpt-4 # Switch model
> /clear # Clear context
> What is Python? # Ask questions
Python API
Batch Orchestration
from hanzo.batch_orchestrator import BatchOrchestrator
orchestrator = BatchOrchestrator()
results = await orchestrator.run_batch([
"Summarize quantum computing",
"Explain machine learning",
"Define artificial intelligence"
])
Memory Management
from hanzo.memory_manager import MemoryManager
memory = MemoryManager()
memory.add_to_context("user", "What is Python?")
memory.add_to_context("assistant", "Python is...")
context = memory.get_context()
Fallback Handling
from hanzo.fallback_handler import FallbackHandler
handler = FallbackHandler()
result = await handler.handle_with_fallback(
primary_fn=api_call,
fallback_fn=local_inference
)
Configuration
Environment Variables
# API settings
HANZO_API_KEY=your-api-key
HANZO_BASE_URL=https://api.hanzo.ai
# Router settings
HANZO_ROUTER_URL=http://localhost:4000/v1
# Node settings
HANZO_NODE_URL=http://localhost:8000/v1
HANZO_NODE_WORKERS=4
# Model preferences
HANZO_DEFAULT_MODEL=gpt-4
HANZO_FALLBACK_MODEL=llama2:7b
Configuration File
Create ~/.hanzo/config.yaml:
api:
key: your-api-key
base_url: https://api.hanzo.ai
router:
url: http://localhost:4000/v1
auto_start: true
node:
url: http://localhost:8000/v1
workers: 4
models:
- llama2:7b
- mistral:7b
models:
default: gpt-4
fallback: llama2:7b
Architecture
Components
- CLI: Command-line interface (
cli.py) - Chat: Interactive chat interface (
commands/chat.py) - Node: Local AI node management (
commands/node.py) - Router: LLM proxy management (
commands/router.py) - REPL: Interactive Python REPL (
interactive/repl.py) - Orchestrator: Batch task orchestration (
batch_orchestrator.py) - Memory: Conversation memory (
memory_manager.py) - Fallback: Resilient API handling (
fallback_handler.py)
Port Allocation
- 4000: Router (LLM proxy)
- 8000: Node (local AI)
- 9550-9553: Desktop app integration
Development
Setup
cd pkg/hanzo
uv sync --all-extras
Testing
# Run tests
pytest tests/
# With coverage
pytest tests/ --cov=hanzo
Building
uv build
License
Apache License 2.0