hanzoai/python-sdk
2
0
Fork 0
mirror of https://github.com/hanzoai/python-sdk.git synced 2026-10-23 20:23:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
399 Commits 9 Branches 339 Tags
Commit Graph
3 Commits
Author SHA1 Message Date
zeekay 2940310a5d chore: update sub-package dependencies for security fixes 
- Update uv.lock files in all sub-packages
- python-multipart 0.0.21 -> 0.0.22 (arbitrary file write fix)
- urllib3 2.6.1 -> 2.6.3 (decompression-bomb fix)
- Various other dependency updates

Note: docs/package-lock.json has next.js vulnerabilities that need
manual resolution due to npm dependency conflicts.
 2026-02-02 22:40:00 -08:00
zeekay 9144211873 feat(computer): add ScreenTool for unified screen recording and Claude interpretation 
New 'screen' tool provides one-shot recording → analysis → compression:

screen(action="session", duration=30)  # Record 30s, return compressed frames

ACTIONS:
- session: ONE-SHOT record → analyze → compress → return for Claude
- capture: Single screenshot (optimized)
- record: Start background recording
- stop: Stop and process recording
- analyze: Process existing video file

HARD LIMITS (Claude API constraints):
- Max 1568px per dimension (Claude 2000px limit for multi-image)
- Max 100 images per request
- Max 32MB payload

DEFAULT SETTINGS:
- 768px max dimension (good quality, safe margin)
- 60% JPEG quality (aggressive compression)
- 30 target frames per session
- Activity detection @ 0.02 threshold

USAGE:
  screen(action="session")  # 30s → ~30 frames → ~500KB
  screen(action="capture")  # Single screenshot
  screen(action="analyze", path="recording.mp4")  # Process existing

ENV VARS:
  HANZO_SCREEN_DURATION=30
  HANZO_SCREEN_TARGET_FRAMES=30
  HANZO_SCREEN_MAX_SIZE=768
  HANZO_SCREEN_QUALITY=60

Bump hanzo-tools-computer to v0.5.0
 2026-01-11 20:07:08 -08:00
zeekay dbd18eca93 feat(computer): add intelligent video slicing with activity detection 
MediaTool v0.4.0 - Smart video compression for Claude interpretation:

NEW ACTIONS:
- analyze: Detect activity segments (movement, scene changes)
- slice: Extract frames ONLY at activity points
- compress_session: Full pipeline for computer use sessions

ACTIVITY DETECTION:
- Frame differencing (PIL + numpy) for movement detection
- FFmpeg scene change detection for major transitions
- Activity clustering into segments with scores
- Configurable sensitivity thresholds

COMPRESSION:
- 512px max dimension for session frames (vs 768px default)
- 60% JPEG quality for aggressive compression
- Target 30 frames per 60-second session
- ~15KB per frame, ~450KB total for typical session

NEW ENV VARS:
  HANZO_MEDIA_ACTIVITY_THRESHOLD=0.02
  HANZO_MEDIA_SCENE_THRESHOLD=0.3
  HANZO_MEDIA_SESSION_MAX_DURATION=60
  HANZO_MEDIA_SESSION_TARGET_FRAMES=30
  HANZO_MEDIA_SESSION_QUALITY=60

Usage:
  media(action="compress_session", path="recording.mp4")
  # Returns compressed keyframes + activity analysis
  # Perfect for Claude to interpret computer use sessions

Added numpy>=1.26.0 dependency for frame differencing.
 2026-01-11 19:52:05 -08:00