mirror of
https://github.com/hanzoai/extension.git
synced 2026-10-31 19:31:07 +00:00
zeekayandHanzo Dev
03cd660ebe
`pnpm --filter @hanzo/aci build` failed with TS2339: Property 'words'
does not exist on type 'Page'. 09997dba moved aci from tesseract.js 5 to
7. Version 5 returned a flat word list and the block tree by default;
version 7 has no flat list, and returns the block tree only when the
output options ask for it. So findText read `result.data.words`, got
undefined and threw "words is not iterable", and waitForText and
clickText, which call it, failed with it.
findText now asks recognize for blocks and walks blocks, paragraphs and
lines to the words. The test mock answered in the version 5 shape, which
is why nothing caught this; it now answers as version 7 does, with
blocks null unless asked for, and a new test finds the centre of a word.
On the old findText that test fails with the same TypeError.
Co-authored-by: Hanzo Dev <[email protected]>
@hanzo/aci
Agent Computer Interface - Cross-platform automation for AI agents.
Features
- 🖱️ Mouse Control: Click, drag, scroll, and move
- ⌨️ Keyboard Control: Type, press keys, and use hotkeys
- 📸 Screen Capture: Take screenshots of full screen or regions
- 🔍 Image Recognition: Find images on screen
- 📝 OCR: Read text from screen using Tesseract.js
- 🤖 MCP Integration: Ready-to-use MCP tools for AI agents
- 🌐 Cross-Platform: Works on Windows, macOS, and Linux
Installation
npm install @hanzo/aci
Usage
Basic Usage
import { ACI } from '@hanzo/aci';
const aci = new ACI();
// Take a screenshot
const screenshot = await aci.screenshot();
// Click at coordinates
await aci.click(100, 200);
// Type text
await aci.type('Hello, world!');
// Find and click on an image
await aci.clickImage('button.png');
// Read text from screen (requires OCR)
const aci = new ACI({ ocr: true });
const text = await aci.readText();
MCP Tools
import { aciTools } from '@hanzo/aci/mcp-tools';
// Use with your MCP server
const tools = aciTools;
API Reference
Mouse Operations
moveTo(x, y, duration?)- Move mouse to positionclick(x?, y?, button?)- Click at positiondoubleClick(x?, y?)- Double clickdrag(fromX, fromY, toX, toY)- Drag from one position to anotherscroll(clicks, x?, y?)- Scroll mouse wheel
Keyboard Operations
type(text, delay?)- Type textpress(key)- Press a single keyhotkey(...keys)- Press keyboard shortcut
Screen Operations
screenshot(region?)- Take screenshotgetScreenSize()- Get screen dimensionslocateOnScreen(imagePath, confidence?)- Find image on screenlocateAllOnScreen(imagePath, confidence?)- Find all occurrences
OCR Operations
readText(region?)- Read text using OCRfindText(text)- Find text location on screen
High-Level Operations
clickImage(imagePath, timeout?)- Click on an imageclickText(text, timeout?)- Click on textwaitForImage(imagePath, timeout?)- Wait for image to appearwaitForText(text, timeout?)- Wait for text to appear
Requirements
- Node.js 18+
- Platform-specific requirements:
- Windows: No additional requirements
- macOS: Accessibility permissions required
- Linux: X11 and dependencies for robotjs
License
MIT © Hanzo AI