Files

1 line
4.2 KiB
JSON
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
{"text":["High-Performance Computing","Hanzo Machines","Rent a machine by the hour, metered to your organization.","Try Hanzo","View Documentation","POST /v1/compute/machines","dryRun","1x H100","2x H100","4x H100","{ \"gpu\":",", \"dryRun\": true }","\"1x H100\"","80 GB","$3.48","/ h","an hour","$27.84","a working day","$2,540","all month","On demand, at the price list’s rate as it stands.","NVIDIA H100","Dedicated GPU instances for AI/ML training","VRAM","80GB HBM3","Cores","16,896 CUDA","Tensor Cores","528 TCs","AMD EPYC 7763","High-core count CPU instances","64 Cores","Threads","128 Threads","Memory","Up to 2TB","Storage Options","Ultra-fast NVMe and persistent storage","Local NVMe","Up to 8TB","Network Storage","Unlimited","I/O Performance","7GB/s","Paste and ship","Paste this into any agent. It reads the skill manifest and calls Machines from there.","Agent prompt","api","/v1/compute/machines","Copy","Read https://hanzo.ai/skill.md and use Hanzo Machines in my project. Start with: hanzo visor machines list","How renting one works","Every step is an API call, so anything you do once by hand you can put in a script afterwards","Ask what exists","The sizes and regions you can launch into are an endpoint, not a page in the docs. Read them, then pick one — nothing to keep in sync by hand.","Price it before you buy it","A launch with dryRun returns the price and creates nothing. The same call without it creates the machine, so what you were quoted is what you asked for.","Metered to the organization","Time is debited from your org's prepaid balance while a machine is up. Before it launches, the cloud says whether you may — and what is missing if you may not.","One list, whoever owns them","Rented machines, the droplets and cluster workers behind them, and your own hardware that dialed in with hanzo link all appear as one fleet, deduplicated.","A row per accelerator","The GPU view counts real cards: from the size of the nodes you rented, and from what your own workers report through nvidia-smi. Where there is no inventory, it returns nothing rather than inventing something.","A machine can carry an agent","Bind a cloud agent to a machine and the pair is one thing to launch, message, stop and tear down. Unbinding is separate, so the agent can move without the machine going with it.","When you want a whole machine","Reach for one when the work outlasts a request, or needs a card of its own","Training runs","A job that needs cards for hours and nothing for the rest of the week.","GPU sizes named from the list the API returns","GPU-hours metered while the job runs","Cancel and the hours used so far are billed, then the job stops","Serving a model","A machine that stays up because something is calling it.","Run Hanzo Engine on a card you rented","Terminate it when the traffic goes away","The bill follows the machine, not a reservation","Work that will not fit in a request","Renders, batches and simulations that take longer than an HTTP call.","A queue per GPU, plus a shared any-GPU lane","Each item says which node claimed it","Read the queue instead of guessing where a job went","Agents that need a computer","An agent with a machine under it, launched and torn down as one thing.","Bind a cloud agent to a machine","Message it, or stop it, by name","Tearing down the pair unbinds the agent first","Whose machine it is","Ownership, region and account are decisions the API makes you state","Scoped to your organization","A machine belongs to one org and is named within it. Every read and every terminate is checked against the org on your token, not against the id in the URL.","Bring your own account","Link a DigitalOcean, AWS or GCP account and the clusters it holds fold into the same fleet. Your capacity, your contract, one place to see it.","Pick the region deliberately","Launches name a region from the list the API returns, so where a workload runs is a decision you made rather than one that was made for you.","Related capabilities","GPUs","On-demand accelerators","Containers","Functions","Serverless handlers","Get Machines","Long-running compute machines","Apache-2.0","License:","hanzoai","Deploy to Cloud"],"links":["/login","https://docs.hanzo.ai","/cloud/gpus","/cloud/containers","/functions","https://github.com/hanzoai","https://platform.hanzo.ai/deploy"]}