mirror of
https://github.com/zenlm/engine.git
synced 2026-10-30 15:00:05 +00:00
Eric BuehlerandGitHub
91a423e95a
* Add device support to topology * Wip * Device topology works now * Update topology * Update docs * Update readme
12 lines
132 B
YAML
12 lines
132 B
YAML
0-8:
|
|
isq: Q3K
|
|
device: cuda[0]
|
|
8-16:
|
|
isq: Q4K
|
|
device: cpu
|
|
16-24:
|
|
isq: Q6K
|
|
# Skip 24-28
|
|
28-32:
|
|
isq: Q8_0
|
|
device: cuda[0] |