mirror of
https://github.com/hanzoai/laya.git
synced 2026-10-30 19:33:31 +00:00
A process that already holds a checkpoint -- the demo Space builds convaiinnovations/laya at start-up -- had no way to give it to the router, so routing loaded a second copy: a duplicate 421M parameters, and a multi-second wait the user sees on their first click. router.attach(name, agent) registers it, counts it as resident, and raises max_loaded to hold it. preload() now skips anything already attached. Measured on a T4: a language flip at max_loaded=1 costs a 10.3 s median reload. Preloading removes that from the request path entirely. Co-Authored-By: Claude Opus 5 <[email protected]>
26 lines
787 B
Python
26 lines
787 B
Python
from setuptools import setup, find_packages
|
|
|
|
setup(
|
|
name="laya",
|
|
version="0.3.3",
|
|
description="Fast, non-autoregressive System 1 decision engine with calibrated probabilities",
|
|
long_description=open("README.md").read(),
|
|
long_description_content_type="text/markdown",
|
|
author="Convai Innovations",
|
|
license="Apache-2.0",
|
|
packages=find_packages(),
|
|
python_requires=">=3.8",
|
|
install_requires=[
|
|
"torch>=2.0.0",
|
|
"transformers>=4.45.0",
|
|
"safetensors>=0.4.0",
|
|
"huggingface_hub>=0.20.0",
|
|
"numpy>=1.20.0",
|
|
],
|
|
classifiers=[
|
|
"Programming Language :: Python :: 3",
|
|
"License :: OSI Approved :: Apache Software License",
|
|
"Topic :: Scientific/Engineering :: Artificial Intelligence",
|
|
],
|
|
)
|