mirror of
https://github.com/luxfi/torus-ml.git
synced 2026-10-30 15:15:23 +00:00
zeekay
e037e8f7ea
The distribution called itself torus-ml while shipping a package directory named concrete, so the name a user installs and the name they import disagreed — and most of the tree already said torus.ml, which could not resolve against src/concrete. Moved src/concrete to src/torus and pointed the include at it. The dependency was Zama's concrete-python from their index. It is torus-fhe from ours, which is what luxfhe/torus already ships: that frontend declares torus-fhe and ships a torus/fhe module, so every 'from torus.fhe' in this tree was already naming our compiler and only the dependency lagged. Two distributions share one namespace, which is the shape the upstream this forked from used and the reason the split works: torus-fhe gives torus.fhe, torus-ml gives torus.ml. Swept every other spelling — identifiers, enum members, workflow variables, filenames, notebooks. LICENSE and NOTICE keep the upstream attribution a fork owes; the figures carry the old name in JPEG metadata a text sweep cannot reach.
1.5 KiB
1.5 KiB
Deployment
In this folder we show how to deploy a Torus ML model that does sentiment analysis, either through Docker or Amazon Web Services. This is based on the sentiment analysis use case example where a XGBoost model is trained on top of a Transformer model.
Get started
To run this example on AWS you will also need to have the AWS CLI properly setup on your system. To do so please refer to AWS documentation. One can also run this example locally using Docker, or just by running the scripts locally.
- To train your model you can use
train.py, ortrain_with_docker.shto use Docker (recommended). This operation might take some time. This will train a model and serialize the FHE circuit. This will result in a new folder called./dev. - Once that's done you can use the script provided in Torus ML in
src/torus/ml/deployment/, usedeploy_to_docker.py.
python use_case_examples/deployment/server/deploy_to_docker.py
- Once that's done you can launch the
build_docker_client_image.shscript to build a client Docker image. - You can then run the client by using the
client.shscript. This will run the container in interactive mode. To interact with the server you can launch theclient.pyscript usingURL="<my_url>" python client.pywhere<my_url>is the content of theurl.txtfile.
And here it is you deployed a Torus ML model and ran an inference using Fully Homormophic Encryption.