mirror of
https://github.com/hanzoai/papers.git
synced 2026-10-30 14:58:42 +00:00
`make -k all` returned 0 over any number of broken papers, so CI was green the
whole time it existed. Four things had to be true for that:
- every recipe line ended in `|| true` and the rule printed "FAIL" instead of
exiting, so make never saw a failure;
- nonstopmode emits a PDF for almost any input, so "the PDF exists" is not
the same question as "the paper compiled" — zen-nano_whitepaper produced
one through 23 LaTeX errors;
- pdfs/ was tracked, so a checkout handed the "check every paper came out"
step 100 of the PDFs it was about to look for;
- discovery was three wildcards, so 69 of the repo's 219 papers were
compiled by nothing at all, defense/ by a second copy of the same
swallowing loop written inline in ci.yml.
The rule is now one latexmk per paper and its exit status is the gate:
-halt-on-error (no PDF from a broken paper), -bibtex (a declared bibliography
must resolve rather than being skipped when the .bib is absent), -Werror (an
undefined citation is a defect, not a log note), -cd (each paper compiles from
its own directory, so zen/ finds references.bib and defense/ finds
hanzo-defense.sty). .DELETE_ON_ERROR so a failed run leaves nothing behind,
and pdfs/ is untracked because it is output.
Run against the tree it was guarding, the honest gate fails 24 papers:
6 \begin{itemize} with its backslash-b eaten, leaving a bare `egin{itemize}`
and no \end — artist, designer-instruct, eco, nano, next, omni
3 the same list with the opener deleted outright, so five \item stood in no
environment — artist-edit, designer-thinking, scribe
4 \and in a cover page's raw \@author: it expands to \end{tabular} and closed
a tabular nothing had opened, and \thanks left hyperref pointing at a
footnote anchor that was never created; plus five stray \end{table} at the
end of those documents — director, foley, musician, video
9 \color{gray} under \usepackage{color}, which defines eight names and not
that one — xcolor is the superset the working papers already load
6 \bibliography{references} naming a database that was never written, so
every citation rendered [?] — zen/references.bib now holds all 27 works
9 \bibliographystyle+\bibliography in papers with no \cite at all — dropped
3 characters pdflatex has no glyph for: CO₂ -> CO\textsubscript{2},
↔ -> $\leftrightarrow$, Persian letters -> their code points, the
SentencePiece marker -> \textvisiblespace
1 \IF{...} \COMMENT{...}: algorithmic's \IF opens a list and the comment
landed in it before any \item; the comment slot is \IF[...]{...}
1 \ref{eq:anchor_update} to an equation the paper never writes
All 219 papers now compile from a clean tree: `make -k all` exits 0.
Co-authored-by: Hanzo Dev <[email protected]>
180 lines
5.7 KiB
TeX
180 lines
5.7 KiB
TeX
\documentclass[11pt]{article}
|
|
\usepackage[margin=1in]{geometry}
|
|
\usepackage{graphicx}
|
|
\usepackage{hyperref}
|
|
\usepackage{amsmath}
|
|
\usepackage{booktabs}
|
|
|
|
\title{Zen-Guard: Multilingual Safety Moderation for AI Systems\\
|
|
\large Technical Whitepaper}
|
|
\author{Antje Worring \and Zach Kelling\thanks{[email protected]} \and Hanzo Industries \and Lux Industries \and Zoo Labs Foundation}
|
|
\date{September 2025}
|
|
|
|
\begin{document}
|
|
|
|
\maketitle
|
|
|
|
\begin{abstract}
|
|
Zen-Guard represents a comprehensive safety moderation solution for AI systems, offering both generative and streaming variants for real-time content filtering. Built upon advanced architectures with support for 119 languages, Zen-Guard provides three-tier severity classification across 9 safety categories. The models achieve 96.8\% accuracy with minimal false positives, enabling robust content moderation at scale.
|
|
\end{abstract}
|
|
|
|
\section{Introduction}
|
|
|
|
As AI systems become increasingly prevalent, ensuring safe and appropriate content generation is paramount. Zen-Guard addresses this challenge through specialized models optimized for different deployment scenarios:
|
|
|
|
\begin{itemize}
|
|
\item \textbf{Zen-Guard-Gen (8B)}: Generative safety classification
|
|
\item \textbf{Zen-Guard-Stream (4B)}: Real-time token-level monitoring
|
|
\end{itemize}
|
|
|
|
\section{Architecture}
|
|
|
|
\subsection{Model Variants}
|
|
|
|
\begin{table}[h]
|
|
\centering
|
|
\begin{tabular}{lcccc}
|
|
\toprule
|
|
Model & Parameters & Type & Languages & Latency \\
|
|
\midrule
|
|
Guard-Gen-8B & 8B & Generative & 119 & 120ms \\
|
|
Guard-Stream-4B & 4B & Streaming & 119 & 5ms/token \\
|
|
\bottomrule
|
|
\end{tabular}
|
|
\caption{Zen-Guard model specifications}
|
|
\end{table}
|
|
|
|
\subsection{Safety Categories}
|
|
|
|
The models classify content across 9 primary categories:
|
|
\begin{enumerate}
|
|
\item Violent content and instructions
|
|
\item Non-violent illegal activities
|
|
\item Sexual content or acts
|
|
\item Personally identifiable information
|
|
\item Suicide and self-harm
|
|
\item Unethical acts and discrimination
|
|
\item Politically sensitive topics
|
|
\item Copyright violations
|
|
\item Jailbreak attempts
|
|
\end{enumerate}
|
|
|
|
\section{Performance Metrics}
|
|
|
|
\subsection{Benchmark Results}
|
|
|
|
\begin{table}[h]
|
|
\centering
|
|
\begin{tabular}{lcccc}
|
|
\toprule
|
|
Metric & Guard-Gen & Guard-Stream & Industry Avg \\
|
|
\midrule
|
|
Accuracy & 96.8\% & 95.2\% & 92.1\% \\
|
|
F1 Score & 94.2\% & 93.1\% & 89.5\% \\
|
|
False Positive & 2.1\% & 2.8\% & 5.3\% \\
|
|
Latency & 120ms & 5ms & 200ms \\
|
|
\bottomrule
|
|
\end{tabular}
|
|
\caption{Performance comparison}
|
|
\end{table}
|
|
|
|
\subsection{Multilingual Performance}
|
|
|
|
Zen-Guard maintains consistent performance across all 119 supported languages:
|
|
\begin{itemize}
|
|
\item English: 97.2\% accuracy
|
|
\item Chinese: 96.5\% accuracy
|
|
\item Spanish: 96.1\% accuracy
|
|
\item Other languages: 95.8\% average
|
|
\end{itemize}
|
|
|
|
\section{Deployment}
|
|
|
|
\subsection{Integration Options}
|
|
|
|
\begin{enumerate}
|
|
\item \textbf{API Integration}: REST/GraphQL endpoints
|
|
\item \textbf{Edge Deployment}: Optimized for local inference
|
|
\item \textbf{Streaming Integration}: Real-time token filtering
|
|
\item \textbf{Batch Processing}: High-throughput moderation
|
|
\end{enumerate}
|
|
|
|
\subsection{Resource Requirements}
|
|
|
|
\begin{itemize}
|
|
\item Guard-Gen-8B: 16GB VRAM (FP16), 8GB (INT8)
|
|
\item Guard-Stream-4B: 8GB VRAM (FP16), 4GB (INT8)
|
|
\item CPU: 8+ cores recommended
|
|
\item Throughput: 1000+ requests/second
|
|
\end{itemize}
|
|
|
|
\section{Use Cases}
|
|
|
|
\subsection{Application Scenarios}
|
|
|
|
\begin{itemize}
|
|
\item \textbf{Chat Applications}: Real-time message filtering
|
|
\item \textbf{Content Platforms}: User-generated content moderation
|
|
\item \textbf{Educational Systems}: Safe learning environments
|
|
\item \textbf{Enterprise AI}: Compliance and safety assurance
|
|
\item \textbf{Gaming}: Community interaction monitoring
|
|
\end{itemize}
|
|
|
|
\section{Environmental Impact}
|
|
|
|
\begin{itemize}
|
|
\item Energy Usage: 92\% less than comparable models
|
|
\item Carbon Footprint: 0.8kg CO\textsubscript{2}/month per instance
|
|
\item Optimization: INT8 quantization reduces energy by 50\%
|
|
\end{itemize}
|
|
|
|
\section{Conclusion}
|
|
|
|
Zen-Guard provides comprehensive, multilingual safety moderation with industry-leading performance. The dual-model approach ensures flexibility for both batch and real-time applications while maintaining high accuracy and low false positive rates.
|
|
|
|
\begin{thebibliography}{99}
|
|
|
|
\bibitem{inan2023llamaguard}
|
|
H.~Inan, K.~Upasani, J.~Chi, R.~Rungta, K.~Iyer, Y.~Mao, M.~Tontchev,
|
|
Q.~Hu, B.~Fuller, D.~Testuggine, and M.~Khabsa.
|
|
\newblock {Llama Guard}: {LLM}-based input-output safeguard for human-{AI}
|
|
conversations.
|
|
\newblock \emph{arXiv preprint arXiv:2312.06674}, 2023.
|
|
|
|
\bibitem{metallamaguard2024}
|
|
{Meta AI}.
|
|
\newblock {Llama Guard 3}: Multi-language safety moderation.
|
|
\newblock \emph{Meta AI Technical Report}, 2024.
|
|
|
|
\bibitem{perez2022redteaming}
|
|
E.~Perez, S.~Huang, F.~Song, T.~Cai, R.~Ring, J.~Aslanides, A.~Glaese,
|
|
N.~McAleese, and G.~Irving.
|
|
\newblock Red teaming language models with language models.
|
|
\newblock In \emph{EMNLP}, 2022.
|
|
|
|
\bibitem{bai2022constitutional}
|
|
Y.~Bai, S.~Kadavath, S.~Kundu, A.~Askell, J.~Kernion, A.~Jones,
|
|
A.~Chen, A.~Goldie, A.~Mirhoseini, C.~McKinnon, et~al.
|
|
\newblock Constitutional {AI}: Harmlessness from {AI} feedback.
|
|
\newblock \emph{arXiv preprint arXiv:2212.08073}, 2022.
|
|
|
|
\bibitem{wang2024llmguard}
|
|
Z.~Wang, Y.~Liu, W.~Shi, R.~Luo, and L.~Wang.
|
|
\newblock {LLM-Guard}: Input-output safeguards for large language models.
|
|
\newblock In \emph{ACL}, 2024.
|
|
|
|
\bibitem{ouyang2022rlhf}
|
|
L.~Ouyang, J.~Wu, X.~Jiang, et~al.
|
|
\newblock Training language models to follow instructions with human feedback.
|
|
\newblock In \emph{NeurIPS}, 2022.
|
|
|
|
\bibitem{gehman2020realtoxicity}
|
|
S.~Gehman, S.~Gururangan, M.~Sap, Y.~Choi, and N.~A.~Smith.
|
|
\newblock {RealToxicityPrompts}: Evaluating neural toxic degeneration in
|
|
language models.
|
|
\newblock In \emph{EMNLP Findings}, 2020.
|
|
|
|
\end{thebibliography}
|
|
|
|
\end{document}
|