Files
graph/tok/langbase_test.go
zeekay f5aaeb712e Hanzo Graph — the engine, on zapdb, ZAP-native
Derived from Dgraph (github.com/dgraph-io/dgraph) at commit 64804bd2, Apache-2.0.
See NOTICE.

WHAT THIS IS. The graph engine as a Go library: posting lists, the DQL parser,
the type and tokenizer system, the index and schema layers, and the wire types.
39,170 lines of the upstream's 166,337.

THE STORE is github.com/luxfi/zapdb, a Badger fork that kept the package name,
the subpackages (options, pb, y) and the API — Open, OpenManaged, DB, Options —
so the 74 import sites are aliased rather than rewritten.

THE CODEC is ZAP. zapdb serializes with ZAP, not protobuf: its pb package builds
the ZAP types by default and the protobuf ones only under `-tags grpc`, a path
that does not compile (table/builder.go calls pb.Marshal, which that tag
removes). One call site in posting needed converting; every other type here is
Hanzo's own protobuf and is untouched.

NO TRANSPORT. An embedded engine dials nothing, so nothing here imports
google.golang.org/grpc. Removed: 20 transport functions in x, the generated
service stubs for Raft, Zero and Worker (1,657 lines), and the JWT helper —
identity belongs to IAM. The core called none of them.

NOT KEPT: worker, conn, raftwal, the cluster commands, the GraphQL layer and the
test harnesses. `query`, the DQL execution engine, went with them because it
depends on worker; parsing DQL is available here, executing it is not.

The history of the upstream project lives at github.com/dgraph-io/dgraph. This
repository begins at the derivation because three quarters of that history
describes code this fork does not carry.
2026-08-20 21:26:27 -07:00

49 lines
1.2 KiB
Go

/*
* SPDX-FileCopyrightText: © 2017-2026 Istari Digital, Inc.
* SPDX-License-Identifier: Apache-2.0
*/
package tok
import (
"testing"
"github.com/stretchr/testify/require"
)
func TestLangBase(t *testing.T) {
tests := []struct {
in, out string
}{
{in: "zh", out: "zh"},
{in: "zh-hant", out: "zh"},
{in: "zh-hans", out: "zh"},
{in: "es-es", out: "es"},
{in: "ar-001", out: "ar"},
{in: "ca-ES-valencia", out: "ca"},
{in: "ca-ES-valencia-u-va-posix", out: "ca"},
{in: "ca-ES-valencia-u-co-phonebk", out: "ca"},
{in: "ca-ES-valencia-u-co-phonebk-va-posix", out: "ca"},
{in: "x-klingon", out: "en"},
{in: "en-US", out: "en"},
{in: "en-US-u-va-posix", out: "en"},
{in: "en", out: "en"},
{in: "en-u-co-phonebk", out: "en"},
{in: "en-001", out: "en"},
{in: "sh", out: "sr"},
{in: "en-GB-u-rg-uszzzz", out: "en"},
{in: "en-GB-u-rg-uszzzz-va-posix", out: "en"},
{in: "en-GB-u-co-phonebk-rg-uszzzz", out: "en"},
{in: "en-GB-u-co-phonebk-rg-uszz", out: "en"},
{in: "", out: "en"},
{in: "no_such_language", out: "en"},
{in: "xxx_such_language", out: "en"},
}
var out string
for _, tc := range tests {
out = LangBase(tc.in)
require.Equal(t, tc.out, out)
}
}