mirror of
https://github.com/hanzo-ds/rs.git
synced 2026-10-30 20:49:56 +00:00
zeekay
86788566d1
Cut from the upstream v0.13.3 release tag (not HEAD) so this is a pure
rename with no behaviour change. v0.13.3 is what our consumers already
resolve to: insights/rust's Cargo.lock pins clickhouse 0.13.3 and its
manifest already declares `datastore` at 0.13.x.
The load-bearing change is the HTTP auth header rename. The Datastore
server reads only X-Datastore-User / X-Datastore-Key; the upstream names
return `401 Code: 194 Authentication failed`. Every un-renamed HTTP
client is therefore unable to authenticate at all — this is a
correctness fix, not branding.
- crate `clickhouse` -> `datastore`, `clickhouse-derive` -> `datastore-derive`;
versions preserved exactly (0.13.3 / 0.2.0).
- derive macro emits `datastore::Row` in lockstep, so downstream
`#[derive(Row)]` keeps resolving.
- User-Agent reports `datastore-rs/{version}`.
- test-harness env vars CLICKHOUSE_* -> DATASTORE_*; compose uses
ghcr.io/hanzoai/datastore with /etc/datastore-server config paths.
- doc links point at docs.hanzo.ai/datastore.
- `publish = false`: the `datastore` name on crates.io belongs to an
unrelated crate, so consume this by git tag, never by version range.
CHANGELOG is truncated to a fork notice rather than find-replaced —
rewriting upstream release history would manufacture changes Datastore
never shipped. References to upstream issues keep their numbers.
34 lines
1.3 KiB
Rust
34 lines
1.3 KiB
Rust
use tokio::io::AsyncBufReadExt;
|
|
|
|
use datastore::Client;
|
|
|
|
/// An example of streaming raw data in an arbitrary format leveraging the
|
|
/// [`AsyncBufReadExt`] helpers. In this case, the format is `JSONEachRow`.
|
|
/// Incoming data is then split into lines, and each line is deserialized into
|
|
/// `serde_json::Value`, a dynamic representation of JSON values.
|
|
///
|
|
/// Similarly, it can be used with other formats such as CSV, TSV, and others
|
|
/// that produce each row on a new line; the only difference will be in how the
|
|
/// data is parsed. See also: https://docs.hanzo.ai/datastore/interfaces/formats
|
|
///
|
|
/// Note: `lines()` produces a new `String` for each line, so it's not the
|
|
/// most performant way to interate over lines.
|
|
#[tokio::main]
|
|
async fn main() {
|
|
let client = Client::default().with_url("http://localhost:8123");
|
|
let mut lines = client
|
|
.query(
|
|
"SELECT number, hex(randomPrintableASCII(20)) AS hex_str
|
|
FROM system.numbers
|
|
LIMIT 100",
|
|
)
|
|
.fetch_bytes("JSONEachRow")
|
|
.unwrap()
|
|
.lines();
|
|
|
|
while let Some(line) = lines.next_line().await.unwrap() {
|
|
let value: serde_json::Value = serde_json::de::from_str(&line).unwrap();
|
|
println!("JSONEachRow value: {}", value);
|
|
}
|
|
}
|