Nimar
942f70105a
chore: release v3.117.2
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-10 20:34:44 +02:00
Nimar and GitHub
b49c152d85
fix(jump-to-playground): fix openai mapping with tool calls ( #9664 )
...
* add obs name as mapping indicator
* fix mapper oai
* lint
* simplify
2025-10-10 18:20:30 +00:00
Max Deichmann and GitHub
d07cb39ef6
chore: restrict time series lookback for tables ( #9665 )
2025-10-10 17:43:24 +00:00
froemic
0e59668ad9
chore: release v3.117.1
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-10 17:21:09 +02:00
75c7d0e448
fix(billing): Update schema validation for existing redis api keys ( #9662 )
...
* feat: Allow isIngestionSuspended to be nullish
Co-authored-by: michael <michael@langfuse.com >
* test: Use expect.anything() for isIngestionSuspended
Co-authored-by: michael <michael@langfuse.com >
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-10-10 15:03:02 +00:00
Nimar and GitHub
094599a424
fix(support): delimit user messages more ( #9655 )
2025-10-10 12:29:45 +00:00
froemic
eca06ca08e
chore: release v3.117.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-10 14:16:37 +02:00
13295f997c
chore(billing): add information banner about billing changes to billing settings ( #9640 )
...
* add banner to billing settings
* Update web/src/ee/features/billing/components/BillingTransitionInfoCard.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* update text
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-10-10 08:45:42 +00:00
a9048a64a1
feat(auth): add account settings with self-serve account deletion and display name update ( #9615 )
...
* add implementation
* add cmd+k shortcut
* use transaction wrapper when deleting user
* Update web/src/server/api/routers/userAccount.ts
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
* add review comments
---------
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
2025-10-10 08:34:07 +00:00
Aneesh and GitHub
fff0734af3
feat: make more env variables in docker-compose files overwritable ( #8705 )
2025-10-10 10:36:52 +02:00
Valery Meleshkin and GitHub
7dd6f31edb
chore: renaming a helper function to match time units ( #9652 )
2025-10-10 08:28:05 +00:00
Valery Meleshkin and GitHub
c32da046de
chore: remove Experimental Traces AMT Table Configuration. ( #9607 )
...
I am leaving measureAndReturn in place because it emits a lot of useful
tracing metadata and it remains a good place to conduct experiments in
the future.
2025-10-10 06:44:57 +00:00
bd704157ed
fix(ui): set default row height to medium for dataset items table ( #9642 )
...
Refactor: Set default row height to medium
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-10-09 18:16:03 +00:00
+3
2eca294a67
chore: refactor chatml mapper v1 ( #9304 )
...
* chore: extract chatmlmappers
* fix da lint
* extract more
* init mappers with registry
* simplify
* chore: enable browser logs in terminal (#8935 )
* fix(billing): Fix invoice table decimal display (#9399 )
Fix: Ensure consistent USD formatting in billing table
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
* fix(prompts): don't throw on prompt deletion message (#9387 )
* vibe
* cleanup
* chore: filter browser extensions from sentry errors (#9405 )
* chore: do not upgrade to postgres 18 (#9407 )
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* feat(playground): add support for claude sonnet 4.5 (#9410 )
* feat(playground): add support for claude sonnet 4.5
* fix id
* cuid2
* upgrade langchain
* chore: release v3.113.0
* style(dataset-item): detail view to show item IO and past runs in two tabs (#9419 )
* fix: skip JSON parsing for completion start time strings (#9418 )
* fix(otel): preferential parsing of environment key from span attributes (#9432 )
* feat(auth): add support for Keycloak scope and ID token configuration (#9359 )
* feat(auth): add support for Keycloak scope and ID token configuration
* fix(auth): update ID token envvar handling to use default value
* feat(trace-ui): natural language filters (#9347 )
* add fetchCompletion route
* use fetchLLMCompletion function
* chore(llm): add execution context to fetchLLMCompletion function
* add router
* chore: refactor to add resolveBedrockCredentials
* feat(env): add optional AWS Bedrock configuration
* chore: revert langfuse execution context for fetch llm completion
* frontend poc
* use bedrock keys
* chore(organization): add aiFeaturesEnabled column
* feat(organization): update organization update procedure to include optional aiFeaturesEnabled
* add route integrated
* add env vars
* update
* add proejct id
* fixup: ai feature toggle
* fully integrated
* fix: organization ai feature settings
* update
* fix ts
* chore: remove env variables from shared
* chore: rename environment variables
* chore: enhance LLM completion context
* chore: fix typing
* typing
* no more token delegate
* add project id
* fix: filter completion should never throw an error, fallback to empty json
* chore: set up bedrock credentials for development
* chore: remove TokenCountDelegate from types
* fix: integrate organization AI feature checks in filter builder
* fix: use project hook over org hook
* send traces to langfuse cloud
* fix build
* fix buuild
* validate filters
* chore: eslint
* add debug
* don't greedy match
* add tooltip
* fix parsing
* update AI feature text
* fix lockfile
* chore(router): gate setting/using ai features on self hosted deployments
* chore: replace env variable usage with useLangfuseCloudRegion hook across components
* chore: integrate useLangfuseCloudRegion hook to conditionally render AI features in filter builder and AI feature switch components
* docs: update REVIEW.md with Langfuse Cloud environment usage guidelines
* link
* chore: add LANGFUSE_AWS_BEDROCK_MODEL to .env.dev.example and update its definition in env.mjs
* Update useFilterState.ts
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
Co-authored-by: Leo <5489276+leoweigand@users.noreply.github.com >
* chore: upgrade turborepo to 2.5.8 (#9337 )
* chore: upgrade turborepo to 2.5.8
* add comments
* comments
* fix for turbo plugin default exports
* fix: Accept any 2xx status for webhooks (#9439 )
feat: Accept 2xx status codes for webhook success
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
* test(llm-connections): add tests for all adapters (#9423 )
* test(llm-connections): add tests for all adapters
* test(llm-connections): add tests for all adapters
* fix
* fix
* push
* push
* fix: add current datetime to ai filter prompt (#9445 )
* Add current datetime to AI prompt context
Co-authored-by: marc <marc@langfuse.com >
* Refactor datetime formatting for AI prompt
Co-authored-by: marc <marc@langfuse.com >
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
* chore: upgrade golang migrate 4.19.0 (#9444 )
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: upgrade golang-migrate
* fix(trace-ui): make row label sticky for long cells (#9454 )
* feat(trace-ui): make row label sticky for long cells
* simplify
* fix(otel): completion start time parsing to handle JSON stringified values (#9455 )
* chore: release v3.114.0
* fix: change tRPC error code for ClickHouse errors (#9459 )
* feat(prompt-experiments): allow for structured output (#9437 )
* feat(prompt-experiments): allow for structured output
* push
* remove propagation from submit in createoreditllmschema
* push
* add output_schema to trace metadata
* push
* push
* push
* push
* perf: add output score index to job_executions table (#9434 )
* fix(llm-schema-dialog): remove unnecessary event handler (#9463 )
* feat(prompt-experiments): allow for structured output
* push
* remove propagation from submit in createoreditllmschema
* push
* add output_schema to trace metadata
* push
* push
* push
* push
* fix(create-llm-schema-dialog): remove unnecessary event handling
* push
* chore: clear up unused entities in clickhouse (#9151 )
* chore: clear up unused entities in clickhouse
* chore: patch
* chore: patches
* chore: remove AMT documentation and background migration (#9465 )
* fix(natural-language-filters): show only on traces table (#9466 )
* fix: show input/output/total columns in traces table correctly (#9468 )
* fix: show input/output/total columns in traces table correctly
* fix: show input/output/total columns in traces table correctly
* fix: show input/output/total columns in traces table correctly
* chore(llm-connections): move test suite to separate run (#9464 )
* chore(llm-connections): move test suite to separate run
* push
* push
* push
* fix: set postgres timezone to UTC across docker compose files (dev and prod) (#9472 )
* test(otel): add test for completion start time parsing (#9456 )
* test(otel): add test for completion start time parsing
* push
* chore(billing): require credit card only on non-zero checkout sessions (#9467 )
* handle upgrades w/o credit card
* fix flickering of error message
* fix flag
* style(dataset-compare-ui): move compare view charts to tabs (#9475 )
* refactor: extract ChatML Mapper from IOPreview (#9202 )
* chore: extract chatmlmappers
* fix da lint
* extract more
* fix(filters): trace with local export (#9471 )
* fix(filters): trace with local export
* fix link
* add real seeder
* track prompt stats
* fix(billing): fix react rule of hooks violation (#9477 )
* Refactor conditional rendering and hook logic
Co-authored-by: michael <michael@langfuse.com >
* fix ordering
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
* chore: release v3.115.0
* switch to scoring
* switch to score
* add langchain
* playground integration
* reset instrumentation-client
* use metadata and zod
* add pydantic
* fix build
* more fix
* simplify
* cleanup
* cleanup
* remove previous functions
* fix types
* simplify
* add llamaindex
* memorize
* fix: don't try to render content parts as chatml
* fix: don't show item badges unless activated
* add seeder stuff
* shhhh
---------
Co-authored-by: Michael Fröhlich <15179255+FroeMic@users.noreply.github.com >
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
Co-authored-by: marliessophie <74332854+marliessophie@users.noreply.github.com >
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
Co-authored-by: Hassieb Pakzad <68423100+hassiebp@users.noreply.github.com >
Co-authored-by: Fabian Reinold <32450519+freinold@users.noreply.github.com >
Co-authored-by: Leo <5489276+leoweigand@users.noreply.github.com >
Co-authored-by: Marc Klingen <git@marcklingen.com >
Co-authored-by: Valery Meleshkin <valeriy@meleshk.in >
2025-10-09 16:32:55 +00:00
Michael Fröhlich and GitHub
e8efbb5e8f
chore(billing): remove usage-tracker component ( #9641 )
...
remove usage-tracker component
2025-10-09 16:05:29 +00:00
Michael Fröhlich and GitHub
3f2e65ce61
fix(billing): exclude orgs with plan override from usage notifications ( #9637 )
...
fix erroneous warning emails
2025-10-09 14:05:12 +00:00
Max Deichmann and GitHub
218db7a5d7
chore: add offset for sessionid ( #9634 )
2025-10-09 12:34:47 +00:00
Nimar and GitHub
69c6a74110
fix(log-view): increase limit to 150 obs ( #9633 )
2025-10-09 14:12:38 +02:00
marliessophie and GitHub
66f55e94fe
docs(evals): add note to hisotric data eval execution tooltip ( #9632 )
2025-10-09 11:23:55 +00:00
0becc56477
chore: bump next (15.5.4), react (19.2), sentry (10.18) ( #9612 )
...
* chore: bump next, react, sentry
* add lock
* fix(playground): replace console warnings with toast notifications in usePersistedWindowIds hook (#9611 )
* feat(onboarding): add onboarding for dataset item creation management (#9609 )
* feat(onboarding): add DatasetItemsOnboarding component for dataset item management
- Introduced a new onboarding component to facilitate the addition of items to datasets, including options for CSV uploads and manual entry.
- Updated SplashScreen to accept children for enhanced flexibility.
- Modified DatasetItemsTable and related components to conditionally render onboarding based on dataset item count.
* chore: references
* feat(playground): scroll horizontally as windows are added (#9613 )
feat(playground): scroll horizontally as windows are added/removed
* chore(support): add delimiter line between boilerplate and user message (#9616 )
Update plainRouter.ts
Update delimiter line
* chore(auth): improved org invite flow (nitpick) (#9617 )
* add implementation
* sanitize targetpath query param
* chore: limit trace filter options (#9622 )
* chore: limit trace filter options
* chore: limit trace filter options
* fix upgrade
* fix shared pkg
---------
Co-authored-by: marliessophie <74332854+marliessophie@users.noreply.github.com >
Co-authored-by: Michael Fröhlich <15179255+FroeMic@users.noreply.github.com >
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-10-09 09:11:02 +00:00
Michael Fröhlich and GitHub
6a6bbf7524
chore(billing): disable ingestion suspension enforcement ( #9623 )
...
disable enforcement of blocking for now
2025-10-09 11:02:53 +02:00
Hassieb Pakzad and GitHub
a369cf0941
feat(prompt-experiments): name runs experiments ( #9540 )
...
* feat(prompt-experiments): name runs experiments
* push
* push
* push
* push
* push
* add multistep form
* push
* refactor to context
* push
* push
* push
* push
* push
* push
* push
* push
* push
* rename to experiment
* onevalutaortoggled
* move to groupedProps instead of context
* factor out StepHeader component
* rely on form state for runName
* push
2025-10-09 08:28:03 +00:00
froemic
cf4ed6bb2e
chore: release v3.116.1
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-09 10:39:32 +02:00
Michael Fröhlich and GitHub
be00006ae2
chore(billing): read cycle usage from db instead of clickhouse for hobby plan users ( #9619 )
...
* read usage in billing settings from db; align with email notifications
* change line
2025-10-09 08:05:07 +00:00
Max Deichmann and GitHub
b88a41443a
chore: limit trace filter options ( #9622 )
...
* chore: limit trace filter options
* chore: limit trace filter options
2025-10-09 07:35:54 +00:00
Michael Fröhlich and GitHub
9843c79f57
chore(auth): improved org invite flow (nitpick) ( #9617 )
...
* add implementation
* sanitize targetpath query param
2025-10-08 20:46:58 +00:00
Michael Fröhlich and GitHub
8fcac23083
chore(support): add delimiter line between boilerplate and user message ( #9616 )
...
Update plainRouter.ts
Update delimiter line
2025-10-08 19:56:36 +00:00
marliessophie and GitHub
b171db153e
feat(playground): scroll horizontally as windows are added ( #9613 )
...
feat(playground): scroll horizontally as windows are added/removed
2025-10-08 18:05:54 +00:00
marliessophie and GitHub
fba07bdff0
feat(onboarding): add onboarding for dataset item creation management ( #9609 )
...
* feat(onboarding): add DatasetItemsOnboarding component for dataset item management
- Introduced a new onboarding component to facilitate the addition of items to datasets, including options for CSV uploads and manual entry.
- Updated SplashScreen to accept children for enhanced flexibility.
- Modified DatasetItemsTable and related components to conditionally render onboarding based on dataset item count.
* chore: references
2025-10-08 17:55:17 +00:00
marliessophie and GitHub
ee7473855c
fix(playground): replace console warnings with toast notifications in usePersistedWindowIds hook ( #9611 )
2025-10-08 17:51:57 +00:00
Nimar and GitHub
53b90fed02
fix(trace-log): show json / formatted switch ( #9601 )
...
* fix(trace-log): show json / formatted switch
* fix
2025-10-08 17:22:30 +00:00
Leo Weigand and GitHub
0ed2c53b6c
chore(playground): make action icon buttons clearer ( #9605 )
2025-10-08 15:17:34 +00:00
Marc Klingen and GitHub
2b6420b78d
feat(ui): add cloudregion to project/org information in settings ( #9600 )
...
* feat(ui): add cloudregion to project/org information in settings
* push
2025-10-08 14:16:35 +00:00
5e5f198aae
Bug fix: Self-hosted hitting cloudBilling.getUsage ( #9597 )
...
fix: guard cloud billing usage tracker
Co-authored-by: Michael Fröhlich <15179255+FroeMic@users.noreply.github.com >
2025-10-08 16:07:56 +02:00
Nimar and GitHub
01e4c57a55
fix(trace-ui): keep expand/collapse state across trace peeks ( #9598 )
2025-10-08 15:44:44 +02:00
Steffen Schmitz and GitHub
1d7c0ae9ab
chore: disable write of eventRaw column in new events table ( #9595 )
2025-10-08 12:03:09 +00:00
marliessophie and GitHub
25d428dc93
feat(datasets): support DnD for CSV file uploads ( #9593 )
2025-10-08 10:10:06 +00:00
aedee34611
fix(billing): fix self-hosted billing error ( #9578 )
...
* fix(billing): fix self-hosted billing error
Fixes 500 errors for self-hosted users when cloudBilling routes are called without NEXT_PUBLIC_LANGFUSE_CLOUD_REGION configured.
## Changes
### Server-Side Protection
- Added `isCloudBillingEnabled()` utility to check cloud region configuration
- Updated all cloudBillingRouter endpoints to gracefully handle non-cloud environments:
- Query endpoints return null/empty responses
- Mutation endpoints throw PRECONDITION_FAILED errors
- Removed DEV-specific check in getUsage, replaced with universal cloud check
### Client-Side Prevention
- Added `useIsCloudBillingAvailable()` hook for components
- Updated UsageTracker to check cloud availability before rendering/querying
- Updated BillingSettings to return null when cloud billing unavailable
- Updated BillingInvoiceTable to include cloud availability check
- Updated organization settings to hide billing tab when not in cloud region
### Defense in Depth
Implements three layers of protection:
1. Server router checks prevent 500 errors
2. Client components conditionally render
3. Settings UI hides billing features appropriately
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
* fix lint errors
* conditionally render usage tracker
---------
Co-authored-by: Claude <noreply@anthropic.com >
2025-10-08 09:55:20 +00:00
Leo Weigand and GitHub
72d7a99ff2
revert: filter sidebar ( #9592 )
...
* Revert "fix: score filter UI issues (#9583 )"
This reverts commit 09f709627a .
* Revert "fix: restore missing sessions view filters (#9577 )"
This reverts commit 3290a3381e .
* Revert "fix: empty trace names breaking filter options (#9575 )"
This reverts commit e0568b0c5e .
* Revert "feat: introduce sidebar filtering UI (#9561 )"
This reverts commit 689dc16307 .
2025-10-08 09:53:51 +00:00
8cb3d26e54
feat(billing): add configurable spend alerts for paid cloud plans ( #9551 )
...
* Checkpoint before follow-up message
Co-authored-by: michael <michael@langfuse.com >
* fix(spend-alerts): format code and fix toast imports
* feat(spend-alerts): add test script for spend alert emails
- Follows same pattern as send-test-threshold-emails.ts
- Includes 3 test scenarios with different thresholds
- Requires manual email configuration for safety
* feat(spend-alerts): add Prisma migration for CloudSpendAlert table
- Creates cloud_spend_alerts table with proper schema
- Adds foreign key constraint to organizations table
- Includes index on org_id for performance
- Supports decimal thresholds and trigger tracking
* add concurrently keyword to index
* fix linter error
* fix linter error
* remove old usage alerts
* update syling
* refatcor alerts jobs
* fix build errors
* update rate limit for stripe
* fix migration
* update email template and tracking
* update text
* add review comments
* add queue body deifniton
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-10-08 08:55:15 +00:00
Valery Meleshkin and GitHub
dee644d8cb
feat: Enable advanced filtering in public API traces endpoint (LFE-3810) ( #9492 )
...
* feat: allow public traces API to use advanced filters
* chore: update API specs
2025-10-08 08:18:24 +00:00
Max Deichmann and GitHub
d3388aac23
chore: add filter options for sessions and remove traces final ( #9589 )
...
* chore: add filter options for users
* chore: add filter options for users
2025-10-07 22:35:14 +00:00
Leo Weigand and GitHub
09f709627a
fix: score filter UI issues ( #9583 )
2025-10-07 20:14:22 +02:00
69c730f1a0
feat(otel): map gen_ai.tool.call.arguments/result to input/output ( #9430 )
...
Map gen_ai.tool.call.arguments/result to input/output
Co-authored-by: Nimar <l.nimar.b@gmail.com >
2025-10-07 20:12:37 +02:00
Nimar and GitHub
33cfd9b4f9
fix(json-view): expand to up to 100 rows on root ( #9580 )
2025-10-07 17:29:59 +00:00
Leo Weigand and GitHub
3290a3381e
fix: restore missing sessions view filters ( #9577 )
...
* fix: env and trace tags filter missing in sessions view
* fix: restore missing sessions view filters
* fix: bookmarked filter in sessions view
* fix: trace tags filter
* fix: add back missing scores filters
2025-10-07 17:12:06 +00:00
Steffen Schmitz and GitHub
cf40ce5093
chore: ingest otel events into new events table (dev) ( #9548 )
...
* chore: ingest otel events into new events table (dev)
* chore: propagate completionStartTime
* chore: add metadata processing
* chore: propagate metadata
* chore: add source attributes
* chore: simplify
* chore: adjust modelname prop
2025-10-07 16:53:03 +00:00
Nimar and GitHub
9b53418780
fix(graph): cause freeze through infinite loop ( #9576 )
2025-10-07 18:42:00 +02:00
Leo Weigand and GitHub
e0568b0c5e
fix: empty trace names breaking filter options ( #9575 )
...
fix: empty trace name breaking filter options
2025-10-07 15:20:12 +00:00
Leo Weigand and GitHub
d03ff3d6a9
fix: peek view params handling in sessions ( #9570 )
2025-10-07 15:47:50 +02:00
Leo Weigand and GitHub
689dc16307
feat: introduce sidebar filtering UI ( #9561 )
...
* shuffle toolbar
* controls sidebar
* setup for filter attributes
* test with environment filter
* new filter state management
* name filter
* add reset filter button
* add tags filter
* add bookmarked filter
* unify column id v display handling
* rename to bookmarked
* polish, fix bugs
* merge hooks, efficiency
* support dual-value in slider
* latency filter
* make filters generic
* add sidebar to observations, sessions, prompts, scores and evals
* simplify table-controls component
* allow resetting individual filters
* clean up layout
* show "all" when only selected item
* text facets
* add key-value filter
* add numerical key-value filter
* add metadata filter
* disable accordion animations
* add filtering for values
* fix observation filters not being applied
* add ai filters
* represent no range filter with empty inputs
* update look of reset button
* fix header shrinking
* tidy up vertical spacing
* clean up
* fix type and lint issues
* fix none-of operator not being used when it should
* fix missing env filter
* a few last fixes
* another type error
* oops
2025-10-07 13:28:37 +00:00
Steffen Schmitz and GitHub
32e6026f24
feat: process livekit semantic attributes in otel parsing ( #9568 )
2025-10-07 13:02:33 +00:00
Nimar and GitHub
d9460e684d
chore: filter out http errors from sentry ( #9569 )
2025-10-07 12:58:56 +00:00
Nimar and GitHub
30726d6150
feat(trace-ui): add log view with all observations concatenated ( #9563 )
...
* feat(trace-ui): add log view with all observations concatenated
* collapse nicer
* move up
* fix types
2025-10-07 10:18:07 +00:00
Hassieb Pakzad and GitHub
28adf5b129
fix(jump-to-playground): allow for nullish tool_call_id and tool_calls ( #9564 )
2025-10-07 10:01:31 +00:00
Marc Klingen and GitHub
dae07f5c93
fix(ui): "New Version" instead of "New" on main prompt mgmt CTA button ( #9562 )
2025-10-07 11:37:38 +02:00
Valery Meleshkin and GitHub
6a18e6615c
chore: use simpler to install CH client + doc update ( #9560 )
...
chore: use simplier to install CH client + doc update.
2025-10-07 11:11:26 +02:00
Hassieb Pakzad and GitHub
07c125bcc1
feat(model-prices): add gpt-5-pro ( #9559 )
2025-10-07 08:24:51 +00:00
446fbe484c
fix(billing): Multiple queue job execution anomaly ( #9553 )
...
* Fix: Prevent duplicate job scheduling in queues
Co-authored-by: michael <michael@langfuse.com >
* Fix: Deduplicate queue jobs across multiple worker instances
Co-authored-by: michael <michael@langfuse.com >
* Checkpoint before follow-up message
Co-authored-by: michael <michael@langfuse.com >
* Checkpoint before follow-up message
Co-authored-by: michael <michael@langfuse.com >
* fix: prevent duplicate queue job scheduling across multiple containers
- Add unique jobIds to CloudFreeTierUsageThresholdQueue for deduplication
- Add comprehensive logging for job scheduling and execution tracking
- Apply best practices pattern with descriptive job data and comments
- Remove investigation documentation files
This resolves the issue where multiple worker containers were creating
duplicate recurring and bootstrap jobs, causing 10x more executions
than expected.
* add logging statements
* remove job id and bootstrap execution
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-10-07 09:08:52 +02:00
Max Deichmann
77733d7774
chore: release v3.116.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-06 23:59:52 +02:00
Max Deichmann and GitHub
7119201dcf
chore: add logs to csv exports ( #9555 )
2025-10-06 21:57:54 +00:00
1354e0937f
fix(billing): implement chunked updates for free tier usage tracking ( #9549 )
...
* fix(billing): implement chunked updates for free tier usage tracking
Reduces DB load by 95% via transaction batching (50,000 → 50 chunks).
Each chunk processes 1,000 orgs with proper error handling.
Failed chunks reported to Datadog without killing the job.
Changes:
- Refactored processThresholds() to return update data instead of executing immediately
- Created bulkUpdates.ts with chunked transaction processing (1000 orgs per batch)
- Modified usageAggregation.ts to collect updates and execute in bulk
- Updated tests to verify returned data instead of mock calls
- Added error handling with traceException for failed chunks
- Structured for easy swap to raw SQL (Option 1) if needed
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
* test: update cache invalidation tests to use bulkUpdateOrganizations
The tests now call bulkUpdateOrganizations() to complete the update flow,
including cache invalidation. This reflects the refactored architecture where
processThresholds() returns update data and bulkUpdateOrganizations() executes it.
* fix: reduce transaction timeout from 60s to 15s per chunk
60 seconds was excessive for 1000 orgs. Even at 10ms per update,
that's only 10 seconds. 15 seconds provides a reasonable buffer.
* refactor: use Promise.allSettled instead of transaction wrapper
Benefits over previous () approach:
- Better resilience: One failed org doesn't fail the entire 1000-org chunk
- Concurrent execution: Much faster than sequential transaction
- Granular error tracking: Track exactly which orgs failed
- Better error handling: Each org failure reported to Datadog individually
Trade-off: No atomicity per chunk, but we don't need it for this use case.
Each org update is independent and idempotent.
* fix: remove unused chunkOrgIds variable
* remove unused code
* refactor transaction update and add rawsql update
* Update worker/src/ee/usageThresholds/bulkUpdates.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update worker/src/ee/usageThresholds/bulkUpdates.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* make rawsql query default
---------
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-10-06 17:46:46 +00:00
a2da9a51b3
fix(billing): enhance free tier usage emails with pricing, reset dates, and CRM integration ( #9547 )
...
* fix(billing): enhance free tier usage emails with pricing, reset dates, and CRM integration
- Add getBillingCycleEnd() helper to calculate when usage limits reset
- Add comprehensive tests for billing cycle end date calculations
- Add optional USAGE_THRESHOLD_EMAIL_BCC env variable for CRM integration (e.g., HubSpot)
- Include reset date in both warning and suspension emails
- Add Core plan pricing ($29/month) and key benefits to email templates
- Mention startup program (50% off for first year) with link to langfuse.com/startups
- Update email templates to include:
- When usage limit resets
- Pricing information from stripeCatalogue
- Key upgrade benefits: unlimited users, 90-day retention, email/chat support
- Startup program callout
- Update test script to include reset date and BCC configuration
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
* refactor(billing): rename USAGE_THRESHOLD_EMAIL_BCC to CLOUD_CRM_EMAIL
Rename environment variable to better reflect its purpose as a general
cloud CRM integration endpoint rather than being specific to email BCC.
Changes:
- Renamed env variable in both .env.dev.example and .env.prod.example
- Updated email sending functions to use new variable name
- Updated test script with new variable name
- Regenerated TypeScript declarations
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
* security(billing): add email validation for CLOUD_CRM_EMAIL
Add Zod email validation before using CLOUD_CRM_EMAIL in BCC field
to prevent potential email header injection attacks.
Changes:
- Import and use zod/v4 for email validation in both email functions
- Validate CLOUD_CRM_EMAIL format before assigning to BCC
- Log warning if invalid email format is detected
- Add CLOUD_CRM_EMAIL to worker env schema
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
---------
Co-authored-by: Claude <noreply@anthropic.com >
2025-10-06 15:02:18 +00:00
3ce6c51009
fix(billing): correct metrics for paid vs free tier orgs when enforcement disabled ( #9544 )
...
When LANGFUSE_FREE_TIER_USAGE_THRESHOLD_ENFORCEMENT_ENABLED is false,
the paid plan check was never reached due to early return. This caused
ALL organizations (paid and free) to be incorrectly counted as free_tier_orgs.
Fix: Move paid plan check before enforcement check to ensure paid orgs
always return "PAID_PLAN" regardless of enforcement status.
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-authored-by: Claude <noreply@anthropic.com >
2025-10-06 14:31:04 +00:00
Valery Meleshkin and GitHub
f1564c3049
chore: add seeding to the events dev table ( #9545 )
2025-10-06 13:42:57 +00:00
marliessophie and GitHub
f2c764c1d7
feat(dataset-compare-view-ui): make cell more digestable ( #9491 )
...
* chore: remove peek view from compare data table
* style(io-table-cell): support content expand on hover
* feat: make compare cell digestable
* feat: open trace peek view from compare view
* style: adjust cell for many scores, IO and metadata
* style: allow untoggling output
* chore: fix
* fix: enable score column query based on runIds length
* chore: rename dataset compare metrics to fields
* refactor: unify score aggregate types under AggregatedScoreData
* chore: extract score detail row component
* refactor: make openPeek optional in DataTablePeekViewProps and update related components
2025-10-06 11:47:35 +00:00
Steffen Schmitz and GitHub
71c7b30516
chore: create setup for dev-tables with new events table ( #9535 )
...
* chore: create setup for dev-tables with new events table
* chore: make tests independent of clickhouse version
2025-10-06 11:00:17 +00:00
Hassieb Pakzad and GitHub
e639e866e1
refactor(fetchLLMCompletion): simplify interface ( #9493 )
...
* refactor(fetchLLMCompletion): simplify interface
* fix llm connection tests
* fix lint
* fix ts errors
* fix
* fix
2025-10-06 10:57:25 +00:00
Michael Fröhlich and GitHub
304f9999dd
fix(billing): correctly name column in backfill-cycle-anchor background migration ( #9538 )
...
fix misnamed column in background script
2025-10-06 12:54:38 +02:00
bee927e159
feat(billing): Enforce Usage Threshold on Hobby Plan (DRAFT) ( #9426 )
...
* feat(billing): Add migration for tracking usage on organization table (#9425 )
Add db migration for tracking usage on hobby plan to organization table
* feat(billing): write org.billingAnchor on organization create and subscription create and delete (#9431 )
* Add billingCycle helper functions with test cases
* update billingAnchor on organization create
* update billingAnchor subscription create / delete
* deduplicate startOfDayUTC definition
* feat(billing): Add clickhouse queries to retrieve usage (#9433 )
add clickhouse queries
* feat(billing): add usage aggregation and threshold processing fns (#9438 )
* export ParsedOrganization type
* add migration to use timestampz instead of datetime and add billingCycleUsageState column
* add endOfDayUTC helper
* update billingCycleHelpers tests
* add usageAggregation functionality
* add threshold processing scaffolding
* add tests for threshold processing
* fix formatting
* feat(billing): add usageThresholdQueue and handleUsageThresholdJob (#9441 )
* add usaegThresholdQueue and handleUsageThresholdJob
* add usaegThresholdQueue and handleUsageThresholdJob
* fix build error
* feat(billing): add email templates for notifications (#9447 )
* add email templates
* trigger email notifications in threshold processing
* fix typo
* fix build error
* fix test
* feat(billing): add env variable to enable/disabled usage threshold enforcement (#9448 )
add LANGFUSE_USAGE_THRESHOLD_ENFORCEMENT_ENABLED env variable
* feat(billing): enforce blocking of ingestion on isIngestionSuspended flag (#9450 )
* block api ingestion on isIngestionSuspended
* fix failing tests
* add tests for api key invalidation
* extract invalidateAPIKey fns into shared package
* invlaidate api key in stripe webhook handler
* fix linter error
* avoid closing redis connection during test
* Update packages/shared/src/server/services/email/usageThresholdSuspension/sendUsageThresholdSuspensionEmail.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* rename queue
* add comment to prisma
* add reply to to email and remove explicit support email
* remove getOrgCreateDataWIthAnchor wrapper
* clean up migrations
* remove manual setting of billingAnchorDate (let db take care)
* set ms specific billingAnchor
* fix docstring
* add functionality to backfill billingAnchor
* add datadog metrics
* add free-tier orgs gauge
* add review comments
* fix failing tests
* update migration to avoid blocking backfills
* add review comments; env variable renaming, test fixes, function renaming
* add guard to only run Queue in cloud environment
* add new queue to test-utils
* remove comment
* rename job, queue, and columns to 'cloud...'
* throw if NEXTAUTH_URL is not set when sending email
* refactor recordGauges to recordIncrement calls
* add explanatory comment
* refactor recordGauges to recordIncrement in cloudUsageMeteringJob
* refactor backfill to background job
* simplify job logic
* check background migration validatity based on cloud environment
* remove active subscription filter
* fix prettier
* feat(billling): add script to send test emails (#9500 )
* add script to send test emails
* add check and error message for empty email array
* add 200k notification threshold and increase blocking threshold to 250k
* replace id with uuid in background migration
* remove date from background migration file name
* check for columns to avoid race conditions
* fix failing test after updating thresholds
* update test thresholds
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-10-06 09:35:55 +00:00
Nimar and GitHub
288b6d4ff2
fix(sentry): don't throw trpcclienterror in sentry ( #9534 )
2025-10-06 07:54:40 +00:00
Max Deichmann and GitHub
a021f99e99
chore: upgrade sentry ( #9528 )
2025-10-05 15:38:27 +00:00
2c3362de5c
chore: remove redundant AI feature sentence ( #9497 )
...
* Refactor AI feature switch description text
Co-authored-by: marc <marc@langfuse.com >
* prettier
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-10-02 20:32:53 +00:00
c6199bc931
chore(ui): Rename table view button to "saved views" ( #9496 )
...
Refactor: Update default button text to "Saved Views"
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-10-02 19:37:36 +00:00
Nimar and GitHub
07352dbf94
feat(agent-graph): cycle through observations by clicking graph nodes… ( #9139 )
...
* feat(agent-graph): cycle through observations by clicking graph nodes multiple times
* fix naming
* fix cycle
* invert numbering
* use dataset
2025-10-02 19:32:19 +00:00
3dd795b095
feat(billing): add self-service enterprise plan ( #9486 )
...
* feat: Add Enterprise plan to billing and update layout
Co-authored-by: michael <michael@langfuse.com >
* update product id
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-10-02 10:20:42 +00:00
marliessophie and GitHub
c519fe1737
style(io-table-cell): support content expand on hover ( #9487 )
2025-10-02 09:22:56 +00:00
Nimar
506d670625
chore: release v3.115.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / test-worker-llm-connections (node24, pg15) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-02 11:01:03 +02:00
4ee723d9ed
fix(billing): fix react rule of hooks violation ( #9477 )
...
* Refactor conditional rendering and hook logic
Co-authored-by: michael <michael@langfuse.com >
* fix ordering
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-10-01 20:54:58 +02:00
Nimar and GitHub
d3f35d1f22
fix(filters): trace with local export ( #9471 )
...
* fix(filters): trace with local export
* fix link
* add real seeder
* track prompt stats
2025-10-01 18:17:12 +00:00
Nimar and GitHub
1a0a2b1b53
refactor: extract ChatML Mapper from IOPreview ( #9202 )
...
* chore: extract chatmlmappers
* fix da lint
* extract more
2025-10-01 18:06:16 +00:00
marliessophie and GitHub
5bb5b105c4
style(dataset-compare-ui): move compare view charts to tabs ( #9475 )
2025-10-01 17:39:31 +00:00
Michael Fröhlich and GitHub
7377a313e5
chore(billing): require credit card only on non-zero checkout sessions ( #9467 )
...
* handle upgrades w/o credit card
* fix flickering of error message
* fix flag
2025-10-01 16:11:53 +00:00
Hassieb Pakzad and GitHub
a1e7867a35
test(otel): add test for completion start time parsing ( #9456 )
...
* test(otel): add test for completion start time parsing
* push
2025-10-01 16:00:28 +00:00
Marc Klingen and GitHub
6081187466
fix: set postgres timezone to UTC across docker compose files (dev and prod) ( #9472 )
2025-10-01 18:07:09 +02:00
Hassieb Pakzad and GitHub
adb40d1bb1
chore(llm-connections): move test suite to separate run ( #9464 )
...
* chore(llm-connections): move test suite to separate run
* push
* push
* push
2025-10-01 15:30:40 +00:00
Max Deichmann and GitHub
f1601bb38d
fix: show input/output/total columns in traces table correctly ( #9468 )
...
* fix: show input/output/total columns in traces table correctly
* fix: show input/output/total columns in traces table correctly
* fix: show input/output/total columns in traces table correctly
2025-10-01 14:55:30 +00:00
marliessophie and GitHub
466d7e32c5
fix(natural-language-filters): show only on traces table ( #9466 )
2025-10-01 14:13:01 +00:00
Steffen Schmitz and GitHub
819fa50f2e
chore: remove AMT documentation and background migration ( #9465 )
2025-10-01 16:00:08 +02:00
Steffen Schmitz and GitHub
2d000cb826
chore: clear up unused entities in clickhouse ( #9151 )
...
* chore: clear up unused entities in clickhouse
* chore: patch
* chore: patches
2025-10-01 13:54:29 +00:00
Hassieb Pakzad and GitHub
d953606e2f
fix(llm-schema-dialog): remove unnecessary event handler ( #9463 )
...
* feat(prompt-experiments): allow for structured output
* push
* remove propagation from submit in createoreditllmschema
* push
* add output_schema to trace metadata
* push
* push
* push
* push
* fix(create-llm-schema-dialog): remove unnecessary event handling
* push
2025-10-01 13:17:06 +00:00
Steffen Schmitz and GitHub
3611fc3b4e
perf: add output score index to job_executions table ( #9434 )
2025-10-01 12:09:49 +00:00
Hassieb Pakzad and GitHub
fedfe24ec4
feat(prompt-experiments): allow for structured output ( #9437 )
...
* feat(prompt-experiments): allow for structured output
* push
* remove propagation from submit in createoreditllmschema
* push
* add output_schema to trace metadata
* push
* push
* push
* push
2025-10-01 11:58:59 +00:00
Valery Meleshkin and GitHub
9842d842d8
fix: change tRPC error code for ClickHouse errors ( #9459 )
2025-10-01 11:39:37 +00:00
Hassieb Pakzad
6cd98d2cd8
chore: release v3.114.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-10-01 11:24:25 +02:00
Hassieb Pakzad and GitHub
23300f9db8
fix(otel): completion start time parsing to handle JSON stringified values ( #9455 )
2025-10-01 09:15:08 +00:00
Nimar and GitHub
5427d3f74f
fix(trace-ui): make row label sticky for long cells ( #9454 )
...
* feat(trace-ui): make row label sticky for long cells
* simplify
2025-10-01 08:19:13 +00:00
Max Deichmann and GitHub
a43fbc8a74
chore: upgrade golang migrate 4.19.0 ( #9444 )
...
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: upgrade golang-migrate
2025-10-01 07:22:25 +00:00
8d9c059572
fix: add current datetime to ai filter prompt ( #9445 )
...
* Add current datetime to AI prompt context
Co-authored-by: marc <marc@langfuse.com >
* Refactor datetime formatting for AI prompt
Co-authored-by: marc <marc@langfuse.com >
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-30 21:01:21 +00:00
Hassieb Pakzad and GitHub
37002f39bd
test(llm-connections): add tests for all adapters ( #9423 )
...
* test(llm-connections): add tests for all adapters
* test(llm-connections): add tests for all adapters
* fix
* fix
* push
* push
2025-09-30 17:13:39 +00:00
c7de984fb1
fix: Accept any 2xx status for webhooks ( #9439 )
...
feat: Accept 2xx status codes for webhook success
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-30 17:02:49 +00:00
Nimar and GitHub
1d3ad16710
chore: upgrade turborepo to 2.5.8 ( #9337 )
...
* chore: upgrade turborepo to 2.5.8
* add comments
* comments
* fix for turbo plugin default exports
2025-09-30 16:58:15 +00:00
17a358a1c2
feat(trace-ui): natural language filters ( #9347 )
...
* add fetchCompletion route
* use fetchLLMCompletion function
* chore(llm): add execution context to fetchLLMCompletion function
* add router
* chore: refactor to add resolveBedrockCredentials
* feat(env): add optional AWS Bedrock configuration
* chore: revert langfuse execution context for fetch llm completion
* frontend poc
* use bedrock keys
* chore(organization): add aiFeaturesEnabled column
* feat(organization): update organization update procedure to include optional aiFeaturesEnabled
* add route integrated
* add env vars
* update
* add proejct id
* fixup: ai feature toggle
* fully integrated
* fix: organization ai feature settings
* update
* fix ts
* chore: remove env variables from shared
* chore: rename environment variables
* chore: enhance LLM completion context
* chore: fix typing
* typing
* no more token delegate
* add project id
* fix: filter completion should never throw an error, fallback to empty json
* chore: set up bedrock credentials for development
* chore: remove TokenCountDelegate from types
* fix: integrate organization AI feature checks in filter builder
* fix: use project hook over org hook
* send traces to langfuse cloud
* fix build
* fix buuild
* validate filters
* chore: eslint
* add debug
* don't greedy match
* add tooltip
* fix parsing
* update AI feature text
* fix lockfile
* chore(router): gate setting/using ai features on self hosted deployments
* chore: replace env variable usage with useLangfuseCloudRegion hook across components
* chore: integrate useLangfuseCloudRegion hook to conditionally render AI features in filter builder and AI feature switch components
* docs: update REVIEW.md with Langfuse Cloud environment usage guidelines
* link
* chore: add LANGFUSE_AWS_BEDROCK_MODEL to .env.dev.example and update its definition in env.mjs
* Update useFilterState.ts
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
Co-authored-by: Leo <5489276+leoweigand@users.noreply.github.com >
2025-09-30 15:19:04 +00:00
Fabian Reinold and GitHub
7e76fbfcb4
feat(auth): add support for Keycloak scope and ID token configuration ( #9359 )
...
* feat(auth): add support for Keycloak scope and ID token configuration
* fix(auth): update ID token envvar handling to use default value
2025-09-30 14:16:40 +00:00
Hassieb Pakzad and GitHub
aa5b5fb8a9
fix(otel): preferential parsing of environment key from span attributes ( #9432 )
2025-09-30 13:12:27 +00:00
Steffen Schmitz and GitHub
c084d19c2d
fix: skip JSON parsing for completion start time strings ( #9418 )
2025-09-30 11:43:31 +00:00
marliessophie and GitHub
23e765fc35
style(dataset-item): detail view to show item IO and past runs in two tabs ( #9419 )
2025-09-30 09:03:02 +00:00
Nimar
f60286f13d
chore: release v3.113.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-30 09:02:29 +02:00
Nimar and GitHub
0f43240c35
feat(playground): add support for claude sonnet 4.5 ( #9410 )
...
* feat(playground): add support for claude sonnet 4.5
* fix id
* cuid2
* upgrade langchain
2025-09-30 06:59:51 +00:00
Max Deichmann and GitHub
dc4e94a68b
chore: do not upgrade to postgres 18 ( #9407 )
...
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
* chore: do not upgrade to postgrs 18
2025-09-29 20:00:33 +00:00
Nimar and GitHub
fd98cd4cd7
chore: filter browser extensions from sentry errors ( #9405 )
2025-09-29 17:59:58 +00:00
Nimar and GitHub
a1f09a2e30
fix(prompts): don't throw on prompt deletion message ( #9387 )
...
* vibe
* cleanup
2025-09-29 17:23:10 +00:00
decac0cd5a
fix(billing): Fix invoice table decimal display ( #9399 )
...
Fix: Ensure consistent USD formatting in billing table
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-09-29 18:36:17 +02:00
Nimar and GitHub
17e600f65e
chore: enable browser logs in terminal ( #8935 )
2025-09-29 15:15:53 +00:00
Steffen Schmitz and GitHub
0540828e21
chore: use otel ingestion queue by default ( #9397 )
2025-09-29 13:46:06 +00:00
Max Deichmann and GitHub
4f9d7b0e60
chore: update clickhouse writer batch size ( #9396 )
2025-09-29 13:15:14 +00:00
Leo Weigand and GitHub
a940fa40d9
fix: always respect to in date range filters ( #9393 )
2025-09-29 12:37:50 +00:00
Steffen Schmitz and GitHub
ab2007a627
perf: avoid updates on session ingest ( #9392 )
2025-09-29 11:58:17 +00:00
marliessophie and GitHub
9b8868ac97
feat(score-configs): support mutability ( #9218 )
...
* chore(score-configs): extract score domain types and unify validation
chore: fix types
chore: add documentation
chore: types
chore: rename types
chore: rename types
chore: fix test type imports
chore: validation tweaks
chore: types
chore: types
* chore: remove dead code
* chore: handle custom errors for score categories
* chore: simplify
* feat(score-configs): support mutability (#9143 )
* fix(scores): refactor validateConfigAgainstBody to support context-based validation
* fix: chore
* fix: chore
* chore(scores): display removed categorical score values as outdated and mark stale
* fix(scores): enrich categories with outdated status and streamline return logic
* fix(scores): handle empty categories in enrichCategories function
* fix(scores): handle empty categories in enrichCategories function
2025-09-29 11:11:27 +00:00
Marc Klingen and GitHub
4f6e917cd7
feat(ui): add search bar to members table ( #9339 )
...
* feat: add search bar to members table
* push
2025-09-25 14:56:24 +02:00
Nimar and GitHub
da51c01f35
fix(otel-mapper): null model props shouldn't cause map to generation ( #9308 )
...
* fix(otel-mapper): empty model properties shouldn't cause map to generation type
* fix test name
* fix the bug
* cleanup
2025-09-25 07:49:29 +00:00
Michael Fröhlich and GitHub
4aeea98b56
fix(billing): Fix base-fee aggregation for legacy billing ( #9328 )
...
Fix base-fee aggregation for legacy billing
2025-09-24 18:18:00 +00:00
Steffen Schmitz and GitHub
917e35a1b3
perf: remove unused join for job exec status aggregation ( #9230 )
2025-09-23 10:29:01 +00:00
marliessophie and GitHub
2e0a548e6f
feat(datasets): support filtering on per-run-basis in compare table ( #9098 )
...
* fixup(datasets-compare): support front-end column filtering
- Added column filtering capabilities to the DatasetCompareRunsTable and DatasetRunAggregateColumnHelpers.
- Introduced useColumnFilterState hook for managing filter state with URL persistence.
- Updated DatasetRunItemsByRunTable to accept multiple dataset run IDs.
- Enhanced PopoverFilterBuilder to support different button variants for filter actions.
- Refactored related components to integrate new filtering features.
* chore: remove fetching of run items data in compare view
* chore: move filter logic into useDatasetRunAggregateColumns
* chore: extend useColumnFilterState
* chore(scores): add ScoreDataType and ScoreDataTypeDomain
* chore: move state out of useDatasetRunAggregateColumns
* chore(dataset-run-items): enhance DatasetRunItem types and converters for optional IO support
* chore: refactor compare data fetching to support one API route
* feat: support filtering on compare view
* feat: add FilteredRunPills component for enhanced filtering display in compare view
* chore: eslint
* chore: simplify and refactor
* chore: push
* fix import
* chore: remove console log
* chore: drop first approach of pulling dataset item ids from postgres
* chore: rename trpc route
* tests: adjust non filter tests
* chore: rename dataset repository helper functions
* chore: add intersection query
* chore: push
* chore: debounce updateRunFilters
* chore: add filter synchronization for run IDs in DatasetCompareRunsTable
2025-09-23 08:56:47 +00:00
Hassieb Pakzad and GitHub
f9222c526f
feat(otel): add llm.response.model parsing ( #9261 )
2025-09-23 06:56:07 +00:00
Hassieb Pakzad and GitHub
5cb61d6a96
fix(llm-tools-and-schemas): allow periods in names ( #9296 )
2025-09-23 06:55:58 +00:00
Hassieb Pakzad and GitHub
463ada23ca
fix(models): drop preview from gemini-2.5-flash-lite ( #9299 )
2025-09-22 18:20:23 +00:00
b2d22a0720
fix(billing): Add delimiting line to support emails ( #9292 )
...
Fix typo in support chat auto-reply
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-09-22 13:39:02 +00:00
Marc Klingen and GitHub
fd1f1786da
chore(cloud): limit org members to 2 on free plan to be in line with pricing/packaging ( #9291 )
2025-09-22 15:17:31 +02:00
Max Deichmann and GitHub
56598597df
chore: remove hosting of ..-in-the-middle packages ( #9288 )
...
push
2025-09-22 11:04:10 +00:00
ea71c40ecb
fix(billing): Hide promotion code for hobby plan users ( #9286 )
...
feat: Hide discount view for Hobby plan users
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: michael <michael@langfuse.com >
2025-09-22 12:05:27 +02:00
Max Deichmann and GitHub
20cc20f908
chore: enable turborepo ( #9275 )
...
* chore: enable turborepo
* chore: enable turborepo
* chore: enable turborepo
2025-09-22 09:08:49 +00:00
Michael Fröhlich and GitHub
6326a6d788
fix(billing): Avoid 500s through uninitialized stripe client in dev environment ( #9276 )
...
make getUsage endpoint nullable to aoid 500s for developers in dev mode without stripe secret
2025-09-21 11:07:30 +00:00
Max Deichmann and GitHub
286f7ea29f
chore: upgrade axios ( #9265 )
...
chore: upgrade zxios
2025-09-19 18:49:08 +00:00
Michael Fröhlich and GitHub
700921f69f
feat(billing): Add option to add discount code to active subscriptions from settings menu ( #9235 )
...
* Add dialog to add discounts to running subscriptions
* reset opId
2025-09-19 16:51:52 +02:00
Leo Weigand and GitHub
9e3379f05f
feat: improved time range filtering ( #9252 )
...
* feat: better relative date range selects
* fix: date picker styles
fixes LFE-6702
* add TimeRangePicker
* use TimeRangePicker in traces view
* update dashboards and tables to use TimeRangePicker
* missed fixes due to updated time range utils
* simplify
* update remaining
* remove old timestamp filter
* address comment
* silence codespell false-positive
* fix badge heights
2025-09-19 14:05:55 +00:00
marliessophie and GitHub
bc178010c1
fix(dataset-runs): during loading states render skeletons for charts ( #9258 )
2025-09-19 13:55:43 +00:00
marliessophie and GitHub
47a1cb24a3
style(experiments-compare): sort scores alphabetically in cell ( #9253 )
2025-09-19 12:43:38 +00:00
Valery Meleshkin and GitHub
312d97f509
fix: ensure cases when CH outputs an error as a row are handled ( #9238 )
...
ClickHouse has a quirk when it comes to handling exceptions mid response.
It will simply output a row with "exception" key inside, which is indistinguishable from
a query like `SELECT "my lovely string" AS exception;` may return.
This PR makes the best effort to convert such rows into errors and throws them.
See:
- https://github.com/ClickHouse/clickhouse-js/issues/332
- https://github.com/ClickHouse/ClickHouse/issues/75175
Ideally this should get fixed in the future versions of ClickHouse.
2025-09-19 12:12:04 +00:00
A. Wilcox and GitHub
7776462c9b
style: Fix grammar of org invite email subject ( #9239 )
2025-09-19 11:34:34 +00:00
Nimar and GitHub
aa8eabbc19
fix(otel-ingest): don't overwrite trace metadata->attributes from new observation ( #9247 )
...
* fix(otel-ingest): don't overwrite trace metadata from new observation
* update test
* skip test, not good
* skip test because it's not getting the entire trace
2025-09-19 11:29:12 +00:00
Valery Meleshkin and GitHub
f4caacabdb
fix: improve error message for CH memory issues on public API ( #9191 )
...
* fix: improve error message for CH memory issues on public API
* fix(ui): surface ClickHouse error message providing a bit of advice to the user.
2025-09-18 22:49:39 +00:00
Nimar and GitHub
7892ff521d
fix(trpc): show toast on trpc error to user ( #9231 )
2025-09-18 17:14:44 +00:00
Michael Fröhlich and GitHub
45215cb4ff
feat(billing): Allow past subscribers see their invoices ( #9232 )
...
* Allow users on hobby plan to see past invoices
* Fix linter errors
2025-09-18 14:42:01 +00:00
Michael Fröhlich and GitHub
5404119473
fix(billing): automatically cancel and invoice stripe subscriptions when an org is deleted ( #9228 )
...
* cancel stripe subscription on invoice delete
* Update organizationRouter.ts
2025-09-18 16:15:58 +02:00
Hassieb Pakzad and GitHub
7769cb9d2a
chore: run sdk-api-spec-bot on changes in fern dir only ( #9229 )
2025-09-18 15:59:34 +02:00
Hassieb Pakzad and GitHub
0b68c410cf
chore(sdk-api-spec-bot): auto add reviewer ( #9227 )
2025-09-18 15:46:55 +02:00
Hassieb Pakzad and GitHub
efa6fe7e6a
chore: update sdk-api-spec bot for js sdk ( #9226 )
2025-09-18 15:37:11 +02:00
Michael Fröhlich and GitHub
16f41f809a
feat(billing): show active promotion codes in billing settings #9210 ( #9221 )
...
* add label for discounts
* remove logging statement
2025-09-18 13:16:57 +00:00
Hassieb Pakzad and GitHub
a7d59d7bb2
chore: update sdk-api-spec bot ( #9222 )
2025-09-18 14:57:59 +02:00
Michael Fröhlich and GitHub
291abf3205
chore(billing): Update price label for core plan ( #9216 )
...
update core price to 29 USD
2025-09-18 13:22:34 +02:00
Leo Weigand and GitHub
5df5a7cd48
chore(single-trace): make tree a little more dense and allow click everywhere ( #9183 )
...
* fix(single-trace): tree slightly more compact, allow click anywhere
* simplify tree node layout and make more robust
* make lint pass
2025-09-18 10:14:55 +00:00
marliessophie and GitHub
ac2936d316
fix(experiment-form-ui): prevent event bubbling from embedded form submission handlers ( #9215 )
2025-09-18 10:12:22 +00:00
Steffen Schmitz and GitHub
0335dcd18d
fix: include session scores in posthog export ( #9214 )
2025-09-18 10:06:20 +00:00
27cfbb14a1
feat: show last authentication method on login ( #9194 )
...
* Refactor: Add last used auth method persistence
Co-authored-by: leo <leo@langfuse.com >
* Refactor: Use useLocalStorage hook for auth method persistence
Co-authored-by: leo <leo@langfuse.com >
* Refactor SSOButtons to use parent-managed last used method
Co-authored-by: leo <leo@langfuse.com >
* Refactor: Conditionally show "Last used" badge on sign-in
Co-authored-by: leo <leo@langfuse.com >
* refactor styles
* pass lint
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-18 10:02:03 +00:00
marliessophie and GitHub
4c5828dade
fix(experiments-ui): resolve composed prompts for prompt-experiment setup ( #9211 )
...
* fix(experiments): resolve composed prompts for prompt-experiment setup
* chore: guard
2025-09-18 09:49:10 +00:00
2c9afcc58b
feat(billing): new billing setup ( #9053 )
...
* Michael/lfe 6645 (#9046 )
* refactor billing settings and cancel button
* refactor billing components
* chore(stripe): bump stripe from 17.4.0 to 18.5.0.basil (#9050 )
* bump stripe api version to 18.5.0.basil
* update stripeAPIHandler to 18.5.0
* update cloud billing router and add log statements
* Show stripe buttons only with active subscription
* remove logging statements
* feat(billing): show plan end in billing settings (#9052 )
* update cloudConfigSchema with metadata field for scheduled cancellations
* add function to unpack cancellation metadata in subscription.update webhook
* store cancellation metadata in db
* add and aggegregation option to LocalIsoDate component
* add BillingCurrentPlanLabel component to indicate cancelled plans
* add title prop to StripeCustomerPortalButton for better accessibility
* remove text from label
* fix(billing): cancel pending cancellations on plan switches (#9076 )
cancel pending cancellations on plan switches
* feat(billing): distinguish between new subscriptions and legacy subscriptions (#9078 )
* add orderKeys to distinguish between upgrades and downgrades of subcriptions
* add optional activeUsageProductId to cloudConfig schema
* add legacy Plan flag on cloudConfig.stripe schema
* set usageProductId in webhook callback
* feat(billing): Add new billing logic and update stripe integration (#9096 )
* update stripe usage product id to match sandbox
* update to cloudBillinRouter.createCheckoutSession to deal with legacy and new prices
* add orderKeys and replace them with monthly price to distinguish upgrade and downgrade paths
* update cloudBillingRouter.changePlan mutation to deal with different upgrade paths
* update stripeWebHookApiHandler to listen for subscriptionSchedule events
* update cloudConfig schema to store subscription schedule metadata
* extract formatLocalIsoDate into own function
* add useBillingInformation hook for common ui-billing operations
* Add BillingScheduleNotification component to indicate to user when their subscription is cancelled or scheduled to change
* refactor billing component to use new hook
* add managed cancellation button
* fix planSwitch info overrides on schedule.update callbacks
* remove logging statements
* add buttons to isolate strip cancelation, plan continuation, and switching
* refacor billingSwitchPlanDialog
* fix linter errors
* fix bug where released schedules where released
* fix Billing Portal ui issue
* add support for legacy plans to enable testing on staging
* clear cancellationInfo and planSwitchScheduleInfo on customer.subscription.deleted webhook
* extract condition into variable
* fix typo
* Add invoice table
* fix unstable ref causing rerenders
* fix uneccessary cast
* feat(billing): invoice table in billing settings (#9134 )
* Add invoice table
* fix unstable ref causing rerenders
* fix uneccessary cast
* update webhooks to allow externally triggered subscription schedules
* nit
* feat(billing): Rewrite Billing Service to Reduce Complexity and Minimize Data Drift Risks (#9169 )
* refactor code for more effective refetches
* Refactor cloudBillingRouter into BillingService
* Add Idempotency keys for unique stripe ops, add logging and auditLogs, Refactor for cleaner dx
* Add env checks to stripe webhook handler
* Add env checks to stripe webhook handler
* add review comments
* standardize logger statements
* Add new readme
* update plan switch/cance/reactivate explanation messages
* Add fallbacks in org resolution to webhook, to deal with susbcriptions created from the dashboard
* fix linter errors
* remove comment
* fix build errors
* implement review comments
* add discount column to invoice table
* update orderkey of core plan to reflect new price
* fix(billing): apply existing discounts to new subscription phase when updating via subscription schedule (#9199 )
* safeguard against illegal invoice.createPreview call and apply discounts on subscription schedule change
* fix typo
* add docstrings to stripeIdempotencyKey.ts
* update productId for prod
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-09-18 11:11:02 +02:00
Nimar
d401d42377
chore: release v3.112.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-18 10:51:49 +02:00
marliessophie and GitHub
322c767a33
fix(datasets): update score filters to handle empty run lists in DatasetRunsTable and DatasetCompare components ( #9209 )
2025-09-18 08:14:56 +00:00
Hassieb Pakzad
53726d58bf
Revert "chore: update fern python generator ( #9203 )"
...
This reverts commit 63feb943a4 .
2025-09-17 22:54:54 +02:00
Hassieb Pakzad and GitHub
63feb943a4
chore: update fern python generator ( #9203 )
2025-09-17 22:18:27 +02:00
Hassieb Pakzad and GitHub
6379c7c54b
chore: update sdk-api-spec bot ( #9197 )
2025-09-17 18:39:48 +02:00
Hassieb Pakzad and GitHub
69b3b81771
chore: update sdk-api-spec bot ( #9195 )
2025-09-17 18:30:59 +02:00
marliessophie and GitHub
668d1b6933
fix(llm): OpenAI llm completion reasoning model checks and token adjustments ( #9174 )
2025-09-17 15:48:42 +00:00
Nimar and GitHub
d7069df433
fix(trace-ui): don't render markdown if content too big ( #9190 )
...
* add key to json viewer
* don't render markdown if there are too many characters
* bump posthog
* cleanup
* restore
2025-09-17 17:55:08 +02:00
Hassieb Pakzad and GitHub
83d3009331
chore: add sdk-api-spec bot ( #9193 )
2025-09-17 17:40:03 +02:00
Hassieb Pakzad and GitHub
688659c597
chore: add sdk-api-spec bot ( #9192 )
2025-09-17 17:26:40 +02:00
marliessophie and GitHub
63ec00efe9
feat(api): GET /scores support for filtering by sessionId ( #9176 )
...
* feat(api): GET /scores support for filtering by sessionId
* chore: test
2025-09-17 15:14:42 +00:00
Steffen Schmitz and GitHub
a11b5ffa92
chore: switch docker compose cluster to bitnami legacy ( #9188 )
2025-09-17 17:01:08 +02:00
Hassieb Pakzad and GitHub
72bf6a75c1
chore: add sdk-api-spec bot ( #9187 )
2025-09-17 16:50:01 +02:00
Hassieb Pakzad and GitHub
92b11374d9
chore: add sdk-api-spec bot ( #9184 )
...
* chore: add sdk-api-spec bot
* Update web/package.json
2025-09-17 16:42:34 +02:00
marliessophie and GitHub
828c3ff7be
fix(llm-completion): add transformations for providers requiring a user message ( #9162 )
2025-09-16 16:27:52 +00:00
7b35cb0e99
docs: mention SLACK_STATE_SECRET env var as a required one ( #9121 )
...
* docs: mention SLACK_STATE_SECRET env var as a required one
Signed-off-by: ajatprabha <ajat.prabha.leo@gmail.com >
* Update README.md
---------
Signed-off-by: ajatprabha <ajat.prabha.leo@gmail.com >
Co-authored-by: Nimar <l.nimar.b@gmail.com >
2025-09-16 16:14:58 +00:00
Leo Weigand and GitHub
8d5c445dc5
fix(tables): cmd+click opens traces and observations in a new tab ( #9161 )
2025-09-16 16:00:26 +00:00
Marc Klingen and GitHub
c752af2201
chore(cloud): remove eval count limit from hobby/free plan ( #9158 )
2025-09-16 16:38:05 +02:00
Steffen Schmitz and GitHub
03f6204797
chore: add debugging log for invalid start_time in batch exports ( #9150 )
2025-09-16 07:51:54 +00:00
Steffen Schmitz and GitHub
c33708e5db
fix: fetch environment options from raw data ( #9141 )
...
* fix: fetch environment options from raw data
* chore: drop stuff
* chore: patch
* chore: always add default
* chore: adjust mapping logic for correctness
* chore: drop materialized views to fill project_environments
* chore: remove migration files
2025-09-16 07:30:36 +00:00
Marc Klingen and GitHub
4c2c3d21c7
chore: move readme images to github assets ( #9142 )
2025-09-15 16:51:55 +02:00
Hassieb Pakzad and GitHub
9a09fa2ad0
fix(ingestion-service): skip tokenization for obs level ERROR ( #9133 )
2025-09-15 13:11:05 +00:00
Steffen Schmitz and GitHub
43e0644c64
perf: drop final on check trace exists ( #9117 )
...
* perf: drop final on check trace exists
* chore: only apply final on eval check if non-id filter is used
* chore: skip full query if not needed
* chore: revert query changes
* chore: simplify condition
* chore: add metrics
2025-09-15 11:11:12 +00:00
Marc Klingen and GitHub
c5be145a53
docs: add note re otel to ingestion endpoint api reference ( #9135 )
2025-09-15 10:29:09 +00:00
Nimar and GitHub
3a002f03d5
chore: upgrade sentry v8 -> v10 ( #8934 )
...
* chore: upgrade sentry v8 -> v10
* fix source maps
* make pnpm-lockfile single quoted as is on main
* move sentry config to new file
2025-09-15 09:53:23 +00:00
Nimar and GitHub
c785156220
fix(datasets): graphs not readable in dark mode ( #9132 )
2025-09-15 09:05:47 +00:00
Max Deichmann
6f8627ed86
chore: release v3.111.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-15 08:27:37 +02:00
6a7034a5ad
chore: Check tracing configuration for data retention ( #9045 )
...
* Refactor: Rename hasAnyTrace to hasTracingConfigured
Co-authored-by: max <max@langfuse.com >
* chore: upgrade posthog repository
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-14 16:16:12 +00:00
Max Deichmann and GitHub
29443bcdbd
chore: upgrade posthog repository ( #9126 )
2025-09-14 16:11:51 +00:00
Steffen Schmitz and GitHub
9f066a285f
feat: export non-trace scores via posthog integration ( #9103 )
2025-09-12 15:15:34 +00:00
Steffen Schmitz and GitHub
664bd3596e
chore: increase default throughput on create eval queue ( #9108 )
2025-09-12 14:16:41 +00:00
Leo Weigand and GitHub
bad27d2625
fix(table): tags wrapping and being cropped ( #9107 )
2025-09-12 13:52:48 +00:00
Leo Weigand and GitHub
4da02c1ebe
fix(design-system): hover card layering ( #9106 )
2025-09-12 13:17:21 +00:00
Max Deichmann and GitHub
65bd0bf5c1
perf: move more endpoints to read only ( #9105 )
2025-09-12 14:38:05 +02:00
Marc Klingen and GitHub
b1ee21fc34
docs: update dependency list in readme ( #9102 )
...
* docs: update readme
* push
2025-09-12 12:20:29 +02:00
Hassieb Pakzad and GitHub
b894e8a620
fix(quickstart): update langchain js import ( #9093 )
2025-09-11 16:48:32 +00:00
Max Deichmann and GitHub
aa39af94fb
chore: move reads to read replica ( #9091 )
...
* chore: mve reads to read replica
* chore: mve reads to read replica
2025-09-11 16:42:05 +00:00
b1880ddb82
feat(support):Include ticket id in email subject ( #8991 )
...
* feat: Add unique ID to support thread titles
Co-authored-by: marc <marc@langfuse.com >
* add nanoid package
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: froemic <m.froehlich1994@gmail.com >
Co-authored-by: Michael Fröhlich <15179255+FroeMic@users.noreply.github.com >
2025-09-11 15:12:22 +00:00
Valery Meleshkin and GitHub
19e9da214e
fix(otel): Make sure we do not process empty otel events ( #9082 )
...
* fix: Make sure we do not process empty otel events
* chore: fix a typo
* chore: addressing review comments.
2025-09-11 13:36:17 +00:00
Hassieb Pakzad and GitHub
2e698c8ec0
chore: bump langchain anthropic ( #9087 )
2025-09-11 15:14:34 +02:00
Marc Klingen and GitHub
46feb262ec
chore(cloud): switch to in-app support for sso setup to replace email ( #9086 )
2025-09-11 12:41:17 +00:00
steffen911
23b830074a
chore: release v3.110.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-11 14:12:21 +02:00
Steffen Schmitz and GitHub
fa5908a749
feat: add api endpoint to configure blob storage integration ( #9047 )
...
* feat: add api endpoint to configure blob storage integration
* chore: add test suite and generated API docs
* chore: add implementation
* chore: simplify delete endpoint
* chore: PUT route cleanups
2025-09-11 12:05:12 +00:00
Steffen Schmitz and GitHub
26045d089c
perf: add a global concurrency limit to the createEvalQueue ( #9077 )
2025-09-11 12:09:28 +02:00
Steffen Schmitz and GitHub
edfb15c010
feat: add gcp vertex tool inputs and outputs on otel spans ( #9074 )
2025-09-11 08:15:28 +00:00
marliessophie and GitHub
1f76ae650f
fix(peek): safe parse runs url parameter in compare data hook ( #9073 )
2025-09-11 07:44:16 +00:00
36dc608b58
chore(worker): Move nodemon to tsx for reloads from packages/shared ( #8801 )
...
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-09-11 00:36:02 +02:00
Jannik Maierhöfer and GitHub
bc0735729f
fix(ui): update JS/TS SDK v4 notification ( #9064 )
2025-09-10 18:58:53 +00:00
88e553734e
chore: avoid otel alerts about public key mismatch on worker ( #9063 )
...
* chore: avoid otel alerts about public key mismatch on worker
* Update worker/src/queues/otelIngestionQueue.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-09-10 18:58:10 +00:00
Jannik Maierhöfer and GitHub
bd5495321e
fix(ui): remove slack support from pro tier ( #9059 )
2025-09-10 17:33:04 +00:00
e8ebfb8e3e
feat(ui): add notification card for JS SDK v4 GA ( #9022 )
...
* feat(ui): add notification card for JS SDK v4 GA
* Update web/src/components/nav/sidebar-notifications.tsx
* Update web/src/components/nav/sidebar-notifications.tsx
* Update web/src/components/nav/sidebar-notifications.tsx
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-09-10 16:47:34 +00:00
Leo Weigand and GitHub
8c076b6b50
fix(tooltip): portal content ( #9055 )
2025-09-10 16:24:13 +00:00
Hassieb Pakzad and GitHub
2cdc3cab7f
fix(otel): add root span metadata to trace ( #9054 )
2025-09-10 16:04:37 +00:00
Leo Weigand and GitHub
729c2132af
feat(sessions): add trace detail peek view and clean up layout ( #9042 )
...
* chore: add richer seed data for sessions
* session styling improvements
* support peek view in session detail
* fix formatting switch padding
* add usePreserveRelativeScroll hook
* button improvements
* move buttons and trace detail link
* columns adjustment
* finalise card layout
* prettify aggr metrics header
* tidy up paddings
* refactor to new peek view hook
* a bit more tidying up
* fix types
2025-09-10 12:44:23 +00:00
marliessophie and GitHub
d3627bf225
feat(dataset-run-items): pin dataset item id column in ui table ( #9040 )
2025-09-10 12:27:28 +00:00
Max Deichmann
05b87199ec
chore: release v3.109.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-10 13:52:40 +02:00
a618d53451
fix: require admin api key for background migration retries in OSS ( #9028 )
...
* feat: Add admin API key authentication for retrying migrations
Co-authored-by: max <max@langfuse.com >
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
* fix: deny background migrations on LF cloud
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-10 09:09:55 +00:00
Matthew Lapointe and GitHub
9907c39861
chore: ip allowlist for webhooks ( #8977 )
2025-09-10 08:49:22 +00:00
marliessophie and GitHub
4c8594e47a
feat(dataset-run-items-ui): support score filters in UI table ( #8993 )
...
* feat(dataset-run-items-ui): support score filters in UI table
* chore: add dataset run item scores to seeder
* chore: make datasetid optional
* chore: drop dataset item id from scores CTE
2025-09-10 08:15:06 +00:00
marliessophie and GitHub
a69609229a
style: increase tooltip and sidebar toggle z-index ( #9035 )
2025-09-10 07:51:44 +00:00
217ae648d6
chore: disallow background migrations on langfuse cloud ( #9027 )
...
* security: rename protectedprocedure
* fix: deny background migrations on LF cloud
* Update web/src/features/background-migrations/server/background-migrations-router.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-09-09 21:53:55 +00:00
Max Deichmann and GitHub
72e5b51398
fix: rename protectedprocedure ( #9026 )
...
security: rename protectedprocedure
2025-09-09 21:37:44 +00:00
0cbbf94568
chore(cloud): allow selection of HIPAA cloud region on sign-in/sign-up page ( #9024 )
...
* feat: Add HIPAA region and improve region selection
Co-authored-by: marc <marc@langfuse.com >
* Refactor: Remove unused state and simplify region logic
Co-authored-by: marc <marc@langfuse.com >
* Fix: Update BAA link to HIPAA security page
Co-authored-by: marc <marc@langfuse.com >
* Refactor AuthCloudRegionSwitch component for clarity
Co-authored-by: marc <marc@langfuse.com >
* delete weird file and prettier
* replace contact support on sign in with mailto link
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-09 22:28:08 +02:00
marliessophie and GitHub
61f4c3ac95
feat(tables-ui): pin columns in annotation and prompt metrics tables ( #9021 )
2025-09-09 17:50:59 +00:00
cc8f521741
fix(auth): on unsuccessful password-reset attempts (wrong OTP) delete verification tokens in db to reduce enumeration risk ( #9009 )
...
* Refactor: Use signIn with redirect: false for OTP verification
Co-authored-by: marc <marc@langfuse.com >
* nit
* revert button changes, not the focus of this pr
* push
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-09 17:17:06 +00:00
Marc Klingen and GitHub
540f8622e3
chore: fix password reset setup docs link ( #9020 )
2025-09-09 18:06:48 +02:00
marliessophie and GitHub
a7e3dec6f0
chore(peek): remove polling logic and dependency on table state from peek implementation ( #8885 )
...
* fixup(peek): isolate data fetching for peek view to depend on trpc and be independent of table state
* fix: rely only on url for peek state management
* fixup: drop complex peek logic
* refactor: replace createPeekHandler with usePeekNavigation for improved URL management in table components
* chore: all peek logic fixed except compare view and expand
* chore: refactor navigation logic
* chore: docs
* chore: clear url params also in row click navigation
2025-09-09 15:43:42 +00:00
Hassieb Pakzad and GitHub
5760d51c08
fix(otel): handle event observation type ( #9012 )
2025-09-09 09:52:17 +00:00
Lance and GitHub
59a75ce36c
fix: add explicit session_id alias in ClickHouse session_data CTE ( #9008 )
2025-09-09 09:38:23 +00:00
Max Deichmann and GitHub
9a6a79f458
chore: add email to auth span ( #9006 )
2025-09-09 08:45:40 +02:00
marliessophie and GitHub
2598f44036
fix(dataset-router): correct datasetItemIds value assignment in dataset filtering logic ( #8997 )
2025-09-08 14:23:02 +00:00
Steffen Schmitz and GitHub
f7e7b132dd
feat: allow custom select filters in dashboard widget flow ( #8995 )
2025-09-08 14:13:10 +00:00
521be4e0b6
fix(quickstart): update js examples ( #8918 )
...
* fix(quickstart): update js examples
* Update web/src/features/prompts/components/prompt-detail.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* push
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-09-08 12:29:07 +00:00
Steffen Schmitz and GitHub
a13b5d0d32
fix: use set utility for seen traces to fix cluster slot detection ( #8990 )
...
* fix: use set utility for seen traces to fix cluster slot detection
* chore: add review instruction
2025-09-08 12:08:26 +00:00
marliessophie and GitHub
ebe557881c
style(dataset-table-ui): reposition columns for run items making IO more prominent; drop repetitive columns ( #8983 )
...
* style(dataset-table-ui): reposition columns for run items making IO more prominent; drop repetitive columns
* chore: avoid triple negation
* chore: types
* fix: seeder
* fix: seeder
2025-09-08 09:55:57 +00:00
marliessophie and GitHub
5e8a9e3e80
feat(dataset-run-metrics): add total cost column to dataset runs table ( #8970 )
2025-09-08 08:38:16 +00:00
marliessophie and GitHub
ab115cdc19
feat(table-ui): pin all select columns for y-/x-overflow ( #8981 )
2025-09-08 07:50:14 +00:00
Henrique Cadioli and GitHub
18deee6434
chore: decouple upload file from url signing in storage service ( #8878 )
2025-09-08 07:37:32 +00:00
marliessophie and GitHub
977724a801
fix(dataset-run-items): depend on stable trpc properties ( #8973 )
2025-09-05 15:54:32 +00:00
marliessophie and GitHub
434c9be8a6
feat(dataset-runs-ui): fix select and name columns on y-/x-scroll ( #8967 )
...
* chore(table): rename isPinned to isFixedPosition
* chore(table): do not allow re-ordering fixed position columns
* refactor(table): update column visibility and order keys for dataset runs
* feat(dataset-runs): fix first two columns on y-/x-scroll
* chore: fixup
* chore: add comment
2025-09-05 14:49:07 +00:00
Michael Fröhlich and GitHub
06bb3bbf43
fix(support): improve context in initial support email ( #8966 )
...
update plain Router
2025-09-05 14:04:04 +00:00
marliessophie and GitHub
736f4762bc
fix(table-column-visibilty): show fixed position columns as unmoveable in visibility drawer ( #8968 )
...
* chore(table): rename isPinned to isFixedPosition
* chore(table): do not allow re-ordering fixed position columns
2025-09-05 13:57:23 +00:00
Leo Weigand and GitHub
4341b37ef3
fix(trace-detail): nested observations not expanded in timeline ( #8965 )
2025-09-05 13:03:04 +00:00
Nimar
95e07f2eb0
chore: release v3.108.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-05 15:06:20 +02:00
Steffen Schmitz and GitHub
242e33c2f6
chore: skip otel processing on empty batch ( #8964 )
...
* chore: skip otel processing on empty batch
* chore: actually return on empty
2025-09-05 13:00:46 +00:00
Marc Klingen and GitHub
01aa0b9ecd
chore: Update support.yml
2025-09-05 14:16:07 +02:00
Jannik Maierhöfer and GitHub
3c0a4c863a
feat(github-discussions): add structured form ( #8953 )
...
* feat(github-discussions): add structured form
* fix
2025-09-05 14:14:27 +02:00
Nimar and GitHub
d9954d14b1
fix(home): dashboard dark mode score analysis graph ( #8961 )
2025-09-05 13:57:22 +02:00
marliessophie and GitHub
7a2c5188cd
fix(playground): show user-friendly toast notification for JSON prettification; do not report to sentry ( #8957 )
2025-09-05 11:28:08 +00:00
Leo Weigand and GitHub
c7f62805c4
fix(tracing): spacings on single user page ( #8954 )
2025-09-05 09:34:02 +00:00
Nimar and GitHub
c23d1521ab
fix(home): chart axis in dark mode ( #8955 )
...
* fix(home): dashboard axis description dark mode
* fix tooltip
* more compact
2025-09-05 11:25:46 +02:00
Michael Fröhlich and GitHub
53b44454f6
feat(support): Send acknowledgement email to user on thread create ( #8950 )
...
* add reply-to call
* Add auto acknowledgement message
* add email version
* add demo version
* add reply-to logic
* bump message length
2025-09-05 09:04:32 +00:00
Nimar and GitHub
8bf6044b24
fix(home): home screen dashboard text in darkmode barely visible 2 ( #8951 )
...
fix(home): home screen dashboard text in darkmode barely visible user consumption chart
2025-09-05 10:31:51 +02:00
marliessophie and GitHub
a28877b9d9
chore(dataset-run-items): clean up deprecated code ( #8949 )
...
* chore(dataset-run-items): clean up deprecated code
* chore: fix
* chore: push
2025-09-05 07:59:51 +00:00
marliessophie and GitHub
902d8fc2f9
style(dataset-run-items): enhance dataset run name display ( #8948 )
2025-09-05 07:15:36 +00:00
marliessophie and GitHub
869851b974
perf(dataset-runs-metrics): utilise trace_id bloom filter in filtered observations ( #8947 )
2025-09-05 07:01:42 +00:00
Nimar and GitHub
f4118e451e
fix(home): home screen dashboard text in darkmode barely visible ( #8946 )
2025-09-05 01:13:54 +02:00
Michael Fröhlich and GitHub
a8471adcea
fix(support): improve form error and add new topic category ( #8941 )
...
* Add 'Other' category to topic select in support form
* enable submit button on uncomplete data and add form error
2025-09-04 20:01:04 +00:00
Max Deichmann and GitHub
2922387793
chore: revert turbo cache ( #8938 )
...
push
2025-09-04 19:21:01 +00:00
Nimar and GitHub
94124ac60c
fix(trace-timeline): cannot select items other than the first 2 ( #8939 )
2025-09-04 21:17:32 +02:00
Nimar and GitHub
69c91c5988
fix(trace-ui): make tracetree scrollable again ( #8936 )
2025-09-04 20:31:21 +02:00
dbb97ca511
chore: improve billing portal navigation, 2 buttons to make it more obvious ( #8921 )
...
* Add billing portal buttons with update and cancel options
Co-authored-by: marc <marc@langfuse.com >
* Apply suggestions from code review
* chore: empty commit
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-09-04 17:20:43 +00:00
Steffen Schmitz and GitHub
3e23f0c58e
perf: upload otel ingestion payloads as batch to blob storage ( #8893 )
2025-09-04 19:15:09 +02:00
Nimar and GitHub
e5d3659b64
fix(prompts): clicking dataset run crashes ui ( #8926 )
...
* fix(prompts): clicking dataset run crashes ui
* update hook form
* upgrade responsive
* fix bug!
2025-09-04 16:56:51 +00:00
Leo Weigand and GitHub
7b6b8b176b
fix(prompts): variables broken when copying prompt content ( #8931 )
2025-09-04 16:27:56 +00:00
marliessophie and GitHub
98151fa706
fix(dataset-run-items): pagination for single dataset run detail view ( #8927 )
...
* fix(dataset-run-items): pagination for single dataset run detail view
* chore: push
2025-09-04 16:14:26 +00:00
Leo Weigand and GitHub
0840ac1a9f
fix(traces): tag assignment opening trace detail ( #8928 )
2025-09-04 15:39:34 +00:00
Nimar and GitHub
7ad3818008
feat(agent-graphs): styling improvements ( #8917 )
...
* make it resizable
* grey not colourful
* graph direction
* basic keep graph in trace
* simplify
* no more
* cleanup
2025-09-04 15:21:33 +00:00
Steffen Schmitz and GitHub
3cbe3bd1bc
chore: terminate tokenizer workers before freeing them from memory ( #8925 )
2025-09-04 14:37:40 +00:00
Nimar and GitHub
0781cfb194
fix(trace): jumptoplayground can cause infinite loop ( #8922 )
2025-09-04 13:53:37 +00:00
Steffen Schmitz and GitHub
8c40cfc97d
fix: make redis recently-processed cache cluster-safe ( #8915 )
...
* fix: make redis recently-processed cache cluster-safe
* chore: add explanation on Promise.all for seen events cache
2025-09-04 12:55:02 +00:00
Hassieb Pakzad and GitHub
6bc996806b
fix(users-table): metrics to include full observation count ( #8914 )
2025-09-04 14:34:52 +02:00
b9e54d2a19
build: add caches to CI pipeline ( #8634 )
...
* build: add caches to CI pipeline
* chore: cleanup
---------
Co-authored-by: Nimar <l.nimar.b@gmail.com >
2025-09-04 12:32:03 +00:00
Nimar and GitHub
99fd7ca6ab
fix(ci): specify types tightly to not block merge queue ( #8916 )
2025-09-04 13:36:59 +02:00
3e083656fa
chore: upgrade to nextjs 15 & react 19 ( #8861 )
...
* chore: upgrade to nextjs v15
* update mui x-tree-view
* upgrade next themese
* update react-day-picker react-resizable-panels
* update sonner
* update next-query-params
* update react-email
* upgrade types react in shared
* upgrade next in ee
* next config remove now stable hook
* fix next-themes not exporting prop types directly anymore
* fix mui-x-tree peer dependency
* fix markdown viewer (ugly) to get around stricter typing
* add config to oltp protobus for nextjs15
* HACK: temp circumvent ApiRouteConfig typing
* TEMP: try nextjs15 workaround for SCIM
* try more ram
* not experimental no more
* moar memory
* update memory
* over 8000
* fix turbopack issues
* fix dockerfile
* default to turbo in web
* accept warnings for now
* cleanup
* cleanup
* remove tiktoken stuff
* chore: move obsevation type setting override to mapper (#8714 )
* chore: move obsevation type setting override to mapper
* simplify mapper
* map nicer
* simplify
* feat(single-trace): add copy button on value cell of json view (#8871 )
* fix: use leftUTF8 for input/output truncation on clickhouse (#8869 )
* chose: use leftUTF8 for input/output truncation on clickhouse
* chore: skip truncation linebreak
* fix(trace-detail): guard against zero latency in trace tree (#8874 )
fix(trace-detail): guard against zero latency
* chore: patch flaky trace repository test (#8870 )
* chore: bump dd-trace to 5.65.0 (#8882 )
* fix(prompts): subfolders hiding prompts (#8876 )
* fix(prompts): subfolders hiding prompts
* Update web/src/features/prompts/server/routers/promptRouter.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix da lint!
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix(trace-single-ui): fix unavailable ref (#8883 )
* fix(trace-single-ui): fix unavailable ref
* really fix it
* chore: release v3.106.4
* chore: add env note to review.md (#8888 )
* feat(table-ui): filter score columns to show score only if has value for given table (#8865 )
* feat(table-ui): filter score columns to show score only if has value for given table
* chore: refactor analytics
* chore: include dataset id in filter condition for DRI scores
* chore: fix tests
* chore: await data
* fixup-remove: upgrade to nextjs v15 (#8795 )
* chore: simplify query
* chore: remove getRunScoresGroupedByNameSourceType
* chore: push
* fix: stabilize hook dependency
* Revert "fixup-remove: upgrade to nextjs v15 (#8795 )"
This reverts commit 50b742325a82057f5dbfbe3f548d0610d3343f13.
* chore: eslint
---------
Co-authored-by: Nimar <l.nimar.b@gmail.com >
* update grid layout
* fix toggle
* ugly hack to make resizable work in turbopack
---------
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
Co-authored-by: Leo Weigand <5489276+leoweigand@users.noreply.github.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-09-04 12:55:49 +02:00
Michael Fröhlich and GitHub
ee80b102bc
fix(support): ensure correct assignment of tenant id ( #8909 )
...
add orgid to client playload and select correct context for current tenant
2025-09-04 12:08:51 +02:00
Marc Klingen and GitHub
7dcd2ad30f
ci: remove pr title check from merge_queue ( #8904 )
...
remove pr title check from merge_queue
2025-09-04 10:34:24 +02:00
Michael Fröhlich and GitHub
43a98141a8
feat(support): revamp in-app support experience ( #8875 )
...
* Add support form and drawer scaffolding
* style changes
* fix flickering
* style support drawer into section
* update form
* refactor to use useForm hook
* add initial trpc router for creating chats
* add plainRouter and remove legacy chat
* refactor plain trpc route to fire and forget non-critical updates
* update success section
* add mobile support view
* make interaction type conditional
* add community section
* replace support-menu-dropdown with supportmenu-button
* add entitlement in-app-support to all cloud plans
* make plain call synchronous
* add file upload
* fix lint error
* remove unused code
* add first implementation of threadEvents
* remove auto-open on project create
* remove auto-open on tracing api generation
* remove comments
* remove old trpc route
* remove unused function
* simplify function return
* reduce input surface of createThread procedure
* simplified layout
* make drawer props more explicit
* remove duplicate threadFields
* remove misleading button
* refactor trpc router and plain client
* add support for uiCustomization
* remove plain chat from csp
* strict equality
* replace radio buttons
2025-09-04 08:16:05 +00:00
Nimar
cf3505805d
chore: release v3.107.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-03 18:08:56 +02:00
Nimar and GitHub
63fa75cc61
fix(ci): attempt fix title checker prevented push to docker ( #8892 )
...
* fix(ci): remove pr title checker
* add to pipeline
2025-09-03 17:22:02 +02:00
Steffen Schmitz and GitHub
a02ef20deb
perf: move tokenization in worker to worker thread ( #8554 )
...
* perf: move tokenization in worker to worker thread
* chore: linting
* chore: test timeouts
* duplicate worker file
* chore: linting
* chore: make async tokenization rate configurable
* chore: add note in worker-thread files on keeping them same
* chore: make pool size dynamic and add error fallback
* chore: pass text as is to tokenization
* chore: patch tracing behaviour
* chore: bump to 4 workers
* chore: linting
* chore: update span prop names
* chore: start with 2 workers
2025-09-03 12:57:57 +00:00
2deb588a57
feat(table-ui): filter score columns to show score only if has value for given table ( #8865 )
...
* feat(table-ui): filter score columns to show score only if has value for given table
* chore: refactor analytics
* chore: include dataset id in filter condition for DRI scores
* chore: fix tests
* chore: await data
* fixup-remove: upgrade to nextjs v15 (#8795 )
* chore: simplify query
* chore: remove getRunScoresGroupedByNameSourceType
* chore: push
* fix: stabilize hook dependency
* Revert "fixup-remove: upgrade to nextjs v15 (#8795 )"
This reverts commit 50b742325a82057f5dbfbe3f548d0610d3343f13.
* chore: eslint
---------
Co-authored-by: Nimar <l.nimar.b@gmail.com >
2025-09-03 12:08:35 +00:00
Marc Klingen and GitHub
f04fd76f6c
chore: add env note to review.md ( #8888 )
2025-09-03 13:24:35 +02:00
Nimar
d022a07263
chore: release v3.106.4
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / validate-pr-title (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-03 12:02:56 +02:00
Nimar and GitHub
94e8f0b592
fix(trace-single-ui): fix unavailable ref ( #8883 )
...
* fix(trace-single-ui): fix unavailable ref
* really fix it
2025-09-03 12:02:16 +02:00
5c8e4d641a
fix(prompts): subfolders hiding prompts ( #8876 )
...
* fix(prompts): subfolders hiding prompts
* Update web/src/features/prompts/server/routers/promptRouter.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix da lint!
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-09-03 09:12:41 +00:00
Steffen Schmitz and GitHub
2eebca4e42
chore: bump dd-trace to 5.65.0 ( #8882 )
2025-09-03 08:37:27 +00:00
Steffen Schmitz and GitHub
426d4b77b6
chore: patch flaky trace repository test ( #8870 )
2025-09-03 08:21:23 +00:00
Leo Weigand and GitHub
1e3f345f5b
fix(trace-detail): guard against zero latency in trace tree ( #8874 )
...
fix(trace-detail): guard against zero latency
2025-09-03 07:37:22 +00:00
Steffen Schmitz and GitHub
2d6e58136d
fix: use leftUTF8 for input/output truncation on clickhouse ( #8869 )
...
* chose: use leftUTF8 for input/output truncation on clickhouse
* chore: skip truncation linebreak
2025-09-02 16:41:40 +00:00
Nimar and GitHub
cf15ee5066
feat(single-trace): add copy button on value cell of json view ( #8871 )
2025-09-02 16:26:20 +00:00
Nimar and GitHub
816abfb59e
chore: move obsevation type setting override to mapper ( #8714 )
...
* chore: move obsevation type setting override to mapper
* simplify mapper
* map nicer
* simplify
2025-09-02 13:20:22 +00:00
Marc Klingen and GitHub
702dd6ac27
ci: check pr title for conventional commit ( #8862 )
2025-09-02 14:18:18 +02:00
Grégoire and GitHub
14fbeb1788
Map gen_ai.input/output.messages to input/output ( #8813 )
2025-09-02 06:35:58 +00:00
Nimar
fbf6110acf
chore: release v3.106.3
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-01 20:54:19 +02:00
Nimar and GitHub
ef950ae381
Revert "chore: upgrade to nextjs v15" ( #8853 )
...
Revert "chore: upgrade to nextjs v15 (#8795 )"
This reverts commit c24ac641e0 .
2025-09-01 20:53:42 +02:00
Nimar
79762e8eb0
chore: release v3.106.2
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-09-01 17:43:45 +02:00
Nimar and GitHub
c24ac641e0
chore: upgrade to nextjs v15 ( #8795 )
...
* chore: upgrade to nextjs v15
* update mui x-tree-view
* upgrade next themese
* update react-day-picker react-resizable-panels
* update sonner
* update next-query-params
* update react-email
* upgrade types react in shared
* upgrade next in ee
* next config remove now stable hook
* fix next-themes not exporting prop types directly anymore
* fix mui-x-tree peer dependency
* fix markdown viewer (ugly) to get around stricter typing
* add config to oltp protobus for nextjs15
* HACK: temp circumvent ApiRouteConfig typing
* TEMP: try nextjs15 workaround for SCIM
* try more ram
* not experimental no more
* moar memory
* update memory
* over 8000
* fix turbopack issues
* fix dockerfile
* default to turbo in web
* accept warnings for now
* cleanup
* cleanup
* remove tiktoken stuff
2025-09-01 15:08:22 +00:00
marliessophie and GitHub
9464e9bfbe
fix(datasets): do not rely on pagination in compare view ( #8842 )
...
* fix(datasets): do not rely on pagination in compare view
* fixup: test
* fixup: test
* fixup: test
2025-09-01 12:57:25 +00:00
Marc Klingen and GitHub
2893fc44db
chore: mention in docs that node 24 is required now ( #8846 )
...
* chore: mention in docs that node 24 is required now
* push
2025-09-01 15:28:45 +02:00
marliessophie and GitHub
6c0ecf75d0
chore(dataset-remote-run): validate remote run URL ( #8835 )
...
chore(dataset-remote-run): validate remote run URL in dataset router
2025-09-01 12:55:46 +00:00
Marc Klingen and GitHub
56ee375a71
feat(cloud): export onboarding survey responses to s3 ( #8841 )
...
feat: export survey responses to s3
2025-09-01 12:11:45 +00:00
marliessophie and GitHub
a54452e1c7
style(dataset-compare): improve layout and visibility of scores and resource metrics sections in output cells ( #8839 )
2025-09-01 09:21:18 +00:00
Srijan Dubey and GitHub
de4a158efb
Fix/keyboard shortcuts modifier handling ( #8824 )
...
* fix(keyboard): prevent list/sidebar actions when Cmd+K triggers global search
* fix(keyboard): refine shortcut handling by removing unnecessary modifier checks
2025-09-01 08:00:03 +00:00
Max Deichmann and GitHub
44ce6ef581
chore: validate IP adresses ( #8821 )
...
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
* chore: validate IP adresses
2025-08-29 16:42:56 +00:00
Nimar
65fc850d96
chore: release v3.106.1
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-29 17:11:39 +02:00
Nimar and GitHub
af35c65d06
fix: infinite recursion on graph render ( #8822 )
2025-08-29 15:07:34 +00:00
c0243c6703
fix(ui): docs link for remote dataset run ( #8818 )
...
Update docs link for dataset runs to remote run page
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-08-29 14:49:05 +02:00
Max Deichmann and GitHub
db11e91539
chore: add evals admin api ( #8803 )
2025-08-29 00:52:45 +02:00
Max Deichmann and GitHub
9aec4081e1
chore: fix eval attribute assignment ( #8802 )
...
push
2025-08-28 23:35:39 +02:00
Max Deichmann and GitHub
e6e40403fa
chore: Improve trace by id ch tagging ( #8799 )
...
* push
* chore: add span metrics for eval executions
* chore: add span metrics for eval executions
* push
2025-08-28 19:48:13 +00:00
Marc Klingen and GitHub
435b19098c
chore: bump plain sdk 5.10.3 ( #8797 )
2025-08-28 17:02:27 +00:00
Nimar
753a716724
chore: release v3.106.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-28 15:57:53 +02:00
Marc Klingen and GitHub
ce7ac9888e
fix: cursor background agent dev setup ( #8728 )
2025-08-28 15:34:12 +02:00
Nimar and GitHub
8f1a202226
feat(tracing): graph views for new observation types ( #8690 )
...
* feat(trace-graph): more generalized availability for graphs
* update
* simplify
* some cleanup
* simplify
* optimize
* fix typescript
* simplify
* physics again
* simplify
* fix color
* fix parallel node display in langgraph
* slightly optimize
* farben
* restructure
* some optimizations
* optimize
* cleanup
* fix do graph detection
* cleanup
* cleanup
* final
* fiux test
2025-08-28 13:13:50 +00:00
Hassieb Pakzad
3ba29710b2
chore: release v3.105.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-28 09:49:02 +02:00
marliessophie and GitHub
dafda00e9d
chore(annotation-queues-ui): show Source ID as column on Annotation Queue Items Table ( #8779 )
2025-08-28 06:01:40 +00:00
marliessophie and GitHub
f2bcf2f5cc
fix(evalQueue): update timeout error handling to match case sensitivity ( #8752 ) ( #8777 )
2025-08-27 22:47:15 +00:00
marliessophie and GitHub
1acef7c0e8
chore(peek): navigation event to create browser history entry ( #8772 )
2025-08-27 17:49:43 +00:00
marliessophie and GitHub
e6b4af4004
feat(dataset-runs): support score filters in ui tables ( #8755 )
...
* fixup(dataset-runs): support score filters
* chore: remove dataset run level score filters
* fixup: adjust DR query
* chore: add working score filters for dataset metrics
* chore: working version of score filters
* chore: fix tests
* test: add filter tests
* fix: add timestamps to remove test flakyness
* chore: rename score filters
* chore: drop aggregated prefix for score columns
* chore: make trpc changes safe
* chore: add ordering ASC to dataset run metrics
* chore: convert ordering to DESC
2025-08-27 17:18:05 +00:00
marliessophie and GitHub
414d950fa0
chore(datasets): enhance description display in table UI ( #8771 )
2025-08-27 17:09:34 +00:00
Max Deichmann and GitHub
f49a20b489
perf: remove traces env filter form observations table ( #8768 )
...
push
2025-08-27 15:17:38 +00:00
Hassieb Pakzad and GitHub
3c2e963bfb
fix(traces-api): include excluded fields in response with empty values ( #8753 )
...
* fix(traces-api): include excluded fields in response with empty values
* fix tests
2025-08-27 12:39:27 +00:00
Marc Klingen and GitHub
8769b65157
chore(cloud): show label that demo is not available only on HIPAA data region ( #8764 )
2025-08-27 12:23:17 +00:00
Max Deichmann
231a8f82bc
chore: release v3.104.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node24, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node24, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-27 11:58:38 +02:00
Max Deichmann and GitHub
a933bf68fb
chore: fix log comments ( #8760 )
2025-08-27 08:45:52 +02:00
Max Deichmann and GitHub
21a16963e2
chore: add log comments ch write ( #8758 )
...
push
2025-08-27 06:28:52 +00:00
marliessophie and GitHub
fe6c647c2b
chore(evals): graceful failure in case of timeouts of LLM providers ( #8752 )
2025-08-26 21:02:43 +00:00
marliessophie and GitHub
f1e5f35659
chore(dataset-run-items): remove PG execution code ( #8732 )
...
* chore(dataset-run-items): remove PG execution code
* chore: remove all dri postgres code
* chore: fix return
* chore: remove env variables
* chore: drop unused exports
* remove: env's from test env configs
2025-08-26 15:42:15 +00:00
Max Deichmann and GitHub
d39f7ba6e5
chore: upgrade to node 24 ( #8734 )
2025-08-26 17:06:04 +02:00
Nimar and GitHub
f701562396
fix: make chain coloring unique ( #8749 )
2025-08-26 13:57:56 +02:00
marliessophie and GitHub
83cbd336e2
fix(runs-compare): infinite re-renders on data table ( #8744 )
2025-08-26 13:02:29 +02:00
marliessophie and GitHub
ec33992412
test(datasets): skip flaky dataset runs test in CI ( #8738 )
2025-08-25 19:06:04 +00:00
Marc Klingen and GitHub
4e67edaaff
fix: cursor bg agent clock scew (skip check) ( #8737 )
...
push
2025-08-25 20:01:02 +02:00
marliessophie and GitHub
ac3ee18373
chore(dataset-run-items-seeder): remove PG dataset run item creation path ( #8733 )
...
* chore(dataset-run-items-seeder): remove PG dataset run item creation path
* chore: drop import
* chore: increase timeout
2025-08-25 16:42:49 +00:00
Hassieb Pakzad and GitHub
7f646757c5
feat(otel): parse vercel ai SDK ai.usage.* ( #8730 )
2025-08-25 14:53:15 +00:00
marliessophie and GitHub
2d82ae6e86
chore(dataset-runs): improve loading animations on runs table ( #8719 )
2025-08-25 13:04:46 +00:00
Marlies Mayerhofer
9aa4c11c56
chore: release v3.103.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-25 14:10:11 +02:00
marliessophie and GitHub
63a99b39fa
chore(datasets): default to reading/writing CH ( #8724 )
2025-08-25 11:49:02 +00:00
marliessophie and GitHub
2066658773
chore(datasets): fix flaky test ( #8722 )
...
* chore(datasets): fix flaky test
* chore: specify timeout
2025-08-25 11:10:55 +00:00
marliessophie and GitHub
43ffd1b72d
perf(evals): propagate trace timestamp to eval execution for better trace and observations filtering ( #8687 )
...
* chore(job_executions): add `job_input_trace_timestamp` to table
* chore: rely on trace timestamp in eval execution trace and observation queries
* fixup: return trace timestamp in existance check
* chore: return trace existence bool and timestamp
* chore: fix tests
* chore: rename
* chore: bump migration
2025-08-25 09:06:42 +00:00
Max Deichmann and GitHub
e5f96790c8
chore: upgrade gcs storage client library ( #8698 )
2025-08-23 12:31:58 +00:00
0b062f7c5b
feat: add dashboard filter persistence ( #8377 )
...
* docs: add spec
* feat: add filter and date range saving to dashboard
* feat: take out url params hook for date ranges
* docs: remove specs
* move migration
* move migration
* fixes
* fixes
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-08-23 11:51:50 +00:00
Leo Weigand and GitHub
8dc119365a
chore: re-enable focus-refetching for data tables ( #8688 )
2025-08-22 15:05:31 +00:00
marliessophie and GitHub
4bdc46ac31
chore(dataset-run-items): remove PG execution fallbacks ( #8685 )
2025-08-22 14:47:58 +00:00
Leo Weigand and GitHub
2308495088
fix(playground): empty message error when submitting all windows ( #8686 )
...
* fix(prompts): variables should not break
* fix(playground): empty message error when submitting all
2025-08-22 14:43:15 +00:00
marliessophie and GitHub
3f847591f4
feat(datasets): full text search for dataset items ( #8680 )
...
* feat(dataset-items-ui): allow filtering by metadata keys
* chore: push
* chore: push
* chore: fix after rebase
* feat(datasets): full text search for dataset items
* chore: remove checking for trace and observation existence before returning dataset items
* chore: eslint
* chore: pass search parameters
2025-08-22 13:51:38 +00:00
Hassieb Pakzad and GitHub
dff54e8ba9
fix(otel): override span observation types if generation-like attributes present ( #8683 )
2025-08-22 12:59:54 +00:00
marliessophie and GitHub
27d43a7a29
chore(dataset-run-items): remove PG execution path from tests ( #8638 )
...
* chore(dataset-run-items): remove PG execution path from web-async tests
* chore: return CH result on CH write
* chore: remove PG code
* chore: add timeouts
* chore: push
* chore: ch inserts
* chore: use CH inserts in worker batch action test
2025-08-22 07:26:09 +00:00
marliessophie and GitHub
fced289c1c
feat(dataset-items-ui): allow filtering by metadata keys ( #8627 )
...
* feat(dataset-items-ui): allow filtering by metadata keys
* chore: push
* chore: push
* chore: fix after rebase
2025-08-22 07:10:34 +00:00
Marc Klingen and GitHub
f37b0cbe3b
fix: clock sync issue with cursor bg agent ( #8674 )
2025-08-21 21:27:03 +02:00
Marc Klingen and GitHub
ca9d42c7a3
chore: add TERM env to cursor dockerfile ( #8673 )
2025-08-21 21:21:32 +02:00
marliessophie and GitHub
4da2fe32b2
docs(dataset-runs-ui): rename experiments to dataset runs across ui ( #8662 )
...
* docs(dataset-runs-ui): rename `experiments` to `dataset runs` across ui
* chore: push
2025-08-21 17:53:12 +00:00
marliessophie and GitHub
3770613a03
fix(annotation): verify existing CH score data type prior to upsert ( #8666 )
...
* fix(annotation): verify existing CH score data type prior to upsert
* chore: push
2025-08-21 16:21:38 +00:00
Nimar
f543dc2e38
chore: release v3.102.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-21 18:00:43 +02:00
Nimar and GitHub
db328c5d82
feat(tracing): map vercel AI sdk observation types ( #8670 )
2025-08-21 14:59:53 +00:00
Nimar and GitHub
9a38bdcce2
feat(tracing): map openinference, openai to new observation types ( #8664 )
...
* feat(tracing): map openinference, openai to new observation types
* make it simpler!
* simplify
* add otel gen-ai
* move instatiation to otelingest
2025-08-21 14:15:25 +00:00
steffen911
6d893cdc75
chore: release v3.101.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-21 14:42:45 +02:00
bd196aa31c
feat: allow opt-out of blob-storage-file-log for lifecycle policed buckets ( #8654 )
...
* feat: allow opt-out of blob-storage-file-log for lifecycle policed buckets
* Update worker/src/features/scores/processClickhouseScoreDelete.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-21 12:11:15 +00:00
Steffen Schmitz and GitHub
1c8d1304d6
perf: avoid final modified for traces.countAll via uniq ( #8661 )
2025-08-21 11:09:31 +02:00
Nimar
9276d2dbbb
chore: release v3.100.0
Codespell / Check for spelling errors (push) Waiting to run
CI/CD / pre-job (push) Waiting to run
CI/CD / lint (push) Blocked by required conditions
CI/CD / prettier-check (push) Blocked by required conditions
CI/CD / test-docker-build (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg12) (push) Blocked by required conditions
CI/CD / tests-web-sync (node20, pg15) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-web-async (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg12, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / tests-worker (node20, pg15, mode-redis-cluster) (push) Blocked by required conditions
CI/CD / e2e-tests (push) Blocked by required conditions
CI/CD / e2e-server-tests (push) Blocked by required conditions
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-08-21 10:01:50 +02:00
Leo Weigand and GitHub
0f76e0769c
fix(trace-detail): remove unnecessary z-indexes ( #8658 )
2025-08-21 07:53:23 +00:00
Steffen Schmitz and GitHub
b309b3ae22
perf: use uniq instead of count for prompt metrics call ( #8647 )
2025-08-21 06:21:48 +00:00
Marc Klingen and GitHub
b22038baaa
fix(posthog-integration): skip processing of person profiles for anon… ( #8617 )
...
* fix(posthog-integration): skip processing of person profiles for anon events
* improve perf via random distinctId for anon events
* fix
2025-08-20 20:50:17 +00:00
Steffen Schmitz and GitHub
d769ed848a
perf: use aggregations to calculate traces all API result ( #8616 )
...
* perf: use aggregations to calculate traces all API result
* chore: adjust AMT settings for redis-cluster tests
* chore: patch test cases
* chore: handle prefix and filter differentl
* chore: move trace column def to shared server to use env imports
2025-08-20 17:36:10 +00:00
Nimar and GitHub
064137c93f
fix: explicit observation types should be respected ( #8644 )
...
* fix: explicit observation types should be respected
* fix test
2025-08-20 16:34:31 +00:00
Leo Weigand and GitHub
22b897a799
fix(playground): tools popover breaking with many tools ( #8643 )
2025-08-20 16:11:41 +00:00
Tyler Ashworth and GitHub
afc0668e40
fix: use dynamic asset path for Ragas logo with custom basePath ( #8612 )
...
* fix: use dynamic asset path for Ragas logo with custom basePath
- Fixes hardcoded /assets/ragas-logo.png path that breaks with NEXT_PUBLIC_BASE_PATH
- Uses router.basePath to construct correct asset URL dynamically
- Resolves broken Ragas evaluator icons for custom base path deployments
- Backward compatible with root path deployments
Fixes #8611
* fix: prettier formatting for ragas-logo.tsx
- Add missing newline at end of file
- Ensure consistent formatting
* fix: apply prettier formatting to ragas-logo.tsx
* fix: use env.NEXT_PUBLIC_BASE_PATH directly for Ragas logo
Addresses reviewer feedback to use environment variable directly
instead of useRouter().basePath, matching pattern used throughout
the codebase (LangfuseLogo, auth redirects, API endpoints, etc.)
2025-08-20 15:49:34 +00:00
Steffen Schmitz and GitHub
63a066c9bd
perf: split batch to be processed on string length errors in CH writer ( #8615 )
...
* perf: split batch to be processed on string length errors in CH writer
* chore: add ress comments
* chore: format
2025-08-20 15:41:04 +00:00
Leo Weigand and GitHub
81d2884364
chore(tracing): consistently use thousands separator ( #8642 )
2025-08-20 15:28:54 +00:00
Max Deichmann and GitHub
14b030eedf
perf: update eval execution indices ( #8641 )
...
* perf: update eval execution indices
* push
2025-08-20 15:14:11 +00:00
Nimar and GitHub
0de920c32f
chore: upgrade trpc to v11, react-query to v5, typescript to v5.7.2 ( #8529 )
...
* chore: upgrade to trpc v11, react-query v5
* equalize ts version
* onSuccess -> useEffect
* isPending
* restore some
* fix
* fixx
* fix again
* fix
* ugly working state
* make the TS concise types a bit more beautifyul
* fix one more
* more loading
* mock
* moar pending
* moar
* use queryclient instead
* upgrade superjson
* pot fix
* more specific types
* fix build
* clean up
* undo
* cleanup
* cleanup
2025-08-20 16:21:26 +02:00
marliessophie and GitHub
df3a4c761e
fix(posthog-telemetry): read from respective strategy for DRI count ( #8639 )
2025-08-20 14:07:33 +00:00
dfce40d029
chore: add debugging logs for otel timestamp parsing errors ( #8631 )
...
* chore: add debugging logs for otel timestamp parsing errors
* Update web/src/features/otel/server/OtelIngestionProcessor.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: prettier
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-20 13:40:51 +00:00
marliessophie and GitHub
01d2095628
chore(dataset-run-items): run experiment service test ( #8595 )
...
* chore(dataset-run-items): run experiment service test
* chore: push
2025-08-20 13:21:07 +00:00
Nimar and GitHub
af80548ea1
chore: add test for encryption ( #8635 )
2025-08-20 15:12:52 +02:00
Leo Weigand and GitHub
e45c24838c
feat: highlight variables in prompt content ( #8632 )
...
chore: highlight variables in prompt content
2025-08-20 12:37:11 +00:00
Steffen Schmitz and GitHub
f9e7d706b7
fix: calculate correct traces table count ( #8629 )
2025-08-20 13:41:46 +02:00
Łukasz Jernaś and GitHub
6ea1b986a5
fix: Coerce SLACK_FETCH_LIMIT to number ( #8628 )
...
You can't pass numbers as Kubernetes env variables, so we need
to coerce from strings.
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
2025-08-20 11:38:54 +00:00
Steffen Schmitz and GitHub
babc02a067
perf: use aggregations to calculate traces trpc all route ( #8599 )
2025-08-20 12:01:33 +02:00
Steffen Schmitz and GitHub
e33b5ff4e1
chore: bump clickhouse deletion timeout default ( #8620 )
2025-08-20 09:03:50 +00:00
Leo Weigand and GitHub
8cd2b8867e
feat(trace-detail): improved search that works well with new trace tree ( #8604 )
...
* wip small scores
* fix: root node missing selected state
* refactor: only use command for search results
* chore: more consistent styling between search and tree
* fix: rerendering issue
* fix: more styling issues
* fix: lint warnings and eslint vscode plugin config
* more cleanup
* fix: selecting root node from search
2025-08-20 08:26:52 +00:00
Marc Klingen and GitHub
542e043f2c
feat(ui): improved demo app menu buttons and link from home to projectid/traces ( #8608 )
...
* jump to traces for demo project instead of / (dashboard)
* add new demo main menu
2025-08-19 18:18:36 +00:00
Marc Klingen and GitHub
1046a9f65e
feat(ui): improve comments in annotation drawer within own panel ( #8601 )
...
* feat(ui): improve comments in annotation drawer within own panel
* autofocus and scroll on submission
* debounce
2025-08-19 16:00:50 +00:00
Marc Klingen and GitHub
28f023b06a
fix(ui): comment count on trace-level trace-tree-node ( #8603 )
2025-08-19 17:17:48 +02:00
Nimar and GitHub
698331a99d
fix: make test data not error UI ( #8564 )
2025-08-19 12:05:35 +00:00
marliessophie and GitHub
0f818048ae
chore(evals-ui): move target data type selection above running evaluator time scope ( #8596 )
2025-08-19 11:38:25 +00:00
marliessophie and GitHub
514d5edb0d
chore(dataset-api-servertest): introduce awaits for async operations and increase timeouts ( #8582 )
2025-08-19 11:29:37 +02:00
Leo
ba91ed14f1
chore: release v3.99.0
2025-08-19 10:23:41 +02:00
Leo Weigand and GitHub
49e8c8c5e0
fix(trace-detail): better contrast for selected span ( #8591 )
...
improve selected item contrast
2025-08-19 08:01:11 +00:00
Steffen Schmitz and GitHub
5748cfedd4
perf: reduce expensive joins for default case on metrics/daily route ( #8587 )
...
* perf: reduce expensive joins for default case on metrics/daily route
* chorE: clarify comment
* chore: ensure tests pass
2025-08-18 16:29:28 +00:00
Leo Weigand and GitHub
3f6916b13f
feat(datasets): allow copying items within source dataset ( #8580 )
...
* feat(datasets): allow duplicating items in same datset
* revert some changes
2025-08-18 16:05:11 +00:00
Nimar and GitHub
d7a4a34df1
fix(eval-service): selected observation type not handled in eval service ( #8586 )
...
* fix: selected observation type not handled in eval service
* sort alphabetically
* add test
* update
2025-08-18 14:12:21 +00:00
Steffen Schmitz and GitHub
3d3e8967a6
fix: drop unused redis reference in evalService ( #8585 )
2025-08-18 13:10:25 +00:00
marliessophie and GitHub
f1bf562811
chore(migrations): add trace_id index for dataset_run_items_rmt ( #8583 )
...
* chore(migrations): add trace_id index for dataset_run_items_rmt
* chore: fix typo in file name
2025-08-18 12:34:21 +00:00
Steffen Schmitz and GitHub
02d6c78626
perf: skip trace upsert queue if no job configs for project configured ( #8558 )
2025-08-18 11:57:32 +00:00
Leo Weigand and GitHub
251741aacb
fix(trace-detail): collapse all button ignoring root node ( #8581 )
2025-08-18 13:16:06 +02:00
Steffen Schmitz and GitHub
ce49294607
perf: add caching for clickhouse dataset run items in createEvalJob ( #8551 )
...
* perf: add caching for clickhouse dataset run items in createEvalJob
* chore: add return statement
* chore: simplify return statement
* chore: patch test case to be PG and CH compatible
* chore: patch worker tests
* chore: update get traceById aggregation behaviour
* chore: comment out redis cluster DRI settings
* chore: add note about parallelization
* chore: add clarification on in-memory filter
2025-08-18 09:55:47 +00:00
Leo Weigand and GitHub
a0c876271a
feat(trace-detail): tree view improvements ( #8557 )
...
* turn timeline toggle into dropdown
* improve collapse / expand all
* fix missing title on view options
* fix observation name overflow
* allow resizing tree view
* better tree indicators and smaller font size
* integrate new feedback
* add some spacing to scores
* fix timeline toggle label
* fix timeline view dynamic sizing
* resizable improvements
* last tree connector fixes
* switching views shouldn't push to history
* even more density
* polish
* fix type errors
* update dataset compare detail view
* fix missing vertical padding in tree node without metrics
* rebase cleanup
2025-08-18 08:26:30 +00:00
Nimar and GitHub
221d8e9043
chore: upgrade turborepo 2.5.6 ( #8575 )
...
upgrade turbo
2025-08-18 08:19:37 +00:00
Steffen Schmitz and GitHub
e5e30eb4cb
fix: check that value is defined before accessing length in ClickhouseWriter ( #8565 )
2025-08-15 20:59:26 +00:00
Steffen Schmitz and GitHub
7834a37d32
chore: upgrade clickhouse-js to 1.12.1 ( #8560 )
2025-08-15 15:28:24 +00:00
Steffen Schmitz and GitHub
261d857e90
perf: add metadata indexes on observations table ( #8555 )
...
* perf: add metadata indexes on observations table
* chore: add materialization settings
* chore: update statements to make materialization async
2025-08-15 13:06:13 +00:00
Marc Klingen
25889323e6
chore: use input in issue form for self-hosted version
2025-08-15 14:29:00 +02:00
Marc Klingen
14f766908b
chore: improve issue template for bug reports
2025-08-15 14:24:42 +02:00
Steffen Schmitz and GitHub
6f06a3ab5f
feat: add membership deletion API endpoints ( #8553 )
...
* feat: add membership deletion API endpoints
* chore: patch deleteMany behaviour
2025-08-15 09:49:23 +00:00
Jannik Maierhöfer and GitHub
f706721c12
chore(UI): replace links to reflect new docs structure ( #8552 )
...
* data model
* push
* prompts
* scores
* datasets
* tracing features
* openai
* langchain
* misc
* remove
2025-08-15 09:12:59 +00:00
35c8adaccc
fix: implement a recursive version of getChannels ( #8470 )
...
* fix: implement a recursive version of getChannels
SlackService.getChannels only fetched 200 channels, which after
filtering might get even less. This doesn't work for large
organizations, as there are usually more than 200 active channels,
with possibly more archived (which counted into the limit)
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
* chore: Add limit on how many records we can download from Slack API
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
* fix: Actually respect the fetch limit
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
* fix: Implement review suggestions
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
---------
Signed-off-by: Łukasz Jernaś <lukasz.jernas@allegro.com >
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
2025-08-15 07:31:53 +00:00
marliessophie and GitHub
465e1661fa
fix(trace-detail-playground): ensure input validation in parseGeneration function ( #8548 )
2025-08-14 20:34:37 +00:00
Marc Klingen and GitHub
1cf917edde
chore: update in-product docs links ( #8547 )
2025-08-14 22:12:11 +02:00
Marc Klingen and GitHub
80efe21420
fix(ui): hide separator of demo badge when sidebar is collapsed & make envlabel dismissable onClick ( #8546 )
2025-08-14 22:11:52 +02:00
marliessophie and GitHub
6be2e203ba
chore(datasets-ui): prefix I/O with "Trace" on runs table in items detail view ( #8545 )
...
* chore(datasets-ui): prefix I/O with "Trace" on runs table in items detail view
* chore: fix space
2025-08-14 20:02:08 +00:00
marliessophie and GitHub
488f5494e0
fix(dataset-run-items): CH execution for dataset-level evals ( #8540 )
...
* fix(dataset-run-items): CH execution for dataset run items
* chore: fix batch action historical evals for CH execution
* chore: comment
* chore: fix tooltip
2025-08-14 18:12:00 +00:00
Nimar
b5eed6653a
chore: release v3.98.2
2025-08-14 17:04:55 +02:00
Nimar and GitHub
78aa8fdd26
feat(traces): add more observation types ( #8507 )
...
* feat(traces): add more observation types
* observations table default filter for all types
* fix test running instructions
* add seeder
* add basic tests
* add to evaluator object selector
* add test to verify we default to span-create for all types
* allow generation like attributes on all types
* check if something is generation LIKE not strictly a GENERATION
* fix test
* ensure that GENERATION-like type's fields can also be null
* simplify create- logic
2025-08-14 13:28:06 +00:00
Marlies Mayerhofer
9f0fbf8081
chore: release v3.98.1
2025-08-14 15:38:30 +02:00
marliessophie and GitHub
d63ce00194
fix(dataset-run-items): pg table read ( #8537 )
2025-08-14 15:37:23 +02:00
Marlies Mayerhofer
9ca761bdc6
chore: release v3.98.0
2025-08-14 14:39:26 +02:00
marliessophie and GitHub
e2ec566fe4
chore(dataset-run-items): read and write to dataset_run_items_rmt clickhouse ( #8532 )
...
* chore(dataset-run-items): add ReplicatedReplacingMergeTree dataset_run_items_rmt
* chore: drop dataset_run_items background migration row and add dataset_run_items_rmt background migration row and script
* chore: read and write to dataset_run_items_rmt
* chore: add
* chore: push
* chore: push
* chore: fix
* chore: push
2025-08-14 11:58:37 +00:00
marliessophie and GitHub
bebc76a502
chore: fix typo in migration name ( #8536 )
2025-08-14 10:13:04 +00:00
Steffen Schmitz and GitHub
7bfbe19a8c
chore: add clickhouse and postgres review guide ( #8535 )
2025-08-14 10:12:02 +00:00
Marc Klingen and GitHub
e625053849
chore: add REVIEW.md for PR reviews
2025-08-14 11:52:09 +02:00
marliessophie and GitHub
dc3530f195
chore(dataset-run-items-rmt): add table with suffix, add background migration from postgres to clickhouse ( #8531 )
...
* chore(dataset-run-items): add ReplicatedReplacingMergeTree dataset_run_items_rmt
* chore: drop dataset_run_items background migration row and add dataset_run_items_rmt background migration row and script
* chore: rename to include rmt suffix
* chore: push
2025-08-14 09:49:16 +00:00
1cf7c81386
feat(llm-invocations): allow additional provider options ( #8510 )
...
* feat(llm-invocations): allow additional provider options
* push
* push
* push
* push
* Apply suggestion from @ellipsis-dev[bot]
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* push
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-14 08:39:25 +00:00
Marlies Mayerhofer
7e31dda960
chore: release v3.97.5
2025-08-13 23:19:49 +02:00
marliessophie and GitHub
1f64991e7e
fix(dataset-run-items): set trace creation default to PG for self-hosters ( #8519 )
2025-08-13 21:07:33 +00:00
Steffen Schmitz and GitHub
577ad574d1
chore: add projectId to eval processing spans ( #8513 )
2025-08-13 16:48:41 +00:00
steffen911
879ef9c8f9
chore: release v3.97.4
2025-08-13 17:40:13 +02:00
Steffen Schmitz and GitHub
a343d5b187
fix: reinstate ability to remove tags from prompts ( #8505 )
2025-08-13 15:28:51 +00:00
marliessophie and GitHub
ac2b9eaa56
chore(dataset-run-items): add env variable for trace creation ( #8508 )
...
* chore(dataset-run-items): add env variable for trace creation
* chore: push
* chore: push
2025-08-13 16:38:59 +02:00
marliessophie and GitHub
43e9cba99a
chore: create traces in CH execution path ( #8504 )
...
* chore: create traces in CH execution path
* chore: push
* chore: fix import
* chore: push
2025-08-13 15:47:11 +02:00
Steffen Schmitz and GitHub
601f431f69
perf: parallelize S3 and clickhouse deletions for data retention ( #8501 )
2025-08-13 13:44:49 +00:00
marliessophie and GitHub
4fd1f86f9d
chore(dataset-run-items): sunset dual-write phase; do not fall back on PG in CH execution path ( #8497 )
...
* chore(dataset-run-items): return CH result
* chore: sunset dual-write phase for dri in CH execution path; do not fall back on PG for reads
* chore: eslint
2025-08-13 12:27:35 +00:00
marliessophie and GitHub
8245888e3c
fix(dataset-runs): implement optimistic concurrency handling for dataset run creation in POST /dataset-run-items ( #8494 )
2025-08-13 10:18:00 +00:00
steffen911
daf4e2fe02
chore: release v3.97.3
2025-08-13 11:38:24 +02:00
Steffen Schmitz and GitHub
129693fb69
chore: skip body validation for bullmq GET requests ( #8490 )
2025-08-13 09:15:33 +00:00
Steffen Schmitz and GitHub
204948db44
perf: skip FINAL for traces all route without metrics ( #8489 )
2025-08-13 09:15:29 +00:00
marliessophie and GitHub
d42ba5fc99
fix(evals): redirect and pull data for latest template version post template edit ( #8491 )
2025-08-13 09:15:25 +00:00
Steffen Schmitz and GitHub
97a539ced3
chore: allow whitelisting which AMTs can be used ( #8488 )
2025-08-13 09:12:07 +00:00
Leo Weigand and GitHub
9d8dace197
feat(llm-connections): populate gcp region in update form ( #8487 )
...
feat(llm-connections): correctly show gcp region in update form
2025-08-13 08:58:31 +00:00
marliessophie and GitHub
bc2dc4d89c
feat(annotation): add POST queue API ( #8478 )
...
* feat(annotation): add POST queue API
* chore: fix types
* docs: add API ref
* chore: improve score configs check
* chore: add postman collection
2025-08-12 17:25:19 +00:00
Marc Klingen
2dd5c8a8aa
chore: release v3.97.2
2025-08-12 17:31:22 +02:00
Marc Klingen
d17b21f04d
chore: specify development node version
2025-08-12 17:30:31 +02:00
Marc Klingen and GitHub
c5a0f44bdd
fix: fail silently when /api/latest-releases returns invalid schema ( #8476 )
...
* fix: fail silently when /api/latest-releases returns invalid schema
* push
2025-08-12 15:18:27 +00:00
Steffen Schmitz and GitHub
011b4912f2
chore: limit traces to trace AMT migration to only write into traces_all_amt ( #8458 )
...
* chore: limit traces to trace AMT migration to only write into traces_all_amt
* chore: revert validation changes
* chore: simplify query
* chore: tune both queries
* chore: avoid full aggregation during migration
* chore: handle IO coalescing to skip aggregations fully
* chore: remove obsolete query parts
2025-08-12 14:44:55 +00:00
Steffen Schmitz and GitHub
a4d773066f
chore: move health check to new traces AMTs ( #8473 )
2025-08-12 14:44:09 +00:00
Marlies Mayerhofer
25bdb1690b
chore: release v3.97.1
2025-08-12 11:33:34 +02:00
marliessophie and GitHub
f8565d7772
fix(evals): update trace deletion logic to remove job executions directly ( #8466 )
2025-08-12 09:15:34 +00:00
marliessophie and GitHub
a912057082
fix(evals): ensure default model supports langfuse evals at set up ( #8411 )
...
* fix(evals): ensure default model supports langfuse evals at set up
* fix: await upsertDefaultModel
* chore: provide actionable error messages in case of misconfiguration
2025-08-12 09:11:00 +00:00
marliessophie and GitHub
e0d3270f50
fix(evals): json parse preview to properly handle doubleEncoded IO ( #8464 )
...
* fixup(evals): json parse preview
* chore: add comment
2025-08-12 07:47:09 +00:00
Hassieb Pakzad
99e5a0b224
chore: release v3.97.0
2025-08-11 19:22:53 +02:00
bccdee5410
feat: add HTTPS proxy support for LLM API calls ( #8461 )
...
* feat: Add HTTPS proxy support for LLM API calls (#7932 )
* remove tests
---------
Co-authored-by: suhwan <52690419+suhwan-cheon@users.noreply.github.com >
2025-08-11 17:18:54 +00:00
marliessophie and GitHub
738cbbc8cd
feat(annotation-assignment): allow removing user assignments in UI ( #8370 )
...
* feat(annotation-assignment): allow removing user assignments in UI
* chore: push
2025-08-11 15:57:02 +00:00
marliessophie and GitHub
920c52bb06
chore(evals): cancel job executions in case of underlying trace delete ( #8443 )
...
* chore(evals): cancel job executions in case of underlying trace delete
* chore: lint
2025-08-11 15:56:27 +00:00
Leo Weigand and GitHub
4f134790af
chore: add edit button to dataset items dot menu ( #8444 )
...
* chore: add edit button to dataset items dot menu
* fix: disable button based on access
* fix: DatasetActionButton not forwarding refs
* fix: eslint
2025-08-11 15:33:03 +00:00
Steffen Schmitz and GitHub
21b3ce3c82
Revert "perf: stream new records to clickhouse in writer ( #8421 )" ( #8459 )
...
This reverts commit b35583056b .
2025-08-11 15:30:42 +00:00
Leo Weigand and GitHub
0531b57e1a
refactor: update create org form validation ( #8455 )
2025-08-11 14:26:45 +00:00
Leo Weigand and GitHub
7b857a0dc4
chore: surface required models for Azure/Bedrock ( #8453 )
...
- LLM connections: surface required model selection
for Azure/Bedrock; simplify advanced settings and validation
- Move custom model names to main form for Azure and Bedrock; require at least one model
- Remove default models toggle for Azure/Bedrock (they don’t support defaults)
- Keep Azure base URL and extra headers in main form; remove Azure advanced panel entirely
- Show advanced settings only for OpenAI, Anthropic, Vertex AI, and Google AI Studio
- Improve validation order to avoid confusing errors when defaults aren’t supported
- Add adapter-based placeholder for provider name; clarify copy
- Consolidate adapter logic to a single helper used in UI and schema
2025-08-11 14:26:27 +00:00
Steffen Schmitz and GitHub
6c97fe3c04
chore: drop "remove tag" capability from UI ( #8454 )
2025-08-11 14:24:08 +00:00
Steffen Schmitz and GitHub
1d69cbd41b
chore: migrate remaining analytics and export queries to traces AMTs ( #8451 )
...
* chore: migrate remaining analytics and export queries to traces AMTs
* chore: patch
* chore: patches
* dummy
* chore: replace start_time with timestamp
* chore: adjust timeshift
* chore: switch to startTime
* chore: updat ereadme
2025-08-11 13:48:48 +00:00
Steffen Schmitz and GitHub
ab26692913
fix(dashboards): patch invalid tags filter ( #8445 )
...
* fix(dashboards): patch invalid tags filter
* chore: move tests
* chore: remove unnecessary auth overwrite
* chore: test update
2025-08-11 12:14:56 +00:00
Hassieb Pakzad and GitHub
b791544864
fix(model-prices): gpt-5 prices with model date ( #8442 )
...
* fix(model-prices): gpt-5 prices with model date
* add to playground and evals
* add cache clearance
2025-08-11 11:49:32 +00:00
Steffen Schmitz and GitHub
b35583056b
perf: stream new records to clickhouse in writer ( #8421 )
...
* perf: stream new records to clickhouse in writer
* chore: update unit tests
2025-08-11 08:23:16 +00:00
Steffen Schmitz and GitHub
4504530e3d
chore: skip unavailable shards in traces AMT background migration ( #8438 )
2025-08-11 08:21:50 +00:00
marliessophie and GitHub
45eed4b5c0
feat(scores-exports): add author to score exports ( #8419 )
2025-08-08 16:29:45 +00:00
marliessophie and GitHub
9fa31ba68e
chore(datasets-csv-upload): no longer nest column values if single valid json object ( #8416 )
2025-08-08 16:04:55 +00:00
Hassieb Pakzad and GitHub
ea35c25269
fix: gemini-2.5-flash name ( #8412 )
2025-08-08 14:47:05 +00:00
steffen911
c427791070
chore: release v3.96.2
2025-08-08 16:35:11 +02:00
Steffen Schmitz and GitHub
25220aef55
perf: allow sharding for trace upsert queue ( #8396 )
...
* perf: allow sharding for trace upsert queue
* chore: handle metrics for traceupsertqueue
* chore: remove outdated comment
* chore: test util upgrade
* chore: patch typing
2025-08-08 14:16:27 +00:00
Max Deichmann
8c02d5dc22
chore: release v3.96.1
2025-08-08 15:57:05 +02:00
Max Deichmann and GitHub
0b60076871
chore: upgrade form data ( #8408 )
2025-08-08 13:17:12 +00:00
marliessophie and GitHub
b28a83531b
fix(evals): display final status in peek view ( #8406 )
2025-08-08 13:12:38 +00:00
Steffen Schmitz and GitHub
aa4d34ae66
chore: skip S3 list and legacy trace insert based on env flag ( #8298 )
...
* chore: skip S3 list and legacy trace insert based on env flag
* chore: adjust skip s3 list conditions
* chore; refactor traceUpserQueue entity assoication
* chore: reverse
2025-08-08 12:47:04 +00:00
Steffen Schmitz and GitHub
cca352ad13
chore: remove trace null deletions ( #8405 )
2025-08-08 15:02:37 +02:00
Steffen Schmitz and GitHub
58c96cada7
chore: include boolean scores in the reference of scores-numeric ( #8086 )
2025-08-08 12:39:56 +00:00
Steffen Schmitz and GitHub
6f93389936
chore: adjust devcontainer setup to install deps via dockerfile ( #8399 )
...
* chore: adjust devcontainer setup to install deps via dockerfile
* Update Dockerfile
2025-08-08 12:10:05 +00:00
Max Deichmann and GitHub
b8d9586490
chore: fix dev command ( #8404 )
2025-08-08 14:38:21 +02:00
Leo
534f5696ad
chore: release v3.96.0
2025-08-08 14:20:05 +02:00
Leo Weigand and GitHub
4cebe2831c
fix(onboarding): only show org onboarding for Cloud and more UX touches ( #8392 )
2025-08-08 14:17:49 +02:00
45a5f3b8a2
chore: upgrade slack dependency ( #8402 )
...
* chore: upgrade slack dependencies
* chore: upgrade slack deps and remove unnecessary deps from web/worker
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-08-08 14:05:41 +02:00
Max Deichmann and GitHub
8dea9b6a3a
chore: remove explicit axios dependency ( #8397 )
...
remove axios
2025-08-08 11:38:42 +00:00
marliessophie and GitHub
c5b781d3f6
fix(llm-connections): ensure dialog remains open when switching tabs ( #8391 )
...
* fix(llm-connections): ensure dialog remains open when switching tabs
* chore: lint
2025-08-08 09:52:48 +00:00
Leo Weigand and GitHub
07469c928d
feat(cloud): new onboarding survey to better understand our users ( #8374 )
2025-08-08 10:37:13 +02:00
Marc Klingen and GitHub
5b10110dfe
fix(auth): honor NEXT_PUBLIC_BASE_PATH in password reset verification ( #8385 )
2025-08-07 23:14:32 +00:00
Thorsten Spieker and GitHub
0eb5d1c3c0
feat: pivot table sorting ( #8214 )
2025-08-08 00:12:09 +02:00
Max Deichmann
1585bf5e14
chore: release v3.95.2
2025-08-07 20:11:10 +02:00
Max Deichmann and GitHub
dec6d6f975
chore: add openai 5 models ( #8378 )
2025-08-07 20:09:36 +02:00
Max Deichmann and GitHub
36fa7ea15e
chore: improve typing of users ( #8376 )
...
push
2025-08-07 17:28:10 +00:00
Marlies Mayerhofer
6a4d56a5a9
chore: release v3.95.1
2025-08-07 18:32:29 +02:00
Marc Klingen and GitHub
9f0a40949e
fix: check projectMembers:read for trpc members.byProjectId ( #8373 )
2025-08-07 17:55:57 +02:00
Steffen Schmitz and GitHub
10fdd9e172
chore: add env to move short-term reads to AMTs ( #8367 )
2025-08-07 15:26:11 +00:00
marliessophie and GitHub
fc58add111
chore(rbac): fix types for resolveProjectRole ( #8371 )
...
* chore(rbac): fix types for resolveProjectRole
* chore: eslint
2025-08-07 15:18:22 +00:00
Steffen Schmitz and GitHub
10993838d5
perf: truncate IO in table overviews and skip internal JSON parse on TRPC ( #8364 )
...
* perf: truncate IO in table overviews and skip internal JSON parse on TRPC
* chore: fix imports
* chore: align test case
2025-08-07 15:09:35 +00:00
148cd29e9f
fix: handle invalid string lengths on traces_null table gracefully ( #8369 )
...
* fix: handle invalid string lengths on traces_null table gracefully
* Update worker/src/services/ClickhouseWriter/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: test dropped record truncation
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-07 14:25:00 +00:00
Steffen Schmitz and GitHub
7a353e99af
chore: disable usage alert configuration temporarily ( #8360 )
2025-08-07 10:22:08 +00:00
Marc Klingen and GitHub
dc52106feb
chore: improve multi-tenant sso error message ( #8363 )
2025-08-07 12:44:06 +02:00
Marlies Mayerhofer
b2f8eb7078
chore: release v3.95.0
2025-08-07 11:55:36 +02:00
026d8e2ba0
feat(annotation): support assigning users to queues ( #8325 )
...
* chore(annotation-queue): add AnnotationQueueMembership model and related database schema updates
* chore(annotation-queue): add AnnotationQueueMembership POST and DEL APIs
* feat(annotation-queue): implement user assignment functionality for annotation queues
* fix: role logic for users
* chore: rn to assignments
* fixup: rn to assignments
* chore(annotation-queue): enhance user assignment section with debounced search and display of assigned users
* feat(annotation-queue): add MultiSelectCombobox for user assignment and enhance DataTable with row class name functionality
* refactor(rbac): replace generateUserQuery with generateUserProjectRolesQuery and introduce utility functions for project role resolution
* fixup: filter query for user ids
* fixup: resolve project role test
* fix: validate user project role before adding to annotation assignment
* chore: remove code
* chore: fix
* chore: fix filter
* chore: fix filter
* tests for auth logic
* push: fix api route test
* tests for auth logic
* fix
* fix
* chore: push
* chore: rename
* docs: api types
* fix: formatting
* fix: formatting
* chore: add disabled prop to MultiSelectCombobox
* chore: rename migration
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-08-07 09:29:45 +00:00
Hassieb Pakzad
9a9f0b1743
chore: release v3.94.0
2025-08-07 10:30:22 +02:00
Hassieb Pakzad and GitHub
74a510fbde
feat(otel): add parsing for Vercel AI SDK ( #8347 )
...
* feat(otel): add parsing for Vercel AI SDK
* push
* push
2025-08-07 07:43:34 +00:00
Steffen Schmitz and GitHub
c23b226e62
chore: move dashboard queries to new AMTs ( #8308 )
...
* chore: create background migrations for traces amt tables
* chore: add database migrations
* chore: move tests to use AMTs in one config
* chore: shift backfill from {} to map()
* chore: modify ingestion test timeouts
* chore: keep minDate updates tracked
* chore: remove android lib to save swap space
* chore: check disk space
* chore: check mnt usage
* chore: skip swap to check runner performance
* chore: add timestamp lines
* chore: handle deletions
* chore: update test cases
* chore: linting
* chore: allow opt-in creation for background migratoin record
* chore: update comparison query
* chore: concurrency config
* chore: update names
* chore: update names
* chore: update tiemout
* chore: add pre-query logs
* chore: refactor long running query into util function
* chore: refactor query exists checks
* chore: set correct tables for clustered configs
* chore: increase number of retries
* chore: extend logging
* chore: gracefully handle aborted query
* chore: handle errors during execution and raise them
* chore; skip in progress header updates
* Update migrateTracesToTracesAMTs.ts
* chore: use default clickhouse settings for ingestion
* chore: add trace_id index on traces_all_amt
* chore: update sorting behaviour of batchAction test
* chore: drop logger
* chore: update test
* chore: lint and renames
* chore: update test cases
* chore: patch score tests
* chore: add final for the checkTraceExists behaviour
* chore: remove background migration insert
* chore: move dashboard queries to new AMTs
* chore: make sure to replace all references to old traces table
* chore: revert replacement behaviour
* chore: formatting
* chore: typo
* chore: lint and refactor
* chore: update import path
* chore: patch test behaviour
* chore: remove outdated comment
2025-08-06 13:57:15 +00:00
Steffen Schmitz and GitHub
2f50b38a68
chore: adjust stalled settings for eval execution queue ( #8343 )
...
* chore: tune queue stalled checks for higher reliability
* chore: only apply stalled to eval execution queue
2025-08-06 12:29:47 +00:00
marliessophie and GitHub
451ae15e00
feat(evaluator-form): add tooltips for evaluator usage and target in edit mode ( #8340 )
...
* feat(evaluator-form): add tooltip for existing evaluator usage in edit mode
* feat(evaluator-form): enhance target data label with tooltip for edit mode
* chore: lint
2025-08-06 10:35:43 +00:00
marliessophie and GitHub
e34d81578b
chore(evaluator-form): prevent form submission on Enter key press; hide controls in preview ( #8337 )
...
* chore(evaluator-form): prevent form submission on Enter key press
* chore: disable select control on evaluation traces preview
2025-08-06 08:28:13 +00:00
Max Deichmann and GitHub
214c9c7ed2
perf: increase clickhouse timeouts for blob storage exports ( #8328 )
...
push
2025-08-05 22:45:49 +00:00
Max Deichmann and GitHub
961b3bfa8d
chore: truncate traces i/o for the traces table ( #8326 )
...
* push
* push
* push
* something
* something
2025-08-05 20:53:40 +00:00
Marc Klingen and GitHub
a1dd5b22a2
docs: improve api reference for llm-connections api ( #8327 )
2025-08-05 20:43:45 +02:00
Marc Klingen and GitHub
49950f9706
chore: add validation to okta issuer ( #8323 )
2025-08-05 17:22:40 +00:00
Max Deichmann and GitHub
cfdd0fdb73
chore: refactor IOTableCell ( #8324 )
2025-08-05 19:26:16 +02:00
Marc Klingen and GitHub
891e7e9716
feat(models): add claude-opus-4-1-20250805 ( #8322 )
2025-08-05 17:19:34 +00:00
Marc Klingen and GitHub
5b407dad53
feat(posthog-integration): add langfuse_trace_id to generations and scores ( #8319 )
...
feat(posthog-integration): add langfuse_trace_id to generations and scores
2025-08-05 15:25:31 +00:00
steffen911
26e3bf9a44
chore: release v3.93.0
2025-08-05 16:56:10 +02:00
Steffen Schmitz and GitHub
1f02e364e1
chore: create background migrations for traces amt tables ( #7689 )
...
* chore: create background migrations for traces amt tables
* chore: add database migrations
* chore: move tests to use AMTs in one config
* chore: shift backfill from {} to map()
* chore: modify ingestion test timeouts
* chore: keep minDate updates tracked
* chore: remove android lib to save swap space
* chore: check disk space
* chore: check mnt usage
* chore: skip swap to check runner performance
* chore: add timestamp lines
* chore: handle deletions
* chore: update test cases
* chore: linting
* chore: allow opt-in creation for background migratoin record
* chore: update comparison query
* chore: concurrency config
* chore: update names
* chore: update names
* chore: update tiemout
* chore: add pre-query logs
* chore: refactor long running query into util function
* chore: refactor query exists checks
* chore: set correct tables for clustered configs
* chore: increase number of retries
* chore: extend logging
* chore: gracefully handle aborted query
* chore: handle errors during execution and raise them
* chore; skip in progress header updates
* Update migrateTracesToTracesAMTs.ts
* chore: use default clickhouse settings for ingestion
* chore: add trace_id index on traces_all_amt
* chore: update sorting behaviour of batchAction test
* chore: drop logger
* chore: update test
* chore: lint and renames
* chore: update test cases
* chore: patch score tests
* chore: add final for the checkTraceExists behaviour
* chore: remove background migration insert
* chore: convert traces_mt to traces_null
* chore: patch tests
* chore: switch from minMap to maxMap
* chore: mark aggregation columns on traces as do not use
* chore: patch new test
* chore: switch to maxMap
* consistent naming
2025-08-05 14:20:49 +00:00
Leo Weigand and GitHub
90dca15d86
feat(settings): improve UX for managing LLM connections ( #8312 )
2025-08-05 14:30:23 +02:00
Steffen Schmitz and GitHub
e3f8dc8bb3
fix(blob-storage): disable auto container check for Azure buckets for costsavings ( #8317 )
2025-08-05 11:44:03 +00:00
Hassieb Pakzad
585ede0919
chore: release v3.92.1
2025-08-05 11:24:29 +02:00
Hassieb Pakzad and GitHub
0db425d120
fix(pagination): allow limit zero again ( #8315 )
2025-08-05 09:22:34 +00:00
Hassieb Pakzad
09e33c3059
chore: release v3.92.0
2025-08-05 10:01:57 +02:00
Hassieb Pakzad and GitHub
66226011af
feat(llm-api-keys): add public api methods ( #8301 )
...
* feat(llm-api-keys): add public api LIST and PATCH endpoints
* puhs
* push
* push
* add post endpoint
* add PUT endpoint
* push
* push
2025-08-05 07:32:18 +00:00
marliessophie and GitHub
571698ab2e
fix(pretty-json-view): prevent infinite recursion and optimize child row processing ( #8302 )
2025-08-04 18:05:45 +00:00
Steffen Schmitz and GitHub
312066f735
chore: add operation_name tag to AMT query experiments ( #8294 )
2025-08-04 11:25:32 +00:00
marliessophie and GitHub
5abeaf8adb
fix(dataset-run-items): fix pagination for consistent ordering across sources ( #8292 )
2025-08-04 10:23:48 +00:00
Steffen Schmitz and GitHub
fac3c732de
chore: optimize queries for session AMT accesses ( #8289 )
2025-08-04 09:55:17 +00:00
marliessophie and GitHub
5e2e3bb5fc
feat(sessions-ui): allow filtering table by scores ( #7858 )
...
* fixup(sessions-ui): allow filtering table by scores
* fix(table-definitions): update scores label from "Scores (avg)" to "Scores (numeric)"
* feat: support scores filters on sessions
* chore
* chore: fix duplicate in query
* chore: hide whitespace
* chore: fix
2025-08-04 09:36:48 +00:00
Max Deichmann
0564df8e51
chore: release v3.91.0
2025-08-04 11:33:20 +02:00
Steffen Schmitz and GitHub
a2801a3be9
chore: add experiment tags to clickhouse queries ( #8288 )
2025-08-04 09:17:07 +00:00
075eb58ecb
chore: add fern JS SDK generator ( #8095 )
...
* chore: add fern JS SDK generator
* push
* return java generator
* push
* push
* push
* Update worker/src/services/IngestionService/tests/IngestionService.integration.test.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update worker/src/services/IngestionService/tests/IngestionService.integration.test.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* puhs
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-04 08:49:43 +00:00
Steffen Schmitz and GitHub
674d66d179
chore: record AMT duration distribution ( #8287 )
2025-08-04 10:32:10 +02:00
marliessophie and GitHub
163f2a02ff
fix(dataset-run-items): include run metadata for runs without dataset_run_items ( #8267 )
...
* fix(dataset-run-items): include run metadata for runs without dataset_run_items
* chore: drop name from metrics query
2025-08-04 08:12:46 +00:00
Steffen Schmitz and GitHub
075836f210
chore: upsert traces into both traces tables ( #8268 )
2025-08-04 09:28:46 +02:00
marliessophie and GitHub
543b6ee0f2
feat(peek-evaluator-config): add edit mode functionality ( #8285 )
2025-08-04 07:12:59 +00:00
marliessophie and GitHub
8c8c488e4d
feat(annotation-queues): add support for batch adding observations to annotation queues ( #8261 )
2025-08-04 07:10:48 +00:00
Hassieb Pakzad and GitHub
6a0e0a4221
feat(llm-connections): remove atla integration ( #8059 )
2025-08-04 05:53:24 +00:00
Max Deichmann and GitHub
1b01a267df
chore: only show 10 traces for evals ( #8283 )
2025-08-03 20:39:51 +00:00
Thorsten Spieker and GitHub
69a9146894
Revert "refactor: break up SlackService and move to web/worker packages" ( #8276 )
...
Revert "refactor: break up SlackService and move to web/worker packages (#8247 )"
This reverts commit e452004a6a .
2025-08-03 18:59:20 +00:00
380403e8ed
fix(cloud): add csp headers needed for attachment upload to Plain support chat ( #7813 )
...
Update CSP headers to allow additional S3 image and connect sources
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-08-03 18:52:25 +02:00
296a6c3ee6
chore: limit batch sizes of trace deletions ( #8274 )
...
* push
* Update worker/src/env.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-08-02 07:07:45 +00:00
Steffen Schmitz and GitHub
62904a9563
ci: debug docker build issues ( #8269 )
2025-08-01 18:07:42 +02:00
Steffen Schmitz and GitHub
90247ab64c
chore: migrate additional queries to traces amts ( #8249 )
2025-08-01 15:06:16 +02:00
marliessophie and GitHub
5cf91c60d9
fix(layout): highlight nav items when viewing child routes ( #8211 )
2025-08-01 11:50:11 +00:00
Steffen Schmitz and GitHub
559ba6d05d
chore: remove unused sessions query ( #8264 )
2025-08-01 13:17:32 +02:00
Steffen Schmitz and GitHub
f071be69b6
build: add always() condition to run notifications on failure ( #8265 )
2025-08-01 12:54:30 +02:00
Max Deichmann and GitHub
52c261b422
perf: delete traces in batches ( #8250 )
2025-08-01 11:33:32 +02:00
Steffen Schmitz and GitHub
6f0a43ec65
build: setup slack alerts on failing CI ( #8255 )
2025-08-01 11:12:02 +02:00
marliessophie and GitHub
301bd6b569
feat(dataset-run-items): reads router ( #8207 )
...
* chore(dataset-run-items): GET /dataset-run-items
* fixup(dataset-run-items): GET /dataset-run-items
* chore(dataset-run-items): GET datasetRun/[runName]
* fix(dataset-run-items): return 0 for count when no records found
* fix(dataset-run-items): ensure offset is calculated only when page and limit are present
* feat(dataset-run-items): enhance dataset filtering by adding datasetId support and refactor related functions
* chore: rm comment
* refactor(dataset-run-items): rename dataset run name to ID across API and table definitions
* feat(dataset-run-items): add dataset_run_items to Clickhouse table names and refactor dataset filtering to use camelCase
* fix(dataset-run-items): update dataset filtering to ensure only the latest version of each dataset run item is retrieved
* chore: imports
* chore: fix de-duplication
* chore(dataset-router): mark runitemsByRunIdOrItemId as deprecated
* chore: refactor only, split out routes into byItemId and byRunId
* Revert "chore: refactor only, split out routes into byItemId and byRunId"
This reverts commit 2e1f2e3c14b9ed1173e2fb73b7f721c72d57bfbb.
* Revert "chore(dataset-router): mark runitemsByRunIdOrItemId as deprecated"
This reverts commit 5cb2232198d84baf7f027b00603c6fb3b9489c52.
* fixup: runitemsbyrunidoritemid
* chore: rewrite runitemsByRunIdOrItemId
* chore: rewrite runsByDatasetIdMetrics
* chore: ordering
* chore: order by created at and remove base data from query
* chore: add back name
* chore: push
2025-08-01 08:10:22 +00:00
Nimar and GitHub
56fd3df2d2
fix(json-view): truncate cell after 2k chacacters ( #8227 )
...
* fix(json-view): truncate cell after 2k chacacters
* real value for truncated chars
* just rely on regex
2025-07-31 20:12:44 +00:00
Max Deichmann
db433e2b72
chore: release v3.90.0
2025-07-31 20:52:35 +02:00
Thorsten Spieker and GitHub
e452004a6a
refactor: break up SlackService and move to web/worker packages ( #8247 )
...
* refactor: break up SlackService and move to web/worker packages
* fix: pnpm lock file
* fix: tests
* fix
2025-07-31 18:33:03 +00:00
Nimar and GitHub
bce026d8b2
fix(dataset-items): add placeholder text for new items ( #8228 )
2025-07-31 19:11:48 +02:00
marliessophie and GitHub
fbdf12bfa3
chore(dataset-run-items): add background migration for DRI ( #8245 )
2025-07-31 18:07:43 +02:00
marliessophie and GitHub
78f59bc543
chore: add dataset-run-items tables to clickhouse ( #8243 )
2025-07-31 16:50:25 +02:00
James Idzik and GitHub
ea338ed83d
fix: coerce LANGFUSE_INIT_PROJECT_RETENTION and other envs correctly to number ( #8103 )
...
fix: coerce init project retention, historic max eval limit envs
2025-07-31 16:01:53 +02:00
Steffen Schmitz and GitHub
8cf67fe329
chore: correctly parse input and output on traces_mt ingestion ( #8242 )
2025-07-31 15:21:36 +02:00
Steffen Schmitz and GitHub
e3b23ea5ec
feat: allow PUT operations on SCIM users endpoint ( #8236 )
...
* feat: allow PUT operations on SCIM users endpoint
* chore: make tests pass
* cleanup
2025-07-31 12:24:45 +00:00
Steffen Schmitz and GitHub
7be2791105
chore: patch docs for ingestion replay ( #8238 )
...
* chore: patch docs for ingestion replay
* chore: increase s3 parallelization
2025-07-31 11:47:10 +00:00
Nimar and GitHub
683aae0069
fix(json-view): tighter ChatML validation ( #8225 )
2025-07-31 10:02:58 +00:00
Steffen Schmitz and GitHub
1c8ffc607d
chore: write single rows into AMTs instead of pre-merged record ( #8218 )
...
* chore: write single rows into AMTs instead of pre-merged record
* chore: adjust assertion
* chore: drop debug log
2025-07-31 09:27:14 +00:00
Steffen Schmitz and GitHub
9c203e8b8a
chore: allow return from aggregatingmergetrees without experiments ( #8215 )
2025-07-31 09:07:39 +00:00
Steffen Schmitz and GitHub
c32cccce52
feat: allow redis username overwrites via env variables ( #8234 )
2025-07-31 09:52:03 +02:00
Nimar and GitHub
f1f8da5b74
fix(json-view): store formatted/json preference in local storage ( #8222 )
2025-07-30 19:47:22 +00:00
Max Deichmann and GitHub
c23447a624
chore: improve slack links ( #8219 )
2025-07-30 18:31:44 +02:00
Thorsten Spieker and GitHub
5e2225de46
fix: use different env variable in worker to construct links ( #8212 )
2025-07-30 17:02:11 +02:00
Nimar
bb9d118853
chore: release v3.89.0
2025-07-30 16:09:51 +02:00
marliessophie and GitHub
df57ff60d6
feat(dataset-run-items): support reads for public APIs ( #8179 )
...
* chore(dataset-run-items): GET /dataset-run-items
* fixup(dataset-run-items): GET /dataset-run-items
* chore(dataset-run-items): GET datasetRun/[runName]
* fix(dataset-run-items): return 0 for count when no records found
* fix(dataset-run-items): ensure offset is calculated only when page and limit are present
* feat(dataset-run-items): enhance dataset filtering by adding datasetId support and refactor related functions
* chore: rm comment
* refactor(dataset-run-items): rename dataset run name to ID across API and table definitions
* feat(dataset-run-items): add dataset_run_items to Clickhouse table names and refactor dataset filtering to use camelCase
* fix(dataset-run-items): update dataset filtering to ensure only the latest version of each dataset run item is retrieved
* chore: imports
* chore: fix de-duplication
2025-07-30 13:52:09 +00:00
Nimar and GitHub
bae2c5a65d
fix(json-table): render links clickable ( #8209 )
...
* fix(json-table): render links clickable
* export
2025-07-30 15:48:01 +02:00
Steffen Schmitz and GitHub
3efa696513
fix(sessions): allow filter combination of environment and session_id ( #8210 )
2025-07-30 13:20:04 +00:00
Hassieb Pakzad and GitHub
58ebf006b8
fix(llm-conenctions): drop system message from test call ( #8189 )
2025-07-30 11:49:31 +00:00
Thorsten Spieker and GitHub
16743363dc
fix: slack channel search component ( #8208 )
2025-07-30 13:56:44 +02:00
Nimar and GitHub
ebf0e35073
fix(json-view): smart retain collapsed/expanded state of json table view ( #8191 )
...
* handle user set expansion state in context provider
* update
* update2
* fix collapse state
* fix state bool
* final cleanup
* fix collapse all
* fix lint
* cleanup
* simplify
* remove log
* fix expand
* fix types
* lint
2025-07-30 11:21:42 +00:00
Thorsten Spieker and GitHub
2c4799340f
fix: set slack redirect uri specifically per environment ( #8205 )
2025-07-30 12:50:15 +02:00
5612c6a9a5
feat(cloud): add billing alerts ( #7903 )
...
* feat(cloud): add billing alerts
* chore: checkpoint state
* chore: cleanup
* chore: remove implementation plan
* chore: update send email behaviour
* chore: add usage alert config options in UI
* chore: implement stripe hook and email
* chore: optimize email
* chore: linting
* chore: use invoice hooks to retrigger usage alerts in each cycle
* chore: add log statement if usage alert got recreated
* chore: update log messages
* chore: replace cloud-billing-alerts with cloud-usage-alerts
* Update web/src/ee/features/billing/components/UsageAlerts.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-30 09:48:59 +00:00
Max Deichmann and GitHub
b62962ca08
chore: move slack database migration in right order ( #8203 )
...
push
2025-07-30 11:12:28 +02:00
Thorsten Spieker and GitHub
3a46283bf2
feat: add slack integration ( #8073 )
2025-07-30 10:52:57 +02:00
Marlies Mayerhofer
07801180f8
chore: release v3.88.1
2025-07-30 10:49:42 +02:00
marliessophie and GitHub
14831902ef
fix(annotation-queues): remove unnecessary refetchOnMount option and ensure current item type is defined ( #8199 )
2025-07-30 08:28:46 +00:00
marliessophie and GitHub
d377f02a49
fix(dataset-items): ensure deterministic ordering given pagination for GET dataset items api ( #8200 )
...
* fix(dataset-items): ensure deterministic ordering given pagination for GET dataset items api
* chore: push
2025-07-30 08:28:22 +00:00
Nimar
e07120b163
chore: release v3.88.0
2025-07-29 20:27:11 +02:00
Nimar and GitHub
506482dbe4
fix(playground): enable jumpt to playground for gemini ( #8188 )
...
* fix(playground): enable jumpt to playground for gemini
* fix exhaustive check
* correct types
2025-07-29 17:34:02 +00:00
Xichen Pan and GitHub
ec61f4a420
fix: set explicit ES2021 target in tsconfig to support Unicode regex ( #8174 )
...
* fix(worker): set explicit ES2021 target in tsconfig to support Unicode regex
* fix(worker): remove redundant lib config from tsconfig.json
2025-07-29 17:30:58 +00:00
marliessophie and GitHub
4db08a2960
fix(eval): trace filter preview enable dynamic sorting based on control visibility ( #8187 )
2025-07-29 17:11:37 +00:00
Nimar and GitHub
2351d0d370
fix(markdown): don't break after list item number ( #8181 )
2025-07-29 12:03:49 +00:00
marliessophie and GitHub
99b3401549
feat(dataset-run-items): implement experiment service writes ( #8090 )
...
* feat(dataset-run-items): implement experiment service writes
* chore: add
* fix(experiments): update error messages for missing API key using constants
* chore(experimentCreateQueue): increase backoff delay to 10 seconds
* chore(auth): update ingestion types for improved flexibility
* chore: create traces & error-level generations for DRIs
* chore: unify timestamps
* chore: revert test to PG implementation until we add DRI migration across environments
* chore: typo
* chore: implement unified trace ID generation for ClickHouse and PostgreSQL executions to prevent duplicate traces
* chore: refactor trace creation logic for ClickHouse and PostgreSQL executions to use a unified approach
* chore: eslint
* chore: comment
* chore: rebase
* chore: rebase
* chore: rename function for clarity and fix typo in comments
* refactor: remove fetchDatasetRun function and replace with direct Prisma query for dataset run retrieval
* chore: eslint
* chore: fix test
* chore: fix test
* refactor: rename function and update comments for clarity in experimentServiceClickhouse
2025-07-29 11:14:30 +00:00
Nimar
6fb796df40
chore: release v3.87.1
2025-07-29 12:04:14 +02:00
Nimar and GitHub
846d6e6c37
fix(markdown-rendering): tighter rendering ( #8177 )
...
* fix(trace-view): better markdown spacing for density
* better spacing
2025-07-29 09:55:05 +00:00
marliessophie and GitHub
1fa4fc6329
fix(annotation): mobile responsivness behaviour ( #8154 )
...
* fix(annotation): mobile behavior of annotation queue item view
* fix(ItemBadge): enhance label display with truncation and overflow handling
* fix(annotation-processing): improve layout by adjusting panel height properties for better overflow handling
2025-07-29 08:29:31 +00:00
Marlies Mayerhofer
a1a48d5e7b
chore: release v3.87.0
2025-07-29 00:15:18 +02:00
Nimar and GitHub
fcb7563763
chore: upgrade turbo to 2.5.5 ( #8171 )
2025-07-28 21:00:45 +00:00
Thorsten Spieker and GitHub
ae754b146d
fix: scroll area for large lists of variables ( #8170 )
2025-07-28 21:13:56 +02:00
marliessophie and GitHub
49343b9a0c
feat(annotation-queues): add support for batch adding sessions to annotation queues ( #8169 )
...
* feat(annotation-queues): add support for batch adding sessions to annotation queues
* chore: eslint types
2025-07-28 18:44:06 +00:00
Steffen Schmitz and GitHub
76bf5c0f4e
fix: add queue prefix to webhook queue ( #8165 )
2025-07-28 16:12:48 +00:00
marliessophie and GitHub
e91a29be61
fix(members-table): update table column visibility and order logic based on project context ( #8164 )
...
refactor(members-table): update column visibility and order logic based on project context
2025-07-28 14:38:14 +00:00
marliessophie and GitHub
81694363a2
fix(metrics): convert latency from milliseconds to seconds for accurate display ( #8162 )
2025-07-28 12:38:43 +00:00
marliessophie and GitHub
5998266680
feat(dataset-run-items): implement deletion for CH writes ( #8074 )
...
* feat(dataset): implement dataset run items deletion queue and processing
* feat(dataset): add dataset run items deletion functionality and integrate with deletion queue
* chore: revert imports
* chore: handle DRI deletion on project deletion conditionally
* fix(dataset-router): await Promise.all for dataset run items deletion
* refactor(dataset-router): streamline dataset deletion process and ensure async handling of dataset run items
* fix(env): add new environment variable for dataset run items deletion concurrency duration
* chore: rm comment
* refactor(dataset-run-items): update delete functions to use object destructuring for parameters
* fix(dataset-run-items): replace hardcoded request timeout with environment variable for deletion timeout
* refactor(dataset): rename and restructure dataset deletion functionality, replacing dataset run items deletion with a unified dataset deletion queue
2025-07-28 11:36:05 +00:00
Nimar
462e8e847d
chore: release v3.86.1
2025-07-28 12:53:59 +02:00
Nimar and GitHub
d7c186858b
fix(observations): if value is 0 show it instead of null ( #8158 )
2025-07-28 10:22:03 +00:00
Nimar and GitHub
e686aedac9
fix(trace-table): smart expand json table if not many rows ( #8142 )
...
* fix(trace-table): smart expand json table if not many rows
* clean up comments
* better performance
* cleanup
* fix lint
* clean
2025-07-28 09:58:02 +00:00
Max Deichmann and GitHub
85f75a5e8e
chore: improve webhook retries ( #8098 )
...
* chore: improve webhook retries
* chore: improve webhook retries
* chore: improve webhook retries
* chore: improve webhook retries
* fixes
* push
* fixes
* fixes
2025-07-26 13:26:15 +00:00
Max Deichmann and GitHub
1ea643300d
chore: remove ingestion via bullmq ( #8143 )
2025-07-26 00:13:53 +02:00
596486c1ec
chore: ingest secondary ingestion queue data ( #8137 )
...
* push
* add duration tracking
* push
---------
Co-authored-by: Hassieb Pakzad <68423100+hassiebp@users.noreply.github.com >
2025-07-25 17:13:03 +00:00
Hassieb Pakzad and GitHub
cb65391c2d
fix(model-selector): correct combinations provider model ( #8135 )
...
* fix(model-selector): correct combinations provider model
* push
* push
* push
* push
* push
2025-07-25 16:29:06 +00:00
marliessophie and GitHub
419e07260d
fix(evaluator): update button label based on form mode ( #8134 )
2025-07-25 14:06:59 +00:00
marliessophie and GitHub
825f030e81
feat(annotation): support annotation on sessions ( #8130 )
...
* feat(session): integrate CreateNewAnnotationQueueItem component into session page
* refactor(annotation-queues): enhance QueueItemRowData structure to support multiple object types
* chore: refactor to extract common functionality
* fixup: refactor to extract common functionality
* chore: handle session annotation type in annotation processing UI
* feat(annotation-queues): add object type column and enhance source display in AnnotationQueueItemsTable
* chore: add session annotation ui
* feat(annotation-queues): add tooltip for detailed view toggle and enhance session item handling
* chore: small improvement
* feat(annotation-queues): implement intersection observer for trace visibility and update pagination logic
* fix(annotation-queues): update current item type retrieval and improve session item handling logic
* chore: eslint
* chore: nits
2025-07-25 13:32:54 +00:00
Max Deichmann and GitHub
34ded9c927
chore: adjust sampling metric ( #8132 )
2025-07-25 11:53:15 +02:00
Hassieb Pakzad and GitHub
c935d4ae73
chore: add sampling to ingestion pipeline ( #8128 )
2025-07-25 11:26:30 +02:00
Hassieb Pakzad and GitHub
e7283ac06e
fix(ingestion): cached model not found ( #8122 )
2025-07-25 06:51:18 +00:00
Max Deichmann and GitHub
20d0106626
chore: fix date parsing for eval retries ( #8119 )
2025-07-25 02:00:48 +02:00
Max Deichmann and GitHub
849591fdf2
chore: improve evals logging ( #8118 )
2025-07-25 01:34:52 +02:00
Max Deichmann and GitHub
0c7b50e564
chore: fix eval event envelope timestmp ( #8117 )
2025-07-25 01:10:40 +02:00
Max Deichmann and GitHub
37b4f43351
chore: increase observability and delay of eval executions ( #8116 )
2025-07-25 00:08:54 +02:00
marliessophie and GitHub
7a3b0379e5
fix(experiments): update loading condition in CreateExperimentsForm to check for datasetId ( #8115 )
2025-07-24 21:11:42 +00:00
marliessophie and GitHub
f458d7626c
chore: add sessions type for annotation queue ( #8107 )
2025-07-24 17:11:47 +00:00
Max Deichmann and GitHub
258dde4691
fix: fix automation updates ( #8108 )
...
* fix: fix automation updates
* fix: fix automation updates
* fix: fix automation updates
2025-07-24 16:35:33 +00:00
marliessophie and GitHub
f15246d9df
feat(experiments): support remote experiment trigger ( #8094 )
...
* fixup(experiments): support trigger for remote experiment run
* chore: remove instructions
* chore: rename webhook > remote experiment server side
* chore: rename webhook > remote experiment client side
* style: design review
* chore: lint
* fix(experiments): change URL validation to use z.url() in RemoteExperimentUpsertForm
* chore: rename
* feat(datasets): add transformation function for datasets and update API responses
2025-07-24 16:12:59 +00:00
Nimar and GitHub
edb43a24ab
fix(trace): show linebreaks in only text markdown view ( #8106 )
2025-07-24 16:08:00 +00:00
Steffen Schmitz and GitHub
c45ae1b140
chore: adjust getSessionsTable query for AMTs ( #8102 )
...
* chore: adjust getSessionsTable query for AMTs
* chore: add additional index on traces_all_amt
2025-07-24 14:56:43 +00:00
Ted Kim and GitHub
90eeeeaf9d
fix: remove 'ON CLUSTER' instruction from unclustered migration ( #7959 )
2025-07-24 16:49:00 +02:00
Nimar
66accb563c
chore: release v3.86.0
2025-07-24 16:30:43 +02:00
Nimar and GitHub
9f2e8906d0
fix(trace-table): expanded state and make it fast! ( #8099 )
...
* preserve expanded state
* lazy load table for better performance
* fix broken commit
* pending: verbose state tracking working again
* fix states
* fix lint
* cleanup
* cleaner even
* fix build
2025-07-24 14:24:47 +00:00
c5d61b7ed2
chore: Remove add window button and its imports ( #8097 )
...
* Remove Add Window button from playground page
Co-authored-by: max <max@langfuse.com >
* feat(playground): remove Add Window button from header
- Remove Add Window button from playground page header
- Clean up unused imports (Plus icon, MULTI_WINDOW_CONFIG)
- Remove unused isAddWindowDisabled variable
- Preserve addWindow function for copy functionality
- Fix linting warnings for unused imports
Users can still add windows via the copy button on individual windows.
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-24 13:05:27 +00:00
Max Deichmann and GitHub
f95dd872e6
chore: fix output box for playground ( #8096 )
2025-07-24 12:38:11 +00:00
marliessophie and GitHub
04339741a9
chore(dataset-run-items): adjust converter for background migration ( #8075 )
...
* chore: reorder converter
* chore: treat numbers and booleans as strings
* chore: adjust metadata conversion
* Revert "chore: adjust metadata conversion"
This reverts commit d5ca3a5cb1b6e5972e5a321ab4884c589b938087.
2025-07-24 11:38:48 +00:00
marliessophie and GitHub
9c85e46996
feat(table): persist column sizes in local storage ( #7816 )
...
* feat(table): persist column sizing in localStorage
* chore: apply to all tables
* chore: push
* chore: add string
2025-07-24 11:37:16 +00:00
Steffen Schmitz and GitHub
4a7236451f
chore: bump clickhouse client to 1.12.0 ( #8092 )
2025-07-24 11:20:21 +00:00
Steffen Schmitz and GitHub
5cb5204181
chore: migrate remaining trace reads to AMT ( #8056 )
...
* chore: migrate remaining trace reads to AMT
* chore: revert box ticks
* chore: revert streamed exports
* chore: confirm trace count by project in creation interval
* chore: confirm trace count since created
* chore: confirm getTracesByIdsForAnyProject
* chore: session table simplification
* chore: refactor user metrics
* chore: update
2025-07-24 10:49:44 +00:00
Nimar and GitHub
c19066afa0
fix(playground): api key link should show llm connection ( #8080 )
2025-07-24 09:43:03 +00:00
Max Deichmann and GitHub
bbb9dc285d
chore: remove delay for otel ( #8085 )
2025-07-24 11:16:59 +02:00
Steffen Schmitz and GitHub
b750acba06
feat(admin-api): add okta role assignment capabilities ( #8084 )
...
* feat(admin-api): add okta role assignment capabilities
* chore: lint
2025-07-24 08:21:36 +00:00
Max Deichmann and GitHub
bb06e079eb
chore: upgrade prism ( #8083 )
...
* chore: upgrade prismjs
* fix
2025-07-24 07:49:50 +00:00
Max Deichmann and GitHub
5f711780e0
chore: upgrade prismjs ( #8077 )
2025-07-23 17:20:53 +00:00
Max Deichmann and GitHub
0f58ea1ebf
chore: remove trivy ( #8076 )
2025-07-23 17:11:59 +00:00
Nimar
ec70ca3951
chore: release v3.85.2
2025-07-23 18:20:34 +02:00
Nimar and GitHub
142d3a1612
fix(trace-view): render new lines in json table view ( #8072 )
2025-07-23 16:09:32 +00:00
Max Deichmann and GitHub
1dee7092b3
chore: configure posthog SDK ( #8067 )
...
* chore: configure posthog SDK
* chore: add score values to scores
* update posthog integration
* update posthog integration
2025-07-23 15:27:06 +00:00
Steffen Schmitz and GitHub
83b64f5e77
perf: extend model cache duration and invalidate on model changes ( #8053 )
2025-07-23 16:39:04 +02:00
Steffen Schmitz and GitHub
48b05247c8
fix(admin-api): handle Okta provisioning for POST and PATCH ( #8064 )
2025-07-23 14:15:10 +00:00
Max Deichmann and GitHub
9732262466
chore: fix node types discrepancies across packages ( #8060 )
...
* chore: fix node types discrepancies across packages
* chore: fix node types discrepancies across packages
2025-07-23 12:23:43 +00:00
Max Deichmann and GitHub
e51e2df2dc
chore: fix snyk again ( #8050 )
...
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
2025-07-23 12:04:01 +00:00
Nimar
74d1dfe5ac
chore: release v3.85.1
2025-07-23 13:55:34 +02:00
Nimar and GitHub
5633a8867e
fix(datasets-table): don't table render json here ( #8058 )
2025-07-23 11:52:50 +00:00
6a8bdae22e
feat: multi window playground ( #7661 )
...
* docs: add technical specs for multi window/prompt playground
* docs: add requirements and tech summary for sharing
* feat: add multi-window playground architecture and state isolation
* feat: make playground UI multi-window capable
* fix: multi window playground caching
* fix: jump to playground button adds windows to playground using stable id
* fix: avoid race condition in writing to cache before navigating to playground
* feat: add collapsible, more compact sections to non-model config
* feat: add compact version of model picker/params component
* feat: add ability to copy window states to multi playground
* fix: solve header crowding for thin windows in playground
* feat: make entire playground config section collapsible
* feat: change SaveToPrompt button to align with other window buttons
* feat: switch buttons in page header to icon-only when too small
* fix: adjust button labels to fit button size
* fix: update the execution window status correctly
* docs: complete remaining task items
* refactor: simplify playground state management hooks
* fix: make the model configuration section prettier
* docs: remove agent work files
* refactor: call register functions on the registry directly
* chore: refactored some components and compacted the design even more
* chore: move add message buttons
* chore: start align model param settings popover when compact
* chore: small UI spacing improvements
* fix: scrolling bug
* fix: handle config headers when window gets small
* chore: rename button hover
* feat: move CMD+Enter to execute all button
* feat: give user the choice to jump to fresh/existing playground
* push
* chore: fix
* chore: fix
* push
* push
* fixes
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-07-23 10:01:43 +00:00
Steffen Schmitz and GitHub
dbf994f9bb
perf: replace prisma upsert with raw query ( #8036 )
...
* perf: replace prisma upsert with raw query
* chore: drop prsima import
* chore: lint
2025-07-23 10:00:06 +00:00
Steffen Schmitz and GitHub
4d5c288d1e
perf: initialize clickhouse skip read map on startup ( #8039 )
...
* perf: initialize clickhouse skip read map on startup
* chore: linting
* chore: patch skip cache init
2025-07-23 09:29:44 +00:00
Hassieb Pakzad and GitHub
cf119fb9cc
fix(otel): parse trace name if as_root is true ( #8008 )
...
* fix(otel): parse trace name if as_root is true
* push
* push
* push
2025-07-23 09:13:54 +00:00
Hassieb Pakzad and GitHub
5af8c4e400
fix(otel): parse public attribute for traces ( #8049 )
2025-07-23 10:18:31 +02:00
Max Deichmann and GitHub
835a19bbd2
fix: fix snyk uploads ( #8044 )
2025-07-22 20:48:38 +00:00
Max Deichmann and GitHub
ae91a98ad9
fix: use drop down for prompt full text search ( #8043 )
...
* fix: use drop down for prompt full text search
* fix: use drop down for prompt full text search
* fix: use drop down for prompt full text search
* fix: use drop down for prompt full text search
* fix: use drop down for prompt full text search
2025-07-22 20:33:25 +00:00
Nimar and GitHub
e38cc24205
chore: add default claude settings ( #8042 )
2025-07-22 19:12:19 +00:00
marliessophie and GitHub
7ab45ec685
feat(dataset-run-items): migrate from postgres to clickhouse; write to CH API-only ( #7912 )
...
* feat(migrations): add dataset_run_items table in clickhouse
* feat(dataset): add environment variables and utility for pg/ch execution
* chore: re-write `runitemsByRunIdOrItemId` to support both clickhouse and postgres execution
* chore: use `runItemsByRunId` or `runItemsByItemId` rather than `runitemsByRunIdOrItemId`
* chore: rename env variables
* chore: reflect dri as ch data is seeder
* fixup: dataset run item types and converters
* chore: background migration
* chore: rewrite dataset-router routes
* chore(dataset): dual-write strategy for dataset run items to support ClickHouse and PostgreSQL
* chore: add utilities and converters
* chore: rewrite GET api/public/dataset-run-items
* feat(dataset): implement dataset run items deletion queue and processing
* chore: rewrite DELETE api/public/datasets/{datasetName}/runs/{runName}
* chore: rewrite GET api/public/datasets/{datasetName}/runs/{runName}
* fixup: rewrite GET api/public/datasets/{datasetName}/runs/{runName}
* chore(schema): add error to DRI schema
* fixup(ingestion): support dataset run items
* fixup: rewrite POST /api/public/dataset-run-items
* fixup: rewrite POST /api/public/dataset-run-items --amend
* fixup(ingestion): support dataset run items --amend
* fixup(experiments): preliminary implementation, for illustrative purposes only
* fixup(schema): indexes
* fixup(schema): remove indexes, add `output`
* chore: support DRI ingestion
* chore: eslint, writes related
* chore: rewrite experiment service
* chore: rm file
* chore: cascade delete dataset run items
* chore: add clustered migrations
* chore: update background migration
* chore: handle experiment job errors
* chore: remove CH read implementation
* chore: remove md file
* chore: remove CH read implementation II
* chore: fix typing
* chore: fix migration types
* fix: lint/imports
* fix: import errors
* chore: imports and comments
* chore: remove only from test
* fix: validateDatasetRunAndFetch
* fix: validateDatasetRunAndFetch id
* fixup: attempt fix of test
* fix: test
* chore: test validate logging
* chore: adjust logs
* chore: revert cascade delete
* Revert "feat(dataset): implement dataset run items deletion queue and processing"
This reverts commit 9f725f053386ded41e3617efaacee128d5ac023f.
* chore: delete imports
* revert: experiment service changes
* chore: adjust comment
* rename: env variables to incl experiment
* chore: remove unused variable eslint disables from datasetExecution and types files
* refactor: remove enrichedDatasetRunItem function and integrate its logic directly into IngestionService
* chore: remove TODO comment regarding dataset run item authorization
* refactor: replace Date constructor with parseClickhouseUTCDateTimeFormat for date parsing in dataset run item conversion
* chore: remove deprecated flag for runitemsByRunIdOrItemId method
* refactor: remove getDatasetRunItemsByRunId function to streamline dataset run item retrieval
* refactor: add back run properties in dataset runs mapping
* chore: revert changes to delete-dataset-run API
* refactor: remove validateDatasetItemAndFetch function and replace its usage with direct Prisma query in IngestionService
* refactor: delete validateCreateDatasetRunItemBodyAndFetch function and replace its logic with direct Prisma queries in dataset-run-items API
* refactor: move createOrFetchDatasetRun function to a new dataset-runs API file and maintain unique constraint handling
* refactor: remove validateDatasetRunAndFetch function and replace its usage with direct Prisma queries in dataset-run-items and IngestionService
* chore: nits
* refactor: streamline dataset run item creation by consolidating validation and execution logic
* chore: fix imports
* fix: types
* fix: simplify ingestion schema
* refactor: enhance ingestion schema creation to support public and internal environments
* chore: extend immutable keys list DRI
* chore: use same id for clickhouse and postgres
* chore: remove background migration trigger
* chore: move dataset run items migration into readme
* chore: remove creation of DRI in seeder
* chore: lint
2025-07-22 16:20:47 +00:00
Nimar
b101bf48d3
chore: release v3.85.0
2025-07-22 16:47:56 +02:00
Nimar and GitHub
4c4f0ff3c0
feat(tracing): pretty display json as collapsible table ( #7938 )
...
* feat(tracing): pretty display json as collapsible table
* show empty list and unwrap single item containing objects
* enable toggle for code or pretty view
* clean up
* fix type casting
* some more fixes
* expand row with click anywhere
* fix alignment
* remove dead code
* cleanup
* make it more clean
* don't unwrap initial items
* collapse expand all
* fixing collapse button
* don't render for chatml
* better markdown check
* reduce col width
* make table borderless
* display null / empty string for empty value
* smaller text
* make table more compact
* make preview items grey & italic
* linebreak path column
* table headers inherit color
* cleanup
* external collapsed state; also move button into code view
* remove code view switch
* show empty dicts also as empty
* always show objects as tables
* extract markdown into helper function
* review fixes
* update
2025-07-22 14:41:11 +00:00
Steffen Schmitz and GitHub
a42ca96225
chore: expose email_from_address and smtp_connection_url in docker-compose ( #8033 )
...
chore: expose email_from_address and smtp_connection_url in docker-compose.yml
2025-07-22 13:26:03 +00:00
marliessophie and GitHub
f63420827b
feat(prompts/playground): allow arbitrary message sorting in messages ( #8031 )
2025-07-22 12:41:39 +00:00
Steffen Schmitz and GitHub
e6fd056ae5
chore: migrate analytic routes to new AMTs ( #8029 )
...
* chore: migrate analytic routes to new AMTs
* chore: reduce new shared code
* chore: cleanup
* chore: cleanup
2025-07-22 12:39:48 +00:00
Steffen Schmitz and GitHub
4708fe4f47
chore: migrate additional session routes to new AMTs ( #8027 )
...
* chore: migrate additional session routes to new AMTs
* chore: remove unused function
* chore: remove unused code
* chore: remove outdated row in readme
* chore: update assertions
2025-07-22 12:24:57 +00:00
marliessophie and GitHub
362246b616
chore(datasets): update button label from "Rename" to "Edit" in DatasetActionButton component ( #8030 )
2025-07-22 12:21:45 +00:00
Steffen Schmitz and GitHub
b3de5fd71a
chore: migrate traces table to AMTs ( #7853 )
...
* chore: migrate traces table to AMTs
* chore: fix linting errors
* chore: ensure inplace update
* chore: add updated query
* chore: use final on query
2025-07-21 14:12:25 +00:00
Hassieb Pakzad and GitHub
ad236ecc99
fix(model-params): increase max tokens limit ( #8005 )
2025-07-21 15:12:37 +02:00
Nimar and GitHub
beb2063dcb
fix: add select all to multi select dropdown ( #8004 )
2025-07-21 12:53:09 +00:00
Hassieb Pakzad and GitHub
4de10298dc
fix(otel): parse only trace io on trace update ( #8003 )
2025-07-21 12:11:04 +00:00
Danushka Fernando and GitHub
f9924975fa
feat: expose a key prefix option for Redis ( #7958 )
2025-07-21 14:01:14 +02:00
Steffen Schmitz and GitHub
98774cbd61
fix(sessions): infer session env from trace ( #7996 )
2025-07-21 10:44:17 +00:00
Steffen Schmitz and GitHub
80361ef53f
fix(sessions): align duration unit with UI ( #7998 )
...
* fix(sessions): align duration unit with UI
* chore: update tests
2025-07-21 09:40:17 +00:00
Steffen Schmitz and GitHub
8350507434
chore: add missing blob-storage export entitlement ( #7990 )
2025-07-21 08:09:22 +00:00
marliessophie and GitHub
0a976edb70
fix(prompts): commitMessage error handling in NewPromptForm ( #7984 )
2025-07-20 16:13:39 +00:00
6a67c93010
chore(deps): bump exponential-backoff from 3.1.1 to 3.1.2 ( #7412 )
...
Bumps [exponential-backoff](https://github.com/coveooss/exponential-backoff ) from 3.1.1 to 3.1.2.
- [Commits](https://github.com/coveooss/exponential-backoff/compare/v3.1.1...v3.1.2 )
---
updated-dependencies:
- dependency-name: exponential-backoff
dependency-version: 3.1.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-07-20 09:33:39 +00:00
Max Deichmann and GitHub
e51ee05d9c
chore: upgrade express 5 ( #7978 )
...
* chore: upgrade express 5
* chore: upgrade express 5
2025-07-20 09:13:22 +00:00
Max Deichmann
565c561715
chore: release v3.84.0
2025-07-20 09:45:00 +02:00
Max Deichmann and GitHub
d1338ad5e1
chore: move dev dependencies to dev dependencies web container ( #7977 )
...
* fix
* fix
* fix
* fix
* chore: move dev dependencies to dev dependencies web container
2025-07-19 19:15:48 +00:00
Max Deichmann and GitHub
52d4fe37de
chore: remove unused tsx ( #7976 )
...
* fix
* fix
* fix
* fix
2025-07-19 19:15:40 +00:00
Max Deichmann and GitHub
67ef7abb63
chore: full text search for prompts ( #7973 )
...
* fix
* fix
* fix
2025-07-19 18:55:58 +00:00
Max Deichmann and GitHub
727ae71a93
fix: fix codemirror upgrade ( #7975 )
...
fix
2025-07-19 17:57:49 +00:00
a8eabbc96d
chore(deps): bump the radix-ui group with 23 updates ( #5562 )
...
Bumps the radix-ui group with 23 updates:
| Package | From | To |
| --- | --- | --- |
| [@radix-ui/react-accordion](https://github.com/radix-ui/primitives ) | `1.2.1` | `1.2.3` |
| [@radix-ui/react-alert-dialog](https://github.com/radix-ui/primitives ) | `1.1.2` | `1.1.6` |
| [@radix-ui/react-avatar](https://github.com/radix-ui/primitives ) | `1.1.1` | `1.1.3` |
| [@radix-ui/react-checkbox](https://github.com/radix-ui/primitives ) | `1.1.2` | `1.1.4` |
| [@radix-ui/react-collapsible](https://github.com/radix-ui/primitives ) | `1.1.1` | `1.1.3` |
| [@radix-ui/react-dialog](https://github.com/radix-ui/primitives ) | `1.1.2` | `1.1.6` |
| [@radix-ui/react-dropdown-menu](https://github.com/radix-ui/primitives ) | `2.1.2` | `2.1.6` |
| [@radix-ui/react-hover-card](https://github.com/radix-ui/primitives ) | `1.1.2` | `1.1.6` |
| @radix-ui/react-icons | `1.3.0` | `1.3.2` |
| [@radix-ui/react-label](https://github.com/radix-ui/primitives ) | `2.1.0` | `2.1.2` |
| [@radix-ui/react-popover](https://github.com/radix-ui/primitives ) | `1.1.2` | `1.1.6` |
| [@radix-ui/react-progress](https://github.com/radix-ui/primitives ) | `1.1.1` | `1.1.2` |
| [@radix-ui/react-radio-group](https://github.com/radix-ui/primitives ) | `1.2.1` | `1.2.3` |
| [@radix-ui/react-scroll-area](https://github.com/radix-ui/primitives ) | `1.2.0` | `1.2.3` |
| [@radix-ui/react-select](https://github.com/radix-ui/primitives ) | `2.1.2` | `2.1.6` |
| [@radix-ui/react-separator](https://github.com/radix-ui/primitives ) | `1.1.0` | `1.1.2` |
| [@radix-ui/react-slider](https://github.com/radix-ui/primitives ) | `1.2.1` | `1.2.3` |
| [@radix-ui/react-slot](https://github.com/radix-ui/primitives ) | `1.1.0` | `1.1.2` |
| [@radix-ui/react-switch](https://github.com/radix-ui/primitives ) | `1.1.1` | `1.1.3` |
| [@radix-ui/react-tabs](https://github.com/radix-ui/primitives ) | `1.1.1` | `1.1.3` |
| [@radix-ui/react-toggle](https://github.com/radix-ui/primitives ) | `1.1.0` | `1.1.2` |
| [@radix-ui/react-toggle-group](https://github.com/radix-ui/primitives ) | `1.1.0` | `1.1.2` |
| [@radix-ui/react-tooltip](https://github.com/radix-ui/primitives ) | `1.1.3` | `1.1.8` |
Updates `@radix-ui/react-accordion` from 1.2.1 to 1.2.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-alert-dialog` from 1.1.2 to 1.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-avatar` from 1.1.1 to 1.1.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-checkbox` from 1.1.2 to 1.1.4
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-collapsible` from 1.1.1 to 1.1.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-dialog` from 1.1.2 to 1.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-dropdown-menu` from 2.1.2 to 2.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-hover-card` from 1.1.2 to 1.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-icons` from 1.3.0 to 1.3.2
Updates `@radix-ui/react-label` from 2.1.0 to 2.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-popover` from 1.1.2 to 1.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-progress` from 1.1.1 to 1.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-radio-group` from 1.2.1 to 1.2.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-scroll-area` from 1.2.0 to 1.2.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-select` from 2.1.2 to 2.1.6
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-separator` from 1.1.0 to 1.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-slider` from 1.2.1 to 1.2.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-slot` from 1.1.0 to 1.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-switch` from 1.1.1 to 1.1.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-tabs` from 1.1.1 to 1.1.3
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-toggle` from 1.1.0 to 1.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-toggle-group` from 1.1.0 to 1.1.2
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
Updates `@radix-ui/react-tooltip` from 1.1.3 to 1.1.8
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md )
- [Commits](https://github.com/radix-ui/primitives/commits )
---
updated-dependencies:
- dependency-name: "@radix-ui/react-accordion"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-alert-dialog"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-avatar"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-checkbox"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-collapsible"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-dialog"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-dropdown-menu"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-hover-card"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-icons"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-label"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-popover"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-progress"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-radio-group"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-scroll-area"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-select"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-separator"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-slider"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-slot"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-switch"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-tabs"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-toggle"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-toggle-group"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
- dependency-name: "@radix-ui/react-tooltip"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: radix-ui
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-19 17:21:00 +00:00
Max Deichmann and GitHub
51befcad0f
chore: upgrade codemirror ( #7972 )
...
fix
2025-07-19 17:13:38 +00:00
Max Deichmann and GitHub
ee8b5e4998
chore: package upgrade vitest ( #7971 )
...
fix
2025-07-19 17:13:14 +00:00
Max Deichmann and GitHub
9bb9f7fa39
chore: remove ineffective pnpm configs ( #7970 )
2025-07-19 17:04:43 +00:00
Thorsten Spieker and GitHub
4cc10840ab
feat: automation secrets ( #7807 )
2025-07-18 17:20:48 +02:00
Hassieb Pakzad
311cd900fb
chore: release v3.83.0
2025-07-18 14:23:53 +02:00
Hassieb Pakzad and GitHub
92f14fd297
feat(llm-connections): default credential provider chain for Bedrock when self-hosted ( #7947 )
...
* feat(llm-connections): default credential provider chain for Bedrock when self-hosted
* push
* push
2025-07-18 12:14:59 +00:00
Max Deichmann and GitHub
42306e5247
chore: fix snyk configuration ( #7944 )
2025-07-18 11:09:07 +02:00
5bb1b6de54
fix(playground): scroll variables if many are present ( #7946 )
...
* Refactor Variables rendering with improved sorting and key management
Co-authored-by: nimar <nimar@langfuse.com >
* fix(playground): make placeholders and variables scroll individually
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-17 15:06:38 +00:00
Marc Klingen and GitHub
dae0ee6165
fix(ui): main menu icons clickable when collapsed ( #7942 )
2025-07-17 12:10:02 +00:00
Nimar
31fb304a5e
chore: release v3.82.0
2025-07-17 10:03:10 +02:00
Nimar and GitHub
d6dac50734
fix(playground): use playground with tool calls form langgraph traces ( #7923 )
...
* fix(playground): test with toolcalls from langgraph traces
* delete comment
* fix ts error
* remove superfluous comment
2025-07-16 18:36:03 +00:00
Max Deichmann and GitHub
0cda8e2e21
fix: add timeouts to webhooks ( #7924 )
...
* fix
* fix
* fix
2025-07-16 20:01:07 +02:00
Hassieb Pakzad and GitHub
3f4fd2ff5e
feat(model-prices): match cross-region inference profile for claude via bedrock ( #7918 )
2025-07-16 16:19:32 +00:00
Steffen Schmitz and GitHub
17f0a10b23
feat: add level filter param to observations api ( #7905 )
...
* feat: add level filter param to observations api
* chore: update fern reference
* chore: generate api spec
* chore: patch
* chore: extend timeout
2025-07-16 12:24:40 +00:00
Max Deichmann and GitHub
6c80b5b4a0
chore: add linter rule for react icons ( #7910 )
...
* push
* perf: import react-icons from one sub path
2025-07-16 13:51:48 +02:00
Max Deichmann and GitHub
91b56518c6
perf: import react-icons from one sub path ( #7907 )
2025-07-16 10:00:00 +00:00
257c4136fe
chore: expand logging for large entity truncation ( #7900 )
...
* chore: expand logging for large entity truncation
* Update worker/src/services/ClickhouseWriter/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: fix tests
* chore: patch table name typing
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-16 07:50:54 +00:00
94e5f4b2e7
perf: optimize shared package rebuilds for dev speed b069 ( #7895 )
...
* Update turbo.json to use @langfuse/shared#dev instead of #build
Co-authored-by: max <max@langfuse.com >
* Add incremental build script and update turbo.json dev dependencies
Co-authored-by: max <max@langfuse.com >
* Remove build:dev script and update turbo.json dependencies
Co-authored-by: max <max@langfuse.com >
* push
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-15 20:43:13 +00:00
Steffen Schmitz and GitHub
f09c363aaf
perf: truncate very large records on insertion ( #7894 )
...
* perf: truncate very large records on insertion
* chore: skip stringify
2025-07-15 19:09:31 +00:00
d0c317b423
chore(ingestions): add s3 download size hist and span attribute ( #7887 )
...
* chore(ingestions): add s3 download size hist and span attribute
* push
* Apply suggestion from @maxdeichmann
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
* Apply suggestion from @maxdeichmann
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
* Apply suggestion from @hassiebp
* push
* push
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-07-15 18:18:13 +00:00
Max Deichmann and GitHub
5bcb6b5b38
chore: remove markdown react-icon ( #7893 )
...
push
2025-07-15 17:59:39 +00:00
Max Deichmann and GitHub
3806cb72a1
chore: remove react icons as much as possible ( #7889 )
...
* fixes
* fixes
* fixes
* fixes
* push
* fixes
* fixes
2025-07-15 16:02:20 +00:00
Max Deichmann and GitHub
cbfc78d0e3
chore: fix automations scrolling ( #7884 )
...
fixes
2025-07-15 13:26:26 +00:00
marliessophie and GitHub
5d87047577
chore(layout): restructure main navigation ( #7875 )
...
* chore(layout): restructure main navigation
* chore: refactor page-header tabs component
* chore: push
* chore: push
* chore: push
* chore: push
* chore: move sessions to main nav
* chore: update test
* chore: test
2025-07-15 11:52:57 +00:00
Steffen Schmitz and GitHub
7a3e5ba0c8
fix: fallback to auto for falsy region value in blob storage integration ( #7879 )
2025-07-15 09:33:14 +00:00
Steffen Schmitz and GitHub
df1ec4d81e
fix(otel): handle missing scope name gracefully ( #7872 )
2025-07-15 07:21:57 +00:00
steffen911
68a884c5ed
chore: release v3.81.1
2025-07-15 08:41:30 +02:00
Steffen Schmitz and GitHub
7bcfb9a57e
fix: adjust trace session indexes for faster API accesses ( #7864 )
2025-07-15 06:30:40 +00:00
Hassieb Pakzad and GitHub
0e360759ec
fix(playground): overflow on large description ( #7863 )
2025-07-14 17:43:51 +02:00
steffen911
0510a352a3
chore: release v3.81.0
2025-07-14 15:22:22 +02:00
Steffen Schmitz and GitHub
7854a7e41f
perf: enable API Key and Prompt caching in redis by default ( #7854 )
...
* perf: enable API Key and Prompt caching in redis by default
* chore: update sync prompt test
* chore: disable prompt caching for sync web tests
* chore: enable prompt caching in sync tests
* chore: disable cachking for v1 pipeline
* chore Use cacheEnabled as pure test overwrite
* chore; undefined check
* chore: log body
* chore: patch promptCache test
* chore: fmt
* remove console log
2025-07-14 13:20:37 +00:00
Hassieb Pakzad and GitHub
f0fee7b0ce
chore: remove turbo flag from dev command ( #7859 )
2025-07-14 13:49:44 +02:00
marliessophie and GitHub
52fd2b9ed8
chore(nav): remove all close/open transition delays for improved user experience ( #7856 )
2025-07-14 09:57:22 +00:00
Hassieb Pakzad and GitHub
3ba75e57a0
fix(otel): keep hex ids in place in id parsing ( #7827 )
2025-07-14 09:54:43 +00:00
marliessophie and GitHub
a42cf72d2a
chore(experiments): enhance error handling in LLM call and implement retry logic for experiment creation jobs ( #7632 )
...
* chore(experiments): enhance error handling in LLM call and implement retry logic for experiment creation jobs
- Added try-catch block in callLLM function to handle specific API errors and return appropriate ApiError responses.
- Implemented retry logic for experiment creation jobs in experimentQueue, allowing retries for rate-limited and server errors, with a delay mechanism based on job age.
* chore: push
* refactor: introduce delay utility for job processing
* chore: abstract standardized error handling for LLM operations
* refactor: reorganize utilities and enhance error handling for job processing
* chore: push
* chore: typing
* chore: unify error message
* fix(retry-handler): change executeTakeFirst to executeTakeFirstOrThrow for better error handling
2025-07-14 09:35:59 +00:00
Steffen Schmitz and GitHub
35171cc77d
chore: add projectId to prices table ( #7817 )
2025-07-14 09:34:11 +02:00
Steffen Schmitz and GitHub
6a5f221567
fix(auditlog): patch llmTool and llmSchema records in auditLog ( #7826 )
...
* fix(auditlog): patch llmTool and llmSchema records in auditLog
* chore: linting
* chore: remove redundant L
2025-07-14 06:55:29 +00:00
c9c61c4b8e
ci: all-ci-passed also checks for cancelled status ( #7845 )
...
Update pipeline workflow to handle cancelled jobs in deployment status
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-13 15:25:23 +00:00
Max Deichmann and GitHub
8b6186f191
chore: use --turbo always in web dev ( #7842 )
2025-07-13 11:07:56 +00:00
Steffen Schmitz and GitHub
73fc0e71a3
chore: remove local claude settings file ( #7828 )
...
chore: remove local cloud settings file
2025-07-11 15:12:34 +00:00
Steffen Schmitz and GitHub
40152d1f3c
chore: forbid html elements on names and descriptions via trpc routes ( #7815 )
...
* chore: forbid html elements on names and descriptions via trpc routes
* chore: patch test cases
* chore: patches
2025-07-11 14:39:59 +00:00
Max Deichmann
6cfb78e06e
chore: release v3.80.1
2025-07-11 14:26:20 +02:00
Max Deichmann and GitHub
4f01e773b3
fix: navigation history automations ( #7822 )
...
* fix: navigation history automations
* fix: navigation history automations
2025-07-11 12:21:43 +00:00
Max Deichmann and GitHub
2a83fdbc9a
fix: remove automations cud for members ( #7820 )
...
* fix: hipaa scaling
* fix: move webhook cud operations to admin
2025-07-11 11:40:14 +00:00
Max Deichmann and GitHub
84dd3fa63b
chore: set default webhook selector without setting the browser history ( #7819 )
...
fix: hipaa scaling
2025-07-11 11:24:39 +00:00
Max Deichmann and GitHub
fdf70cdde9
fix: remove S3 delete marker in S3 backfill ( #7812 )
...
push
2025-07-10 20:44:22 +00:00
Marc Klingen and GitHub
07f0125e7c
fix: stripe webhook should also match subscriptions which were not created via checkout session ( #7810 )
...
* wip
* attempted fix
* typo
2025-07-10 19:29:17 +00:00
Nimar and GitHub
bacd44abb1
fix(prompts): prompt folder pagination fix ( #7776 )
...
* remove folder detection from frontend
* filter in be
* update
* update
* caps
* cleanup
* cleanup
* clarify
* fix
* robust
* dedup
* smiplif
* simplift
* update
2025-07-10 17:16:33 +00:00
Marc Klingen and GitHub
cb032047d3
fix: when projects are queued for deletion, hide them and block access from UI ( #7809 )
...
fix: when projects are queued for deletion, hide them and block access
2025-07-10 15:35:50 +00:00
Max Deichmann and GitHub
3ecbcc1670
fix: webhook UI ( #7808 )
2025-07-10 14:48:08 +00:00
Steffen Schmitz and GitHub
85774535ae
chore: create script to refill arbitrary queue events ( #7806 )
2025-07-10 13:29:55 +00:00
Steffen Schmitz and GitHub
db15742d29
chore: add migration checks to confirm that required env variables are present ( #7802 )
2025-07-10 12:42:19 +00:00
cc1c847728
README: update language-specific README files ( #7798 )
...
* Update README.cn.md with Terraform templates and minor text changes
Co-authored-by: jannik <jannik@langfuse.com >
* Update cloud deployment and integration sections in README files
Co-authored-by: jannik <jannik@langfuse.com >
* Changes from background composer bc-f4eefbe6-9e55-4dc0-be21-0fc7d81c9079
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-10 09:37:24 +00:00
Max Deichmann and GitHub
a6bf28495c
security: upgrade alpine image ( #7796 )
...
push
2025-07-10 09:13:58 +00:00
marliessophie and GitHub
0391b9a263
chore(prompt-experiments): set langfuse-native environment ( #7573 )
...
* chore(prompt-experiments): set langfuse-native environment
* refactor: no longer export ingestionEvent schema directly
* chore: rm line number
* chore(ingestion): refactor processEventBatch to accept options object
* chore(ingestion): refactor ingestion schemas for public and internal environments
- Introduced separate schemas for public and internal environments.
- Updated environment name validation logic and error messages.
- Refactored event schemas to utilize the new schema structure.
- Deprecated direct export of `ingestionEvent` schema in favor of factory method for better environment handling.
* chore: push
* chore: type environment schema as string
* chore: push
* chore: fix import statements
* chore: update langfuse-langchain to version 3.38.3
* chore: prettier
* chore: revert prettier
2025-07-10 08:23:28 +00:00
Max Deichmann and GitHub
4fc2e33058
fix: gracefully handle missing config for webhooks ( #7787 )
...
* fix: gracefully handle missing config for webhooks
* fix: gracefully handle missing config for webhooks
2025-07-09 18:34:08 +00:00
Max Deichmann and GitHub
9a6fa8747b
fix: remove swap settings from release gha ( #7786 )
...
fix: remove swap settings from releasegha
2025-07-09 18:18:52 +00:00
Max Deichmann
bd0b204d18
chore: release v3.80.0
2025-07-09 19:30:09 +02:00
Max Deichmann and GitHub
94586e3f62
fix: fix webhook storage ( #7783 )
2025-07-09 17:20:49 +00:00
steffen911
63349976fa
chore: rename migration folder
2025-07-09 18:02:21 +02:00
Max Deichmann and GitHub
8d092d0e18
chore: remove prompt logs ( #7779 )
...
* security: upgrade golang-migrate
* push
* push
* push
2025-07-09 15:45:43 +00:00
c8c031e0bd
feat(blob-integration): allow custom start date for blob storage exports ( #7745 )
...
* chore: formatting
* chore: add migration file and patches
* format
* chore: add test case
* chore: patch test case
* chore; frontend cleanup
* Apply suggestion from @ellipsis-dev[bot]
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update .devcontainer.json
* chore: test
* patch azure
* chore: revert
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-09 15:44:22 +00:00
Steffen Schmitz and GitHub
b616b0d260
fix(dashboard): allow score numeric value filter and metric ( #7771 )
...
* fix(dashboard): allow score numeric value filter and metric
* revert
* chore: drop debug log
2025-07-09 13:33:55 +00:00
Hassieb Pakzad and GitHub
91d929646e
chore(prompt-experiments): upgrade langfuse-langchain ( #7770 )
2025-07-09 13:18:14 +00:00
Nimar and GitHub
bfdbd93997
feat(playground): allow arbitrary values for placeholders in playground ( #7768 )
...
* allow arbitrary values for placeholders in playground
* update playground
* fix lint
* re-add removed functions
* stringify if arbitrary
* safety first!
2025-07-09 12:14:57 +00:00
2916b4228d
chore: improve retry script for ingestion events ( #7769 )
...
* chore: improve retry script for ingestion events
* chore: move file
* Update worker/src/scripts/replayIngestionEvents/README.md
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-09 11:30:31 +00:00
e5a04751e1
fix: Ensure json output for single value csv import ( #7763 )
...
* Ensure CSV parsing always returns JSON object for single columns
Co-authored-by: marc <marc@langfuse.com >
* Update web/src/features/datasets/lib/csvHelpers.ts
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-09 10:57:11 +00:00
bb554b38af
chore: remove webhook button from single prompt page ( #7762 )
...
* Changes from background composer bc-61bc6129-a444-40fd-9e03-d397fc1c9ee1
* fix lint
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-09 10:57:05 +00:00
marliessophie and GitHub
cfc8161473
chore(experimentService): extend logging ( #7759 )
...
* chore(experimentService): extend logging
* chore: eslint
* chore: revert
2025-07-09 08:49:41 +00:00
Steffen Schmitz and GitHub
aecd8eff2d
chore: add backoff retries to clickhouse writer ( #7761 )
2025-07-09 08:39:54 +00:00
Nimar
74c59f58c2
chore: release v3.79.1
2025-07-09 09:55:32 +02:00
Nimar and GitHub
e073ec9a21
fix(traces): jumptoplayground possible for langgraph traces with tools ( #7744 )
...
* fix jumptoplayground for langgraph
* update type
2025-07-09 07:38:31 +00:00
Nimar and GitHub
5920f3a6c7
chore(dx): add prettier to CI ( #7735 )
...
* add prettier to CI
* escape
* use an array
* make CI simple again
* debug
* debug
* debug2
* debug again
2025-07-08 08:54:55 +00:00
c2a0b381d4
feat: Add gen_ai.conversation.id support ( #7738 )
...
Changes from background composer bc-11040caa-e818-42ef-8bb2-4b004ae862a7
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-08 06:45:45 +00:00
7598c95fc3
fix(prompts): prompts with many labels look good ( #7731 )
...
* Add TruncatedLabels component for flexible label display with hover
Co-authored-by: nimar <nimar@langfuse.com >
* Refactor: Improve code formatting and consistency across components
Co-authored-by: nimar <nimar@langfuse.com >
* add many labelled prompt
* add many labelled prompt
* remove superfluous code
* do 8 labels here
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-07 15:16:08 +00:00
Steffen Schmitz and GitHub
35f6f5f0fc
feat(dashboard): allow breakdown by month ( #7725 )
...
* feat(dashboard): allow breakdown by month
* chore: add aliases to the queries
* chore: add test case and formatting
* chore: adjust test behaviour
2025-07-07 15:07:39 +00:00
da23a5ad0b
chore(ui-markdown-viewer): stop interpreting $currency symbol as latex math block marker ( #7723 )
...
Remove remark-math plugin from MarkdownViewer
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-07 14:38:08 +00:00
Max Deichmann and GitHub
5adac14049
chore: print response body webhook errors ( #7728 )
...
* security: upgrade golang-migrate
* push
* push
2025-07-07 13:36:45 +00:00
Nimar
234f131493
chore: release v3.79.0
2025-07-07 15:24:20 +02:00
Nimar
c87e3f88fc
chore: release v3.78.3
2025-07-07 15:17:43 +02:00
b0aeb8c454
fix(prompts): handle placeholder messages in diff view ( #7726 )
...
* Improve prompt diff display with formatted content for placeholders
Co-authored-by: nimar <nimar@langfuse.com >
* tmp
* Update PromptVersionDiffDialog.tsx
* fix diff
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-07 13:15:14 +00:00
Nimar and GitHub
a71ac105b9
chore(dx): fix prettier version in ee ( #7722 )
...
* chore(dx): fix prettier in ee
* fix tailwind
* update formatting
* cache formattgin
2025-07-07 12:09:29 +00:00
Steffen Schmitz and GitHub
225d64d0f8
build: add registry prefix to docker-compose files ( #7719 )
2025-07-07 11:48:33 +00:00
Steffen Schmitz and GitHub
327018eb09
build: remove swap settings from pipeline config ( #7717 )
2025-07-07 11:29:05 +00:00
fe8ba75ff3
chore(dx): prettier for all ( #7692 )
...
* add prettier command
* add pre-commit hook
* sync prettier config with .vscode config
* add line
* fix husky
* update for less changes
* upgrade to prettier 3.4 for bug fixes
* ignore no-undef in TS (also worker!)
* changes to prettier
* adhere to style
* make prettier 3.4 default for bug fix
* add prettier ignore
* reset to standard
* update to 3.6.2
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-07-07 11:00:45 +00:00
Jannik Maierhöfer and GitHub
74e8c0fe58
chore(ui): change link on traces and observations table to data model docs page ( #7713 )
2025-07-07 09:15:09 +00:00
marliessophie and GitHub
4f57af8ea1
refactor(datasets-compare): implement context for managing selected resource metrics ( #7660 )
...
* refactor(datasets-compare): implement context for managing selected resource metrics
* chore: push
* chore: add dialog header wrapper
2025-07-07 09:12:17 +00:00
Max Deichmann and GitHub
4132335c96
security: upgrade golang-migrate ( #7712 )
...
* security: upgrade golang-migrate
* push
2025-07-07 08:52:53 +00:00
Steffen Schmitz and GitHub
67dae75e3a
chore: add timestamp column to AMTs for backwards compat ( #7710 )
...
* chore: add timestamp column to AMTs for backwards compat
* chore; expand allowed claude functions
2025-07-07 08:12:30 +00:00
ed0a07a958
fix(cloud): update CSP to allow for file upload in support chat ( #7703 )
...
Update CSP to allow connections to AWS S3 domains
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-06 12:45:09 +02:00
Steffen Schmitz and GitHub
0a63cc61fc
chore: fix timestamp ordering for amt table ( #7700 )
...
* chore: fix timestamp ordering for amt table
* chore: update comment
2025-07-05 13:50:53 +00:00
Max Deichmann and GitHub
c385121406
chore: improve auto selection of automations page ( #7698 )
...
* chore: add webhook throughput alert
* chore: add webhook throughput alert
* chore: add webhook throughput alert
2025-07-05 08:28:45 +00:00
Max Deichmann and GitHub
7d7932e024
fix: do not store output of webhook automations ( #7697 )
...
* push
* fixes
2025-07-05 08:07:46 +00:00
b26362cbca
feat: webhook for prompt version changes ( #7012 )
...
* push
* fix
* fix
* fix
* fix
* fix
* push
* fix
* push
* push
* push
* push
* fix
* fix
* push
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fixes
* Update .cursor/rules/global.mdc
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update web/src/features/rbac/constants/projectAccessRights.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* push
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* push
* change event prcessing
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* Update worker/src/__tests__/webhooks.test.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* push
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fix tests
* Update web/src/__tests__/async/prompts.v2.servertest.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* data model
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-05 07:02:30 +00:00
Nimar and GitHub
9b8095f8f5
chore(dx): unit tests run against their own db ( #7671 )
...
* chore(dx): unit tests run against their own db
* fix clickhouse
* clean up a bit
* close
* update only use different postgres
* update with command
* remove CH
2025-07-04 14:50:27 +00:00
Hassieb Pakzad and GitHub
8b76617019
fix(dataset-run-items-api-spec): correct response type ( #7690 )
2025-07-04 15:20:54 +02:00
93e50f4720
feat(prompts): Add prompt filtering by config ( #7688 )
...
* Add config column to prompts table for JSON filtering
Co-authored-by: marc <marc@langfuse.com >
* remove plan
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-04 13:09:07 +00:00
Hassieb Pakzad and GitHub
c1388c8699
chore: upgrade langfuse-langchain ( #7687 )
2025-07-04 12:37:00 +00:00
Steffen Schmitz and GitHub
43fc305d5b
fix: create virtual timestamp column in AMT query to support all filters ( #7676 )
...
* fix: create virtual timestamp column in AMT query to support all filters
* chore: add test logging
* chore: skip database prune for async tests
* chore: cleanup
* chore: drop console logs
2025-07-04 12:06:43 +00:00
marliessophie and GitHub
ebd4cf3e8a
chore(sentry): restrict loggerLink to development environment only for less noise in sentry ( #7684 )
2025-07-04 12:00:23 +00:00
Nimar and GitHub
5dfc821575
fix: run prettier on my changes ( #7685 )
...
format all
2025-07-04 11:52:37 +00:00
marliessophie and GitHub
3965a5174f
chore(sentry): only report server side errors (5xx) to sentry; skip reporting client side errors ( #7682 )
2025-07-04 11:09:46 +00:00
Max Deichmann and GitHub
df237a11d5
chore: refactor prompts test ( #7680 )
...
* push
* fixes
* fixes
* fixes
2025-07-04 09:55:27 +00:00
marliessophie and GitHub
373cefdcb5
chore(sentry): do not report expected API key errors to sentry ( #7678 )
2025-07-04 08:57:37 +00:00
Steffen Schmitz and GitHub
b92a8c6d81
fix(dashboard): adjust filters on view change and expose bad request errors ( #7675 )
...
* fix(dashboard): adjust filters on view change and expose bad request errors
* chore: skip error typing
2025-07-04 08:52:27 +00:00
Steffen Schmitz and GitHub
68422d404c
chore(dashboard): remove breakdowns by 1:N dimensional relations ( #7674 )
2025-07-04 07:28:42 +00:00
Steffen Schmitz and GitHub
d42c4e5e2f
perf: start to experimentally shift reads to new aggregatingmergetrees ( #7631 )
...
* perf: start to experimentally shift reads to new aggregatingmergetrees
* chore: linting
* chore: more linting
* chore: create checklist for trace table view migrations
* feat: shift by id queries onto new AMTs
* chore: cover traces for public api
* chore: add notes for maxMap
* chore: incorporate feedback into query declarations
* chore: cleanup queries
* chore: adjust reads to new layout
* chore: update ingestion pipeline to make use of nullable fields
* chore: add sampling
* chore: update sampling decision attribute
* chore: fix limit for getTracesByIds
* chore: spacing
* chore: linting
2025-07-03 17:30:10 +00:00
0d2586e4f2
feat(ui): Add trace download button, exports trace and observation metadata as json ( #7668 )
...
* Add download trace as JSON button to TracePage
Co-authored-by: marc <marc@langfuse.com >
* Add JSON download functionality for trace details
Co-authored-by: marc <marc@langfuse.com >
* Checkpoint before follow-up message
* Refactor trace download button placement and add conditional rendering
Co-authored-by: marc <marc@langfuse.com >
* Refactor trace download to export trace and observations data
Co-authored-by: marc <marc@langfuse.com >
* fix
* push
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-03 17:28:00 +00:00
Hassieb Pakzad and GitHub
ff40e79143
feat(llm-connections): add gemini 2.5 flash lite and gemini 2.5 prices ( #7666 )
...
* feat(llm-connections): add gemini 2.5 flash lite and gemini 2.5 prices
* push
* add reasoning
2025-07-03 16:25:11 +00:00
marliessophie and GitHub
bd04f6b186
fix(nav): implement responsive navigation with DropdownMenu for mobile ( #7665 )
...
* feat(nav): implement responsive navigation with DropdownMenu for mobile
* chore: push
2025-07-03 16:06:44 +00:00
Max Deichmann and GitHub
d107f98654
perf: increase ingestion queue retry attempts ( #7649 )
...
* push
* push
2025-07-03 12:55:37 +00:00
Hassieb Pakzad and GitHub
de9fa8199a
feat(llm-connections): add gemini 2.5 pro and flash GA ( #7659 )
2025-07-03 12:33:32 +00:00
Marlies Mayerhofer
0e1498a094
chore: release v3.78.2
2025-07-03 13:37:47 +02:00
marliessophie and GitHub
38f020e482
fix(scores): update score validation logic to accept inclusive ranges for score config validation ( #7650 )
...
* fix(scores): update score validation logic to accept inclusive ranges for score config validation
* chore: typo
2025-07-03 09:22:33 +00:00
Hassieb Pakzad and GitHub
07e1d4e960
fix(otel): trace update events on present metadata ( #7648 )
2025-07-03 08:36:40 +00:00
Hassieb Pakzad and GitHub
602d00a5bb
chore: upgrade langfuse-langchain ( #7647 )
2025-07-03 08:16:41 +00:00
7395bd8d83
fix: loading state of csv import button ( #7640 )
...
* Disable import button during processing and show loading state
Co-authored-by: marc <marc@langfuse.com >
* prettier
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-03 00:12:27 +00:00
Marc Klingen and GitHub
63d164ad52
chore: improve cursor background agent configuration ( #7641 )
...
* fix
* push
* test
2025-07-03 01:41:14 +02:00
Thorsten Spieker and GitHub
f1b915c8b7
fix: remove invalid metrics and dimensions from pivot table widget on view change ( #7636 )
...
* fix: remove invalid metrics and dimensions from pivot table widget on view change
* linting
2025-07-02 19:01:26 +02:00
Steffen Schmitz and GitHub
e3886b94c1
chore: set static backoff for query clickhouse retries ( #7635 )
2025-07-02 17:35:43 +02:00
Steffen Schmitz and GitHub
44376c2a9f
chore: ignore all pending linting errors and enforce zero warnings ( #7634 )
2025-07-02 14:32:35 +00:00
marliessophie and GitHub
2e85c9ac15
chore(evals): add QUEUE_ERROR_MESSAGES constants for improved error handling ( #7630 )
...
* chore(evals): add QUEUE_ERROR_MESSAGES constants for improved error handling
* chore: push
2025-07-02 14:01:15 +00:00
Steffen Schmitz and GitHub
7cc81deb65
chore: retry socket hang ups for CH queries ( #7628 )
2025-07-02 13:52:26 +00:00
Steffen Schmitz and GitHub
a13ddd41ae
exp: write observation and score info to traces_mt ( #7590 )
...
* exp: write observation and score info to traces_mt
* chore: update declarations for experimental traces table
* chore: change anyLast pattern to working condition
* chore: revert anyLast setup
* chore: revert
* chore: cleanup queries
2025-07-02 11:53:38 +00:00
Nimar
ebe85f2a67
chore: release v3.78.1
2025-07-02 12:15:50 +02:00
Nimar and GitHub
c7b62adbab
feat(experiments) support for placeholders as message histories ( #7615 )
...
* run experiments with placeholders as well
* add missing file
* fix experiements
* run outside of loop
* add tests
* fix tests
* make tests clean again
* also test that variables resovle first
2025-07-02 10:04:51 +00:00
66d4926fd0
feat: add tags to search on prompts table ( #7619 )
...
* Enhance prompt search to include tags with case-insensitive matching
Co-authored-by: marc <marc@langfuse.com >
* drop md
* prettier
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-01 20:37:57 +00:00
b26f5c512f
refactor: pivot table dropdowns ( #7611 )
...
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-07-01 21:21:46 +02:00
marliessophie and GitHub
9227eaab9c
feat(deleteButton): add custom delete message for running evaluator ( #7617 )
2025-07-01 18:33:41 +00:00
Nimar
3debac082a
chore: release v3.78.0
2025-07-01 18:34:30 +02:00
fb43e03171
feat(prompts): Add search bar to prompts table ( #7603 )
...
* Add search functionality to prompts table with query param support
Co-authored-by: marc <marc@langfuse.com >
* prettier
* fix
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-01 14:16:45 +00:00
marliessophie and GitHub
dd04da64ba
fix(prisma): update JobExecution and DefaultLlmModel relations to include onUpdate and onDelete behaviors to match DB constraints ( #7602 )
...
* fix(prisma): update JobExecution and DefaultLlmModel relations to include onUpdate and onDelete behaviors to match DB constraints
* chore(prisma): update foreign key onUpdate behavior for job_template_id in JobExecution model
* Revert "chore(prisma): update foreign key onUpdate behavior for job_template_id in JobExecution model"
This reverts commit e65c12c9c36a1f8732560e665b1d8d7422c530f0.
2025-07-01 14:07:42 +00:00
b94cd9880a
chore: fix typos ( #7604 )
...
* Fix typos: GitHub brand name and "check out" verb phrase
Co-authored-by: marc <marc@langfuse.com >
* Checkpoint before follow-up message
* Fix GitHub brand name and typos across documentation and UI
Co-authored-by: marc <marc@langfuse.com >
* Changes from background composer bc-bdbd909e-6932-4489-b125-e66b1d0f5ebe
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-07-01 13:54:09 +00:00
Nimar and GitHub
0f2d2b8850
fix(prompts): don't allow placeholders and variable with same name on same prompt version ( #7598 )
...
* no naming collisions between prompt and placeholder
* tests for variable placeholder name collision
* fix test spelling
* also show conflict in playhground
2025-07-01 13:39:35 +00:00
steffen911
69db85cfe4
chore: release v3.77.0
2025-07-01 13:37:53 +02:00
Thorsten Spieker and GitHub
b445471f98
feat(dashboard): add pivot table widget type ( #7546 )
2025-07-01 13:36:54 +02:00
2ce014980b
feat(posthog-export): Add environment attribute to PostHog exports ( #7581 )
...
* Add environment to PostHog event tracking for traces and observations
Co-authored-by: marc <marc@langfuse.com >
* use object envs instead of trace env
* fix
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-06-30 22:47:14 +00:00
Nimar
40ad6761cc
chore: release v3.76.0
2025-06-30 19:13:49 +02:00
bd36669c6a
feat(prompts): prompt chat message placeholders in backend and api ( #7388 )
...
* add first unit test
* first test passes
* share types
* fix tests
* update docs for placeholder
* improve tests
* add message compile
* update types
* add backend remaining
* fix playground
* review suggest
* add playground
* code review
* fix spelling
* fix validation in FE
* fix validation
* add seed data
* allow placeholdered prompt to playgrounf
* add tooltip
* fix build
* code feedback
* use zod to validate
* Update CLAUDE.md
* chore: remove prefix from user_id column (#7477 )
* chore: add .env values for sdk integration tests (#7479 )
* fix(data-tables): table peeks and full links should respect custom basePaths (#7483 )
* strip url
* fix for dataset peek
* add to cursor rules
* chore: release v3.75.1
* feat: line breaks on evaluation run tooltip hints (#7486 )
* Fix comment display to preserve whitespace and line breaks
* include in seeder
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
* chore: reduce number of listed S3 files in event processing (#7487 )
* chore(cloud): apply "cloud:demo" tier to demo org tenant in plain sup… (#7489 )
chore(cloud): apply "cloud:demo" tier to demo org tenant in plain support
* make the api beautiful again
* update api
* reorg import
* fix improt
* prefill message placeholders
* remove todos
* fix prompt mapping
---------
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
Co-authored-by: Marc Klingen <git@marcklingen.com >
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-06-30 16:54:07 +00:00
Steffen Schmitz and GitHub
98cc1bb7a1
exp: add aggregating merge trees experiment for traces tables ( #7574 )
...
* exp: add aggregating merge trees experiment for traces tables
* chore: lint
2025-06-30 16:46:50 +00:00
marliessophie and GitHub
3dcdbd99b3
fix(evals): show loading state of detail buttons only if preview is enabled ( #7570 )
...
fix(evals): show loading state of detail buttons only if show preview is enabled
2025-06-30 14:40:17 +00:00
Hassieb Pakzad and GitHub
1a5c5f6383
fix(otel): skip multiproject check for non-python ( #7568 )
2025-06-30 13:38:14 +00:00
Steffen Schmitz and GitHub
867f6c7484
feat(dashboard): allow filtering by score value in custom dashboards ( #7567 )
...
* feat(dashboard): allow filtering by score value in custom dashboards
* chore: remove console log
2025-06-30 13:16:14 +00:00
Nimar and GitHub
1097f1b8d5
chore(dx): show different favicon for dev mode - easier to find tab ( #7550 )
...
add dev favicon
2025-06-30 12:00:25 +00:00
Marc Klingen and GitHub
a73156bbe5
fix: warn if missing encryption_key when updating posthog integration ( #7560 )
...
* fix: warn if missing encryption_key when updating posthog integration
* push
2025-06-30 11:20:22 +00:00
marliessophie and GitHub
7a9c62b106
refactor(evals): optimize variable extraction logic in EvaluationPromptPreview and useExtractVariables hooks ( #7409 )
...
* refactor(evals): optimize variable extraction logic in EvaluationPromptPreview and useExtractVariables hooks
* style: improve preview header
* chore: eslint
2025-06-30 10:57:37 +00:00
marliessophie and GitHub
70cc910ee9
fix(datasets): allow users to update metadata and description while keeping name constant ( #7562 )
...
* feat: add whitelisted name support for unique name validation in dataset form
* fix: pass metadata to update dataset form
2025-06-30 09:55:00 +00:00
Steffen Schmitz and GitHub
64a71f059f
chore: add trace update compatibility properties ( #7561 )
2025-06-30 09:28:23 +00:00
Max Deichmann and GitHub
f5a0c7cfed
chore: move prompt types into shared package ( #7555 )
...
* push
* fixes
* fixes
* fixes
* fixes
* fixes
* fixes
2025-06-29 10:38:14 +00:00
Marc Klingen and GitHub
2472d2f6da
chore(cloud): remove posthog groups to reduce costs ( #7552 )
2025-06-27 20:01:38 +00:00
Max Deichmann and GitHub
dd0446f4dd
chore: add python sdk v3 notification ( #7543 )
...
* fixes
* push
2025-06-27 14:08:47 +00:00
Max Deichmann and GitHub
7263a1554c
chore: fix admin api ( #7530 )
...
* fixes
* fixes
2025-06-27 11:10:00 +00:00
Max Deichmann and GitHub
2c25c27b51
chore: skip s3 LIST for projects configured in env ( #7541 )
...
push
2025-06-27 11:09:50 +00:00
Steffen Schmitz and GitHub
f2b92e1f23
chore: only consider getWaitingCount for queue length ( #7542 )
2025-06-27 09:44:37 +00:00
Steffen Schmitz and GitHub
593c0a567c
perf: execute eval variable parsing sequentially ( #7540 )
...
* perf: execute eval variable parsing sequentially
* chore: skip caching for dataset items
2025-06-27 09:24:02 +00:00
Steffen Schmitz and GitHub
ac1f465634
perf: cache eval entities during variable extraction ( #7538 )
2025-06-27 07:56:01 +00:00
Nimar and GitHub
083b1357a1
fix: long trace names shouldn't break at icons ( #7382 )
...
* fix breaks
* fix
* undo
2025-06-26 18:27:36 +00:00
Nimar
30e594e839
chore: release v3.75.4
2025-06-26 19:25:59 +02:00
2b8f583c44
fix(prompts): custom label creation popover too wide ( #7529 )
...
* fix UI
* disable button if nothing changed
* Update web/src/features/prompts/components/SetPromptVersionLabels/index.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-26 17:20:27 +00:00
steffen911
ef3656a8d3
chore: release v3.75.3
2025-06-26 14:57:02 +02:00
Steffen Schmitz and GitHub
5cf2411e74
feat: include all values from scoreConfig in filterOptions ( #7524 )
2025-06-26 12:54:00 +00:00
Steffen Schmitz and GitHub
6d9956ae6e
fix(dashboard): correctly display name filters on widget edit ( #7522 )
2025-06-26 12:29:39 +00:00
Nimar and GitHub
37d1ac7ff8
chore: update contributing.md with recent state ( #7510 )
2025-06-25 17:50:07 +00:00
Marc Klingen and GitHub
339633e8de
chore(cloud): color of upgrade notification ( #7508 )
...
* add danger color to sidebar notification
* add icon when sidebar is collapsed
* fix
2025-06-25 17:05:33 +00:00
Nimar
a31af76ba1
chore: release v3.75.2
2025-06-25 19:01:15 +02:00
Steffen Schmitz and GitHub
dfd527a740
fix: show falsy values in IOTableCell unless null/undefined ( #7507 )
2025-06-25 16:53:23 +00:00
d65bdaa761
fix(dashboards): represent small numbers in scientific notation ( #7506 )
...
* fix(dashboards): represent small numbers in scientific notation
* Update web/src/utils/numbers.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-25 16:09:17 +00:00
Nimar and GitHub
ef08a514af
chore: enable sentry replays ( #7498 )
...
* Update sentry.client.config.ts
* simpify
* fix TS build - complexify
2025-06-25 10:11:15 +00:00
Nimar and GitHub
3b3d9de206
chore(deps): upgrade turborepo 1.13 to 2.5.4+ ( #7492 )
...
* upgrade turbo
* add web dev turbo runner
* upgrade docker
* fix linter
* set env mode to loose (as in turbo v1) so we don't have to double specify env vars
2025-06-25 09:48:24 +00:00
Max Deichmann and GitHub
f1ca851b0d
chore: gracefully handle failed evals ( #7500 )
...
push
2025-06-25 09:14:16 +00:00
Steffen Schmitz and GitHub
c1c6035778
chore: propagate additional properties on logs and spans ( #7497 )
2025-06-25 08:11:44 +00:00
Marc Klingen and GitHub
d2bf002ea2
chore: improve support widget CTAs ( #7494 )
2025-06-25 00:08:32 +00:00
Marc Klingen and GitHub
88f9008558
chore(cloud): apply "cloud:demo" tier to demo org tenant in plain sup… ( #7489 )
...
chore(cloud): apply "cloud:demo" tier to demo org tenant in plain support
2025-06-24 20:05:22 +00:00
Steffen Schmitz and GitHub
586e852375
chore: reduce number of listed S3 files in event processing ( #7487 )
2025-06-24 18:18:35 +00:00
94e49dbc4e
feat: line breaks on evaluation run tooltip hints ( #7486 )
...
* Fix comment display to preserve whitespace and line breaks
* include in seeder
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-06-24 18:07:55 +00:00
Nimar
d37e676ea6
chore: release v3.75.1
2025-06-24 19:29:19 +02:00
Nimar and GitHub
626b36e225
fix(data-tables): table peeks and full links should respect custom basePaths ( #7483 )
...
* strip url
* fix for dataset peek
* add to cursor rules
2025-06-24 17:21:03 +00:00
Nimar and GitHub
62cd67f431
chore: add .env values for sdk integration tests ( #7479 )
2025-06-24 15:37:44 +00:00
Steffen Schmitz and GitHub
09f1bb9f7f
chore: remove prefix from user_id column ( #7477 )
2025-06-24 15:19:45 +00:00
Steffen Schmitz and GitHub
d6963297a7
fix: handle dataset queries with cached traces in evals ( #7475 )
...
* fix: handle dataset queries with cached traces in evals
* chore: replace all validatedfilter calls in Inmemorytacefitlerlogic
2025-06-24 14:35:17 +00:00
Steffen Schmitz and GitHub
06b9e88d3a
chore: update lossless-json to 4.1.1 ( #7473 )
2025-06-24 12:55:53 +00:00
Hassieb Pakzad and GitHub
39feb65d90
fix(llm-connection-vertex): use zodV3 for structured output calls ( #7468 )
...
* fix(llm-connection-vertex): use zodV3 for structured output calls
* fix
2025-06-24 12:07:56 +00:00
b85511a3fe
perf: cache eval trace check across multiple configs ( #7407 )
...
* perf: cache eval trace check across multiple configs
* chore: update conditions
* chore: udpate conditions
* chore: remove unused eval test
* chore: update filter stuff
* chore: reduce unused test properties
* chore: filters
* chore: add missing in memory filter types
* Update packages/shared/src/server/services/InMemoryFilterService.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: comments
* chore: add metrics for eval config fetches
* chore: linting
* chore: fix tests
* chore: linting
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-24 12:07:54 +00:00
marliessophie and GitHub
88e47faec4
refactor(dialog): update button layouts in forms for consistent styling ( #7470 )
2025-06-24 11:04:48 +00:00
steffen911
9291f8e110
chore: release v3.75.0
2025-06-24 11:18:52 +02:00
Steffen Schmitz and GitHub
fad5d047e7
fix: avoid ambigious identifiers for full-text search ( #7465 )
2025-06-24 10:46:04 +02:00
5071009dfb
fix: export datasets ( #7455 )
...
* feat: add mapDatasetItems table definition
* feat: add dataset_items table to database read stream
* feat: add export button to dataset items table
* feat: add dataset items batch export tests
* fix: remove unnecessary filtering attempt
* fix: remove unused imports, refactor use of b utton component
* push fixes
* fix: only export dataset items for the displayed dataset
* fix: set htmlSourcePath to empty string for dataset items with no source
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-06-23 19:21:37 +00:00
Marc Klingen and GitHub
8dfb023a55
chore(cloud): update in-product pricing page for new graduated pricing ( #7393 )
...
* chore(cloud): update in-product pricing page for new graduated pricing
* rename to units
* push
2025-06-23 21:14:53 +02:00
Marc Klingen and GitHub
870adf284a
chore(cloud): apply pro rate limits to core plan (tmp) ( #7392 )
2025-06-23 19:00:04 +00:00
Hassieb Pakzad and GitHub
164f81f249
fix(trace-ui): remove unnecessary json key ( #7454 )
2025-06-23 17:07:24 +00:00
d43f30a40f
feat(llm-api-keys): allow configuring GCP location for VertexAI ( #7367 )
...
* feat(llm-api-keys): allow configuring GCP location for VertexAI
* Update web/src/features/public-api/components/CreateLLMApiKeyForm.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-23 14:04:29 +00:00
Hassieb Pakzad and GitHub
4243be58f6
fix(models): zodResolver ignoring modelName ( #7451 )
2025-06-23 12:11:22 +00:00
88074ea024
feat: add ability to export dataset items ( #7199 )
...
* feat: add mapDatasetItems table definition
* feat: add dataset_items table to database read stream
* feat: add export button to dataset items table
* feat: add dataset items batch export tests
* fix: remove unnecessary filtering attempt
* fix: remove unused imports, refactor use of b utton component
* push fixes
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-06-23 11:09:10 +00:00
marliessophie and GitHub
a31add749f
fix(playground): do not report playground errors to sentry ( #7448 )
2025-06-23 10:48:32 +00:00
Nimar and GitHub
8d19030391
fix(data-tables): pagination not adjusted by enter key ( #7425 )
...
fix pagination not accessible by enter key
2025-06-23 10:47:21 +00:00
marliessophie and GitHub
8bab408098
fix(observation): filter out null values from model parameters in ObservationPreview ( #7447 )
2025-06-23 10:27:44 +00:00
marliessophie and GitHub
9f2dd6190d
fix(scores): add environment field to upsert annotation score ( #7446 )
2025-06-23 10:13:56 +00:00
steffen911
89a339a6bf
chore: release v3.74.0
2025-06-23 11:45:18 +02:00
Steffen Schmitz and GitHub
ca9c64099f
fix(exports): propagate search state to export ( #7445 )
2025-06-23 09:33:35 +00:00
5a10257b64
add claude.md file ( #7439 )
...
* add claude.md file
* spelling
* Update CLAUDE.md
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-22 21:51:41 +00:00
Clemo and GitHub
6ee95d5cac
docs: update readme
2025-06-20 16:23:46 -07:00
marliessophie and GitHub
0a9e322d26
feat(sidebar): persist collapsed state ( #7424 )
...
* feat(nav): integrate HoverCard component for improved navigation item display
* refactor(nav): enhance HoverCard integration and sidebar styles for improved UX
* chore(sidebar): replace cookie-based state management with local storage for sidebar state persistence
* chore: push
* refactor(nav): wrap HoverCardContent in Portal for improved rendering context
* style: mark hovered item as active
2025-06-20 15:11:34 +00:00
marliessophie and GitHub
faee716eba
chore(seeder): tweak session and prompt data ( #7423 )
...
* chore(seeder): tweak session and prompt data
* chore: push
2025-06-20 12:42:26 +00:00
Nimar
03880ba4c6
chore: release v3.73.1
2025-06-20 13:18:11 +02:00
Nimar and GitHub
2626c1a57c
fix(prompts): bottom pagination buttons didn't respond ( #7421 )
...
fix bottom pagination buttons don't work
2025-06-20 09:51:45 +00:00
marliessophie and GitHub
31810bb2b7
fix(button): set default button type to "button" if not specified ( #7406 )
2025-06-19 14:51:14 +00:00
marliessophie and GitHub
b5c6727db7
fix(evals): use jsonpath-plus for JSONPath extraction in frontend preview ( #7404 )
...
* fix(evals): use jsonpath-plus for JSONPath extraction in frontend preview
* refactor(evals): remove
* chore: perf
* fix: imports
2025-06-19 14:43:28 +00:00
marliessophie and GitHub
e1d0b5e173
chore(seeder): represent correct langfuse data model in seed data ( #7389 )
...
* chore(CreateLLMApiKeyForm): replace Input with PasswordInput for improved UX
* chore: revert
* chore(data): add seed data and constants for datasets, prompts, and traces
- Introduced new JSON files for chat ML and nested JSON data.
- Created seed constants for datasets and prompts to streamline data generation.
- Updated seed scripts to utilize new constants and improve dataset creation logic.
- Enhanced Clickhouse preparation scripts to support new dataset structures and trace generation.
- Added utility functions for generating unique trace IDs.
This commit lays the groundwork for improved data handling and observability in the Langfuse application.
* chore(data): remove deprecated prompt files and enhance seed constants
* chore(prisma): remove unique constraint on projectId, datasetId, and input in DatasetItem model
* chore: push
* chore(seeder): introduce seeder abstraction
* chore: typos
* chore: restructure files
* chore: restructure files
* chore: fix imports
* chore: fix imports
* chore: lint
* chore: simplify
* chore: ensure eval data integrity
* chore: update metric name calculation in ClickHouse query builder
* refactor: use test-utils for clickhouse inserts
2025-06-19 13:23:13 +00:00
Steffen Schmitz and GitHub
f147f344d6
chore: add devcontainer.json ( #7402 )
...
* chore: add devcontainer.json
* chore: add pnpm install
* chore: replace tab with space
* chore: node version
* chore: add host requirements
* chore: revert hostrequirements
* Update .devcontainer.json
* Update .devcontainer.json
* add claude code
2025-06-19 12:33:44 +00:00
Steffen Schmitz and GitHub
9c0d16fb3a
chore: upgrade prisma to 6.10.1 ( #7401 )
2025-06-19 07:30:10 +00:00
Steffen Schmitz and GitHub
20d11f1a4d
chore: move trpc unauthed logging to info/warn ( #7391 )
2025-06-18 18:21:11 +02:00
Steffen Schmitz and GitHub
89eedcd807
chore: track clickhouse calls in ingestion-pipeline as clients & auth error logging ( #7390 )
2025-06-18 17:26:54 +02:00
ef5efe530e
chore(deps): bump @react-email/components from 0.0.42 to 0.1.0 ( #7371 )
...
Bumps [@react-email/components](https://github.com/resend/react-email/tree/HEAD/packages/components ) from 0.0.42 to 0.1.0.
- [Release notes](https://github.com/resend/react-email/releases )
- [Changelog](https://github.com/resend/react-email/blob/canary/packages/components/CHANGELOG.md )
- [Commits](https://github.com/resend/react-email/commits/@react-email/components@0.1.0/packages/components )
---
updated-dependencies:
- dependency-name: "@react-email/components"
dependency-version: 0.1.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-18 10:43:41 +00:00
Nimar and GitHub
7918faa942
fix: center align dataset description vertically ( #7383 )
...
center align vertically
2025-06-18 09:53:56 +00:00
Steffen Schmitz and GitHub
6210ca3e14
chore: add otel conventional attributes to clickhouse db spans ( #6550 )
...
* chore: add otel conventional attributes to clickhouse db spans
* chore: use db.system instead of db.system.name
* chore: set span kind client for clickhouse queries
2025-06-18 09:32:28 +00:00
steffen911
ff8c44c25f
chore: release v3.73.0
2025-06-18 10:08:46 +02:00
marliessophie and GitHub
20480321ab
chore(evals): re-introduce delay input field for evaluation timing ( #7357 )
...
* chore(evals): re-introduce delay input field for evaluation timing
* chore(evals): enforce minimum value for delay
2025-06-18 07:49:22 +00:00
Steffen Schmitz and GitHub
d39855a2e3
feat: select fields in get traces api route ( #7356 )
...
* feat: select fields in get traces api route
* chore: add implementation
* chore: rounding
* chore: remove planning file
* chore: align tests
* chore: cleanup
* chore: lint
* chore: add zod verifications again
2025-06-18 07:01:02 +00:00
Marc Klingen and GitHub
9fd03082ea
feat(dashboard): add csv download from ui and loading state ( #7364 )
...
* feat(web): add download dropdown for dashboard charts
* csv escaping
* fix
* add loading indicator
* add loading spinner and fix 0 state during loading of BigNumber
* fix name DownloadButton
* refactor
* add success confirm
2025-06-17 16:18:52 +00:00
marliessophie and GitHub
d6941f903b
chore(CreateLLMApiKeyForm): replace Input with PasswordInput for improved UX ( #7359 )
...
* chore(CreateLLMApiKeyForm): replace Input with PasswordInput for improved UX
* chore: revert
2025-06-17 13:59:40 +00:00
Nimar
125db51dd1
chore: release v3.72.1
2025-06-17 13:21:19 +02:00
Nimar and GitHub
7f40a32aa9
fix(prompts): undefined prompt name when clicking on metrics ( #7358 )
...
* fix undefined prompt name when clicking on metrics
* better comment
* only remove last metrics segement
* pass promptName as prop
* add note for bug
* update comment
* fix spelling
* add noreferer
2025-06-17 10:21:30 +00:00
Hassieb Pakzad
6f3050af0f
chore: release v3.72.0
2025-06-17 12:21:49 +02:00
Hassieb Pakzad and GitHub
926c2b8e45
feat(playground): allow non-streaming responses ( #7344 )
...
* feat(playground): allow non-streaming responses
* push
* push
* push
* push
* push
2025-06-17 12:21:02 +02:00
Marc Klingen and GitHub
9e0bd8ed75
docs: Update network diagram ( #7355 )
...
docs: fix newline characters in network diagram
2025-06-17 09:12:03 +00:00
Hassieb Pakzad and GitHub
d0cca331ed
fix(otel): force modelparam values to be strings ( #7337 )
...
* fix(otel): force modelparam values to be strings
* fix
2025-06-17 09:03:11 +00:00
Max Deichmann and GitHub
1f55032c34
fix: gracefully fail exceeded context length for evals ( #7343 )
...
fixes
2025-06-16 19:02:44 +00:00
marliessophie and GitHub
52967de1ac
fix(slider): handle undefined or null values in slider input ( #7341 )
2025-06-16 18:52:13 +00:00
marliessophie and GitHub
9ca8614644
fix(BigNumber): adjust decimal formatting to limit to a maximum of 3 decimal places ( #7332 )
2025-06-16 15:25:24 +00:00
Jannik Maierhöfer and GitHub
80714c6e5e
chore(ui): change wording for consistency ( #7016 )
2025-06-16 14:36:28 +00:00
Nimar
b7eb46bd4b
chore: release v3.71.0
2025-06-16 16:20:48 +02:00
Nimar and GitHub
ca3791e66d
feat(prompts): virtual folders for prompt management ( #7262 )
2025-06-16 16:01:15 +02:00
Hassieb Pakzad and GitHub
652036e8d3
chore(otel): add metrics for shallow trace events and sdk batches ( #7325 )
...
* chore(otel): add metrics for shallow trace events and sdk batches
* push
2025-06-16 13:19:49 +00:00
marliessophie and GitHub
9054df5685
refactor(peek): remove urlPathname parameter from peek navigation and state hooks ( #7292 )
...
* refactor(peek): remove urlPathname parameter from peek navigation and state hooks
* chore: eslint
* chore: eslint
* chore: eslint
2025-06-16 11:24:40 +00:00
steffen911
30ca47b667
chore: release v3.70.0
2025-06-16 13:14:22 +02:00
ce1c1a5016
feat: allow sharded ingestion queue ( #7240 )
...
* feat: create outline for redis cluster mode setup
* chore: fix compilation problems
* chore: add redis-cluster docker compose setup
* chore: make cluster config compile
* chore: remove unused env var declarations
* chore: remove experimental queue length metrics flag
* chore: include queue name into prefix
* chore: lint
* chore: update node config
* chore: lint
* chore: tty to skip model match cache
* chore: execute test flush on all nodes
* chore: add aws specific dns lookup
* chore: add ioredis debug logs for tests
* chore: optimize setup for ci
* chore: update example config
* chore: secret
* chore: cleanup
* chore: remove redis cluster testing script
* feat: allow sharded ingestion queue
* Update packages/shared/src/server/redis/ingestionQueue.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: patch
* chore: remove redundent getQueue
* chore: lint
* chore: skip queue metric collection
* chore: release v3.67.1-0
* chore: linting
* chore: release v3.67.1-1
* chore: release v3.67.1-2
* chore: queue metric collection
* chore: update docs
* chore: add docs
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-16 10:28:55 +00:00
Steffen Schmitz and GitHub
ed01cb7d91
chore: upgrade langchain components ( #7320 )
2025-06-16 10:18:59 +00:00
marliessophie and GitHub
17364919af
fix(observation-ui): enhance badge rendering with text truncation and improved value display ( #7321 )
2025-06-16 10:03:20 +00:00
Hassieb Pakzad and GitHub
0c58edcf5e
feat(otel): parse trace attributes from trace metadata ( #7314 )
...
* feat(otel): parse trace attributes from trace metadata
* add test
2025-06-16 08:02:37 +00:00
Steffen Schmitz and GitHub
90d7c7df98
feat: add redis cluster mode setup ( #7162 )
...
* feat: create outline for redis cluster mode setup
* chore: fix compilation problems
* chore: add redis-cluster docker compose setup
* chore: make cluster config compile
* chore: remove unused env var declarations
* chore: remove experimental queue length metrics flag
* chore: include queue name into prefix
* chore: lint
* chore: update node config
* chore: lint
* chore: tty to skip model match cache
* chore: execute test flush on all nodes
* chore: add aws specific dns lookup
* chore: add ioredis debug logs for tests
* chore: optimize setup for ci
* chore: update example config
* chore: secret
* chore: cleanup
* chore: remove redis cluster testing script
2025-06-16 07:51:08 +00:00
Max Deichmann and GitHub
07fbae3da7
security: upgrade react-syntax-highlighter ( #7313 )
2025-06-16 07:35:15 +00:00
steffen911
b4bd8208c3
chore: release v3.69.0
2025-06-16 09:35:37 +02:00
Max Deichmann and GitHub
c8b282dc82
chore: upgrade react email ( #6358 )
...
* chore: upgrade react email
* chore: upgrade react email
* chore: upgrade react email
* chore: upgrade react email
* upgrade
* upgrade
2025-06-15 13:05:52 +00:00
Max Deichmann and GitHub
e2922aa787
fix: fix select all UI bug ( #7312 )
2025-06-15 12:13:25 +00:00
Max Deichmann and GitHub
e8690eeb0b
chore: clean up scripts ( #7306 )
...
chore: clean up
2025-06-13 23:05:34 +00:00
Max Deichmann and GitHub
a695d58e8e
chore: improve search tooltip ( #7305 )
...
push
2025-06-13 22:59:11 +00:00
b097a98444
chore(deps): bump next from 14.2.26 to 14.2.30 ( #7301 )
...
Bumps [next](https://github.com/vercel/next.js ) from 14.2.26 to 14.2.30.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.26...v14.2.30 )
---
updated-dependencies:
- dependency-name: next
dependency-version: 14.2.30
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-13 19:12:39 +00:00
Max Deichmann and GitHub
87c6d45a01
security: upgrade release-it ( #7300 )
2025-06-13 17:27:23 +00:00
d5a79b1830
chore(ui) Update LLM connection API key message ( #7278 )
...
Update API key description based on cloud or self-hosted deployment
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-06-13 16:22:56 +00:00
Steffen Schmitz and GitHub
40b967c258
fix: add auth headers to ctx within middleware, update not found logging ( #7295 )
2025-06-13 11:56:14 +00:00
marliessophie and GitHub
b6b7a7c670
chore(dialog): move close button to DialogHeader for improved accessibility ( #7294 )
...
refactor(dialog): move close button to DialogHeader for improved accessibility
2025-06-13 11:08:07 +00:00
Hassieb Pakzad and GitHub
346e787784
fix(prompts-api): make updates via API concurrency safe ( #7287 )
...
* fix(prompts-api): make updates via API concurrency safe
* push
2025-06-13 10:04:57 +00:00
Steffen Schmitz and GitHub
8e67f851b0
fix: keep zod/v3 schema for langchainjs interactions ( #7293 )
...
Patches https://github.com/langchain-ai/langchainjs/issues/8357
2025-06-13 09:33:40 +00:00
marliessophie and GitHub
8b416da2ef
fix(PopoverFilterBuilder): ensure filter buttons do not submit forms ( #7290 )
2025-06-13 09:29:59 +00:00
marliessophie and GitHub
88237dcb30
fix(evals): add missing Dialog Body and Footer components ( #7289 )
2025-06-13 09:12:35 +00:00
Steffen Schmitz and GitHub
8a0b3962ac
chore: upgrade zod to v4 ( #7271 )
...
* chore: upgrade zod to v4
* chore: docs
* chore: switch enums to non-deprecated api
* chore: remove unnecessary any
* chore: reverts
* chore: cleanup
* chore: cleanup
* chore: prompts filter tags
* chore: fix sync tests
* chore: patch tests
2025-06-13 08:04:27 +00:00
marliessophie and GitHub
2f6414bbf4
fix(dataset-items): add sorting by id for deterministic ordering ( #7280 )
2025-06-13 07:34:48 +00:00
c7aa992586
feat: add export functionality to audit log table ( #7202 )
...
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-06-12 20:48:58 +02:00
marliessophie and GitHub
c2b5923e88
fix(NewDatasetItemForm): add JSON formatting utility for input, output, and metadata field ( #7265 )
...
* fix(NewDatasetItemForm): add JSON formatting utility for input, output, and metadata fields
* perf(NewDatasetItemFromExistingObject): conditionally render NewDatasetItemForm based on form state
* fix(NewDatasetItemForm): update JSON value check to handle undefined case
2025-06-12 17:57:22 +00:00
marliessophie and GitHub
fc411d0c5c
style(CommentList): reduce font size for author username ( #7277 )
2025-06-12 17:57:08 +00:00
marliessophie and GitHub
3fac8d2608
style(sessions): align header pills ( #7282 )
2025-06-12 16:38:55 +00:00
marliessophie and GitHub
cd413fa887
style(TagButton): reduce size of spinner icon ( #7281 )
2025-06-12 16:29:11 +00:00
Marc Klingen and GitHub
be7cc835be
fix(trpcErrorToast): enhance error handling for 5xx server errors wit… ( #7279 )
...
fix(trpcErrorToast): enhance error handling for 5xx server errors with user-friendly message
2025-06-12 16:23:43 +00:00
marliessophie and GitHub
b68896d14a
refactor(DataTableToolbar): reposition PopoverFilterBuilder for improved UX ( #7275 )
2025-06-12 15:22:58 +00:00
Marc Klingen
aae1909466
chore: release v3.68.0
2025-06-12 17:45:04 +02:00
Steffen Schmitz and GitHub
3d7960f43e
fix: propagate searchQuery to deleteMany call ( #7274 )
...
* fix: propagate searchQuery to deleteMany call
* chore: address feedback
* chore: propagate filters from frontend
2025-06-12 14:16:35 +00:00
Hassieb Pakzad and GitHub
a121e24b79
feat(otel-ingestion): handle long-running traces ( #7241 )
...
* feat(otel-ingestion): handle long-running traces
* rename
* push
* push
* add tests
* add test
* use logger and update cache key
* refactor to OtelIngestionProcessor
* fix
* fix
* fix
* push
* fix graph view
2025-06-12 12:06:17 +00:00
7279a924ed
fix: add llm_api_key_update to events, fix linting & call chain ( #7160 )
...
* feat: add ability to update llm api keys
* fix: add llm_api_key_update to events, fix linting & call chain
* fix: security issue, deleting last headers, typing
* fix: remove unused variable
* fix: remove unused variable
* refactor: align LlmApiKeys type with shared package across the components
* push fixes
* push fixes
* push fixes
* push fixes
* push fixes
* push fixes
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-06-12 11:57:38 +00:00
Max Deichmann and GitHub
a10951b7e5
chore: allow trace deletions on entire history ( #7252 )
...
push
2025-06-12 11:57:04 +00:00
marliessophie and GitHub
e456b08f92
fix(trace-graph): validate node existence before selection and handle errors gracefully ( #7272 )
2025-06-12 11:46:02 +00:00
85130cecb3
feat(cloud): 2-step sign in to make enterprise sso easier ( #7250 )
...
* chore: update `pnpm dx-f` to require no confirmation
* chore: setup cursor background agent
* Implement two-step login flow with SSO domain detection
* Simplify SSO fallback logic in sign-in page
* Conditionally render credentials form based on auth provider config
* Reorder SSO buttons and error display in sign-in page layout
* Checkpoint before follow-up message
* add focus password
* skip two step if no sso configured
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
2025-06-12 09:52:29 +00:00
marliessophie and GitHub
fbb15e26ec
fix(dialog): adjust dialog component styling to prevent overflow issues ( #7264 )
...
* fix(dialog): adjust dialog component styling to prevent overflow issues
* refactor(dialog): simplify dialog footer styling across multiple components
2025-06-12 08:36:33 +00:00
Marc Klingen and GitHub
dd203a1f18
chore: setup cursor background agent ( #7251 )
...
* chore: update `pnpm dx-f` to require no confirmation
* chore: setup cursor background agent
* push
2025-06-11 22:06:15 +00:00
Marc Klingen and GitHub
06c25f9ec3
chore: update pnpm dx-f to require no confirmation ( #7249 )
2025-06-11 21:23:07 +00:00
marliessophie and GitHub
7072ca2786
fix(popover): update max-width calculation for popover component to use fit-content ( #7248 )
2025-06-11 20:30:12 +00:00
marliessophie and GitHub
cb1e5f4c19
fix(TracesTable): stabilize control column definition ( #7247 )
...
* fix(TracesTable): stabilize control column definition
- Ensured conditional rendering of the bookmarked column remains intact while simplifying the structure.
* refactor(TracesTable): enhance column visibility and order identifiers for control states
2025-06-11 19:36:46 +00:00
Steffen Schmitz and GitHub
d4a28aa164
chore: upgrade clickhouse client dependency ( #7246 )
2025-06-11 18:40:43 +00:00
marliessophie and GitHub
fda5fcdd0c
refactor(dialog): improve dialog component layout and styling for billing settings ( #7245 )
...
- Updated dialog header to use a title component and improved button layout for clarity.
- Adjusted positioning of the close button for better alignment.
- Enhanced header and footer with rounded corners for a more polished look.
2025-06-11 16:39:42 +00:00
Marc Klingen and GitHub
24131e0791
feat(cloud): add stripe productid of cloud enterprise plan ( #7244 )
2025-06-11 16:14:16 +00:00
Marc Klingen and GitHub
ffe132403e
chore(cloud): increase user limit on core plan ( #7243 )
2025-06-11 15:51:39 +00:00
marliessophie and GitHub
cce3bf35e1
fix(CreateExperimentsForm): clear modelConfig errors when valid model parameters are set and adjust layout spacing ( #7233 )
2025-06-11 10:34:06 +00:00
marliessophie and GitHub
eccfec36e8
feat(MarkdownViewer): add URL sanitization using DOMPurify for safe link rendering ( #7232 )
2025-06-11 09:31:29 +00:00
Hassieb Pakzad and GitHub
a71faa4e60
feat(model-prices): add o1-pro ( #7229 )
2025-06-11 08:41:26 +00:00
b7362258c6
fix(ui): enable clipboard copying for self-hosted instances ( #7227 )
...
* fix(ui): Enable clipboard copying in insecure browser contexts
* Fixes #5541
* Adds clipboard utility file to manage copy interactions
* Implements fallback method for scenarios lacking Clipboard API
support in insecure contexts (e.g., HTTP resources not delivered locally)
* Suggested review comments addressed
* chore: eslint
* chore: apply copy functionality to new occurrences
---------
Co-authored-by: akshitvijay <akshitthevijay@gmail.com >
2025-06-11 08:35:08 +00:00
Hassieb Pakzad and GitHub
5eb1d98985
fix(graph-view): do not JSON parse node names ( #7228 )
2025-06-11 10:13:06 +02:00
Marlies Mayerhofer
1c574b2a5d
chore: release v3.67.0
2025-06-11 01:39:36 +02:00
marliessophie and GitHub
6db9b87b6a
chore(models): adjust price of o3 to reflected updated openai pricing ( #7223 )
2025-06-10 22:30:07 +00:00
marliessophie and GitHub
3e3ccb65ff
feat(models): add o3-pro for cost tracking ( #7222 )
...
* feat(models): add o3-pro for playground and costs
* chore: remove from playground as langchain does not support o3 model for completions
2025-06-10 22:23:28 +00:00
marliessophie and GitHub
0d53b443e5
style(CreateScoreConfigButton): add padding to confirmation message for improved readability ( #7220 )
2025-06-10 16:26:16 +00:00
marliessophie and GitHub
1b795a3dcf
chore(evals): show warning if API key was deleted ( #7053 )
...
* chore(evals): show warning if API key was deleted
* chore: fix typo
2025-06-10 15:44:36 +00:00
Hassieb Pakzad and GitHub
2e94bc9e09
fix(graph-view): handle missing __start__ node for langgraph>=0.4 ( #7215 )
2025-06-10 15:44:12 +00:00
marliessophie and GitHub
8b94e8a3bd
fix(annotation): handle deletes gracefully and protect against race conditions ( #6848 )
2025-06-10 15:00:43 +00:00
marliessophie and GitHub
91730a2eaf
refactor(dialogs): dialog components with improved structure and styling ( #7218 )
2025-06-10 14:40:26 +00:00
marliessophie and GitHub
4f1a2337be
fix(datasets): prevent delete modal from closing on mouse navigation event ( #7163 )
2025-06-10 14:30:05 +00:00
Hassieb Pakzad and GitHub
4cf5aa03ec
fix(trpc-prompts-api): handle prompt not found case on setLabels ( #7216 )
2025-06-10 13:00:23 +00:00
Steffen Schmitz and GitHub
922eafd4f6
chore: refactor chart display names into single util ( #7209 )
2025-06-10 07:29:06 +00:00
Hassieb Pakzad and GitHub
9067f80206
fix(evals): do not throw errors if eval model does not consistently return JSON ( #7187 )
2025-06-08 14:05:51 +00:00
Steffen Schmitz and GitHub
a7ca1fb269
chore: show frontend name for histogram chart type ( #7181 )
2025-06-06 15:09:54 +00:00
Hassieb Pakzad and GitHub
b51f321d22
feat(quickstart+readme): add python SDK v3 examples ( #7157 )
2025-06-06 16:36:16 +02:00
Hassieb Pakzad and GitHub
dd048a64a0
chore: upgrade langchain ( #7178 )
...
* chore: upgrade langchain
* push
2025-06-06 11:41:08 +00:00
Clemo and GitHub
c6c19de0e8
docs: update readme, add terraform templates
2025-06-06 11:25:16 +02:00
marliessophie and GitHub
5491f176e1
chore(datasets): simplify DatasetAnalytics component interaction and integrate local storage for chart metrics ( #7161 )
...
* chore(datasets): simplify DatasetAnalytics component interaction and integrate local storage for chart metrics
* chore: eslint
2025-06-05 16:10:06 +00:00
marliessophie and GitHub
7a28473ebb
perf(traces-table): improve performance ( #7126 )
...
* fixup: limit render duration of traces table
* fixup: reduce render cycles through data flows and memoization
* refactor: enhance performance and structure of table components
- Removed unnecessary console logs in `data-table.tsx`.
- Refactored `TablePeekView` to use a more structured props type and memoization for improved performance.
- Updated `usePeekData` to reduce stale time from 5 minutes to 1 minute.
- Replaced `IOTableCell` with `MemoizedIOTableCell` in various components to optimize rendering.
- Adjusted `peekView` configurations in `observations.tsx` and `traces.tsx` for consistency and clarity.
* chore: eslint
2025-06-05 14:16:10 +00:00
Steffen Schmitz and GitHub
005ce7318c
chore: allow bullmq-api for non-cloud deployments ( #7156 )
2025-06-05 12:22:18 +00:00
marliessophie and GitHub
448c56e114
feat(dialog): add sticky header and footer ( #7154 )
...
* chore(ui-components): add dialog body
* style(popover): update width styling to use CSS variable for dynamic sizing
* feat(dialog): add DialogBody and DialogFooter components to enhance dialog structure
* chore: eslint
* chore: adjust modal height
2025-06-05 12:05:31 +00:00
Hassieb Pakzad and GitHub
1d6e498e2b
fix(otel): read resourceAttributes for release attribute ( #7155 )
2025-06-05 11:38:13 +00:00
Steffen Schmitz and GitHub
33ab717ae0
chore: include LANGFUSE_USE_AZURE_BLOB in docker-compose options ( #7153 )
2025-06-05 08:29:05 +00:00
Steffen Schmitz and GitHub
ec563b775b
feat(dashboards): add histogram chart type ( #7140 )
...
* feat(dashboards): add histogram chart type
* chore: update querybuilder behaviour
* chore: lint
* chore: push
* chore: format numbers nicely
* chore: store histogram bins in chartConfig
* chore: change order
* chore: add histogram function to metrics api
* chore: docs
* chore: generate docs
2025-06-05 07:43:35 +00:00
marliessophie and GitHub
de427b5572
chore(evals): implement update confirmation for default evaluation model ( #7137 )
...
* chore(evals): implement update confirmation for default evaluation model
* chore: adjust alert to confirm
* chore: adjust alert to confirm
2025-06-04 17:08:44 +00:00
Marc Klingen
95921fa5da
chore: release v3.66.1
2025-06-04 11:09:25 +02:00
Marc Klingen and GitHub
9e4d352366
fix(ee): pro plan label ( #7136 )
...
fix(ee): self-hosted pro plan label
2025-06-04 08:57:50 +00:00
steffen911
02449cbe0a
chore: release v3.66.0
2025-06-04 09:24:50 +02:00
Steffen Schmitz and GitHub
616c68a87b
feat: add support for new OTEL semantic event types ( #7135 )
2025-06-04 07:06:07 +00:00
Steffen Schmitz and GitHub
319b22ae78
chore: disentangle batch actions from batch exports ( #7092 )
...
* chore: disentangle batch actions from batch exports
* chore: revert
* chore: revert
* chore: revert
2025-06-04 06:53:52 +00:00
Max Deichmann
b919562eed
chore: release v3.65.3
2025-06-04 01:17:23 +02:00
Max Deichmann and GitHub
91c01e7363
chore: allow annotation queues on FOSS ( #7130 )
...
chore: move features
2025-06-03 22:17:02 +00:00
Max Deichmann and GitHub
48ec1bccae
fix: fix full text search selector ( #7129 )
...
* push
* fix: annotation queue count
* chore: move features
* chore: move features
* chore: move features
2025-06-03 22:04:49 +00:00
steffen911
66aa2fd48e
chore: release v3.65.2
2025-06-03 22:02:11 +02:00
Steffen Schmitz and GitHub
f822bf1049
chore: add opt-out flag from queue length metric checks ( #7123 )
2025-06-03 19:21:35 +00:00
96ec24aad8
fix(otel): set trace io from root span ( #7127 )
...
* fix(otel): set trace io from root span
* Update web/src/features/otel/server/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-06-03 16:48:58 +00:00
steffen911
068fbd0cc6
chore: release v3.65.1
2025-06-03 11:33:30 +02:00
Steffen Schmitz and GitHub
7c8b76d573
security: bump tar-fs, rollup version ( #7116 )
...
* security: bump tar-fs version
* chore: bump rollup version
2025-06-03 08:13:54 +00:00
Max Deichmann
e4e93d64bb
chore: release v3.65.0
2025-06-03 10:09:46 +02:00
Max Deichmann and GitHub
f5cf8693e9
chore: move core features to OSS ( #7091 )
...
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* chore: move features
* changes to pro plan
* chore: move features
2025-06-03 08:07:45 +00:00
marliessophie and GitHub
5beef28214
style(scores): limit height of grouped scores hovercard ( #7106 )
2025-06-02 10:59:46 +00:00
marliessophie and GitHub
d93712c6ab
chore: sort dataset (run) items by created_at and id ( #7105 )
...
* `created_at` is not unique, we require a deterministic order of items to ensure data consistency
2025-06-02 10:46:46 +00:00
Hassieb Pakzad and GitHub
b1b0a966be
fix(projects-api-docs): retentionDays to optional ( #7103 )
2025-06-02 11:49:25 +02:00
b5edadb203
fix: update Google AI Studio model name to preview version ( #7086 ) ( #7102 )
...
Co-authored-by: Faris Ibrahim <faris@traba.work >
2025-06-02 11:23:51 +02:00
marliessophie and GitHub
3090882590
fix(default-model): allow set up flow to add LLM API key ( #7101 )
2025-06-02 07:58:37 +00:00
Max Deichmann and GitHub
787f5d8d10
chore: remove popup from count for historic eval elements ( #7098 )
...
* chore: move features
* chore: move features
* chore: move features
2025-05-30 21:25:50 +00:00
Jannik Maierhöfer and GitHub
5fa142eda4
chore(ui): changed wording on checkout page ( #7045 )
2025-05-30 10:05:15 +00:00
steffen911
d96865b019
chore: release v3.64.0
2025-05-30 11:25:55 +02:00
Steffen Schmitz and GitHub
8d808923a1
feat: allow host credentials for blob storage S3 integration ( #7072 )
...
* feat: allow host credentials for blob storage S3 integration
* chore: compilation errors
2025-05-30 09:07:52 +00:00
Max Deichmann and GitHub
0f056c1c2d
fix: add error message for missing encryption key for self-hosters ( #7090 )
...
push
2025-05-30 08:40:50 +00:00
Max Deichmann and GitHub
094a523795
perf: use trace identifier stream to batch delete traces ( #7081 )
2025-05-29 20:08:27 +02:00
Marc Klingen and GitHub
c60e58a568
feat(ui): misc improvements to dashboards including mobile view, big number chart, truncate title/description, enforce min height/width of widgets ( #7082 )
...
* truncate title and description to prevent wraps
* remove unnecessary padding from charts
* improve bignumber chart
* add min h/w
* mobile resizing
* fix
2025-05-29 15:58:38 +00:00
6147e9c518
perf: only read trace identifiers for historic eval read stream ( #7080 )
...
* push
* Update packages/shared/src/server/services/traces-ui-table-service.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* perf: add exact timestamp match for eval batch actions
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-29 14:35:39 +00:00
Max Deichmann and GitHub
f0408b208e
perf: add exact timestamp match for eval batch actions ( #7077 )
...
* perf: add exact timestamp match for eval batch actions
* perf: add exact timestamp match for eval batch actions
* perf: add exact timestamp match for eval batch actions
2025-05-29 10:54:13 +00:00
Steffen Schmitz and GitHub
55e0bdcac0
feat: allow validation and run now for blob storage integrations ( #7064 )
...
* feat: allow validation and run now for blob storage integrations
* chore: error handling and formatting
* lint
* chore: linting
2025-05-28 16:47:23 +00:00
Hassieb Pakzad and GitHub
05e15c9f53
fix(otel): update trace name only for root spans ( #7061 )
...
* fix(otel): update trace name only for root spans
* push
2025-05-28 15:30:37 +00:00
Max Deichmann and GitHub
ce6249b266
perf: data retention concurrency ( #7065 )
2025-05-28 17:36:20 +02:00
Max Deichmann and GitHub
83e91e5bf5
chore: add logging to retry queue ( #7062 )
...
fix: do not wrap traces toolbar
2025-05-28 13:58:46 +00:00
Hassieb Pakzad and GitHub
edf073cc18
feat(api-models): return model prices on public API ( #7046 )
...
* feat(api-models): return model prices on public API
* add tests
* add openapi spec
* return map instead of list
2025-05-28 13:24:20 +00:00
Hassieb Pakzad
65343a8e9b
chore: release v3.63.1
2025-05-28 14:17:40 +02:00
Max Deichmann and GitHub
0978055bdc
chore: rename dead letter retry queue ( #7058 )
...
* push
* push
* push
2025-05-28 11:54:11 +00:00
Max Deichmann and GitHub
76aaf2a3d0
chore: upgrade clickhouse node client ( #6806 )
...
* push
* fix: do not wrap traces toolbar
* fix: do not wrap traces toolbar
* fix: do not wrap traces toolbar
2025-05-28 07:57:14 +00:00
Max Deichmann and GitHub
8ed61bf705
perf: increase retry batch action queue ( #7049 )
...
push
2025-05-27 19:59:47 +00:00
Steffen Schmitz and GitHub
45436530b4
chore: add analytic views in ClickHouse ( #7034 )
...
* chore: add analytic views in ClickHouse
* chore: add additional properties
* chore: add filtering and order changes
2025-05-27 15:59:12 +00:00
Hassieb Pakzad and GitHub
7a3f01fc0a
fix(playground): resolve prompts when jumping to playground ( #7041 )
...
* fix(playground): resolve prompts when jumping to playground
* push
2025-05-27 14:36:40 +00:00
marliessophie and GitHub
468fc4d079
chore(evals): display default model on peek ( #7042 )
2025-05-27 14:19:11 +00:00
Hassieb Pakzad and GitHub
945d13dac0
fix(playground): update tools and schemas if name already exists ( #7039 )
...
* fix(playground): update tools and schemas if name already exists
* push
2025-05-27 13:38:59 +00:00
Marc Klingen and GitHub
3646eaa5a8
feat(model): add regex for claude-sonnet-4@20250514 ( #7035 )
2025-05-27 00:50:10 +00:00
marliessophie and GitHub
feb5af11b8
style: default evaluation model management components ( #7028 )
2025-05-26 16:57:08 +00:00
marliessophie and GitHub
3711af5663
fix: prompt variables of SQL Semantic Equivalence evaluator ( #7029 )
2025-05-26 14:56:35 +00:00
marliessophie and GitHub
9ec798f393
feat(evaluation): allow filtering by log status ( #7018 )
2025-05-26 14:43:57 +00:00
Hassieb Pakzad and GitHub
f71fd43d91
fix(llm-tool-dialog): do not propagate textarea keystrokes up ( #7023 )
...
* fix(llm-tool-dialog): do not propagate textarea keystrokes up
* push
2025-05-26 13:51:51 +00:00
marliessophie and GitHub
0303596420
fix(scores): conditionally render metadata in score badges ( #7020 )
2025-05-26 11:31:50 +00:00
marliessophie and GitHub
cfaccc46d3
chore: ensure eval config modal closes after successful delete ( #7015 )
...
* chore: ensure eval config modal closes after successful delete
* chore: eslint
2025-05-26 10:21:47 +00:00
Max Deichmann and GitHub
907f764adc
fix: do not wrap traces toolbar ( #7019 )
...
* fix: do not wrap traces toolbar
* fix: do not wrap traces toolbar
2025-05-26 10:18:23 +00:00
Hassieb Pakzad and GitHub
652e9e3fe5
fix(otel): set trace name only if root span or attr provided ( #7017 )
2025-05-26 09:59:59 +00:00
48673e43d7
feat: allow propagation of request headers through logs ( #6979 )
...
* feat: allow propagation of request headers through logs
* chore: propagate under correct name
* chore: take all header values
* chore: allow more properties in context propagation
* chore: update trpc propagation
* Update packages/shared/src/env.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: trace header props for ingestion api
* chore: rename env variable
* chore: remove unused comments
* chore: remove outdated addUserToSpan method
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-26 07:33:02 +00:00
Marlies Mayerhofer
a136ac8184
chore: release v3.63.0
2025-05-24 14:05:07 +02:00
marliessophie and GitHub
9ebf62fc9c
chore: do not alert on missing API keys or model ( #7007 )
...
* chore: change error string for LLM API key not found
* chore: push
* chore: do not alert on missing default model
2025-05-24 07:16:17 +00:00
cf52dce773
chore: fix dataset eval executions for historic evals ( #7001 )
...
* push
* fix
* push
* fix
* fix
* fix
* fix
* fix
* fix
* Update worker/src/ee/evaluation/evalService.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-23 17:44:21 +00:00
marliessophie and GitHub
0a6ecf1cba
feat: evaluator library ( #6956 )
...
* chore: make `project_id` nullable on `eval_templates`
* feat: add script for managed langfuse evaluators
* feat: restyle running evaluator configs table
* feat: add peek view for running evals
* fixup: add peek view for evaluator library
* fixup: add configure button to table
* feat: rework eval creation flow
* feat: add option to edit eval from table
* fixup: configure evaluator flow with traces data preview
* style: eval configuration UI elements
* chore: add support for current langfuse templates
* chore: reference templateId on jobExecution
* style: add maintainer icon across
* chore: extract WorkerEvaluationVariableService
* fixup: support live data mapping interface
* fixup: revamp datasets eval ui
* fixup: add clone functionality
* chore: rename online evaluation -> llm-as-a-judge
* feat: add evaluator selection in experiment creation flow
* chore: refactor into hooks in experiment form
* feat: add ragas evaluator prompt templates
* chore: show evaluator prompt preview by default
* fix: eval table filtering
* feat: add input box to slider
* fix: clean up running eval peek view and logs
* fix: ensure preview variables are not wrapped in quotes in evaluation prompt preview
* feat: support navigating through traces table
* feat: support default model workflow
* fix: typos in managed evaluators
* fix: do not allow selection of evaluators requiring default to run
* fix: type and build errors
* chore: rename table to default_llm_model
* chore: rm empty file
* fixup: complete rename
* chore: push
* style: eval set up form
* style: separate new evaluator form out into two steps
* chore: ensure we only run evals if default model is set
* chore: add `partner` col to `eval_templates`
* style: new eval template creation
* chore: add proper mapping for dataset evals
* feat: also put evaluation selection on datasets page
* feat: datasets also run on historic experiments after creating mapping
* revert: 09ab242dc12c8647bc716c84d180bc8e631d4919
* chore: fix eslint and ts
* chore: fix warnings
* fix: ensure we inactivate all job configs that rely on default eval model
* fix: tests
* chore: fix eslint
* chore: wrap in tx
* chore: fix default model checkbox logic
* chore: improve wording on delete model
* fix: eslint
* chore: adjust migration order
* style: push ui improvements
* style: sort templates by partner
* fix: eslint
2025-05-23 17:10:47 +00:00
Steffen Schmitz and GitHub
c359900b59
perf: skip S3 list calls for OTEL observations ( #6995 )
...
* perf: skip S3 list calls for OTEL observations
* chore: reuse prefix definition
2025-05-23 14:04:40 +00:00
Steffen Schmitz and GitHub
720ed7a36f
feat: add new /api/public/organizations/projects route to list projects ( #6997 )
...
* feat: add new /api/public/organizations/projects route to list projects
* chore: address typos
2025-05-23 13:56:07 +00:00
Marc Klingen and GitHub
1dbefb0994
feat(cloud): push orgs as tenants to plain ( #6986 )
...
* fix: plain initialization issues via updatequeue
* apply to the show cb
* chore
* catch errors
* feat(cloud): push orgs as tenants to plain
* add PLAIN_CARDS_API_TOKEN
* fix
* fix
* limit to cloud
* fix
2025-05-23 13:17:45 +00:00
Jannik Maierhöfer and GitHub
abfdd2366a
chore: lw3-5 notification ( #6992 )
2025-05-23 10:06:02 +00:00
Marc Klingen and GitHub
1f9bb37f3b
fix(cloud): plain.com initialization issues via update queue ( #6866 )
...
* fix: plain initialization issues via updatequeue
* apply to the show cb
* chore
* catch errors
2025-05-22 23:00:52 +00:00
Marc Klingen
00afab9725
chore: release v3.62.1
2025-05-22 20:24:52 +02:00
Hassieb Pakzad and GitHub
d04e808515
feat(cost-tracking+llm-keys): add claude 4 sonnet and opus ( #6982 )
2025-05-22 17:56:45 +00:00
Jannik Maierhöfer and GitHub
ee04912f0e
chore: lw3-4 notification ( #6977 )
2025-05-22 14:34:55 +00:00
steffen911
7f04a54c0c
chore: release v3.62.0
2025-05-22 16:31:39 +02:00
Steffen Schmitz and GitHub
cce11ef6b5
perf: drop unused observation_media index ( #6978 )
2025-05-22 14:27:21 +00:00
1b03f537e2
feat: allow AWS S3 SSE configuration for S3 interactions ( #6965 )
...
* feat: allow AWS S3 SSE configuration for S3 interactions
* Update packages/shared/src/env.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: whitelist allowed SSE settings
* dummy
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-22 12:32:12 +00:00
Hassieb Pakzad and GitHub
dba114e4a3
feat(otel): add support for observations of type 'event' ( #6972 )
2025-05-22 12:27:14 +00:00
Steffen Schmitz and GitHub
fefe3bc3bd
fix: dynamically calc max value for home line charts ( #6966 )
...
* fix: dynamically calc max value for home line charts
* chore: wrap in useMemo
* dummy
2025-05-22 12:21:18 +00:00
Steffen Schmitz and GitHub
800cc299cb
fix: use quorum writes for temporary dataset tables ( #6958 )
2025-05-21 15:21:58 +00:00
Hassieb Pakzad and GitHub
1bdaed4314
fix(ui-jump-to-playground): look up llm api keys when model parsing ( #6957 )
...
* fix(ui-jump-to-playground): look up llm api keys when model parsing
* push
* push
2025-05-21 14:18:37 +00:00
Hassieb Pakzad and GitHub
71dde233c5
fix(ui-jump-to-playground): allow response format in modelParams ( #6955 )
2025-05-21 14:13:05 +02:00
3b80afdf2d
chore: reduce minimum project retention to 3 days ( #6954 )
...
* chore: reduce minimum project retention to 3 days
* Update web/src/features/projects/components/ConfigureRetention.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: update test cases
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-21 12:08:52 +00:00
Steffen Schmitz and GitHub
b69f0bda9d
chore: bump metrics-api rate limits and deprecate daily metrics ( #6950 )
...
* chore: bump metrics-api rate limits
* chore: remove docs for metrics/daily
* chore: remove flaky assertion
2025-05-21 10:26:36 +00:00
Hassieb Pakzad and GitHub
9b9a58ae45
fix(prompt-experiments): use resolved prompts ( #6940 )
...
* fix(prompt-experiments): use resolved prompts
* fix test
2025-05-21 09:39:37 +00:00
Marc Klingen
775e6a8bfc
chore: release v3.61.0
2025-05-21 11:12:29 +02:00
5253014fa6
chore: lw3-3 product hunt notification ( #6942 )
...
* chore: lw3-3 product hunt notification
* reverse order
* add created date
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-05-21 09:37:55 +02:00
Marc Klingen and GitHub
1571de133b
chore: update pipcat otel attribute mapping ( #6944 )
...
based on this change: https://github.com/pipecat-ai/pipecat/pull/1859
2025-05-20 23:50:45 +00:00
Marc Klingen and GitHub
9202f4ec79
docs: add note that docker ENTRYPOINT is covered by semver ( #6941 )
2025-05-20 23:27:18 +00:00
Steffen Schmitz and GitHub
949e3d1181
chore(dashboards): add more langfuse managed templates ( #6939 )
...
* chore(dashboards): add more langfuse managed templates
* chore: update descriptions
* chore: dashboards
* chore: remove wrong dashboard
* chore: commit
* chore: push
* chore: typo
* chore: drop projectId etc from default
* chore: remove beta label
* chore: fix number chart type naming
2025-05-20 17:32:08 +00:00
2d280329c5
chore: update product notification - lw3-2 ( #6929 )
...
* chore: update product notification: launch week day 2
* update
* Update web/src/components/nav/sidebar-notifications.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* update
* push
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-20 17:24:29 +00:00
Steffen Schmitz and GitHub
6e1886055a
feat(dashboards): add langfuse managed dashboards ( #6877 )
...
* feat(dashboards): add langfuse managed dashboard templates
* chore: typing
* chore: update dashboards
2025-05-20 14:49:21 +00:00
Marc Klingen and GitHub
39e4a7533a
feat(dashboards): add big number chart type ( #6933 )
2025-05-20 15:46:20 +02:00
Steffen Schmitz and GitHub
e8787e3f38
chore(dashboards): expand measures for dashboards ( #6932 )
...
* chore(dashboards): expand measures for dashboards
* chore: add testcase
* chore: define inputTokens and outputTokens
* chore: add timePerOutputToken and costs
* chore: fix definition and handling of tag based breakdowns
2025-05-20 13:43:20 +00:00
Max Deichmann and GitHub
59055cd311
chore: add metrics to measure by-id recency ( #6930 )
...
push
2025-05-20 14:59:55 +02:00
Marc Klingen and GitHub
7712b63b95
fix(auth): only apply login domain enforcement to multi-tenant sso ( #6928 )
2025-05-20 10:33:35 +02:00
marliessophie and GitHub
f25d466388
fix(tables-ui): truncate name columns in traces and observations table ( #6925 )
2025-05-20 07:55:46 +00:00
Max Deichmann and GitHub
b9e18f59d8
chore: upgrade zod ( #6921 )
...
push
2025-05-19 20:59:03 +00:00
Steffen Schmitz and GitHub
09f3343db2
fix(dashboards): update resize migration to handle empty widget list correctly ( #6918 )
...
fix(dashboards): update migration to handle empty widget list correctly
2025-05-19 15:15:32 +00:00
Steffen Schmitz and GitHub
5ab8e4219f
feat(dashboard): make dashboard widgets draggable ( #6891 )
...
* feat(dashboard): make dashboard widgets draggable
* chore: do not update on layout change
* chore: fix size
* chore: remove the preventCollision flag
* chore: linting
* chore: get row height dynamically
* chore: make chart resizable
* chore: styling for resizes
* chore: add migration to align y values
2025-05-19 14:48:39 +00:00
Steffen Schmitz and GitHub
40359f0e3f
chore(dashboards): order metrics and dimensions in widgetform ( #6917 )
...
* chore(dashboards): make metrics and dimensions in widgetform searchable
* chore: only sort without search
2025-05-19 14:18:48 +00:00
Marc Klingen and GitHub
817b6d37bc
feat(ui): implement optional sidebar notification expiry ( #6916 )
...
* feat(web): add expiry for sidebar notifications
* Update web/src/components/nav/sidebar-notifications.tsx
* Update web/src/components/nav/sidebar-notifications.tsx
2025-05-19 13:57:04 +00:00
Hassieb Pakzad
8bb73822d3
chore: release v3.60.1
2025-05-19 14:50:33 +02:00
fa53ba3c1a
chore: add lw3-1 notification ( #6912 )
...
* chore: add lw3-1 notification
* Update web/src/components/nav/sidebar-notifications.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-19 09:56:02 +00:00
Hassieb Pakzad and GitHub
086a764083
chore(media): make ID generation fully deterministic based on hash ( #6900 )
2025-05-19 11:52:55 +02:00
Steffen Schmitz and GitHub
79a9f3c3e3
perf: add mediaId index to efficiently delete media items ( #6909 )
...
* perf: add mediaId index to efficiently delete media items
* chore: only add index if they do not exist yet
2025-05-19 09:30:16 +00:00
Max Deichmann
abd46f2d4d
chore: release v3.60.0
2025-05-19 11:16:27 +02:00
marliessophie and GitHub
dfd9565a3f
chore(experiments): improve delete experiment confirm message ( #6908 )
2025-05-19 07:41:27 +00:00
Marc Klingen and GitHub
ebb8a5a13f
chore(ui): trim password reset otp ( #6905 )
2025-05-18 20:01:26 +00:00
Marc Klingen and GitHub
44104596f6
fix(auth): add domain check for multi-tenant sso providers ( #6904 )
2025-05-18 19:54:40 +00:00
Marc Klingen and GitHub
17f6260671
feat: otel span mapping for pipecat traces ( #6903 )
2025-05-18 17:41:49 +00:00
Marc Klingen and GitHub
0a2bfe5ab5
fix(ui): peek view header should stay single line on mobile screens ( #6902 )
2025-05-18 17:23:32 +00:00
Marc Klingen and GitHub
8bd1a4da3e
chore(ui): hide thread refs in support chat ( #6901 )
...
feat(web): hide thread refs in support chat
2025-05-18 13:28:49 +00:00
31b230d3e0
feat(auth): switch to OTP based password reset instead of magic link ( #6898 )
...
* feat(auth): add otp-based password reset
* fix
* fix lint and margins
* Update web/src/features/auth-credentials/components/ResetPasswordButton.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update web/src/server/auth.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* simplify
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-18 13:04:40 +00:00
Marc Klingen and GitHub
dbe71249e7
chore: ignore HEAD request for auth api endpoints ( #6899 )
2025-05-18 12:04:20 +00:00
Marc Klingen and GitHub
a9d0486edd
chore: Update AGENTS guide ( #6897 )
...
docs: mention conventional commits
2025-05-18 13:45:29 +02:00
Marc Klingen and GitHub
2bf506a436
fix(ui): hover state color of chat message types ( #6895 )
2025-05-18 10:38:17 +00:00
Steffen Schmitz and GitHub
edca91c12a
chore(dashboard): auto-generate widget name from selected props ( #6890 )
...
* chore(dashboard): auto-generate widget name from selected props
* chore: lint
2025-05-17 13:52:52 +00:00
Steffen Schmitz and GitHub
a11e7ddfee
feat(dashboard): include dashboards in cmdk menu ( #6889 )
2025-05-17 12:28:26 +00:00
Steffen Schmitz and GitHub
cb9eb23f36
chore(dashboard): show description on hover in selection tables ( #6888 )
2025-05-17 12:25:43 +00:00
Steffen Schmitz and GitHub
5e942f0208
feat(dashboards): add langfuse managed read-only dashboard support ( #6873 )
...
* chore: add owner to project and return langfuse dashboards
* chore: show owner for dashborads in table
* chore: snapshot
* chore: snapshot
* chore: allow widget clone
* chore: snapshot
* chore: linting
* chore: use project instead of user
* chore: show error message on clone failure
* chore: indicate existing dashboard widget relationship
* chore: show only project dashboards in selection for adding widgets
* chore: make full dashboard row clickable
* chore: add clone button to langfuse dashboards
2025-05-17 12:02:50 +00:00
Max Deichmann and GitHub
8e0e139848
chore: remove clickhouse session id ( #6849 )
...
* push
* push
2025-05-16 15:09:08 +00:00
Hassieb Pakzad
acc1227962
chore: release v3.59.1
2025-05-16 16:57:30 +02:00
Hassieb Pakzad and GitHub
d9682511c1
perf(otel): do not pass deep parsed metadata ( #6878 )
...
* revert previous commit
* perf(otel): do not pass deep parsed metadata
2025-05-16 14:55:16 +00:00
Hassieb Pakzad
00e0b51bc4
chore: release v3.59.0
2025-05-16 14:06:50 +02:00
e63cf84e4f
feat(otel): add Langfuse attribute parsing ( #6692 )
...
* feat(otel): add Langfuse attribute parsing
* fix
* push
* add safeguard for cross project spans
* fix test
* add extract completionStartTime
* fix type issues
* handle trace io
* fix
* Update web/src/features/otel/server/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-16 12:03:01 +00:00
Steffen Schmitz and GitHub
63d1051ac2
perf: increase socket lifetime and connections for clickhouse client ( #6870 )
2025-05-16 08:54:38 +00:00
Steffen Schmitz and GitHub
0e056eb072
chore: increase default timeframe in custom dashboards to 7d ( #6871 )
2025-05-16 05:45:37 +00:00
Steffen Schmitz and GitHub
87f7095966
chore: reduce title size in widget item doc hover ( #6869 )
2025-05-16 05:26:57 +00:00
steffen911
5eefe997ae
chore: release v3.58.0
2025-05-16 06:39:23 +02:00
Marc Klingen and GitHub
e251e60b53
fix: plain chat availability check should not rely on window.Plain but only on env ( #6867 )
2025-05-16 05:36:07 +02:00
Marc Klingen and GitHub
adc05eeef4
feat(ui-ee): show/hide product modules in main menu via LANGFUSE_UI_VISIBLE/HIDDEN_PRODUCT_MODULES ( #6841 )
...
* feat(ui): show/hide product modules in main menu
* prod example
* add dashboards
* improve comment
2025-05-16 00:20:17 +00:00
Steffen Schmitz and GitHub
702143fbe2
perf: skip zod validation for otel event batches ( #6861 )
...
* perf: skip zod validation for otel event batches
* chore: remove unnecessary casting
2025-05-15 16:47:30 +00:00
Steffen Schmitz and GitHub
06643f30e5
feat(dashboard): add documentation hovers onto widget properties ( #6856 )
...
* feat(dashboard): add documentation hovers onto widget properties
* chore: fix typing
* chore: remove open and close delays of hovercards
2025-05-15 14:31:20 +00:00
Steffen Schmitz and GitHub
2e496d5429
chore(dashboard): make hovers in dark mode more readable ( #6858 )
2025-05-15 13:54:44 +00:00
Steffen Schmitz and GitHub
5b62df9122
feat(dashboard): add new widget to dashboard on save ( #6854 )
...
* feat(dashboard): add new widget to dashboard on save
* chore: linting
2025-05-15 13:15:08 +00:00
Steffen Schmitz and GitHub
fd189dc66b
fix(dashboard): map traceRelease and traceVersion correctly on breakdown ( #6853 )
2025-05-15 11:39:51 +00:00
Steffen Schmitz and GitHub
10a3644dcf
chore(dashboard): auto-save dashboard on any changes ( #6820 )
...
* chore(dashboard): auto-save dashboard on any changes
* chore: linting
* chore: switch timeouts to useDebounce
* chore: linting
2025-05-15 09:48:02 +00:00
Max Deichmann and GitHub
8ca000b225
chore: reduce worker logs ( #6851 )
2025-05-15 11:33:33 +02:00
Steffen Schmitz and GitHub
47d41b6a42
chore: change logging pattern around redis retries ( #6843 )
2025-05-15 07:34:00 +00:00
Steffen Schmitz and GitHub
1d66408c18
fix(dashboard): avoid invalid filter name on view switches ( #6829 )
...
* fix(dashboard): avoid invalid filter name on view switches
* chore: add test case
2025-05-15 07:18:41 +00:00
Max Deichmann and GitHub
44d1727dd0
chore: reduce error logs for llm 429 errors ( #6836 )
2025-05-15 00:37:58 +02:00
Max Deichmann and GitHub
bfb2878719
chore: reduce log level for prompt service ( #6835 )
...
fix
2025-05-14 22:19:00 +00:00
Marc Klingen and GitHub
67e6b4ce87
chore(cloud): increases api rate limits ( #6783 )
2025-05-14 23:03:49 +02:00
Max Deichmann and GitHub
dcc5bf9c6e
fix: fix traceid filter for observations by id clickhouse query ( #6828 )
2025-05-14 16:10:23 +02:00
Steffen Schmitz and GitHub
db357101b7
feat(dashboards): add support for cloning existing dashboards ( #6824 )
...
* feat(dashboards): add support for cloning existing dashboards
* chore: move buttons into a dedicated dropdown menu
* chore: allow updates to dashboard name and description
* chore: lint
* chore: removal double capturing of dashboard delete
* chore: track deletions
2025-05-14 12:50:26 +00:00
Steffen Schmitz and GitHub
afbd45b9c3
chore(metrics-api): return bad request errors for invalid query ( #6826 )
2025-05-14 11:01:10 +00:00
b6b37212ce
perf: reduce project deletion concurrency ( #6823 )
...
* push
* Update worker/src/app.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-14 10:30:46 +00:00
Steffen Schmitz and GitHub
76a090241e
feat(dashboard): add newly created widget to dashboard on save ( #6819 )
...
* feat(dashboard): add newly created widget to dashboard on save
* chore: linting
2025-05-14 09:25:23 +00:00
Max Deichmann and GitHub
c53abf6aeb
perf: also add trace_id to observations search ( #6822 )
...
push
2025-05-14 09:16:49 +00:00
Hassieb Pakzad
5cbfd922f9
chore: release v3.57.2
2025-05-14 09:55:07 +02:00
Hassieb Pakzad and GitHub
0be269d519
fix(ui-tool-calls): handle parsing errors gracefully ( #6817 )
2025-05-14 07:52:47 +00:00
Max Deichmann and GitHub
d0eeb44b90
fix: fail gracefully for batch actions in case eval config does not exist ( #6809 )
...
* push
* fix
2025-05-13 15:03:57 +00:00
Marlies Mayerhofer
30ced3ab42
chore: release v3.57.1
2025-05-13 16:52:57 +02:00
Max Deichmann and GitHub
2ed6b5a40f
chore: parameterize clickhouse deletion timeouts ( #6801 )
2025-05-13 16:20:13 +02:00
Steffen Schmitz and GitHub
6eaef75f20
fix(dashboard): render localized time strings for LineCharts ( #6799 )
...
* fix(dashboard): render localized time strings for LineCharts
* chore: use memo
2025-05-13 13:57:07 +00:00
Max Deichmann and GitHub
31c36565c3
chore: fix clickhouse timeout settings ( #6798 )
2025-05-13 15:30:04 +02:00
Steffen Schmitz and GitHub
d1a1ca7744
fix(dashboard): increase precision of numbers on hover cards ( #6797 )
2025-05-13 12:54:52 +00:00
Steffen Schmitz and GitHub
2dac75d203
chore(dashboard): use more granular time buckets on home dashboard ( #6795 )
2025-05-13 12:25:39 +00:00
Steffen Schmitz and GitHub
fab90b36a6
chore: remove queryPlayground page ( #6796 )
2025-05-13 12:20:12 +00:00
Steffen Schmitz and GitHub
597bd6c96b
fix(dashboard): warn on slow chart render and ask users to confirm ( #6794 )
2025-05-13 12:03:02 +00:00
Max Deichmann and GitHub
ba3bcc9295
fix: Increase memory usage for deploy ( #6793 )
...
Increase memory usage for deploy
2025-05-13 10:32:29 +00:00
marliessophie and GitHub
5f65929a5e
fix(session-ui): handling mine type as enum string equivalent ( #6792 )
2025-05-13 09:40:01 +00:00
Steffen Schmitz and GitHub
f1344a4c1a
chore: remove unused env variable ( #6789 )
2025-05-13 08:44:02 +00:00
Steffen Schmitz and GitHub
4e3b9a82f7
fix: do not refresh blobstorage form on browser navigation ( #6788 )
2025-05-13 08:12:28 +00:00
Max Deichmann and GitHub
7b803619fd
fix: fix metadata json selector ( #6784 )
2025-05-12 21:11:21 +02:00
marliessophie and GitHub
1ef51b1644
feat(datasets): support GET dataset-run-items ( #6780 )
...
* feat(datasets): support `GET` dataset run items
* chore: add fern api types
* chore: eslint
2025-05-12 17:55:26 +00:00
Hassieb Pakzad and GitHub
fee9e34b7e
chore(ui-graph-view): allow graph view in impersonation mode ( #6782 )
2025-05-12 17:37:32 +00:00
Hassieb Pakzad and GitHub
1354db489f
fix(ui-graph-view): fetch graph data separately ( #6781 )
...
* fix(ui-graph-view): fetch graph data separately
* fix
* push
* refactor
* fix
* fix lint
2025-05-12 16:33:33 +00:00
steffen911
740a25150c
chore: release v3.57.0
2025-05-12 17:49:49 +02:00
Marc Klingen and GitHub
47c2d65d12
chore(ui): improve ux of full-text search input ( #6772 )
...
* width
* change to dropdown
* fix
2025-05-12 15:08:12 +00:00
Steffen Schmitz and GitHub
d94e7c1c06
feat: add new metrics api endpoint ( #6778 )
...
* feat: add metric api endpoint
* feat: add implementation and documentation
* chore: add defaults for timeDimension and ordering
2025-05-12 14:17:40 +00:00
Steffen Schmitz and GitHub
38ed98a76d
feat: add org API keys to organization settings ( #6729 )
...
* feat: add org API keys to organization settings
* chore: linting suggestions
* chore: fix typing
* feedback: do not call hooks conditionally
2025-05-12 11:25:01 +00:00
Max Deichmann and GitHub
92567b765b
chore: reduce amount of ingested dd spans ( #6775 )
...
* push
* fix
2025-05-12 09:47:37 +00:00
Marc Klingen and GitHub
b37396893a
chore: improve auth error message ( #6773 )
2025-05-12 04:02:11 +00:00
Steffen Schmitz and GitHub
0fd1eebbff
fix: align signed download URL with hostname ( #6764 )
2025-05-11 12:24:49 +00:00
Max Deichmann and GitHub
f478bb5763
refactor: refactor observations by id repo function ( #6768 )
...
fix
2025-05-10 20:12:13 +00:00
Max Deichmann
1de48b42ba
chore: release v3.56.0
2025-05-09 19:14:08 +02:00
Max Deichmann and GitHub
4c78450924
chore: do not fetch metadata for trace detail initial load ( #6763 )
...
* fix
* fix
* fix
2025-05-09 14:59:22 +00:00
Hassieb Pakzad and GitHub
e360c13763
fix(ui-graph-view): fix metadata parsing in isLanggraphTrace ( #6762 )
2025-05-09 12:25:44 +00:00
Max Deichmann and GitHub
a03a451088
fix: full text search ( #6759 )
2025-05-09 10:45:33 +02:00
e3fa322ecf
feat: full text search ( #6343 )
...
* feat: full text search
* push
* feat: full text search
* feat: full text search
* feat: full text search
* feat: full text search
* feat: full text search
* fix
* push
* fix: fix json limits and scope to single bodies only
* fix
* fix
* jumping UI
* jumping UI
* jumping UI
* push
* Update web/src/components/table/data-table-toolbar.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-09 08:41:27 +00:00
2b20c9bdc2
fix(ui) langgraph agent graph ( #6753 )
...
* fix(ui) langgraph agent graph
* push
* push
* push
---------
Co-authored-by: Hassieb Pakzad <68423100+hassiebp@users.noreply.github.com >
2025-05-09 06:50:26 +00:00
Max Deichmann and GitHub
860d05a3f4
chore: add sentry release tag ( #6743 )
2025-05-08 13:30:50 +02:00
Marlies Mayerhofer
398174d3a4
chore: release v3.55.0
2025-05-08 12:55:54 +02:00
Max Deichmann and GitHub
040ff26853
chore: allow js-profiling in browser via header ( #6740 )
...
push
2025-05-08 09:38:37 +00:00
marliessophie and GitHub
78924f42e2
chore(run-scores): show only populated run-level scores ( #6739 )
...
* chore(run-scores): show only populated run-level scores
* chore: early return
2025-05-08 09:10:02 +00:00
Jannik Maierhöfer and GitHub
515186e9a2
feat: add otel attribute parsing for google adk ( #6736 )
2025-05-08 04:20:46 +00:00
Jannik Maierhöfer and GitHub
af863bcbd9
fix(otel): avoid logging model name as model param ( #6737 )
2025-05-08 04:19:38 +00:00
marliessophie and GitHub
4e3f97d56e
chore(table-view-presets): conditionally apply generations filter; add avatar fallback; set beta badge ( #6734 )
...
* chore(table-view-presets): conditionally apply generations filter
* chore: add fallback avatar; set beta badge
2025-05-07 22:20:16 +00:00
marliessophie and GitHub
159f7560a4
feat(scores): support run level scores ( #6676 )
...
* feat(scores): support run level scores
* style: show run level scores on runs table
* chore: fix type
* chore: tests
* chore: rename runId -> datasetRunId
* chore: generate fern api docs
* style: improve UI/UX naming
* style: improve UI
2025-05-07 17:56:43 +00:00
marliessophie and GitHub
fa77bc9daf
chore(table-views): handle nullish avatar ( #6730 )
2025-05-07 19:21:32 +02:00
marliessophie and GitHub
23e55cd90a
feat(tables): support saving and sharing table views ( #6595 )
...
* style(traces-table): re-order columns
* style(observations-table): re-order columns
* feat: add peek view to observations view
* style: revamp column visibility filter
* chore(saved-views): add data model
* chore(saved-views): add CRUD operations
* fixup: ui for saved filter views
* fixup: add create table views functionality
* chore: support update and delete operations in UI
* feat: generate permalink
* feat: allow permalink to resolve
* chore: save view in session storage too
* style: show image of author
* chore: remove duplicated columns
* chore: push
* chore: refactor
* chore: rename
* chore: move types
* feat: add support on session, scores, observations tables
* chore: ensure invalid ordering and filtering conditions are ignored
* chore: add posthog events
* tests: add validation unit tests
* chore: remove testing readme
* chore: fix test
* chore: remove async
* chore: rename saved table views -> table view presets
* chore: reformulate
* chore: adjust
* feat: support table views on datasets
* chore: ui for viewers
2025-05-07 15:42:49 +00:00
marliessophie and GitHub
5e39ac49f0
feat(scores): add link to session on session scores table ( #6728 )
2025-05-07 11:50:46 +00:00
marliessophie and GitHub
75b4c6da1e
style(observations): correctly display costs as sums ( #6725 )
2025-05-07 09:16:50 +00:00
Steffen Schmitz and GitHub
03a8eeaf08
feat: allow metadata filtering in dashboard builder ( #6724 )
...
* feat: allow metadata filtering in dashboard builder
* chore: update query type for metadata
2025-05-07 09:02:36 +00:00
marliessophie and GitHub
0da9738243
fix: persist changes in evals template edit on tab change ( #6716 )
2025-05-07 08:02:26 +00:00
Marc Klingen and GitHub
8d2d242375
chore(ui): add border to trace timeline bars to increase contrast ( #6723 )
...
* chore(ui): add border to trace timeline bars to increase contrast
* fix
2025-05-07 03:36:43 +00:00
Marc Klingen and GitHub
7b5231db88
chore: show full user email on hover ( #6722 )
...
chore(ui): show full user email address on hover
2025-05-07 03:23:14 +00:00
Marc Klingen and GitHub
2925bc77fc
chore(ui): increase contrast ratio of annotation selection ( #6721 )
...
chore(ui): The selection in `Annotate` window should have higher-contrast color
Fixes langfuse/langfuse#6720
2025-05-07 03:14:00 +00:00
Max Deichmann and GitHub
cfc8d68a57
fix: increase io limit ( #6714 )
...
* push
* fix: fix json limits and scope to single bodies only
* push
* fix: fix json limits and scope to single bodies only
* fix: fix json limits and scope to single bodies only
* fix: fix json limits and scope to single bodies only
* fix: fix json limits and scope to single bodies only
* fix: fix json limits and scope to single bodies only
2025-05-06 21:34:03 +00:00
Steffen Schmitz and GitHub
aa38a2cbb8
feat: add totalTokens and totalCost to dashboard builder ( #6715 )
2025-05-06 19:20:07 +00:00
marliessophie and GitHub
78958ac5f9
fix(score-analytics): css on categorical charts ( #6710 )
2025-05-06 16:04:03 +00:00
Marlies Mayerhofer
98506db2b0
chore: release v3.54.1
2025-05-06 16:54:54 +02:00
Steffen Schmitz and GitHub
1ecf3a2a60
fix: allow protected keys in metadata object ( #6701 )
2025-05-06 11:37:14 +00:00
marliessophie and GitHub
bca360b738
fix(security): remove hyperlinks from organization invitation emails ( #6703 )
2025-05-06 09:43:16 +00:00
Steffen Schmitz and GitHub
8c44e03cc3
chore: remove non-production note on worker in CONTRIBUTING.md ( #6626 )
2025-05-06 06:36:47 +00:00
marliessophie and GitHub
5487dc36c9
fix: navigation issue with organization/project members pages ( #6695 )
2025-05-05 18:51:55 +00:00
marliessophie and GitHub
4e2fa5d794
chore(peek): memoize table body for enhanced front-end performance ( #6690 )
...
* chore: memoize table body for enhanced front end performance
* chore: push
* chore: refactor
* style: speed up animation
* chore: re-render on table state changes
* chore: import function directly
* chore: refactor to use timestamp
* chore: push
* chore: push
2025-05-05 18:04:56 +00:00
8b013c6712
fix(trace-ui): usage breakdown on hover ( #6694 )
...
* fix(trace-ui): usage breakdown on hover
* Update web/src/components/table/use-cases/traces.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-05 17:36:03 +00:00
76fae866ea
fix: improve axis labeling in widgets ( #6691 )
...
* fix: improve axis labeling in widgets
* Update web/src/features/widgets/chart-library/utils.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-05-05 15:16:42 +00:00
Max Deichmann and GitHub
0e0bf5cfbc
chore: improve front end performance ( #6683 )
...
* push
* push
2025-05-02 22:30:52 +00:00
Max Deichmann
81872c1fdc
chore: release v3.54.0
2025-05-01 17:24:48 +02:00
Max Deichmann and GitHub
c06af525bf
chore: disable dlx retry for oss ( #6665 )
2025-05-01 16:33:59 +02:00
Max Deichmann and GitHub
cd30f0c89c
chore: add eval execution metric ( #6664 )
...
push
2025-05-01 16:32:18 +02:00
marliessophie and GitHub
5bc4f1cbac
chore: add copy ID button to trace/observation preview ( #6651 )
2025-04-30 09:39:42 +00:00
marliessophie and GitHub
d0f7663ea2
feat(datasets): search by name on table ( #6645 )
...
* feat: add search by name to datasets
* chore: apply search query on count
2025-04-29 14:24:58 +00:00
Max Deichmann and GitHub
7496e2aeb0
chore: increase trace id delete observability ( #6635 )
2025-04-28 22:49:24 +02:00
marliessophie and GitHub
d39b0214b8
chore(markdown): introduce type guards for markdown rendering ( #6631 )
2025-04-28 14:50:15 +00:00
Max Deichmann
9957c51d66
chore: release v3.53.0
2025-04-28 12:19:51 +02:00
0f06a066df
feat(scores): support session level scores ( #6367 )
...
* chore: make changes to `scores` data structure
* fixup: migrations
* chore: update CH score types and schemas
* feat: support session level scores
* chore: add mock session level scores
* feat(session-scores): create v2 APIs; extract score and trace api service
* chore: clean up todos
* eslint
* eslint
* chore: reorder migrations after rebase
* chore: order unclustered migrations after rebase
* chore: fixes after rebase
* chore
* revert changes to .json file
* chore
* chore: move session_id column
* typo
* chore: migration adjustment
* chore: styling adjustments
* chore: materialize index
* chore: fix types after rebase
* chore: fix types after rebase
* chore: feedback
* chore: refactor scores types file structure
* chore: fix lint
* chore: add api types
* chore: rename
* fix: wait for clickhouse mutations to succeed (#6629 )
* fix: wait for clickhouse mutations to succeed
* push
* fix: wait for clickhouse mutations to succeed
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-04-28 09:51:22 +00:00
marliessophie and GitHub
ff8ccf1d61
chore(ui): add support for input_text and output_text in markdown rendering ( #6625 )
2025-04-28 08:39:15 +00:00
Max Deichmann and GitHub
eeff4a4f68
feat: add dlx retry queue and service ( #6621 )
...
* feat: add dlx retry queue and service
* feat: add dlx retry queue and service
* feat: add dlx retry queue and service
* feat: add dlx retry queue and service
* feat: add dlx retry queue and service
2025-04-27 10:15:24 +00:00
Hassieb Pakzad and GitHub
876d43e317
perf(api-traces): increase observations payload limit to 10mb ( #6615 )
...
* perf(api-traces): increase observations payload limit to 10mb
* add test
2025-04-25 18:47:05 +02:00
Hassieb Pakzad and GitHub
3da7f3c8b2
perf(trace-api): increase observations payload limit to 6mb ( #6614 )
2025-04-25 15:11:48 +00:00
Hassieb Pakzad and GitHub
6e5d0cee7b
fix(api-prompts): use middleware to send response when updating labels ( #6611 )
...
* fix(api-prompts): use middleware to send response when updating labels
* fix lint error
2025-04-25 14:57:45 +00:00
Steffen Schmitz and GitHub
9f1fafd1bb
build: prepare deployment for HIPAA compatibility ( #6613 )
2025-04-25 14:26:04 +00:00
Steffen Schmitz and GitHub
a2cbcbc585
Revert "perf: race byId queries for traces and observations ( #6555 )" ( #6612 )
...
* Revert "perf: race byId queries for traces and observations (#6555 )"
This reverts commit 591fb98a
* chore: compare on toDate starttime
2025-04-25 13:29:25 +00:00
Steffen Schmitz and GitHub
e7aa0fbe08
feat: add support for score name filters on dashboard ( #6608 )
2025-04-25 09:52:23 +00:00
Hassieb Pakzad and GitHub
30e608244a
test(trace-api): fix observations too large test ( #6607 )
2025-04-25 11:32:59 +02:00
Hassieb Pakzad and GitHub
3ec5476c04
perf(api-traces): increase byId size limit to 5MB ( #6604 )
2025-04-25 10:11:01 +02:00
Max Deichmann and GitHub
8c46c79e4f
perf: reduce optimistic lookback for byid queries ( #6593 )
...
* perf: reduce optimistic lookback for byid queries
* perf: reduce optimistic lookback for byid queries
2025-04-24 15:58:13 +00:00
Hassieb Pakzad and GitHub
231ee5873c
perf(public-api-traces): raise early error if observations are too large ( #6592 )
2025-04-24 14:25:01 +00:00
Steffen Schmitz and GitHub
7a74f7da9d
perf: refactor clickhouseClient creation to singletons ( #6584 )
...
* perf: refactor clickhouseClient creation to singletons
* chore: align remaining client usages
* chore: update test usage
2025-04-24 14:03:53 +00:00
Steffen Schmitz and GitHub
82bf0baab7
perf: return only on API if no trace found ( #6587 )
2025-04-24 14:29:26 +02:00
Steffen Schmitz and GitHub
591fb98afb
perf: race byId queries for traces and observations ( #6555 )
...
* perf: race byId queries for traces and observations
* chore: update tests
2025-04-24 10:02:04 +00:00
marliessophie and GitHub
e919893c2b
fix(ui): add deprecated col mapping on traces table for cached filter states ( #6583 )
...
* fix(ui): add deprecated col mapping on traces table for cached filter states
* chore: improve comments
* chore: fix
* chore: push
2025-04-24 07:01:54 +00:00
Max Deichmann and GitHub
237076bf92
chore: improve user identification in observability ( #6575 )
2025-04-23 20:11:27 +00:00
Steffen Schmitz and GitHub
c7b09e7843
perf: include timestamp on trace retrieval on sessions and datasetrunitemstable ( #6549 )
2025-04-23 16:03:12 +00:00
marliessophie and GitHub
277e7b7501
feat(scores): support categorical filters across tables ( #6484 )
...
* fixup(scores): add categorical scores filter to traces table
* chore: support categorical scores filter on traces table
* chore: throw error if categories options filter is used in postgres
* chore: eslint
* feat: support categorical scores filter on observation scores
* chore: adjust typing
* style: filter builder
* chore: rename function
2025-04-23 07:30:43 +00:00
a01d12c064
fix: use source entity environment for annotation scores ( #6545 )
...
* fix: use source entity environment for annotation scores
* chore: resolve typo
* perf: remove redundant trace fetch for traces.byIdWithObservationsAndScores
* Revert "perf: remove redundant trace fetch for traces.byIdWithObservationsAndScores"
This reverts commit 544d241f0ddeccc9e1b7c1cd8f33a63d7253ae6c.
* fix: include `environment` in `handleCommentUpdate` call
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-04-22 16:14:36 +00:00
e1ae79e0d1
perf: soft delete event logs clickhouse ( #6533 )
...
* chore: mograte event_log table to new blob storage table
* push
* push
* push
* fix
* fix
* Update packages/shared/clickhouse/migrations/clustered/00011_add_blob_storage_file_log.up.sql
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update worker/src/backgroundMigrations/migrateEventLogToBlobStorageRefTable.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* push
* push
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* push
* fix
* fix
* fix
* push
* fix
* fix
* fix
* fix
* fix
* fix
* push
* push
* Update packages/shared/src/server/data-deletion/ingestionFileDeletion.ts
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
* push
* fix
* fix
* fix
* push
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
2025-04-22 13:43:10 +00:00
marliessophie and GitHub
9804739ff1
chore(observations): show model name in table column ( #6552 )
2025-04-22 12:39:17 +00:00
Steffen Schmitz and GitHub
2d1f104a1c
perf: remove redundant trace fetch for traces.byIdWithObservationsAndScores ( #6548 )
...
* perf: remove redundant trace fetch for traces.byIdWithObservationsAndScores
* chore: include fromTimestamp in enforceTraceAccess util
2025-04-22 11:38:31 +00:00
Max Deichmann and GitHub
2a871d1e75
chore: migrate event_log table to new blob storage table ( #6534 )
2025-04-22 12:24:55 +02:00
marliessophie and GitHub
4c749298e6
chore(prompts): throw 400 if prompt name type mismatched ( #6547 )
...
chore(prompts): throw 400 if prompt name type mismatched
2025-04-22 10:17:52 +00:00
marliessophie and GitHub
b207712bcd
chore(model-costs): support alias for all models ( #6542 )
...
* chore(model-costs): support alias for all models
* chore: remove from playground
2025-04-22 09:29:46 +00:00
Hassieb Pakzad and GitHub
472b053c44
fix(llm-keys): drop top_p from test call ( #6544 )
2025-04-22 09:22:26 +00:00
steffen911
5b77e5835b
chore: release v3.52.0
2025-04-22 10:00:35 +02:00
Steffen Schmitz and GitHub
657bb63c3e
chore: make custom dashboards available for self-hosters ( #6541 )
2025-04-22 07:33:56 +00:00
Steffen Schmitz and GitHub
b101e7c558
feat: allow optional metadata param on org / project CRUD API ( #6524 )
...
* feat: allow optional metadata param on org / project CRUD API
* chore: drop debugger statements
* chore: remove more debuggers
* chore: update tests
* chore: add metadata to fern spec
2025-04-22 07:30:02 +00:00
Steffen Schmitz and GitHub
bac6b13145
fix: handle data retention on clustered clickhouse deployments ( #6538 )
2025-04-22 07:27:09 +00:00
Steffen Schmitz and GitHub
6817cdab0a
chore: confirm pagination behaviour for scores-api ( #6537 )
...
* chore: confirm pagination behaviour for scores-api
* chore: use correct logger for score errors
* chore: inline error
2025-04-22 07:22:31 +00:00
Steffen Schmitz and GitHub
2d4708921c
feat(dashboard): allow filtering by observation name ( #6511 )
2025-04-18 10:12:44 +00:00
marliessophie and GitHub
756b2f7501
chore(ui-forms): ensure name uniqueness enforced on form-level also ( #6503 )
...
* chore(ui-forms): ensure name uniqueness enforced on form-level also
* chore: nits
2025-04-17 14:13:01 +00:00
marliessophie and GitHub
2a685edbfa
fix(tables): rename usage column to tokens column ( #6498 )
2025-04-17 11:58:12 +00:00
Steffen Schmitz and GitHub
c1c22a9b9b
fix: parse negative integer signs on otel timestamps ( #6497 )
2025-04-17 11:23:55 +00:00
Marlies Mayerhofer
ecd3afb4c9
chore: release v3.51.2
2025-04-17 11:40:15 +02:00
marliessophie and GitHub
362902a69c
fix(llm-keys): ensure default openai model supports all model params ( #6496 )
2025-04-17 11:38:05 +02:00
Marlies Mayerhofer
ab14bac8df
chore: release v3.51.1
2025-04-17 09:11:58 +02:00
Steffen Schmitz and GitHub
3e92e6b74d
chore: add query tags to health check queries ( #6493 )
...
* chore: add query tags to health check queries
* chore: update type
* chore: switch to domain_ts instead of created_at
2025-04-17 05:34:59 +00:00
Steffen Schmitz and GitHub
54f3c224a7
chore: configure global posthog processing rate limit ( #6492 )
2025-04-17 04:44:34 +00:00
marliessophie and GitHub
e39dda87f9
chore(cost-tracking): add support for openai o3 and o4-mini models ( #6491 )
2025-04-16 21:43:38 +00:00
Max Deichmann and GitHub
0b8ad96b18
fix: do not report usage to stripe for projects which have been deleted ( #6468 )
...
push
2025-04-16 13:14:58 +00:00
marliessophie and GitHub
a4ba66f329
perf(datasets): split metrics and core data into two endpoints ( #6481 )
...
* perf(datasets): split metrics and core data into two endpoints
* chore: nit
2025-04-16 10:21:36 +00:00
Marc Klingen and GitHub
9c473be745
chore: Update CONTRIBUTING.md ( #6476 )
2025-04-16 01:46:33 +00:00
Marc Klingen and GitHub
4da0b9874a
fix: preserve new lines when displaying score comments on single trace view ( #6475 )
2025-04-16 00:24:43 +00:00
Marc Klingen and GitHub
8fd6951a19
fix: window not available at build time ( #6472 )
2025-04-15 21:11:25 +02:00
Marc Klingen and GitHub
b30734f43c
fix: plain not available on some page loads ( #6471 )
2025-04-15 20:53:32 +02:00
Max Deichmann and GitHub
293215d1d4
chore: more error logging improvements for project deletions ( #6467 )
...
* fix
* push
2025-04-15 16:41:54 +00:00
Max Deichmann and GitHub
ead31c8ca4
chore: improve logging for project deletion queue ( #6465 )
...
fix
2025-04-15 16:26:40 +00:00
marliessophie and GitHub
870336a5ed
fix(prompts): prompt label popover overflows screen bounds ( #6463 )
2025-04-15 14:21:29 +00:00
steffen911
40792d6587
chore: release v3.51.0
2025-04-15 15:58:59 +02:00
Steffen Schmitz and GitHub
820de6f30f
chore: refactor admin-api handling into ee folder ( #6462 )
...
* chore: refactor admin-api handling into ee folder
* chore: lint
* chore: add a license key for testing
2025-04-15 13:41:18 +00:00
marliessophie and GitHub
39fb6d99d4
feat(tables): reorder traces and observations column order; re-style visibility selector; peek on observations table ( #6442 )
...
* style(traces-table): re-order columns
* style(observations-table): re-order columns
* feat: add peek view to observations view
* style: revamp column visibility filter
* chore: typo
* chore: css
2025-04-15 13:27:55 +00:00
marliessophie and GitHub
c156a961a2
chore(cost-tracking): add support for openai 4.1 models ( #6459 )
...
* chore(cost-tracking): add support for openai 4.1 models
* chore: add tokenizer config
* chore: add gpt-4.1 prefix
2025-04-15 11:45:57 +00:00
steffen911
8907056b39
chore: release v3.50.0
2025-04-15 10:42:48 +02:00
Steffen Schmitz and GitHub
7ad6749058
feat: expose project retention via the projects API ( #6456 )
...
* feat: expose project retention via the projects API
* chore: adjust docs
* chore: remove unnecessary assertion
2025-04-15 07:55:44 +00:00
Steffen Schmitz and GitHub
2e40330df8
feat: allow management of project api keys via API ( #6457 )
...
* feat: allow management of project api keys via API
* chore: add api docs
2025-04-15 07:37:51 +00:00
Jason E. Jensen and GitHub
3f36fc1191
fix(users): adjust pagination calculation for user retrieval ( #6453 )
2025-04-15 08:42:27 +02:00
Steffen Schmitz and GitHub
82d7cb9769
chore: expand project and org name limit to 60 chars ( #6455 )
2025-04-15 06:22:41 +00:00
Steffen Schmitz and GitHub
9bc75b5081
chore: add reference to full Langfuse API spec ( #6454 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* feat: allow org api key management via admin api
* feat: allow the creation of projects using an org api key
* chore: allow deletion of projects via API
* feat: create outline of SCIM Users support
* feat: implement SCIM style user endpoints
* chore: allow set password on user
* chore: lint
* feat: add endpoints to manage project and organization memberships
* chore: add memberships api docs
* chore: reject project membership calls if entitlement is missing
* chore: add team plan to test org
* chore: add reference to full Langfuse API spec
2025-04-15 06:07:05 +00:00
Steffen Schmitz and GitHub
3b4811599d
feat: add endpoints to manage project and organization memberships ( #6449 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* feat: allow org api key management via admin api
* feat: allow the creation of projects using an org api key
* chore: allow deletion of projects via API
* feat: create outline of SCIM Users support
* feat: implement SCIM style user endpoints
* chore: allow set password on user
* chore: lint
* feat: add endpoints to manage project and organization memberships
* chore: add memberships api docs
* chore: reject project membership calls if entitlement is missing
* chore: add team plan to test org
2025-04-15 05:51:11 +00:00
Steffen Schmitz and GitHub
d6eee1687e
feat: create outline of SCIM Users support ( #6439 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* feat: allow org api key management via admin api
* feat: allow the creation of projects using an org api key
* chore: allow deletion of projects via API
* feat: create outline of SCIM Users support
* feat: implement SCIM style user endpoints
* chore: allow set password on user
* chore: lint
* chore: add scim api docs
* chore: remove outdated generated artifacts
2025-04-15 05:31:22 +00:00
Steffen Schmitz and GitHub
4b36ff8752
feat: allow the creation and deletion of projects using an org api key ( #6438 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* feat: allow org api key management via admin api
* feat: allow the creation of projects using an org api key
* chore: allow deletion of projects via API
* chore: add documentation for new project routes
* chore: cleanup
* chore: error updates and handling
* chore: reduce reduntant error handling
2025-04-14 20:05:14 +00:00
Steffen Schmitz and GitHub
64827a0c9d
feat: allow org api key management via admin api ( #6437 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* feat: allow org api key management via admin api
* chore: add defs
* chore: remove admin api
2025-04-14 19:34:46 +00:00
Steffen Schmitz and GitHub
fc84da9508
feat: add new organization routes ( #6430 )
...
* feat: add new organizations apiKey route
* chore: implement additional org routes
* chore: add API docs
* chore: checkin openapi spec
* chore: update tests
* chore: move admin-api spec to organizations-api
* chore: add postman collection
2025-04-14 19:00:01 +00:00
Marc Klingen and GitHub
3ca321d9f8
feat(cloud): switch from crisp to plain for in-app chat support ( #6433 )
...
* feat(cloud): switch from crisp to plain for in-app chat support
* push
* fix lint
* push
2025-04-14 16:49:56 +02:00
marliessophie and GitHub
66df08e232
chore(evals): fall back to bullmq job.data.timestamp allowing for successful retries ( #6450 )
...
* chore(evals): fall back to bullmq `job.data.timestamp` allowing for successful retries
* chore: test
* chore: test
* docs: add diagram and docs
* chore: typo
* chore: typo
2025-04-14 14:33:22 +00:00
Hassieb Pakzad and GitHub
af3cf6d860
fix(llm-tools): do not strip additional properties in schema ( #6445 )
2025-04-14 11:02:25 +02:00
marliessophie and GitHub
0edecde6e3
style(compare-runs): label on run metrics visibility settings ( #6405 )
2025-04-14 08:34:41 +00:00
marliessophie and GitHub
5a2fef1fe9
feat(compare-runs): Allow for variable row height on compare view ( #6400 )
...
* feat(dataset-compare-runs): Allow for variable row height on compare view
* chore: import as type
2025-04-14 08:21:47 +00:00
Steffen Schmitz and GitHub
28bada800d
chore: add test cases for projects api ( #6429 )
...
* chore: add test cases for projects api
* chore: lint
* chore: align project name with pipeline
2025-04-11 15:06:53 +00:00
Steffen Schmitz and GitHub
663d67cbd6
fix: update access check for projects api ( #6428 )
2025-04-11 16:00:32 +02:00
Steffen Schmitz and GitHub
bd651e81b7
chore: refactor authentication for admin apis ( #6417 )
...
* chore: refactor authentication for admin apis
* chore: lint
* chore: address feedback
* feat: add post organizations endpoint
* chore: update tests
* chore: update api key data model
* chore: align code with new scoped api keys
* chore: typing
* chore: align tests with new logic
* chore: remove ratelimitoverrides
* chore: remove accesslevel from queue message
* chore: add additional check to ingestion endpoint
* chore: add test for legacy api key format in redis
* chore: map all api keys in auditlog
2025-04-11 12:37:38 +00:00
Steffen Schmitz and GitHub
f1547dab58
fix: avoid write after end errors on otel metrics endpoint ( #6419 )
2025-04-10 14:09:12 +00:00
Steffen Schmitz and GitHub
34b470f1fe
fix: allow sessions filter on widgets ( #6418 )
2025-04-10 14:04:16 +00:00
steffen911
040b720dbf
chore: release v3.49.1
2025-04-10 15:04:52 +02:00
Steffen Schmitz and GitHub
d56e06d6c9
Revert "fix: access all replicas to create dataset score metrics ( #6407 ) ( #6416 )"
...
Revert "fix: access all replicas to create dataset score metrics (#6407 )"
This reverts commit a3b407ac92 .
2025-04-10 15:04:39 +02:00
steffen911
08af244179
chore: release v3.49.0
2025-04-10 14:39:07 +02:00
c821d06099
chore: disable error log checks in playwright tests ( #6414 )
...
* push
* dummy
* chore: lint
---------
Co-authored-by: steffen911 <steffen@langfuse.com >
2025-04-10 12:11:58 +00:00
Steffen Schmitz and GitHub
7ed5f71154
fix(dashboards): support all dashboard filters across views ( #6413 )
2025-04-10 11:59:46 +00:00
Steffen Schmitz and GitHub
8c44314f56
chore: add dummy route that accepts all otel metrics calls ( #6408 )
2025-04-10 11:37:54 +00:00
Steffen Schmitz and GitHub
a3b407ac92
fix: access all replicas to create dataset score metrics ( #6407 )
...
* fix: access all replicas to create dataset score metrics
* fix: access all replicas to create dataset score metrics
* chore: linting
* dummy
2025-04-10 09:31:03 +00:00
marliessophie and GitHub
b043cf2600
style(compare-runs): remove duplicate run column selector ( #6403 )
2025-04-10 09:12:29 +00:00
Steffen Schmitz and GitHub
d7f75a5e62
build: update end to end tests after dashboard change ( #6406 )
2025-04-09 19:28:34 +00:00
Steffen Schmitz and GitHub
9951364ff0
feat(dashboards): add beta preview for customizable dashboards ( #6376 )
2025-04-09 18:14:51 +02:00
David Alexander Pfeiffer and GitHub
03cf7bccfc
feat(evals): Extend job configuration filter options; Evaluators can run based on environments ( #6039 )
...
* added environment filter option to traces
* WIP on multi-select ui inconsistency
* fixed overflow issue in multi select where an item would not take the full width automatically; also changed to overflow-x-auto
* fixed invalid DOM nesting of div within p (FormDescription) that resulted in a hydration error
* fix multiselect to cut overflowing text with ellipsis and take full name as titlte so you can hover over it, removed unnecessary css classes
* WIP on create evaluator page ui issue with filter builder
* Revert "WIP on create evaluator page ui issue with filter builder"
This reverts commit fd6dd507f2df3c5fb404f4e38a2983e8ef6405ef.
* hide empty string from multi-select options, as supporting empty values would require further work - out of scope for now; also checked for side effects, with current usage all good
* Added test suite for eval filtering
* Resolved comment: removed getEnvironmentsForProject from traces router and instead fetched environments inside evaluator-form via api.projects.environmentFilterOptions
* move eval filtering tests into separate test file
* removed redundancy via fixtures, prepared tests for concurrency
* filtering tests run concurrently
* extracted traceFilterOptions fetching into separate hook as it is used in both the evaluator form and the traces table, also fixed traces table since the environment was now missing there
* useTraceFilterOptions Hook after merge
* Make TraceOptions keys partial so that we can update filter options asynchronously
* default to empty object if response undefined
* exclude environment filter builder column from traces table since toolbar already has env
* removed useTraceFilterOptions hook as use case changed such that extraction into hook is no longer warranted
2025-04-09 13:40:52 +00:00
Steffen Schmitz and GitHub
4e737ea6cf
fix: update column mapping for categorical score charts ( #6399 )
2025-04-09 13:39:21 +00:00
marliessophie and GitHub
d604ce3ceb
feat(run-compare): add detail navigation ( #6398 )
...
* feat(run-compare): add detail navigation
* nits
* typo
* eslint
2025-04-09 13:26:41 +00:00
Steffen Schmitz and GitHub
2c2daf6bb4
chore: remove beta flag from blob storage integration ( #6397 )
2025-04-09 09:45:56 +00:00
Hassieb Pakzad and GitHub
8ebafda8a4
fix(prompt-ui): internal type on review chat prompt ( #6391 )
2025-04-08 21:22:22 +02:00
Steffen Schmitz and GitHub
af7384b549
fix: propagate userId correctly to downstream tables ( #6389 )
2025-04-08 14:14:18 +00:00
Hassieb Pakzad and GitHub
9768c2d171
perf(batch-exports): make page size configurable and set to 500 ( #6385 )
2025-04-08 12:59:44 +02:00
David Alexander Pfeiffer and GitHub
f5aec02277
fix(scores/trpc): byid on deleted score resulted in 5xx error instead of 404 ( #6384 )
2025-04-08 09:58:31 +00:00
David Alexander Pfeiffer and GitHub
b9cf01dd28
feat: add metadata field to scores ( #6046 )
2025-04-07 22:13:21 +02:00
7c42cf4357
perf: retry failed S3 deletions ( #6378 )
...
* push
* Update packages/shared/src/server/services/StorageService.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-04-07 18:19:19 +00:00
Max Deichmann and GitHub
72f4b88d15
perf: Increase batch export timeouts ( #6375 )
...
* push
* push
* push
* fix: flaky playwright
* fix
* push
* push
2025-04-07 13:26:23 +00:00
Max Deichmann and GitHub
99ce7c5093
chore: Increase project deletion retries ( #6372 )
...
* fix: flaky playwright
* push
* push
2025-04-07 12:31:09 +00:00
Max Deichmann and GitHub
fcb7b82ba4
chore: improve project deletion logs ( #6373 )
...
push
2025-04-07 12:30:51 +00:00
Max Deichmann and GitHub
ac5017c9ae
chore: increase batch export retries and improve observability ( #6374 )
...
push
2025-04-07 12:17:57 +00:00
Max Deichmann and GitHub
00ffddad0f
chore: Increase delete queue processing observability ( #6371 )
...
* fix: flaky playwright
* push
2025-04-07 11:34:37 +00:00
Steffen Schmitz and GitHub
28bf40769e
chore: clarify titles in dashboard latency charts ( #6370 )
2025-04-07 11:33:13 +00:00
Hassieb Pakzad and GitHub
b65b0e25fc
fix(playground): handle undefined content with toolCalls ( #6364 )
2025-04-07 09:13:31 +00:00
Max Deichmann and GitHub
62f860d9ef
fix: flaky playwright ( #6365 )
2025-04-07 09:02:33 +00:00
Steffen Schmitz and GitHub
3989480a94
fix: update dashboard column accesses after query builder updates ( #6363 )
...
* fix: update dashboard column accesses after query builder updates
* chore: modify count
2025-04-07 08:50:09 +00:00
Max Deichmann and GitHub
4a6afddbed
chore: create scores domain ( #6360 )
...
* push
* security: upgrade next
* fix
* push
* fix
* fix
* fix
* fix
* push
* push
* feat: full text search
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* push
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* security: upgrade nextjs 14.2.26
* push
* push
* playwright
* push
* fix
* remove
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* chore: create score domain
* chore: create score domain
* chore: create score domain
* chore: create score domain
* chore: create score domain
2025-04-07 07:19:04 +00:00
Max Deichmann and GitHub
4c6e8964e3
chore: refactor observations domain ( #6353 )
...
* push
* security: upgrade next
* fix
* push
* fix
* fix
* fix
* fix
* push
* push
* feat: full text search
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* push
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* chore: refactor observations domain
* security: upgrade nextjs 14.2.26
* push
* push
* playwright
* push
* fix
* remove
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* chore: create score domain
2025-04-07 07:03:38 +00:00
Max Deichmann and GitHub
cb900c61f8
chore: add traces domain layer ( #6253 )
...
* push
* security: upgrade next
* fix
* push
* fix
* fix
* fix
* fix
* push
* push
* feat: full text search
2025-04-07 06:42:03 +00:00
9bc745d647
chore: upgrade playwright tests ( #6359 )
...
* push
* push
* fix
* fix
* Update web/src/__e2e__/create-project.spec.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix
* fix
* fix
* fix
* fix
* fix
* Update web/src/__e2e__/create-project.spec.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix
* fix
* fix
* fix
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-04-06 16:41:54 +00:00
Max Deichmann and GitHub
1b6e9e1c8b
chore: upgrade tiktoken ( #6357 )
2025-04-06 12:23:24 +00:00
Max Deichmann and GitHub
ce21cf34ae
fix: fix model table provided_model_name ( #6356 )
...
* fix: fix model table
* fix: fix model table
* fix: fix model table
2025-04-06 12:15:54 +00:00
bf063a72a0
chore(deps): bump next from 14.2.25 to 14.2.26 ( #6316 )
...
Bumps [next](https://github.com/vercel/next.js ) from 14.2.25 to 14.2.26.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.25...v14.2.26 )
---
updated-dependencies:
- dependency-name: next
dependency-version: 14.2.26
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-05 22:05:30 +00:00
5c2ac78eca
feat: add new widget creator page ( #6322 )
...
* feat: add new widget creator page
* chore: add widget configuration box to creation screen
* chore: make chart title and description editable
* chore: auto-create cases
* chore: dynamically render chart based on output properties
* chore: linting
* chore: coloring
* chore: allow time series breakdowns
* chore: add support for additional chart types
* chore: conditionally show aggregation and row limit
* chore: add more separation between data selection and visualization in chart builder
* chore: add filter and time selector
* chore: make widget form overflow vertically
* chore: linting
* chore: reuse chart colors
* style: revert padding changes to card.tsx
* style: revert changing card headings to div element in card.tsx
* chore: refactoring and feedback
* chore: remove selected view restrictions
* chore: chart formatting
* chore: lint
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-04-04 14:18:33 +00:00
steffen911
c6dadda96f
chore: release v3.48.1
2025-04-04 11:47:13 +02:00
Steffen Schmitz and GitHub
f831d1ac21
fix: improve parsing of tags for otel endpoint ( #6345 )
2025-04-04 09:44:29 +00:00
steffen911
1ca4ec7e28
chore: release v3.48.0
2025-04-03 19:04:59 +02:00
Steffen Schmitz and GitHub
a9ca40aa81
fix: include tag filtering support on dashboard ( #6338 )
2025-04-03 16:58:05 +00:00
Marc Klingen and GitHub
8b0588a786
fix(auth): block duplicate membership invites that lead to sign in issues ( #6337 )
2025-04-03 16:24:54 +00:00
marliessophie and GitHub
cc79604302
style(ui): reduce text size of trace/observation name on detail ( #6329 )
2025-04-03 13:41:28 +00:00
marliessophie and GitHub
f12532c0a2
chore(ui): minor peek ui improvements ( #6328 )
...
chore(ui): minor peek ui wording improvements
2025-04-03 12:08:54 +00:00
Steffen Schmitz and GitHub
1c1519555a
fix: blob storage export UI consistency ( #6327 )
...
* fix: blob storage export UI consistency
* chore: only set field value
2025-04-03 11:39:34 +00:00
Sebi and GitHub
8954cf0c82
feat(auth): scope cookies to path for custom BASE_PATH deployments ( #6320 )
...
extend cookie paths
2025-04-03 11:10:36 +00:00
marliessophie and GitHub
849428abee
feat(dataset-runs): improve UI/UX of runs and compare page ( #6296 )
...
* fixup: dataset io cell
* fixup: restructure dataset compare view
* fix: react dom error
* chore: fix margins
* chore: remove dataset details popover
* feat: make dataset runs table resizeable
* fix: react dom error
* fix: show more fraction digits on cost chart for experiment runs
* chore: improve design of observation tree peek view
* chore: refactor peek view pattern
* chore: implement new peek view pattern for compare view
* chore: remove zustand dep
* push
* perf: improve dataset compare view
* chore: eslint
* eslint
* push
* lint
* chore
* push
2025-04-03 10:57:35 +00:00
Hassieb Pakzad and GitHub
c014612cca
feat(playground): allow uppercase in tool / schema names ( #6326 )
...
* feat(playground): allow uppercase in tool / schema names
* refactor
2025-04-03 09:59:04 +00:00
Hassieb Pakzad and GitHub
803057b5eb
fix(localStorage): memoize properly to avoid navigation issues ( #6323 )
2025-04-03 09:01:42 +00:00
Steffen Schmitz and GitHub
2152447932
perf: reduce search interval for trace existence check ( #6315 )
...
* perf: reduce search interval for trace existence check
* chore: add final again
2025-04-03 07:28:08 +00:00
marliessophie and GitHub
70e0b036e5
chore(batch-action): make entitlement prop optional ( #5884 )
...
* chore(batch-action): make `entitlement` prop optional
* push
2025-04-02 17:00:54 +00:00
Steffen Schmitz and GitHub
bef666a694
feat: add json and jsonl support for scheduled blob exports ( #6313 )
...
* feat: add json and jsonl support for scheduled blob exports
* chore: revert schedule and add migration
2025-04-02 15:38:54 +00:00
Hassieb Pakzad and GitHub
601a22d42c
feat(playground): add tool parsing from Langchain generations ( #6314 )
2025-04-02 15:26:52 +00:00
Steffen Schmitz and GitHub
5fdde72d64
chore: track dlq length ( #6312 )
2025-04-02 12:54:06 +00:00
Hassieb Pakzad
f9fc778ee7
chore: release v3.47.0
2025-04-02 14:01:27 +02:00
Hassieb Pakzad and GitHub
975ef81bb5
feat(prompts): add protected labels ( #6306 )
2025-04-02 13:57:31 +02:00
Steffen Schmitz and GitHub
28e61fae0b
chore: remove obsolete dashboard queries ( #6303 )
2025-04-02 09:32:41 +00:00
Steffen Schmitz and GitHub
0534ccacb2
perf: reduce input validation for dataset items ( #6307 )
2025-04-01 19:25:23 +00:00
Steffen Schmitz and GitHub
0c5089fd2b
chore: pin dev clickhouse version to 24.3 ( #6304 )
...
* chore: pin dev clickhouse version to 24.3
* chore: only add input format flag for cloud
* chore: whitelist accepted cloud regions
* chore: disable test
2025-04-01 15:48:18 +00:00
Max Deichmann and GitHub
37c4c1422c
perf: remove sentry tunnel config ( #6305 )
...
* fix
* fix
2025-04-01 13:01:48 +00:00
014da40fbf
fix(ui): TableWithMetadataWrapper uses contain-layout on its root div so that EvaluatorDetail overflow issue is mitigated ( #5982 )
...
* fix: (workaround) evals page overflows when rendering right hand side metadata bar
This is more of a workaround, we should probably disable the overflow on the main wrapper div in layout.tsx and enable it only where needed - or find out why the overflow inside the metadata sidebar trigggers the scrollbar to pop up - some info on what I found:
- The body and other divs close to the root do not increase their size.
- The navigation sidebar does increase its vertical height, but limiting that does not resolve the main scrollbar.
- Limiting specifically the wrapper div in layout.tsx with overflow-hidden does resolve this, but globally disabling it requires most pages to be refactored.
* Revert "fix: (workaround) evals page overflows when rendering right hand side metadata bar"
This reverts commit 313a1c0d8a885a04974399f850f7f9aee58fd714.
* fix(ui): TableWithMetadataWrapper uses contain-layout on its root div so that EvaluatorDetail overflow issue is mitigated
Checked for side effects on the other components using TableWithMetadataWrapper and all work as expected.
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-04-01 10:38:42 +00:00
Hassieb Pakzad and GitHub
2317334bff
feat(playground): persist selected model ( #6292 )
...
* feat(playground): persist selected model
* push
* push
2025-04-01 08:27:48 +00:00
Steffen Schmitz and GitHub
9ed449288b
chore: add batch export env variables to docker-compose.yml ( #6300 )
2025-04-01 06:54:23 +00:00
Steffen Schmitz and GitHub
3b4800c37a
chore: migrate score charts to new query builder ( #6294 )
2025-04-01 08:47:37 +02:00
Hassieb Pakzad and GitHub
b2ffd05ff8
fix(prompt-form): move prompt reference button ( #6289 )
2025-03-31 15:09:15 +00:00
Steffen Schmitz and GitHub
e4594db953
chore: migrate latency charts to new query builder ( #6284 )
...
* chore: migrate latency charts to new query builder
* chore: convert model latencies chart
* chore: typing
2025-03-31 13:00:05 +00:00
marliessophie and GitHub
4b733c4da8
chore(annotation-scores): revert to synchronous delete; upsert on create route ( #6282 )
...
* chore(annotation-scores): revert to synchronous delete; upsert on create route
* fix: ensure scores data not only marked as stale but refreshed on score update
2025-03-31 12:36:29 +00:00
Hassieb Pakzad and GitHub
378ac1c1a4
feat(llm-connections): add gemini-2.5-pro-exp-03-25 ( #6286 )
2025-03-31 11:57:18 +00:00
steffen911
9233c7c2d2
chore: release v3.46.0
2025-03-31 12:10:23 +02:00
Steffen Schmitz and GitHub
c2170c0c8d
feat: add support for GCS buckets ( #6269 )
...
* feat: add support for GCS buckets
* chore: cleanup
* chore: trim gcs credentials before parsing
* chore: add logging for redis shutdown in tests
* chore: update timeout for trace delete test
* chore: bump trace delete concurrency for tests
2025-03-31 10:04:49 +00:00
Max Deichmann and GitHub
7faf0e009f
chore: revert unintended worker concurrency changes ( #6275 )
...
push
2025-03-29 14:42:12 +01:00
Max Deichmann and GitHub
86318ab50b
perf: reduce worker deletion concurrency ( #6274 )
...
push
2025-03-29 14:39:17 +01:00
Max Deichmann and GitHub
48d280433a
perf: reduce delete concurrency ( #6273 )
...
push
2025-03-29 14:27:38 +01:00
marliessophie and GitHub
45f29eaad8
fix(patch): hide scores tab on trace/observation preview ( #6270 )
...
fix(patch): hide scores tab on peek view
2025-03-28 20:34:52 +00:00
2bca2899f4
feat(evals, ui): enable deletion of evaluator via UI, DeleteButton refactor ( #6247 )
...
* feat(evals): enable deletion of evaluators and templates via UI
* Added tests for the evals job and template deletion trpc endpoints
* evals-trpc test refactor, it had a side effect on other tests since it was pruning the db, now instead creates a new org and project per tests and cleans them up after all tests are done
* removed test comments as those are now implemented
* fix wrong wording
* added template version to delete confirmation on template details delete action
* DeleteButton refactoring and moved deletion of templates to LFE-4573
* moving the call to captureDeleteSuccess inside the successful branch of executeDeleteMutation
* Display lock icon when action button in icon mode is unauthorized
* fix: quietly delete scheduled evals for deleted job executions
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-03-28 18:22:21 +00:00
marliessophie and GitHub
af6d0f0086
fix(ui): trace timeline width calculation error ( #6268 )
...
fix(ui): timeline width
2025-03-28 15:44:01 +00:00
Steffen Schmitz and GitHub
3802b1849d
chore: migrate user chart to new query builder ( #6262 )
2025-03-28 14:28:03 +00:00
Steffen Schmitz and GitHub
19d2ee06e9
chore: update list of allowed blob storage export intervals ( #6266 )
2025-03-28 14:26:44 +00:00
Hassieb Pakzad and GitHub
b670abc6bc
feat(playground): add tool call support ( #6069 )
2025-03-28 15:21:51 +01:00
Hassieb Pakzad and GitHub
9395e94670
fix(prompts): handle resolvePromptGraph on deleted prompt ( #6264 )
2025-03-28 14:49:15 +01:00
Hassieb Pakzad and GitHub
684e52e11f
chore(docker-compose): update default LANGFUSE_S3_MEDIA_UPLOAD_ENDPOINT ( #6265 )
2025-03-28 14:49:00 +01:00
marliessophie and GitHub
4048e807af
fix(prompt-ui): state stuck in showing prompt diff cycle ( #6258 )
2025-03-28 09:31:19 +00:00
Hassieb Pakzad and GitHub
0b173f47f7
fix(prompts): dollar sign in replaceValue breaking resolution ( #6256 )
2025-03-27 23:39:38 +01:00
Max Deichmann and GitHub
15cad50991
chore: add logger for trpc route ( #6255 )
2025-03-27 21:48:28 +01:00
marliessophie and GitHub
747bfae721
chore(eval-count-tooltip): refactor to extract business logic into hook ( #6251 )
...
* chore(eval-count-tooltip): refactor to extract business logic into hook
* eslint
2025-03-27 17:45:50 +00:00
marliessophie and GitHub
a01ec32715
feat(evals): allow adding custom value to tags filter ( #6250 )
2025-03-27 16:22:08 +00:00
Max Deichmann and GitHub
780fd577c4
chore: set sentry profiling sample rate ( #6249 )
...
push
2025-03-27 15:49:33 +00:00
marliessophie and GitHub
cd33442168
fix(ui): detail navigation on users > traces page ( #6248 )
2025-03-27 15:39:49 +00:00
Steffen Schmitz and GitHub
6582dbc645
chore: migrate observation by model charts to new query builder ( #6245 )
2025-03-27 14:50:39 +00:00
Max Deichmann and GitHub
055eb06a4f
chore: add sentry remove dd env variables in build step ( #6246 )
2025-03-27 15:40:26 +01:00
marliessophie and GitHub
daeaf0a986
fix(trace-timeline): overflow and scroll behaviour ( #6216 )
...
* fix(trace-timeline): overflow and scroll behaviour
* fix(trace-timeline): show maximum of 3 scores and remainder in hover card
* push
* chore: refactor
* chore
* chore
2025-03-27 13:53:55 +00:00
Steffen Schmitz and GitHub
f199dcb61c
chore: remove warnings on missing domain timestamp ( #6235 )
2025-03-27 12:09:33 +01:00
Max Deichmann and GitHub
0ec0cca442
chore: enable sentry tunnel ( #6234 )
2025-03-27 11:38:53 +01:00
Steffen Schmitz and GitHub
f4c75b896b
chore: bump timeout for posthog export queries ( #6233 )
2025-03-27 09:57:04 +00:00
Steffen Schmitz and GitHub
16c76b2722
perf: reduce memory usage for posthog export via join_algo overwrite ( #6230 )
2025-03-27 10:17:44 +01:00
Steffen Schmitz and GitHub
64f6051048
chore: move the traces timeseries chart to new query builder ( #6226 )
2025-03-26 17:02:03 +00:00
Max Deichmann and GitHub
96dfd86b51
chore: improve sentry setup ( #6224 )
2025-03-26 16:20:14 +01:00
Steffen Schmitz and GitHub
b1aaf57ad5
chore: migrate ModelCostTable to new query mechanism ( #6222 )
...
* chore: migrate ModelCostTable to new query mechanism
* chore: lint
2025-03-26 14:58:43 +00:00
steffen911
fae508d820
chore: release v3.45.2
2025-03-26 09:59:47 +01:00
Steffen Schmitz and GitHub
a6e581d349
fix: use correct column name for filtering traces bar chart ( #6215 )
2025-03-26 08:56:09 +00:00
Max Deichmann and GitHub
9e77738a2f
fix: fix by model charts ( #6208 )
...
* fix
* push
* push
* push
2025-03-25 20:56:00 +00:00
Marc Klingen
d15c0a27f5
chore: release v3.45.1
2025-03-25 19:49:44 +01:00
Marc Klingen and GitHub
a8626841b5
chore(cloud): update blobstorage integration entitlement ( #6209 )
2025-03-25 18:40:57 +00:00
marliessophie and GitHub
5945a93b7d
fix(evaluator-config): preview execution of dataset run items ( #6206 )
...
* chore(evaluator-config): preview execution of dataset run items
* push
2025-03-25 17:44:11 +00:00
Steffen Schmitz and GitHub
9c447de584
chore: auto-close stale issues ( #6207 )
2025-03-25 17:21:44 +00:00
48df0e04de
fix: fix model charts ( #6202 )
...
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* Update packages/shared/src/server/repositories/dashboards.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update web/src/__tests__/async/repositories/dashboard-repository.servertest.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix
* fix
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-25 17:12:50 +00:00
Steffen Schmitz and GitHub
0897ac753b
feat: add custom-query backend ( #6006 )
...
* feat: add self-serve dashboard backend poc
* chore: data model thoughts
* chore: create initial query builder example and test case
* chore: handle empty dimensions and metrics
* chore: lint
* chore: extend filter conditions to account for timestamps
* chore: refactor query builder into sub-functions
* chore: use template queries for user-supplied values
* chore: add query builder tests
* chore: handle time dimension
* chore: add trpc endpoint to execute custom clickhouse query
* chore: add a query playground component to test a couple of queries
* chore: handle multiple joins
* chore: add observations table to data model
* chore: fix bug in data model
* chore: add test case to compare with old dashboard results
* chore: add scaffold for additional views
* expand the users view and add segments to filter scores subviews
* chore: add test cases for score views
* chore: drop users and sessions for now
* chore: add scores aggregate and observations cost tests
* chore: add sql injection tests
* chore: lint
* chore: fix dashboard test cases
* chore: drop users query test
* chore: add order by logic
* chore: fill timeseries values
* chore: use new query function on dashboard
* chore: convert TracesBarListChart.tsx to new query endpoint
* chore: make chart data compile
* chore: update tests
* chore: add tags to custom queries
* chore: typing
* chore: suffix join condition with sql
* chore: add typing in queryBuidler
* chore: limit playground to cloud admin users
* chore: add util to map legacy dashboard columns to new model
* chore: separate time filter state for TracesBarListChart.tsx
* chore: pass timestamps directly into chart components
* chore: add userId and sessionId on observations
* chore: pick auto time granularity based on hours
2025-03-25 14:54:37 +00:00
Marc Klingen and GitHub
d00c63100e
chore(cloud): remove rate limits from projects api as it is used by auth_check in sdks ( #6193 )
...
* chore(cloud): remove rate limits from projects api as it is used by auth_check in sdks
* address feedback
* improve comment
2025-03-25 14:52:23 +00:00
steffen911
e8970bc11c
chore: release v3.45.0
2025-03-25 15:52:33 +01:00
eecb253093
feat: add blob storage integration ( #6143 )
...
* feat: add page to configure blob storage integration
* chore: remove blob storage logo and include three config options
* chore: add blob storage integration table
* chore: update router for blobstorage
* chore: placeholder for password and type update
* chore: create scaffolding for blobstorage queue processors
* chore: add scheduling logic for blob storage integration
* chore: prepare setup in processing job
* chore: implement extraction fucntion
* chore: add test case and fix generator setup
* chore: lint
* chore: overwrite default region to empty
* chore: remove details from auditlog and add beta
* Update web/src/pages/project/[projectId]/settings/integrations/blobstorage.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update worker/src/__tests__/blobStorageIntegrationProcessing.test.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: correct env name in tests
* Update worker/src/ee/integrations/blobstorage/handleBlobStorageIntegrationProjectJob.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: update doc urls
* chore: open docs in new tab
* chore: ensure consistent block id length azure
* chore: revert test change
* chore: remove dummy error log
* chore: type annotation
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-25 13:39:33 +00:00
4e4fbb5101
fix(prompt-experiments): show form error if name is duplicated ( #6189 )
...
* fix(prompt-experiments): show form error if name is duplicated
* chore: fix typo
* Update web/src/ee/features/experiments/hooks/useExperimentNameValidation.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* eslint
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-25 09:07:16 +00:00
marliessophie and GitHub
bb4823aa27
fix(evaluator-templates): control editing state ( #6187 )
2025-03-24 13:29:19 +00:00
marliessophie and GitHub
174d96c100
feat(evals): preview number of historic items to be evaluated ( #6116 )
...
* feat(evals): preview number of historic items to be evaluated
* refactor: split up large evaluator form file
* chore: drop optional pagination
* chore: fix eslint
* chore: rename test
2025-03-24 13:05:50 +00:00
8e59b544c9
chore(deps): bump next from 14.2.21 to 14.2.25 ( #6175 )
...
Bumps [next](https://github.com/vercel/next.js ) from 14.2.21 to 14.2.25.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.21...v14.2.25 )
---
updated-dependencies:
- dependency-name: next
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-24 12:57:26 +00:00
Hassieb Pakzad and GitHub
cffd84f0e7
chore(azure-llm-connection): update api-version to support reasoning models ( #6186 )
2025-03-24 14:06:55 +01:00
Hassieb Pakzad and GitHub
845faee385
fix(cost-tracking): null values in OpenAI usage schema ( #6184 )
2025-03-24 13:42:20 +01:00
e45c4af30f
chore(prompts): add error logs for resolvePromptGraph ( #6181 )
...
* chore(prompts): add error logs for resolvePromptGraph
* Update packages/shared/src/server/services/PromptService/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-24 11:31:29 +00:00
Marc Klingen and GitHub
616544a48c
chore: apply prettier ( #6176 )
2025-03-24 09:46:13 +00:00
steffen911
75d64b38b3
chore: release v3.44.0
2025-03-24 09:35:15 +01:00
Steffen Schmitz and GitHub
65cdd75282
chore: drop queue backup option in bullmq ( #6141 )
...
* chore: drop queue backup option in bullmq
* chore: lint
2025-03-24 08:26:32 +00:00
Steffen Schmitz and GitHub
2744028f4c
feat: extract top-level metadata from langfuse.metadata ( #6173 )
...
* feat: extract top-level metadata from langfuse.metadata
* chore: extract metadata based on prefix
* chore: add support for resourceAttributes
2025-03-24 08:09:04 +00:00
Max Deichmann and GitHub
3c02c54de2
fix: fix model paring from redis ( #6157 )
...
* push
* fix
* push
* fix
* fix
2025-03-21 18:42:06 +00:00
marliessophie and GitHub
974d2c1007
fix(ui): reference errors in prompt detail screen ( #6126 )
...
* chore(ui): convert `action-button` to use forwardRef for compatibility w/ buttons
* fix(ui): ensure prompt item ref points to `command-item`
2025-03-21 17:07:21 +00:00
Max Deichmann and GitHub
008045c771
perf: cache model not found ( #6148 )
...
* push
* push
* fix
2025-03-21 14:57:17 +00:00
Marc Klingen and GitHub
c6790c6c0e
chore(ui): do not auto-generate new api keys in setup-tracing step ( #6149 )
...
* chore(ui): do not auto-generate new api keys in setup-tracing step
* fix
2025-03-21 14:17:01 +00:00
Marc Klingen and GitHub
909445ce5b
fix(prompts): trim prompt names ( #6145 )
...
* fix(prompts): trim prompt names
* push
2025-03-21 13:38:04 +00:00
Max Deichmann and GitHub
f4ed4a2635
chore: improve model match observability ( #6147 )
...
push
2025-03-21 13:18:39 +00:00
Max Deichmann and GitHub
d6206b5269
chore: increase model match observability ( #6144 )
2025-03-21 13:45:36 +01:00
Max Deichmann and GitHub
62fa43aa78
feat: cache LLM models in Redis ( #6129 )
...
* push
* fix
* fix
* fix
* push
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* push
* push
* push
* fix
* fix
* fix
* fix
* push
2025-03-21 11:26:11 +00:00
Steffen Schmitz and GitHub
3c9239a4ab
chore: update .env.prod.example ( #6140 )
2025-03-21 10:24:48 +00:00
marliessophie and GitHub
476cddb4e1
chore(ui): clamp page-header title to one line ( #6139 )
2025-03-21 10:01:45 +00:00
Steffen Schmitz and GitHub
a6c1678da8
feat: add additional input/output parsing for pydantic via OTel ( #6138 )
2025-03-21 10:00:33 +00:00
Steffen Schmitz and GitHub
129805ebde
fix: safely parse big numbers in api responses ( #6136 )
...
* fix: safely parse big numbers in api responses
* feat: add additional input/output parsing for pydantic via OTel
* Revert "feat: add additional input/output parsing for pydantic via OTel"
This reverts commit 71d0f3abd951702393aac7ab79a875b888f089cf.
2025-03-21 09:30:24 +00:00
marliessophie and GitHub
59eafb42c3
fix(ui): require annotation queue selection for bulk action ( #6127 )
2025-03-20 21:08:57 +00:00
marliessophie and GitHub
e4695ac717
fix(ui): dom nesting error data-table-row-height-switch ( #6125 )
2025-03-20 20:12:52 +00:00
marliessophie and GitHub
eebd6ea0e9
fix(ui): dom nesting error page-header ( #6124 )
2025-03-20 20:06:05 +00:00
Marc Klingen and GitHub
b4a8b08d3d
chore(cloud): add posthog for projects and orgs ( #6117 )
...
* chore(cloud): add posthog for projects and orgs
* push
2025-03-20 18:07:17 +00:00
Max Deichmann and GitHub
ed44b663ff
chore: add dd env variables to github build command ( #6119 )
2025-03-20 17:36:48 +01:00
Marc Klingen and GitHub
720ebe861e
chore(cloud): cache response of cloudStatus api for 5 minutes ( #6115 )
...
chore(cloud): keep response of cloudStatus api cached across views for 5 minutes
2025-03-20 14:25:54 +00:00
Max Deichmann and GitHub
9a6f8fd75d
refactor: refactor naming of database batch exports ( #6111 )
...
* refactor: refactor naming of database batch exports
* refactor: refactor naming of database batch exports
2025-03-20 12:56:38 +00:00
Steffen Schmitz and GitHub
f0da1cfa30
chore: reduce cloudwatch flush frequency and batch metrics ( #6108 )
...
* chore: reduce cloudwatch flush frequency and batch metrics
* chore: simplify metrics reset
* chore: keep 30s flush
* chore: correct CW metrics
2025-03-20 12:05:07 +00:00
Marc Klingen and GitHub
0c9ebb3da7
feat(cloud): show status page menu item during incidents ( #6100 )
...
* feat(cloud): show status page menu item during incidents
* add to support menu
2025-03-20 09:59:49 +00:00
Hassieb Pakzad and GitHub
3d16d1ac57
fix(model-params-ui): duplicate model names leading to rendering issues ( #6107 )
2025-03-20 10:40:59 +01:00
Marc Klingen and GitHub
fa462a8bc4
chore(ui): improve padding in peek view header ( #6099 )
2025-03-19 18:59:29 +00:00
David Alexander Pfeiffer and GitHub
695b65fe0d
chore(tests): fully unpin node version from temporary fix #6063 ( #6096 )
2025-03-19 15:38:36 +00:00
955388e846
feat(llm-connections): add atla adapter ( #6088 )
...
* feat: enable Atla integration (#6022 )
* push
* push
* Update packages/shared/src/server/llm/fetchLLMCompletion.ts
* Update web/src/features/public-api/components/CreateLLMApiKeyForm.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Revert "Update web/src/features/public-api/components/CreateLLMApiKeyForm.tsx"
This reverts commit efb2d3b359a85680224876481421d31bfbd44fd3.
---------
Co-authored-by: jake golden <jackson.golden@gmail.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-19 12:36:12 +00:00
David Alexander Pfeiffer and GitHub
c6864ed8d9
fix(tests): disable --experimental-require-module (default since Node 20.19.0) since it breaks jest-based testing ( #6075 )
...
* pin node to problematic version for working on a fix
* added cross-env and disabled the feature flag causing the testing issue - long term fix should probably be switching to vitest
* unpin node version since problematic feature is now disabled fo affected tests
2025-03-19 11:04:59 +00:00
marliessophie and GitHub
917516fa91
chore(ui): control for more specific onClick actions in table with peek view ( #6086 )
2025-03-19 10:25:03 +00:00
David Alexander Pfeiffer and GitHub
19017a6709
fix(ui): OpenAiMessageView now renders messages where content is an empty string instead of ignoring them ( #6068 )
...
* fix(ui): IOPreview now renders messages where content is an empty string instead of ignoring them
* removed debug logs
* OpenAiMessageView first filters valid messages to render and then executes the "show x more ..." logic, this way we ensure that there can never be a mismatch between messages items and the amount of fields we support displaying
* Render empty string quotation marks if content is empty but not null or undefined
* Change length check to falsy check for conditional display of empty quotes if content is empty
* cleaner falsy check for rendering empty string quotation marks
2025-03-19 09:41:32 +00:00
marliessophie and GitHub
ca5e6569f9
fix(peek-view): ensure onClickRow action smoothly keeps peek view open; onClick of select cells independent of peek view state ( #6079 )
...
* fix(ui): stop propagation on traces table checkbox
* fix(peek-ui): handle onRowClick action correctly for peek view
* feat(peek): do not close upon any screen button or checkbox clicks
* push
2025-03-19 00:41:36 +00:00
marliessophie and GitHub
101942b98b
fix(ui): padding on single prompt page ( #6070 )
2025-03-18 18:35:32 +00:00
marliessophie and GitHub
1188a21b02
feat(traces): add peek view on traces table ( #6048 )
...
* feat: adjust table to new style
* style: filter and column options
* fixup: add peek view
* feat: add detail navigation
* chore: remove duplicated code
* chore: style settings tables
* chore: pin first column on traces table
* style: adjust animation speed of peek view
* fix: padding on score configs table
* style: onClick cursor in table
* fix: eslint
* style
* chore: fix toggle for timeline
* push
* style: add padding
2025-03-18 17:25:52 +00:00
Marc Klingen and GitHub
ec72dd840d
chore(ui): render min-level hint in a single line ( #6051 )
2025-03-18 14:55:54 +00:00
steffen911
c2d800ff0e
chore: release v3.43.0
2025-03-18 15:15:41 +01:00
Steffen Schmitz and GitHub
dcf159ef82
chore: lock dd-trace to 5.36.0 ( #6064 )
2025-03-18 14:13:30 +00:00
Marc Klingen and GitHub
998984b9ed
chore(cloud): improved pricing/packaging ( #5664 )
...
* wip
* simplify
* actionbutton for upgrade prompt
* count events for free plan limit
* add sso settings
* rename lite to core
* add product id
* nit
* nits
* fix rate limit test
* ci run on teams plan
* fix
* fix names of pipeline steps
* test tmp
* add better error logs to makeAPICall
* push
* clone to throw better errors
* improve error
* improve error
* fix
* remove comment
* refactor
* push
* next attempt
* nit
* create new auth for failing test suites
* push
* fix rate limit test
2025-03-18 13:47:03 +00:00
Marc Klingen and GitHub
022b234e57
chore: pin node 20.18.3 to avoid issue introduced by 20.19.0 ( #6063 )
...
* test commit
* chore: pin node 20.18.3 to avoid issue introduced by 20.19.0
* docker
* revert test commit
* push
2025-03-18 13:30:58 +00:00
b8777aa5d1
chore: better error message when uploading existing dataset item ( #6053 )
...
chore: better docstring when uploading existing dataset item to different dataset
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-18 13:07:11 +00:00
Steffen Schmitz and GitHub
2e84feeab7
feat: support external S3 endpoint for batch exports ( #6055 )
...
* feat: add media and export external endpoint config
* chore: add docs string
* chore: add external endpoint support for azure
* chore: drop feature for media
2025-03-18 10:57:14 +00:00
Steffen Schmitz and GitHub
a508485f88
chore: enable datadog profiling for web ( #6020 )
...
* chore: enable datadog profiling for web
* chore: update dockerfile
2025-03-18 07:26:53 +00:00
marliessophie and GitHub
d8bb283a44
fix(ui): make models detail page scrollable ( #6050 )
2025-03-17 19:48:27 +00:00
Steffen Schmitz and GitHub
75ec05e206
Delete .devcontainer/devcontainer.json
2025-03-17 15:01:41 +01:00
Steffen Schmitz and GitHub
19f710abe2
chore: add devcontainer config
2025-03-17 14:56:35 +01:00
David Alexander Pfeiffer and GitHub
ad2d6bee66
chore(ui): remove padding of "Additional Input" field on OpenAiMessageView ( #6037 )
2025-03-17 10:06:32 +00:00
David Alexander Pfeiffer and GitHub
40d0acae5f
chore(ui): alignment and sizing consitency in ObservationTree / GroupedScoreBadge ( #6031 )
...
* Unified design of grouped score badge with trace detail score badges, except that text is no longer medium/semibold
* Made padding of root item of ObservationTree consistent with other items
2025-03-17 09:58:23 +00:00
Marc Klingen and GitHub
4d387cc35c
chore(ui): standardize the prompt variable list preview across views ( #6027 )
...
* chore(ui): standardize the prompt variable list preview across views
* use ctx prisma
2025-03-17 09:34:44 +00:00
690885c900
fix(ui): fixed scrollbar appearing on IO preview mode switcher in trace and observation details ( #5995 )
...
* fixed scrollbar appearing on IO preview mode switcher in trace and observation details
* fix
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-14 19:32:46 +00:00
David Alexander Pfeiffer and GitHub
ef2baa94be
fix(ui): fixed misalignment of badges in trace and observation details ( #5994 )
...
* fixed alignment issues of badges wrapped in links in trace and observation detail views
* Fixed tooltip of aggregated usage data badge (in trace details) rendering even if there is no underlying data
2025-03-14 19:19:14 +00:00
db6b442832
feat: Add environment tag on trace / observation detail views ( #5985 )
...
* feat: Add environment tag on trace / observation detail views
* shorten label
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-14 19:17:19 +00:00
Hassieb Pakzad
8231ebae4a
chore: release v3.42.1
2025-03-14 17:05:33 +01:00
Marc Klingen and GitHub
326e8d3189
chore(ui): always show tag buttons in table cells instead of only on hover ( #6025 )
2025-03-14 15:23:32 +00:00
Hassieb Pakzad and GitHub
d2001d110d
chore(docker-compose): bind services to localhost ( #6023 )
2025-03-14 14:16:36 +01:00
Hassieb Pakzad and GitHub
3f81c6b9d5
feat(cost-tracking): add OpenAIResponseUsageSchema support ( #6003 )
2025-03-14 12:08:28 +00:00
Marc Klingen and GitHub
991f837ee5
fix(ui): hide jump to playground button when not entitled ( #6014 )
2025-03-14 00:01:40 +00:00
Marc Klingen
062a7f27b8
chore: release v3.42.0
2025-03-13 19:23:52 +01:00
Steffen Schmitz and GitHub
924b326db6
chore: remove unused prisma query builder ( #6005 )
2025-03-13 17:21:23 +00:00
Andres Carrillo and GitHub
2780e66c13
feat(auth): add custom Gitlab SSO URL option ( #5984 ) ( #6004 )
2025-03-13 17:50:16 +01:00
Marc Klingen and GitHub
c2f51b8d2d
feat(ui): add csv/json export for scores table ( #5949 )
...
* feat(ui): add csv/json export for scores table
* Merge branch 'main' into marc/lfe-3466-export-scores
* push
* add test
* fix cols
* clean up diff
* fix
2025-03-13 16:23:30 +00:00
Steffen Schmitz and GitHub
3a3021a176
chore: reduce host port mapping for internal docker compose components ( #6002 )
2025-03-13 15:36:34 +00:00
Marc Klingen and GitHub
5dd5a39f90
feat(api): add api for annotation queues ( #5945 )
...
* feat(api): add api for annotation queues
* fix
* push
* strict zod interfaces
* fix
* fix spec and types
* add additional tests
2025-03-13 15:24:19 +00:00
Steffen Schmitz and GitHub
9ee4544e1d
docs: add security notes to docker compose deployment ( #5999 )
2025-03-13 14:27:10 +00:00
Hassieb Pakzad and GitHub
136f8a3e83
fix(llm-connections): show bedrock error ( #6000 )
2025-03-13 15:06:42 +01:00
Hassieb Pakzad
eecf0d680b
chore: release v3.41.1
2025-03-13 11:07:07 +01:00
Hassieb Pakzad and GitHub
d50dbed797
feat(llm-connections): allow extraHeaders for azure ( #5996 )
2025-03-13 09:46:38 +00:00
Steffen Schmitz and GitHub
bb1dbdf824
chore: reproduce clickhouse missing surrogate key error ( #5980 )
...
* chore: reproduce clickhouse missing surrogate key error
* chore: add fix candidate
* chore: adjust test cases
* chore: adjust test case
2025-03-13 07:47:31 +00:00
Hassieb Pakzad
0991d44525
chore: release v3.41.0
2025-03-12 18:28:25 +01:00
Max Deichmann and GitHub
449c9360ac
fix: search past observations with correct timestamp in evals ( #5986 )
...
fix: use readonly for the column definitions
2025-03-12 16:41:14 +00:00
Hassieb Pakzad and GitHub
cc4a88d6da
fix(prompts): block label deletion if dependent exists ( #5983 )
...
* fix(prompts): block label deletion if dependent exists
* fix
* Update web/src/features/prompts/server/actions/updatePrompts.ts
2025-03-12 16:05:46 +00:00
Steffen Schmitz and GitHub
11b2411a5b
chore: prevent sorting by environment in UI tables ( #5978 )
2025-03-12 13:45:25 +00:00
d8a5ebc42e
chore(cloud): Make UI recognize cloud:enterprise plan and add corresponding access rights and rate limits ( #5975 )
...
* chore(cloud): Make UI recognize cloud:enterprise plan and add corresponding access rights and rate limits
- label on project selector
- rate limits same as team
- access rights same as team
- no stripe product id for this (yet), cannot be purchased self-serve in product
* remove comments
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-12 13:44:01 +00:00
Steffen Schmitz and GitHub
9042b005b8
feat: extract logfire.msg as span and trace name ( #5977 )
2025-03-12 13:23:33 +00:00
Hassieb Pakzad and GitHub
7b70b5b678
feat(prompts): add composability ( #5882 )
2025-03-12 13:26:00 +01:00
Marc Klingen and GitHub
c3ce043d47
chore: remove unnecessary comment ( #5961 )
2025-03-11 13:20:18 +00:00
Marc Klingen and GitHub
8c5737ebea
chore: rename batch exports from generation to observation as table was generalized ( #5950 )
...
* chore: rename batch exports from generation to observation as table was generalized
* fix test
2025-03-11 13:15:36 +00:00
steffen911
cb928bf3fc
chore: release v3.40.0
2025-03-11 13:49:18 +01:00
Steffen Schmitz and GitHub
dc8a997324
feat: add score deletion to UI ( #5956 )
...
* feat: enable score deletion via Langfuse UI
* chore: add test cases
* chore: typo
* chore: implement deleteAnnotationScore
* chore: lint
* feat: add score deletion to UI
* chore: add trpc tests
* chore: allow multi-score deletion from table view
* chore: typoes and mock resets
* chore: update mock handling
2025-03-11 12:44:17 +00:00
Steffen Schmitz and GitHub
31da4bc5a5
chore: refactor score deletions into async queue ( #5939 )
...
* feat: enable score deletion via Langfuse UI
* chore: add test cases
* chore: typo
* chore: implement deleteAnnotationScore
* chore: lint
2025-03-11 08:02:13 +00:00
Max Deichmann and GitHub
c0189eecad
fix: use readonly for the column definitions ( #5948 )
...
* fix: use readonly for the column definitions
* fix: use readonly for the column definitions
2025-03-10 22:13:28 +00:00
Marc Klingen and GitHub
a3f85e75dc
docs: add zod type strict() to public api cursor rule ( #5947 )
2025-03-10 21:56:41 +00:00
Marc Klingen and GitHub
88ee2f3823
docs: improve public api cursor rule ( #5946 )
2025-03-10 21:35:38 +00:00
Max Deichmann and GitHub
0b485ad5d8
fix: fix eval status on details page ( #5944 )
...
* fix: fix eval status on details page
* push
* fix: fix eval status on details page
* fix: fix eval status on details page
2025-03-10 20:18:04 +00:00
Marc Klingen and GitHub
4e95550411
feat(datasets): show run name on runitems table ( #5943 )
...
* feat(datasets): show run name on runitems table
* perf
* push
2025-03-10 19:50:00 +00:00
Marc Klingen and GitHub
ba9e26181b
chore: remove models page notification ( #5942 )
2025-03-10 19:28:48 +00:00
Marc Klingen and GitHub
289a7210ee
chore(cloud): add more data masking for posthog ( #5941 )
2025-03-10 19:27:36 +00:00
Max Deichmann
fe0c4dc98d
chore: release v3.39.0
2025-03-10 17:09:30 +01:00
Hassieb Pakzad and GitHub
61c2ec268a
perf(playground): memoizate ChatMessages ( #5937 )
...
* perf(playground): memoizate ChatMessages
* push
* add callbacks
2025-03-10 16:07:28 +00:00
Max Deichmann and GitHub
1df2781b59
fix: correctly extract jsonpath form observations for evals ( #5938 )
...
* fix: correctly extract jsonpath form observations for evals
* fix: correctly extract jsonpath form observations for evals
2025-03-10 15:42:44 +00:00
5478e870b3
chore(deps): bump axios from 1.7.7 to 1.8.2 ( #5915 )
...
Bumps [axios](https://github.com/axios/axios ) from 1.7.7 to 1.8.2.
- [Release notes](https://github.com/axios/axios/releases )
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md )
- [Commits](https://github.com/axios/axios/compare/v1.7.7...v1.8.2 )
---
updated-dependencies:
- dependency-name: axios
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-10 14:49:50 +00:00
Max Deichmann and GitHub
80c298fa1e
chore: limit event id length ( #5934 )
2025-03-10 14:48:51 +00:00
Steffen Schmitz and GitHub
330cca6978
feat: add trace delete API endpoints ( #5931 )
...
* feat: add trace delete API endpoints
* chore: add api docs
* chore: update docs
* chore: typo
* chore: update audit logs
* chore: lint
* chore: update fern docs
* chore: fix return type
2025-03-10 14:13:33 +00:00
Steffen Schmitz and GitHub
286b78a1fe
feat: add api key actions to auditlog table ( #5932 )
...
* feat: add api key actions to auditlog table
* chore: propagate audit logs to all relevant API routes
* chore: lint
2025-03-10 12:35:10 +00:00
f0c37c8309
chore: add initial cursor rules ( #5926 )
...
* chore: add some initial cursor rules
* Update .cursor/rules/frontend-features.mdc
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update .cursor/rules/public-api.mdc
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-09 22:54:01 +00:00
Marc Klingen and GitHub
326b27cdda
fix: ui config in localstorage should persist signing out ( #5916 )
...
* fix: ui config in localstorage should persist signing out
* push
* push
2025-03-07 17:50:04 +00:00
Marc Klingen and GitHub
886e352c39
fix: select/highlight text in Compare Dataset view ( #5914 )
...
* fix: select/highlight text in Compare Dataset view
* clean diff
2025-03-07 15:59:53 +00:00
steffen911
1cd76a49f1
chore: release v3.38.0
2025-03-07 16:48:21 +01:00
Marc Klingen and GitHub
0639b78468
feat(datasets): add multi-delete for dataset runs table ( #5912 )
2025-03-07 15:29:50 +00:00
Steffen Schmitz and GitHub
2d6e51e219
chore: test processing of special characters in S3 ( #5907 )
...
* chore: test processing of special characters in S3
* chore: reject carriage-return character in IDs
* Update ingestion-api.servertest.ts
2025-03-07 15:20:11 +00:00
Yohan Gonçalves and GitHub
1ed6358738
feat: add customizable claim mapping for SSO ( #5858 )
2025-03-07 16:19:51 +01:00
4fc339dbac
chore: remove redundant readme files ( #5900 )
...
chore: remoe redundant readme files
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-06 19:55:34 +00:00
Steffen Schmitz and GitHub
1e64d97b75
feat: create new environment materialized views for quick lookups ( #5895 )
...
* feat: create new environment materialized views for quick lookups
* chore: update repository
* chore: lint
* chore: add final to environments query
* chore: always include default in array
2025-03-06 19:09:28 +00:00
Steffen Schmitz and GitHub
4d06482d78
fix: enforce ints on usageDetails ( #5889 )
...
* fix: enforce ints on usageDetails
* chore: make test actually test a generation
* chore: lint
2025-03-06 17:05:10 +00:00
Marc Klingen and GitHub
603e5ca7c9
chore(ui): add env label on env multi-select ( #5890 )
2025-03-06 16:37:22 +00:00
Steffen Schmitz and GitHub
61c6560f24
chore: return 200 instead of 207 as OTel success status ( #5883 )
2025-03-06 14:58:40 +00:00
Steffen Schmitz and GitHub
6bff022a88
chore: log dropped data items correctly in clickhouse writer ( #5876 )
...
* chore: log dropped data items correctly in clickhouse writer
* chore: update test case
2025-03-06 14:43:11 +00:00
Steffen Schmitz and GitHub
1f7cac2dd8
feat: add environment column to UI tables ( #5877 )
...
* feat: add environment column to UI tables
* feat: add environment on sessions table
* chore: add to observations
* chore: add to scores
* chore: add to users table
* chore: lint
2025-03-06 14:08:41 +00:00
Hassieb Pakzad and GitHub
49bccb8fa0
fix(ui-graph-view): handle single top most node ( #5881 )
2025-03-06 15:15:03 +01:00
Marc Klingen and GitHub
fea8a3d8d1
chore: add noindex header ( #5880 )
2025-03-06 13:46:00 +00:00
Max Deichmann and GitHub
08fcdb68be
chore: fix contributingmd file ( #5879 )
2025-03-06 14:34:46 +01:00
f18a120bd8
feat: add environment filter ( #5765 )
...
* feat: add environment filter on dashboard
* chore: add a useEffect and dashboard columns for filtering
* chore: add dashboard filters
* fixup: add environment filter hook and barebone code
* chore: add traces table filter
* chore: add sessions environment filter
* chore: do observations, scores, users
* chore make filter bar dynamic and change UI placement
* chore: map environment column specially in dashboard
* chore: add column
* chore: lint
* chore: remove overflow on multi-select
* chore: only load downstream calls once environment is available
* chore: only use isLoading condition
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-03-06 10:45:18 +00:00
Max Deichmann and GitHub
2b3ca85344
chore: fix contributingmd file ( #5870 )
...
* chore: fix contributingmd file
* chore: fix contributingmd file
* chore: fix contributingmd file
* chore: fix contributingmd file
* chore: fix contributingmd file
2025-03-06 08:03:39 +00:00
Hassieb Pakzad and GitHub
8b408858c4
feat(batch-exports): increase row limit to 1.5M ( #5872 )
2025-03-06 08:47:56 +01:00
89ad92c0ff
chore: consistent casing of README files ( #5865 )
...
* docs: fix broken link in CONTRIBUTING.md
* chore: rename files to fix casing
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-03-05 23:23:54 +00:00
Marc Klingen
16e1d19917
chore: release v3.37.0
2025-03-05 23:51:35 +01:00
Marc Klingen and GitHub
18d5ba1bfa
feat(auth): add AUTH_WORKOS_ORGANIZATION_ID and AUTH_WORKOS_CONNECTION_ID envs ( #5866 )
2025-03-05 21:31:45 +00:00
Steffen Schmitz and GitHub
95d6b9fe13
chore: add name mappings to sync prisma schema with reality ( #5863 )
2025-03-05 16:56:47 +00:00
Max Deichmann and GitHub
23183a71c1
chore: add missing clickhouse writer metrics ( #5851 )
...
* chore: add missing clickhouse writer metrics
* chore: add missing clickhouse writer metrics
* Update worker/src/services/ClickhouseWriter/index.ts
2025-03-05 16:37:00 +00:00
5eb0a275a5
feat: add S3_CONCURRENT_READS and S3_CONCURRENT_WRITES config options ( #5824 )
...
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
2025-03-05 16:58:26 +01:00
Steffen Schmitz and GitHub
4c5366fa20
perf: reduce trace scans for scores counts ( #5860 )
...
* perf: reduce trace scans for sessions counts
* chore: add countAll test
* chore: add session for testing
2025-03-05 15:18:10 +00:00
Marc Klingen
4ebaf0a24a
chore: release v3.36.0
2025-03-05 13:32:42 +01:00
Marc Klingen and GitHub
b98b90e635
feat(auth): add workos as idp ( #5828 )
...
* feat(auth): add workos as idp
* add button for org and connection based sign in
* fix
* remove client auth method and checks
* remove unnecessary diff
2025-03-05 12:29:26 +00:00
Marc Klingen
36f11a645f
chore: release v3.35.1
2025-03-04 22:32:19 +01:00
Marc Klingen and GitHub
3c8b26aa79
chore(api): update api reference and postman collection ( #5842 )
2025-03-04 22:31:38 +01:00
Marc Klingen
86840e4119
chore: release v3.35.0
2025-03-04 22:23:24 +01:00
Steffen Schmitz and GitHub
4b412fb6ca
feat: map pydantic logfire events to langfuse datamodel ( #5841 )
...
* feat: map pydantic logfire events to langfuse datamodel
* chore: map events to empty if parsing fails
2025-03-04 20:58:42 +00:00
Steffen Schmitz and GitHub
271f75aa17
chore: reduce default batch size of background migrations ( #5838 )
...
* chore: reduce default batch size of background migrations
* chore: update the cli defaults
2025-03-04 15:58:11 +00:00
Marc Klingen and GitHub
669ad4cb92
feat(datasets): deletion of dataset runs via api ( #5834 )
...
* public api
* improve public api
2025-03-04 13:41:27 +00:00
Steffen Schmitz and GitHub
9b237d4041
fix: detect openinference LLM calls as generations ( #5833 )
...
feat: detect openinference LLM calls as generations
2025-03-04 11:13:42 +00:00
marliessophie and GitHub
15b4ca01ec
fix(ui): overlapping status message on trace detail page ( #5830 )
2025-03-04 09:07:29 +00:00
Marc Klingen and GitHub
196b5319bf
feat(datasets): allow for deletion of dataset items in ui and public API ( #5816 )
...
* push
* move into drop down menu
* fix
* move copy to the right side
* fern generate
* use trpc errors
2025-03-03 14:03:18 +00:00
Steffen Schmitz and GitHub
d88e0456b8
perf: reduce memory consumption on observations query ( #5811 )
...
* perf: reduce memory consumption on observations query
* chore: drop skip index list for lint
2025-03-03 13:35:40 +00:00
Marc Klingen and GitHub
78463a9ce3
feat(datasets): copy items between datasets ( #5800 )
...
* wip
* push
* push
2025-03-03 12:51:06 +00:00
marliessophie and GitHub
0bd7219eba
style(ui): trace view alignment improvements ( #5789 )
...
* style(ui): trace view alignment improvements
* fix: test
2025-03-03 12:25:15 +00:00
Steffen Schmitz and GitHub
a307270d8c
chore: upgrade fern and add java sdk example ( #5814 )
2025-03-03 11:09:41 +00:00
Max Deichmann and GitHub
f1555190c1
fix: use aes-gcm 12 bytes for IV ( #5764 )
...
* fix: use aes-gcm 12 bytes for IV
* fix: use aes-gcm 12 bytes for IV
* fix: use aes-gcm 12 bytes for IV
2025-03-03 10:32:22 +00:00
Max Deichmann and GitHub
56c77e0de8
chore: reduce log level for frequent logs ( #5804 )
2025-03-02 17:54:07 +00:00
Marc Klingen and GitHub
48cbbb694f
feat(ui): add LLM connections settings page separate from api keys ( #5798 )
2025-03-01 19:04:33 +00:00
Marc Klingen and GitHub
168dfd2caa
feat(datasets): add archive/unarchive functionality for dataset items on single item view ( #5797 )
...
* feat(datasets): add archive/unarchive functionality for dataset items on single item view
* imrpove copy
2025-03-01 19:04:23 +00:00
Marc Klingen and GitHub
ae66dd9e6f
fix(ui): add playsInline attribute to video players ( #5795 )
2025-03-01 18:33:46 +00:00
Marc Klingen and GitHub
d081aab38f
feat(datasets): support adding dataset items to multiple datasets ( #5796 )
...
* feat(datasets): support adding dataset items to multiple datasets
* feat(datasets): optimize bulk dataset item creation with createMany
2025-03-01 18:09:46 +00:00
Marc Klingen and GitHub
a86f0ab263
fix(cloud): only active evals should count towards plan limit ( #5793 )
2025-03-01 12:42:39 +00:00
Marc Klingen and GitHub
738df01ab7
feat(ui): add settings deep links to cmd+k ( #5680 )
...
* proejct settings
* push
* add org and small fixes
2025-03-01 10:12:04 +00:00
marliessophie and GitHub
549eac6fd3
fix(ui): overflow behaviour on trace timeline ( #5792 )
2025-03-01 07:50:55 +00:00
Marc Klingen and GitHub
6d125ec274
chore(ui): remove redundant className props from splash screens ( #5791 )
2025-03-01 00:44:46 +00:00
Marc Klingen and GitHub
4f54577f83
chore(ui): improve perf of sessions hasAny ( #5783 )
...
chore: improve performance of sessions hasAny
2025-03-01 00:31:29 +00:00
Steffen Schmitz and GitHub
1ec1bdf849
feat: add environment properties on api routes ( #5781 )
...
* feat: add environment properties on api routes
* chore: add env filter to traces
* chore: add observation env and daily metrics env filters
* chore: add env to score endpoints
* chore: filter sessions by environment
* chore: filter traces by environment
* chore: expand trace test assertions
* chore: lint
2025-02-28 16:12:18 +00:00
Hassieb Pakzad and GitHub
ed5a53b10e
fix(ui): llm api key form model name delete ( #5786 )
2025-02-28 15:57:18 +00:00
marliessophie and GitHub
5b1d9b1dd1
style(page-header): margins ( #5784 )
2025-02-28 14:42:19 +00:00
marliessophie and GitHub
adf4508ffd
feat(traces): redesign single trace UI ( #5718 )
...
* feat(traces-ui): refactor preview for traces and observations
* fix: typo in use prompt code
* feat(ui): add redesigned timeline
* feat: support all settings on timeline view
* feat: support langgraph trace
* style: langgraph view
* chore: fix other usages of single trace components
* style: comment icon color
* fix: eslint
* style: optimise for reponsive design
* chore: refactor common functions to helpers
* chore(globals): remove comments
* style: expand clickable area; adjust search string
* style: small improvements
* fix: styling of trace preview page
* fix: eslint
* fix: remove duplicated cost in observation preview
* fix: session IO formatting
* style
* style
* style: final margins
2025-02-28 13:37:07 +00:00
Steffen Schmitz and GitHub
45f8b2e97b
chore: skip tracing for LLM Api key routes ( #5780 )
2025-02-28 10:49:40 +00:00
marliessophie and GitHub
39c49b65a4
fix(ui): overlap on dataset runs screen ( #5778 )
2025-02-28 10:15:26 +00:00
steffen911
d905623cb3
chore: release v3.34.1
2025-02-28 11:11:43 +01:00
Steffen Schmitz and GitHub
a87a3505b8
chore: add env.HOSTNAME support for worker container ( #5779 )
2025-02-28 10:06:41 +00:00
591de20a72
feat: simplify otel input/output and accept string token values ( #5777 )
...
* feat: simplify otel input/output and accept string token values
* chore: typo
* Update web/src/features/otel/server/index.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: also beautify event attribute fallback
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-28 09:49:49 +00:00
Marc Klingen
33d3ab80cb
chore: release v3.34.0
2025-02-27 22:54:18 +01:00
Marc Klingen and GitHub
6b9773caec
feat(models): add openai gpt-4.5-preview ( #5772 )
2025-02-27 21:47:24 +00:00
Steffen Schmitz and GitHub
c90b477d40
fix: disable tracing for resetPassword route ( #5763 )
2025-02-27 15:36:36 +00:00
0f448ccdde
fix: always return 422 for signup error handler ( #5761 )
...
* fix: always return 422 for signup error handler
* Update web/src/features/auth-credentials/server/signupApiHandler.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update web/src/features/auth-credentials/server/signupApiHandler.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-27 15:33:41 +00:00
marliessophie and GitHub
74f93aad79
chore: move dashboard button to the right, unify eval headers ( #5762 )
...
chore: move dashboard button to the right
2025-02-27 15:15:40 +00:00
Max Deichmann and GitHub
9650e87f64
fix: standardize way to get sso blocked domains ( #5760 )
...
fix: standardise way to get sso blocked domains
2025-02-27 15:15:10 +00:00
Steffen Schmitz and GitHub
c5fc30a9d0
feat: map otel environment config to langfuse environment ( #5757 )
2025-02-27 14:46:43 +00:00
steffen911
4a26f47971
chore: release v3.33.1
2025-02-27 15:34:24 +01:00
e3a9e61d07
perf: filter relevant observation for data set run item stats ( #5752 )
...
* perf: filter relevant observation for data set run item stats
* Update web/src/features/datasets/server/service.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-27 14:08:07 +00:00
Hassieb Pakzad
a12c2a3a97
fix(model-prices): bedrock claude 3-7 version
2025-02-27 13:14:05 +01:00
Hassieb Pakzad and GitHub
80681e08af
fix(model-prices): bedrock claude sonnet 3-7 version ( #5753 )
2025-02-27 13:10:08 +01:00
steffen911
4e97494390
chore: release v3.33.0
2025-02-27 11:58:10 +01:00
Steffen Schmitz and GitHub
346e5fe7b6
feat: map environment to score within eval service ( #5749 )
...
* feat: map environment to score within eval service
* chore: adjust tests
* chore: drop unused imports
2025-02-27 10:50:36 +00:00
Steffen Schmitz and GitHub
16482f588a
fix: create traces via otel for empty parent span buffer ( #5748 )
...
* fix: create traces via otel for empty parent span buffer
* chore: test range for session duration
2025-02-27 10:10:51 +00:00
Marc Klingen and GitHub
f047e21e13
chore: improved domain handling and early return in signupApiHandler ( #5744 )
2025-02-26 21:56:20 +00:00
marliessophie and GitHub
534e832c13
fix(ui): overlapping variables for chat prompt ( #5740 )
2025-02-26 17:47:03 +00:00
marliessophie and GitHub
5dbfec24f0
fix(ui): experiment from the prompt screen -> window does not fit screen ( #5738 )
2025-02-26 17:21:05 +00:00
Hassieb Pakzad and GitHub
700705be84
chore(llm-keys): update bedrock form description ( #5737 )
2025-02-26 17:58:49 +01:00
Hassieb Pakzad
611c31ce54
chore: release v3.32.1
2025-02-26 17:06:23 +01:00
Hassieb Pakzad and GitHub
bdb5ddadd9
fix(ingestion): environment to immutable keys ( #5736 )
2025-02-26 16:01:26 +00:00
Hassieb Pakzad and GitHub
0fd1f065bd
fix(api): add environment to ingestion spec ( #5735 )
2025-02-26 16:02:49 +01:00
Marc Klingen and GitHub
8aa063303a
chore(ui): move "configure tracing" to the right in dashboard header ( #5731 )
2025-02-26 13:59:21 +00:00
Marc Klingen and GitHub
d0ff8a87fe
chore(ui): minor improvements to onboarding pages ( #5730 )
...
chore: minor improvements to onboarding pages
2025-02-26 13:56:39 +00:00
marliessophie and GitHub
0e61ffd621
style(prompts): always show edit label button for prompt versions ( #5729 )
2025-02-26 13:41:01 +00:00
steffen911
9f20926bc4
chore: release v3.32.0
2025-02-26 14:36:38 +01:00
Steffen Schmitz and GitHub
81a232e4a4
fix: fallback to "default" for missing environment ( #5728 )
2025-02-26 13:34:33 +00:00
Marc Klingen and GitHub
c7e7d62f47
feat(ui): add onboarding screens for core features ( #5706 )
...
* feat: add in-ui-onboarding for tracing
* feat(ui): add onboarding screens for core features
* add annotation queues
* move videos to static, add eval onboarding
* push
* push
* push
* push
* push
2025-02-26 13:13:43 +00:00
steffen911
2aa8971dff
chore: release v3.31.0
2025-02-26 13:53:58 +01:00
Steffen Schmitz and GitHub
85f4cb0c13
fix: show retention settings for self-hosters ( #5727 )
2025-02-26 12:34:14 +00:00
Hassieb Pakzad and GitHub
4bbba9d983
feat(api): add environment property to traces, scores, obs ( #5724 )
2025-02-26 13:32:03 +01:00
Steffen Schmitz and GitHub
0b7dd5a1a7
feat: process environment in ingestion pipeline ( #5671 )
...
* feat: process environment in ingestion pipeline
* chore: remove unnecessary status
* chore: typing
* chore: more typing
* chore: score env prop
* chore: adjust apis to pass tests
* chore: adjust ingestion service test
* chore: restrict allowed prefix
2025-02-26 12:18:38 +00:00
Steffen Schmitz and GitHub
b5cad2693f
fix: exclude clickhouse default date from session duration calc ( #5726 )
2025-02-26 09:51:52 +00:00
Max Deichmann
58d85d66b3
chore: release v3.30.0
2025-02-26 10:30:59 +01:00
Max Deichmann and GitHub
55a5a896f1
chore: track distribution of ingested event body size ( #5723 )
...
push
2025-02-26 09:05:08 +00:00
Steffen Schmitz and GitHub
5437beec48
Revert "fix: return nulls for left-joins for correct session durations ( #5697 )" ( #5717 )
...
This reverts commit ce967bac12 .
2025-02-25 18:14:26 +01:00
Steffen Schmitz and GitHub
418e33a333
fix: only delete media items with no remaining references ( #5713 )
...
* fix: only delete media items with no remaining references
* chore: expand filter condition
2025-02-25 15:18:02 +00:00
Hassieb Pakzad and GitHub
e9bbd4488f
feat(playground+evals): add Google AI Studio support ( #5711 )
2025-02-25 14:48:22 +01:00
Steffen Schmitz and GitHub
668ca24d5e
fix: support gzip encoding on otel endpoint ( #5710 )
...
* fix: support gzip encoding on otel endpoint
* chore: check for includes
2025-02-25 10:41:43 +00:00
Hassieb Pakzad and GitHub
7c746c7cfc
feat(models): add claude-3-7-sonnet-20250219 ( #5709 )
2025-02-25 10:07:41 +00:00
Hassieb Pakzad
de0eb76153
chore: release v3.29.1
2025-02-24 20:53:46 +01:00
Hassieb Pakzad and GitHub
85088574b2
fix(public-api): list observations with name filter ( #5700 )
2025-02-24 20:52:58 +01:00
Steffen Schmitz and GitHub
ce967bac12
fix: return nulls for left-joins for correct session durations ( #5697 )
...
* fix: return nulls for left-joins for correct session durations
* chore: comment updates
* chore: adjust trace_count
2025-02-24 15:57:47 +00:00
Steffen Schmitz and GitHub
b8d0a4bbe8
chore: remove prisma references to traces, observations, scores ( #5672 )
...
* chore: remove prisma references to traces, observations, scores
* chore: separate enum and type name
* chore: type overwrites
* chore: chore
* chore: drop views
* chore: reduce diff
* chore: diff
* chore: types gen
* chore: lint
* chore: adjust tests
* chore: remove unused objects in test utils
* chore: adjust tests
* chore: score type parsing
* chore: fix otelmapping
* chore: make observation level internal
2025-02-24 15:43:25 +00:00
marliessophie and GitHub
1e7aeb8fc5
chore(llmCompletion): support system/developer messages for o3 ( #5661 )
2025-02-24 09:25:33 +00:00
marliessophie and GitHub
9d5cc39cd4
style(ui): improvements to prompt details screen ( #5678 )
...
* fix: header
* fix: search always show current version
* chore: adjust code block
* chore: re-add copy in code editor if no title
* chore: do not match current version always
* adjust margins
* chore: remove breadcrumb
* fix: typo
* fix: final margin
* style: eval template
* small design nits
2025-02-22 09:16:44 +00:00
Marc Klingen and GitHub
5c5dfcbac6
chore(ui): improve consistency of prompt and eval template forms ( #5679 )
...
* chore(ui): consistency in prompt form labels
* eval prompt form
2025-02-21 18:10:12 +00:00
marliessophie and GitHub
628d180051
feat(ui): new prompt detail screen; adjust design of IO and message view components ( #5537 )
...
* style(ui): adjust design of IO and message view components
* chore: adjust final style and fix imports
* style
* nit: show "null" if no output in dataset compare view
* style: add header and tertiary colors
* chore: add Header levels
* chore: add Timeline component
* feat: make JSONView optionally scrollable
* chore: refactor TagManager styling
* style: button variants for header
* chore: ensure chatml message overflow behaves within chat message
* feat: new prompt screen outline
* chore: refactor `extractVariables` to return count
* chore: ensure robust mobile behaviour
* style: small component adjustments
* chore: refactor style of `Comment` button
* feat: add search functionality to prompt nodes
* style: restyle tags
* revert: variable extraction count
* style: prompts page overflow
* chore: control label behaviour
* labels: show buttons on hover
* fix: formatting of titles
* eslint
* push
* push
* fix: overflows
* push
* diabled view
2025-02-21 13:46:59 +00:00
Max Deichmann
57708f0219
chore: release v3.29.0
2025-02-21 13:42:45 +01:00
Max Deichmann and GitHub
5d30aefcb3
fix: do not allow to deactivate eval configs which are only on existing objects ( #5675 )
...
* fix: do not allow to deactivate eval configs which rano on historic traces only
* fix: do not allow to deactivate eval configs which rano on historic traces only
* fix: do not allow to deactivate eval configs which rano on historic traces only
* fix: do not allow to deactivate eval configs which rano on historic traces only
* fix: do not allow to deactivate eval configs which rano on historic traces only
2025-02-21 12:40:18 +00:00
Max Deichmann and GitHub
dd14e11535
perf: reduce eval create queue concurrency ( #5665 )
2025-02-20 19:24:38 +00:00
Max Deichmann and GitHub
5f87980013
fix: do not return all executions for eval config list trpc ( #5663 )
...
* fix: do not return all executions for eval config list trpc
* fix: do not return all executions for eval config list trpc
* fix: do not return all executions for eval config list trpc
* fix: do not return all executions for eval config list trpc
2025-02-20 17:56:38 +00:00
Max Deichmann and GitHub
2edc2487ae
perf: limit concurrency for eval job creations ( #5660 )
...
* push
* push
2025-02-20 16:05:41 +00:00
Steffen Schmitz and GitHub
18508187f6
chore: add environment column to trace_sessions ( #5656 )
...
* chore: add environment column to trace_sessions
* chore: update test
2025-02-20 15:06:39 +00:00
eb5ee957e6
feat: apply evals on history of datasets + traces ( #5488 )
...
* push
* push
* push
* push
* fix
* fix
* add tests
* add tests
* add tests
* add tests
* add tests
* add tests
* fic
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* push
* push
* Update web/src/ee/features/evals/components/evaluator-form.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* push
* fix: fix dompurify
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-20 13:59:14 +00:00
Steffen Schmitz and GitHub
582f150b72
chore: add environment columns in clickhouse ( #5649 )
...
* chore: add environment columns in clickhouse
* chore: replace logger.warning with logger.warn
2025-02-20 13:05:35 +00:00
Steffen Schmitz and GitHub
7ce4e24cab
chore: replace logger.warning with logger.warn ( #5650 )
2025-02-20 12:12:31 +00:00
marliessophie and GitHub
b2d3080790
chore(prompts): support developer message ( #5639 )
...
* chore(prompts): support developer message
* chore: fix eslint config
* push
2025-02-20 09:40:32 +00:00
steffen911
3590608d30
chore: increase event log deletion timeout to 5min
2025-02-19 15:56:11 +01:00
Steffen Schmitz and GitHub
78e6c882ba
chore: reduce attempts and increase delay on trace delete errors ( #5637 )
2025-02-19 14:24:28 +00:00
Steffen Schmitz and GitHub
d5ea44b33c
perf: only validate response schema on dev servers ( #5630 )
2025-02-19 13:11:42 +00:00
Steffen Schmitz and GitHub
8b601eed20
fix: re-enable trace deletion and remove trace S3 files ( #5594 )
...
* fix: re-enable trace deletion and remove trace S3 files
* chore: lint
* chore: lint
* chore: increase query timeout
* chore: reduce query result to only return event log
* chore: keep condition pattern
* chore: revert entitlement changes
* chore: move permission check
* chore: explain semi join and shift entitlement comment
2025-02-19 12:45:37 +00:00
Steffen Schmitz and GitHub
caebc92051
chore: bump static page generation timeout ( #5621 )
2025-02-18 14:44:33 +00:00
Steffen Schmitz and GitHub
e41f1c5e5b
build: notify slack on failed deployment ( #5617 )
2025-02-18 14:40:29 +01:00
Steffen Schmitz and GitHub
c419fd69fa
chore: remove superfluous container_name overwrites ( #5615 )
2025-02-18 13:03:45 +00:00
Steffen Schmitz and GitHub
485dc94444
feat: map langfuse data model to further otel attributes ( #5614 )
...
* feat: map langfuse data model to further otel attributes
* chore: expand tests
2025-02-18 11:29:17 +00:00
Steffen Schmitz and GitHub
c233c7fa8d
feat: parse mlflow attributes on otel spans ( #5609 )
...
* feat: parse mlflow attributes on otel spans
* chore: correct failing test
2025-02-18 09:07:12 +00:00
marliessophie and GitHub
0263b40987
perf(sessions): display only first 10 users; show rest in paginated popover ( #5599 )
...
* perf(sessions): show only up to 10 initial users and the rest in popover
* nit: fix header on traces page
2025-02-17 19:01:01 +00:00
Marc Klingen and GitHub
44621d0d1f
chore: remove the unnecessary file ( #5598 )
...
chore: remove unnecessary file
2025-02-17 18:34:01 +00:00
marliessophie and GitHub
5bd891ddc7
style(traces): style traces delete button in more menu in table ( #5596 )
2025-02-17 14:59:12 +00:00
marliessophie and GitHub
8e02f86fa7
chore(page-header): add new tabsComponent ( #5593 )
...
* chore(page-header): add tabs component
* style: replace tabs component on datasets pages
* style: replace tabs component on evals pages
* nit: fix dataset item page formatting
* style: replace tabs component on prompts pages
* chore: adjust col behaviour on header
* eslint
2025-02-17 13:34:57 +00:00
Max Deichmann and GitHub
d7582c66ee
security: upgrade jsonpath plus ( #5591 )
2025-02-17 12:41:12 +00:00
marliessophie and GitHub
75bef08f0b
style(page-header): optimise for mobile view ( #5590 )
...
* chore: fix demo banner
* fix(page-header): info icon relative positioning
* fix: header title wrap behaviour
* fix(page-header): have info icon follow title
* style: move dataset level buttons to more menu
* push
* push
2025-02-17 12:36:33 +00:00
Max Deichmann
5f7b50cea8
chore: release v3.28.3
2025-02-17 09:56:07 +01:00
Steffen Schmitz and GitHub
a9757d144f
chore: fallback to LLM http status for /api/chatCompletion ( #5554 )
2025-02-17 08:42:49 +00:00
Steffen Schmitz and GitHub
12fb26388c
fix: accept further content type formats on otel endpoint ( #5584 )
2025-02-17 08:41:14 +00:00
Max Deichmann
95d9aef705
chore: release v3.28.2
2025-02-15 13:29:06 +01:00
Max Deichmann
15fea028c2
chore: release v3.28.1
2025-02-15 01:04:28 +01:00
Max Deichmann and GitHub
ac6e94ee3c
security: upgrade release-it ( #5558 )
...
* security: upgrade release-it
* security: upgrade release-it
* security: upgrade release-it
2025-02-14 18:59:53 +00:00
Max Deichmann and GitHub
e7332bd1e5
security: upgrade dompurify ( #5557 )
2025-02-14 19:39:59 +01:00
Max Deichmann
fe8b2ba7ae
chore: release v3.28.0
2025-02-14 19:20:25 +01:00
marliessophie and GitHub
652e96ee9d
fix(header): breakpoint header behaviour ( #5555 )
...
fix(header): fix breakpoint header behaviour
2025-02-14 17:49:13 +00:00
Steffen Schmitz and GitHub
40ce493b06
fix: change numeric type parsing for sessions table filters ( #5553 )
2025-02-14 16:21:43 +00:00
aa7ba1a9c5
chore: add dashboard time filter test case ( #5526 )
...
* add tests
* Update web/src/__tests__/async/repositories/dashboard-repository.servertest.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-14 15:22:15 +00:00
Jannik Maierhöfer and GitHub
869b027110
docs: fix gif on Readme ( #5502 )
2025-02-14 15:18:05 +00:00
Hassieb Pakzad and GitHub
1243d9022e
feat(trace-ui): add graph view ( #5511 )
...
* feat(trace-ui): add graph view
* push
* rename
* fix build error
2025-02-14 15:08:15 +00:00
marliessophie and GitHub
d988c07d46
style(header): adjust minor paddings and relative scroll behaviour ( #5551 )
...
* style(header): relative positioning on scroll page
* style: add padding to container layout
* chore: rm top margin
2025-02-14 14:27:46 +00:00
0a53682ed6
chore: Update README.ja.md ( #5545 )
...
Update README.ja.md
modification in Japanese and put Japanese support info.
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-02-14 14:24:15 +00:00
Steffen Schmitz and GitHub
ac517c1849
chore: enhance ingestion api documentation ( #5550 )
2025-02-14 14:17:45 +00:00
Iaroslav Volkov and GitHub
2778be5abb
feat: add TLS env variable support for Redis ( #5393 )
2025-02-14 13:28:15 +01:00
56e4b92fd7
feat(ui): add new langfuse header ( #5451 )
...
* chore: extract PageContainer component
* chore: add ItemBadge component
* style: redesign publish trace switch
* style: redesign detail page nav
* chore: extract copybutton
* chore: wrap all pages in `PageContainer`
* chore: add settings-container; style nits
* chore: simplify langfuse header
* chore: replace session icon in itembadge
* chore: mv lg:container to settings-container level
* chore: refactor component logic in ProjectOverview
* style: make project button primary
* style: adjust light mode sidebar colors
* fix: rm unneccessary class
* fix: eslint
* chore: update readme
* chore: adjust page header to <h2/>
* chore: adjust colors
* style: button color
* style: refactor public/private highlight
* push
* chore: rename components
* style: add breadcrumb to pages
* style: add sidebar border
* style: adjust sharing logic
* push
* chore: eslint
* fix: header alignment
* push
* push
* eslint
---------
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2025-02-14 10:39:42 +00:00
Steffen Schmitz and GitHub
613126bbfb
chore: add clickhouse tags to queries ( #5535 ) ( #5538 )
...
* chore: add clickhouse tags to queries (#5535 )
* chore: add clickhouse tags to queries
* chore: linting
* chore: add dashboard tags
(cherry picked from commit 95d67d65d7 )
* chore: move tags to json
* chore: move to json format
* chore: fix build
* chore: remove redundant fallback
2025-02-14 10:09:08 +00:00
Max Deichmann
d8738e7594
chore: release v3.27.2
2025-02-13 23:01:58 +01:00
Max Deichmann and GitHub
b4f7aded4f
chore: increase static page generation timeout nextjs ( #5539 )
...
* add tests
* push
2025-02-13 21:59:17 +00:00
Max Deichmann
dd1ac129d1
chore: release v3.27.1
2025-02-13 20:19:28 +01:00
steffen911
7fd8c03aca
Revert "chore: add clickhouse tags to queries ( #5535 )"
...
This reverts commit 95d67d65d7 .
2025-02-13 19:03:13 +01:00
Steffen Schmitz and GitHub
95d67d65d7
chore: add clickhouse tags to queries ( #5535 )
...
* chore: add clickhouse tags to queries
* chore: linting
* chore: add dashboard tags
2025-02-13 15:59:54 +00:00
Hassieb Pakzad and GitHub
8b7b3570e8
fix(prompts-api): handle unique constraint errors ( #5534 )
2025-02-13 15:34:34 +00:00
Hassieb Pakzad and GitHub
7fa738693a
fix(model-prices): move gemini prices to Google AI values ( #5533 )
2025-02-13 14:46:23 +00:00
Hassieb Pakzad and GitHub
b554068713
fix(batch-exports): handle retries on stalled jobs for killed workers ( #5532 )
2025-02-13 14:42:50 +00:00
Marc Klingen
3396cc86a2
chore: release v3.27.0
2025-02-13 15:22:28 +01:00
Marc Klingen and GitHub
e41ca6baa1
fix(env): standardize AZURE_AD auth environment variables and add all to .env.prod.example ( #5530 )
...
* fix(env): standardize AZURE_AD auth environment variables and add all to .env.prod.example
* push
2025-02-13 14:05:15 +00:00
marliessophie and GitHub
2001630e4d
perf(tables): truncate large I/O content preview in tables ( #5531 )
...
* perf(tables): truncate large I/O content preview in tables
* push
2025-02-13 14:01:58 +00:00
Steffen Schmitz and GitHub
e9da31f26a
chore: delay project delete queue to allow for remaining events to be processed ( #5528 )
2025-02-13 12:58:59 +00:00
Steffen Schmitz and GitHub
6dd1a12bfc
chore: reduce authed request logging to debug ( #5527 )
2025-02-13 12:24:09 +00:00
marliessophie and GitHub
922f846ce8
chore: re-enable sentry; reverts #5505 ( #5524 )
...
* chore: re-enable sentry
* chore: revert back to original version
* chore: revert removing client config
2025-02-13 09:21:13 +00:00
marliessophie and GitHub
7f16fc353d
fix(datasets): broken link in compare view ( #5521 )
2025-02-13 09:01:39 +00:00
marliessophie and GitHub
becae4c720
chore: revert changes to session storage hook from #5314 ( #5513 )
2025-02-12 21:45:45 +00:00
Hassieb Pakzad and GitHub
fede3480d1
perf(exports): increase max row limit to 1M ( #5512 )
2025-02-12 22:01:14 +01:00
Steffen Schmitz and GitHub
9bf5b829a7
fix: delete event files from s3 after retention period end ( #5509 )
...
* fix: delete event files from s3 after retention period end
* chore: lint
2025-02-12 17:03:36 +00:00
marliessophie and GitHub
92d5591171
perf(tables): disable link prefetching in viewport, only prefetch on link hover ( #5508 )
2025-02-12 16:59:29 +00:00
40f7849444
fix: disable sentry ( #5505 )
...
* fix: disable sentry
* chore: remove usages of sentry
* dep: remove sentry dependency
* Revert "dep: remove sentry dependency"
This reverts commit 63fb207fce4fafc17993cc6be9905db3b4e5713c.
* dep: remove sentry dependency
* chore: lint
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-02-12 16:44:00 +00:00
Steffen Schmitz and GitHub
9f21b1044f
chore: upgrade dd-trace-js ( #5506 )
2025-02-12 16:36:55 +01:00
Steffen Schmitz and GitHub
030e759c0d
fix: delete media and event files from S3 on project delete ( #5504 )
...
* fix: delete media and event files from S3 on project delete
* chore: update comment
* chore: test cleanup
2025-02-12 14:07:24 +00:00
Steffen Schmitz and GitHub
90a0b67ea2
chore: propagate otel trace context to clickhouse spans ( #5501 )
2025-02-12 12:45:13 +00:00
Steffen Schmitz and GitHub
731958ca11
chore: add additional attributes to ingestion spans ( #5499 )
2025-02-12 10:25:12 +00:00
marliessophie and GitHub
9d37cc4d34
chore(csv-upload): reduce min chunk size ( #5496 )
...
* chore(csv-upload): reduce min chunk size
* push
2025-02-12 09:15:09 +00:00
marliessophie and GitHub
55e0ff4169
chore: hide trace deletion button on cloud until enabled again ( #5495 )
...
* chore: hide trace deletion button on cloud until enabled again
* docs: add reasoning
2025-02-12 08:39:35 +00:00
Steffen Schmitz and GitHub
304c4fcb7e
chore: link to docs for batch export config errors ( #5484 )
2025-02-11 16:14:29 +00:00
Steffen Schmitz and GitHub
8ede19d263
feat: log all created s3 event files in clickhouse ( #5476 )
...
* feat: log all created s3 event files in clickhouse
* chore: remove empty module
* chore: bucket path for clickhouse events
* chore: add test
* chore: lint
2025-02-11 15:38:04 +00:00
Steffen Schmitz and GitHub
eda925c686
fix: map token filters for ui table to fitting clickhouse types ( #5482 )
2025-02-11 13:59:19 +00:00
Jannik Maierhöfer and GitHub
57e8de852e
docs: add translations of README for Chinese, Japanese and Korean ( #5479 )
2025-02-11 13:34:23 +00:00
Clemo and GitHub
7d77c36817
Update LICENSE
...
add clarification
2025-02-11 13:06:38 +01:00
c821d1b2fe
docs: new readme ( #5446 )
...
* docs: readme rework
* banner update
* docs: minor edits
* add star us cta
* add feature overview image
* delete image and careers
* push
---------
Co-authored-by: Clemo <121163007+clemra@users.noreply.github.com >
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-02-11 12:04:24 +00:00
Steffen Schmitz and GitHub
0ea80605b1
chore: drop postgres events table ( #5472 )
...
* chore: drop postgres events table
* chore: celanup
* chore: drop events table
2025-02-11 11:45:43 +00:00
Steffen Schmitz and GitHub
05e16e7d00
chore: remove event_log table ( #5471 )
...
* chore: remove event_log table
* chore: add fileKey for score events
2025-02-11 11:28:41 +00:00
Max Deichmann and GitHub
67876d4e4f
fix: add clickhouse final for traces grouped by name dashboard ( #5474 )
...
fix
2025-02-11 10:58:51 +00:00
marliessophie and GitHub
179751db91
style(dashboard): round to two decimals on model latencies chart ( #5473 )
2025-02-11 10:35:08 +00:00
marliessophie and GitHub
e2164c2f00
fix(dataset-upsert): filter on dataset evals triggered in trace-upsert queue ( #5353 )
2025-02-11 09:38:28 +00:00
marliessophie and GitHub
778dc24324
chore(datasets): reduce max payload size in csv upload ( #5466 )
2025-02-11 09:02:39 +00:00
Steffen Schmitz and GitHub
d48da06274
chore: instrument api authentication ( #5465 )
2025-02-11 08:54:49 +00:00
Steffen Schmitz and GitHub
185cb10d7c
feat(otel): map traceloop.entity.input/output to input/output ( #5460 )
...
* feat(otel): map traceloop.entity.input/output to input/output in langfuse
* chore: workaround to have `null` detections parsed in snyk
* chore: add workaround source note
* chore: formatting
* chore: add replace for worker
2025-02-11 08:43:13 +00:00
Steffen Schmitz and GitHub
92d5f3524b
chore: enable tracing on all platforms ( #5461 )
2025-02-11 07:41:16 +00:00
Steffen Schmitz and GitHub
e490147d73
feat(otel): accept application/json content type spans ( #5450 )
...
* feat(otel): accept application/json content type spans
* chore: apply suggestion
2025-02-11 07:22:02 +00:00
Max Deichmann
5a7ba1fcbc
chore: release v3.26.0
2025-02-10 22:44:15 +01:00
Max Deichmann and GitHub
8204fb2a24
fix: fix cost calculation discrepancies in dashboards ( #5448 )
...
* fix: fix charts
* security: upgrade jsonpath-plus
* security: upgrade jsonpath-plus
* fix
* fix
* fix
* fix
* push
* push
2025-02-10 21:13:05 +00:00
Steffen Schmitz and GitHub
2559a388aa
feat(otel): add input/output and name on traces ( #5449 )
2025-02-10 17:22:44 +00:00
Max Deichmann and GitHub
27e1785362
security: upgrade jsonpath-plus ( #5445 )
...
* security: upgrade jsonpath-plus
* push
2025-02-10 15:25:15 +00:00
Hassieb Pakzad and GitHub
3fc9cee53d
fix(model-prices): gemini 2 vertex AI prices ( #5444 )
2025-02-10 14:28:03 +00:00
Steffen Schmitz and GitHub
0dfefd2793
perf: skip processing of already seen events in worker ( #5437 )
...
* perf: skip processing of already seen events in worker
* chore: add queue delay to make use of seen events processing
2025-02-10 09:45:45 +00:00
25bc0fc660
perf: improve trpc session.id performance ( #5431 )
...
* perf: improve trpc session.id performance
* perf: improve trpc session.id performance
* push
* perf: improve trpc session.id performance
* Update web/src/server/api/routers/sessions.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-02-09 10:28:36 +00:00
Max Deichmann and GitHub
ccd5ab97a4
perf: improve performance for trace.id trpc route ( #5430 )
...
* push
* fix
2025-02-08 10:54:38 +00:00
Steffen Schmitz and GitHub
bf68a7edd5
feat: map additional properties for otel llm spans ( #5422 )
2025-02-07 15:40:20 +00:00
marliessophie and GitHub
2a697a9048
feat(tables): add select all interface to tables ( #5314 )
...
* feat(ui): extract generalized `TableActionMenu`
* chore(select-all): add queue infra
* chore(select-all): add `POST` selectAll trpc route
* fixup: register queue
* chore: improve state management
* fixup: handle select all job
* chore: handle streamed records in actions
* chore(ui): add `DataTableSelectAllBanner`
* chore: handle multi-select in interface
* chore: skip processed chunks on retries
* chore: clear select all state on route nav
* chore: extract select-column components
* feat: query options for create action
* refactor: rename router
* chore: add annotation queue item processing in select all job
* fix: TS typo
* fix: sync session storage across modals and tabs
* chore: block select all if job on table for project is in progress
* chore: fix blocking select all jobs
* chore: make specific to table name
* push
* revert: commited by mistake
* remove dead code
* fixup: test
* push
* push
* chore: simplify `TableSelectionManager`
* chore(ui): refactor `SelectAll` -> `BulkAction`
* chore(fixup): refactor `SelectAll` -> `BatchAction`
* chore: set a deterministic `jobId` on redis
* chore: drop progress indicator
* chore: refactor remove selectAll route and extend existing routes instead
* push
* chore: remove dead code
* chore: refactor extract `processPostgresTraceDelete`
* push
* fix test
* chore: add batch action capability to annotation queue
* eslint
* push
* push
* push
* push
* push
* push
* push
* fix: add trace entitlement check to trace.deleteMany
* style: show note if batch action is in progress
* push
* fix imports
* cleanup
2025-02-07 10:21:44 +00:00
marliessophie and GitHub
87a961be47
fix(gemini): pricing units ( #5420 )
...
* fix(gemini): pricing units
* push
2025-02-07 10:03:52 +00:00
Max Deichmann and GitHub
3a52c59f2a
fix: do not run snyk in merge groups ( #5415 )
...
fix
2025-02-06 22:55:23 +00:00
1722703623
chore(deps): bump jsonpath-plus from 10.0.7 to 10.2.0 ( #5411 )
...
Bumps [jsonpath-plus](https://github.com/s3u/JSONPath ) from 10.0.7 to 10.2.0.
- [Release notes](https://github.com/s3u/JSONPath/releases )
- [Changelog](https://github.com/JSONPath-Plus/JSONPath/blob/main/CHANGES.md )
- [Commits](https://github.com/s3u/JSONPath/compare/v10.0.7...v10.2.0 )
---
updated-dependencies:
- dependency-name: jsonpath-plus
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-06 21:32:03 +00:00
Max Deichmann and GitHub
129c94c455
security: upgrade jsonpath-plus ( #5409 )
...
* fix
* fix
2025-02-06 14:24:19 +00:00
Steffen Schmitz and GitHub
23a62e3a03
chore: deduplicate postgres event list by bucketPath ( #5407 )
2025-02-06 13:56:46 +00:00
steffen911
d2a8d4e4b1
chore: release v3.25.0
2025-02-06 14:29:41 +01:00
Steffen Schmitz and GitHub
431f8ed941
chore: fetch file list for worker processing from s3 event log ( #5405 )
2025-02-06 13:08:35 +00:00
Iaroslav Volkov and GitHub
f50b69cbc8
feat: add custom gid and uid support ( #5355 )
2025-02-06 14:06:07 +01:00
Max Deichmann and GitHub
cdde86d96e
fix: improve working for eval jsonpath selector ( #5406 )
...
* fix
* push
2025-02-06 12:54:02 +00:00
marliessophie and GitHub
9e84150ce0
feat(model): add playground and eval support for Gemini 2.0 Flash, Gemini 2.0 Flash-Lite, and Gemini 2.0 Pro ( #5403 )
...
* feat(model): add playground and eval support for Gemini 2.0 Flash, Gemini 2.0 Flash-Lite, and Gemini 2.0 Pro
* chore: add costs
2025-02-06 11:51:38 +00:00
Max Deichmann and GitHub
a6fbceff84
feat: use json-path to select from tracing data for evals ( #5402 )
...
* push
* push
* push
* error handling
2025-02-06 11:02:57 +00:00
Max Deichmann and GitHub
3ca6dd48c0
fix: return empty results in dashboard if from is larger than to ( #5389 )
...
push
2025-02-05 16:36:22 +00:00
marliessophie and GitHub
03e80bac76
fix(ui-markdown): fallback to json view if markdown parsing is unsucessful ( #5386 )
...
fix(ui-markdown): fallback to json view if markdown parsing is unsuccessful
2025-02-05 15:13:10 +00:00
Steffen Schmitz and GitHub
005ba31740
chore: remove unused imports ( #5388 )
2025-02-05 15:00:49 +00:00
Max Deichmann and GitHub
727797e0ec
perf: do not load all models by default in the dashboards ( #5387 )
...
* fix
* push
* fix
2025-02-05 14:31:51 +00:00
Steffen Schmitz and GitHub
123f513199
chore: optionally log s3 event bucket uploads in postgres ( #5381 )
...
* chore: optionally log s3 event bucket uploads in postgres
* chore: reduce uniqueness constraints and separate eventId from eventLog id field
2025-02-05 14:05:45 +00:00
89896c70ee
fix: model aggregation for daily metrics ( #5384 )
...
* fix: model aggregation for daily metrics
* fix query
* remove comment
---------
Co-authored-by: Hassieb Pakzad <68423100+hassiebp@users.noreply.github.com >
2025-02-05 11:23:02 +00:00
marliessophie and GitHub
e52f9dd1e2
fix(dataset-evals): reference job.observationId rather than sourceObservationId ( #5350 )
...
* fix(dataset-evals): reference `job.observationId` rather than `sourceObservationId`
* chore: typo
2025-02-05 10:53:36 +00:00
marliessophie and GitHub
ace69419b3
fix(ui): input changes lost on focus in dataset item edit ( #5380 )
...
* fix(ui): input changes lost on focus in dataset item edit
* push
2025-02-05 09:21:01 +00:00
marliessophie and GitHub
6f3cc8982a
style(dataset-analytics): decrease chart height and width ( #5379 )
2025-02-05 08:55:09 +00:00
Steffen Schmitz and GitHub
c612109948
chore: fix flaky traces-api test ( #5370 )
2025-02-04 16:43:03 +00:00
Marc Klingen
2359d7f9ae
chore: release v3.24.1
2025-02-04 15:55:02 +01:00
Steffen Schmitz and GitHub
1baa0aaaed
chore: decrease ingestion queue delay outside of date boundaries ( #5364 )
...
* chore: decrease ingestion queue delay outside of date boundaries
* chore: check for non-null delay instead of truthy
2025-02-04 13:33:29 +00:00
c4186102eb
fix: fix flaky dataset test ( #5366 )
...
* fix(dataset-evals): reference `job.observationId` rather than `sourceObservationId`
* chore: typo
* push
* push
---------
Co-authored-by: Marlies Mayerhofer <74332854+marliessophie@users.noreply.github.com >
2025-02-04 13:29:27 +00:00
Steffen Schmitz and GitHub
016993c117
fix: instantiate the ratelimit redis client on first use to avoid connection errors ( #5362 )
2025-02-04 07:23:44 +00:00
Marc Klingen
909bdde9d8
chore: release v3.24.0
2025-02-03 20:54:10 +01:00
Marc Klingen and GitHub
6f074dc59f
feat(ui): add local iso date with utc on hover and ms precision on traces ( #5359 )
...
* feat(ui): add local iso date with utc on hover and ms precision on traces
* fixes
2025-02-03 19:48:06 +00:00
Hassieb Pakzad and GitHub
b8bc474b83
fix(playground): allow o3 ( #5357 )
2025-02-03 16:16:31 +00:00
Marc Klingen and GitHub
334d34ac15
chore: add cmd_k_menu:opened event for main menu "go to..." button ( #5351 )
2025-02-03 13:13:55 +00:00
marliessophie and GitHub
1efb37f3c1
fix(filter-ui): support mouse wheel scroll behaviour on desktop and mobile ( #5346 )
2025-02-03 10:26:23 +00:00
Steffen Schmitz and GitHub
5fc87cabeb
chore: upgrade prisma to version 6 ( #5266 )
...
* chore: upgrade prisma to version 6
* chore: update dockerfile
* chore: upgrade prisma
2025-02-03 10:03:07 +00:00
marliessophie and GitHub
a14fb003e6
fix(score-analytics): display categorical data in dashboard ( #5341 )
2025-02-03 08:36:24 +00:00
Max Deichmann and GitHub
e1521b4ef1
fix: add bedrock throttling exception to retries for evals ( #5338 )
...
push
2025-02-02 22:52:13 +00:00
Hassieb Pakzad and GitHub
fd8756ff4c
chore(media): add retries on media record write ( #5336 )
2025-02-02 09:14:11 +01:00
Marc Klingen and GitHub
d69808747c
chore(models): updated price for o1-mini ( #5335 )
2025-02-01 13:58:44 +00:00
Max Deichmann and GitHub
854e2c60c8
fix: fix observation frontend exception ( #5334 )
...
* fix
* push
* fix
* push
2025-02-01 10:57:40 +00:00
Hassieb Pakzad and GitHub
4567ed473e
chore(media-api): add instrumentation ( #5333 )
2025-02-01 10:00:08 +01:00
Steffen Schmitz and GitHub
2abc9fed7a
fix: handle multiple number types in otel parser ( #5323 )
...
* chore: add more otel logging
* chore: logging
* chore: enhance log message
* chore: handle number timestamps correctly
* chore: handle non-object intvalue
2025-02-01 07:19:55 +00:00
Marc Klingen and GitHub
f6de06d695
chore: remove polynomial regex from MUSTACHE_REGEX ( #5328 )
...
fix: optimize MUSTACHE_REGEX to remove polynomial regex
2025-01-31 21:53:42 +00:00
Marc Klingen
02b9220c14
chore: release v3.23.0
2025-01-31 22:09:29 +01:00
Marc Klingen and GitHub
e15a26d1de
feat(models): add o3-mini and o3-mini-2025-01-31 ( #5327 )
2025-01-31 22:08:50 +01:00
Max Deichmann
1c5c072eed
chore: release v3.22.0
2025-01-31 20:00:46 +01:00
Max Deichmann and GitHub
b805b9c93f
perf: improve observation list endpoint CH performance ( #5325 )
...
fix
2025-01-31 18:56:49 +00:00
Hassieb Pakzad and GitHub
da147ea5aa
fix(media-api): handle retries on existing UUIDs ( #5320 )
2025-01-31 18:07:29 +01:00
Marc Klingen and GitHub
8e15c9770b
chore(ui): improve sizing of chat message role button ( #5321 )
2025-01-31 16:12:04 +00:00
Steffen Schmitz and GitHub
799c7cf940
feat: create otel/v1/traces endpoint to accept otel spans ( #5241 )
...
* feat: create otel/v1/traces endpoint to accept otel spans
* chore: add comments
* chore: otel test
* chore: fallback for buffers
* chore: attribute parsing
* chore: empty fallback on attributes
* chore: remove otel collector
* chore: remove otlp-transformer dependency
* chore: remove unrelated test case
* chore: remove header logging
* chore: add traceloop example
* chore: update lockfile
* chore: revert lock
* chore: reduce delta
* chore: add otel specific rate limits
* chore: reuse ingestion rate-limit config
* chore: document generated code
* chore: test setup
* chore: adjust result parsing
* chore: typing
* chore: otel typing
2025-01-31 15:58:43 +00:00
Steffen Schmitz and GitHub
64d784e16e
fix: retry failed connections in RateLimiter and disable offlinequeue ( #5317 )
2025-01-31 14:58:57 +00:00
Marc Klingen and GitHub
096467d7dd
feat(ui): open cmd+k menu from main menu ( #5318 )
...
* feat(ui): open cmd+k menu from main menu
* fix lint and naming
* move provider to fix issue
2025-01-31 14:51:13 +00:00
Marc Klingen and GitHub
dc995ff377
fix(ui): deduplicate prompt variables in variable preview ( #5316 )
2025-01-31 13:46:57 +00:00
Marc Klingen and GitHub
935aa20dda
fix(ui): correct value for accent-foreground color ( #5315 )
2025-01-31 13:43:51 +00:00
Steffen Schmitz and GitHub
543ee3fb77
fix: disable autopipelining for rate limits to avoid uncaught exceptions ( #5300 )
...
* fix: disable autopipelining for rate limits to avoid uncaught exceptions
* chore: adjust
* chore: add shutdown logic for ratelimitservice
* chore: adjust tests
* chore: test setup
2025-01-31 10:13:13 +00:00
Max Deichmann
95c6047724
chore: release v3.21.0
2025-01-30 23:31:27 +01:00
Max Deichmann and GitHub
6e31e559f0
fix: parse inputs and outputs correctly when adding to datasets ( #5307 )
...
* fix
* fix
* fix
2025-01-30 22:18:31 +00:00
Marc Klingen and GitHub
4ec1fc53d1
feat(ui): customize codemirror theme ( #5305 )
...
* remove existing theme
* init themes
* push
* doesnt work
* hide gutters when no line numbers
* push
* push
* fix import
2025-01-30 22:13:29 +00:00
Max Deichmann and GitHub
7e24f5f42c
chore: download 20 S3 ingestion events at a time ( #5306 )
2025-01-30 21:54:58 +01:00
Marc Klingen and GitHub
fe00afa627
fix(ui): hide project-level routes in project overview main menu, disable active project in cmd+k menu ( #5303 )
2025-01-30 20:10:19 +00:00
Max Deichmann and GitHub
3e5dc4a551
fix: pass tracing input / output as string via trpc ( #5302 )
...
* fix
* fix
* fix
* fix
2025-01-30 19:37:46 +00:00
Marc Klingen and GitHub
fa75fb9245
feat(ui): use codemirror for text area input, highlighting/linting of prompt variables ( #5296 )
...
* abstract editor to support "text" mode in addition to "json" mode
* always use CodeMirrorEditor for prompts
* minheight on editor
* upgrade codemirror and add language package
* add linting for prompts and switch to githubDark theme
* package
* use codemirror for chat prompts
* imrpove scroll behavior of new dataset form
* improve dataset item editor view
* push
* remove dep pinning
* align editor linting with current variable definition
* defauklt value to value
2025-01-30 19:36:40 +00:00
Max Deichmann
a640a6a139
chore: release v3.20.0
2025-01-30 19:50:57 +01:00
Hassieb Pakzad and GitHub
b0c12f02ec
fix(llm-api-key): overwrite default top_p on key test ( #5301 )
2025-01-30 18:47:28 +01:00
Max Deichmann and GitHub
774efa4eaa
perf: batch read single S3 events ( #5298 )
...
* push
* fix
* push
* fix
2025-01-30 17:13:40 +00:00
Max Deichmann and GitHub
a866cba228
chore: improve 429 error handling ( #5282 )
2025-01-30 16:46:38 +00:00
Marc Klingen and GitHub
92b6963347
feat: add posthog events to cmd+k menu ( #5288 )
...
* feat: add posthog events to cmd+k menu
* ellipsis fix
2025-01-30 17:27:33 +01:00
Steffen Schmitz and GitHub
ba55837b71
chore: move create export job log to internal lib ( #5295 )
2025-01-30 15:50:27 +00:00
Marc Klingen and GitHub
966efa1b92
docs(tracing-users): add header tooltips to user table ( #5290 )
...
docs: add header tooltips to user table
2025-01-30 15:12:37 +00:00
Marc Klingen and GitHub
dbe5b93a8a
fix(ui): do not close dialogs on outside interactions by default ( #5294 )
2025-01-30 15:11:52 +00:00
Marc Klingen and GitHub
22371b4c32
feat(prompts): scroll selected prompt version into view ( #5293 )
...
* feat(prompts): scroll prompt versions independently from prompt itself
* feat(prompts): scroll selected prompt version into view
2025-01-30 15:00:23 +00:00
marliessophie and GitHub
8d1c381d46
fix(media-ui): fetch i/o media only for authed project member ( #5284 )
2025-01-30 15:57:49 +01:00
Marc Klingen and GitHub
1efce634e7
feat(prompts): scroll prompt versions independently from prompt itself ( #5292 )
2025-01-30 14:20:17 +00:00
Steffen Schmitz and GitHub
ec46e7d68e
fix: correct default timestamp order for traces table ( #5291 )
...
* fix: correct default timestamp order for traces table
* chore: correct order
* chore: typo
2025-01-30 14:18:58 +00:00
Hassieb Pakzad and GitHub
b302e8eb96
chore(evals): handle invalid JSON error if maxTokens too low ( #5289 )
2025-01-30 14:50:10 +01:00
marliessophie and GitHub
e04e21bf13
fix(rbac): load trace data in shared sessions ( #5283 )
...
* fix(rbac): load trace data in shared sessions
* chore: refactor and simplify
2025-01-30 13:12:16 +00:00
Marc Klingen and GitHub
273bcddc0f
feat: switch between projects/orgs via cmd+k menu ( #5285 )
...
* filter out dynamic routes
* add project deeplinks
2025-01-30 13:10:53 +00:00
Max Deichmann
e2099de653
chore: release v3.19.0
2025-01-30 11:46:17 +01:00
Max Deichmann and GitHub
435a09f7df
feat: add more x-axis chart ticks ( #5220 )
...
* push
* push
* push
* chore: release v2.58.0
* push
* push
* push
* fix
* push
* push
* fix
2025-01-30 10:06:28 +00:00
Steffen Schmitz and GitHub
037dbd8c9d
feat: add LANGFUSE_INIT_PROJECT_RETENTION support to init data retention ( #5281 )
...
* feat: accept LANGFUSE_INIT_PROJECT_RETENTION setting
* feat: add LANGFUSE_INIT_PROJECT_RETENTION support to init data retention
2025-01-30 09:52:30 +00:00
Marc Klingen and GitHub
02a3d91c56
feat(ui): add cmd+k menu ( #5276 )
...
* rename existing command exports
* move existing to input-command
* add comment
* wip cmd k menu for navigation
* fix types and paths of nested menu items
* add support for nested menu items
* filter correctly
2025-01-30 09:38:27 +00:00
Steffen Schmitz and GitHub
8821ad5b30
chore: remove data retention beta label and allow self-host enterprise plan ( #5279 )
...
* chore: remove data retention beta label
* chore: allow data-retention for self-host enterprise
2025-01-30 09:28:45 +00:00
Marc Klingen and GitHub
ae1ba493aa
chore(deps): bump cmdk 1.0.4 ( #5275 )
2025-01-30 00:01:04 +00:00
Max Deichmann and GitHub
5d2735ee14
security: upgrade sentry ( #5269 )
...
push
2025-01-29 17:48:29 +00:00
marliessophie and GitHub
38f3336ad5
style(prompts): add note explaining prompt commit message purpose ( #5268 )
2025-01-29 16:19:33 +00:00
marliessophie and GitHub
6224d7ad0f
fix(dataset-analytics): latency label should denote seconds (s) ( #5267 )
2025-01-29 15:03:39 +00:00
marliessophie and GitHub
30c8fc2239
fix(experiments): double brace in json syntax mistaken as variable ( #5264 )
...
* fix(experiments): double brace in json syntax mistaken as variable
* push
2025-01-29 13:33:51 +00:00
marliessophie and GitHub
edbf16f3a6
fix(experiments): change logger.warning to logger.error call ( #5263 )
...
fix(experiments): remove invalid `logger.warning` call from service
2025-01-29 12:41:42 +00:00
marliessophie and GitHub
8d050717a9
chore: support uploads of CSV files with just one column ( #5262 )
...
* chore: support uploads of CSV files with just one column
* chore: increase preview file byte size
* push
2025-01-29 10:45:18 +00:00
74703f62c4
ci: lock in current lint warning levels ( #2648 )
...
* ci(worker): enforce linting
* chore: lock current linting levels
* chore: lock current lint warning levels
---------
Co-authored-by: steffen911 <steffen@langfuse.com >
2025-01-29 08:53:19 +00:00
Max Deichmann and GitHub
09603a1f23
security: upgrade golang github.com/golang-jwt/jwt/v4 ( #5249 )
...
* push
* push
2025-01-28 16:53:48 +00:00
Steffen Schmitz and GitHub
34eb3e3d76
perf: reduce redundant parsing operations within ingestionservice ( #5243 )
...
* perf: reduce redundant parsing operations within ingestionservice
* chore: utils
* chore: move trace record parsing
* chore: cleanup
* chore: access input output correctly
* chore: avoid mutations
* chore: test cases
* chore: typo
2025-01-28 16:42:04 +00:00
Hassieb Pakzad and GitHub
b307a75a9a
feat(messages-ui): allow removing system message ( #5248 )
2025-01-28 17:44:41 +01:00
marliessophie and GitHub
9f20b3e1cd
feat(prompts): support commit_message ( #5197 )
...
* chore(prompts-ui): add nullable `commit_message` col
* chore(prompts-ui): add commit message to prompts
* chore(prompts-api): add commit message to prompts v2 api
* chore: rename migration
* chore: extract commit message length const
* fix: legacy types
* push
* chore: refactor types to not extend legancy, but create base types
* feat: add commit message to prompt diff view between versions
* chore: migration final in order
* push
2025-01-28 16:32:05 +00:00
Hassieb Pakzad and GitHub
4ae24f97f5
fix(ui-model-table): collapsed view ( #5246 )
2025-01-28 16:40:04 +01:00
Hassieb Pakzad and GitHub
58858de930
chore(llm-keys): rename vertex-ai to google-vertex-ai ( #5244 )
2025-01-28 16:11:16 +01:00
Max Deichmann
b8a9630731
chore: release v3.18.0
2025-01-27 23:56:51 +01:00
Max Deichmann and GitHub
aec58b1149
fix: use correct path for prompt versions api ( #5236 )
...
* push
* push
2025-01-27 22:54:50 +00:00
marliessophie and GitHub
d3634917d4
chore(datasets): increase csv upload limit to 10MB ( #5234 )
2025-01-27 21:33:23 +00:00
Max Deichmann and GitHub
52fa9eb1ff
fix: align naming of prompt patch docs ( #5233 )
...
push
2025-01-27 16:12:52 +00:00
Marc Klingen and GitHub
e27f0bdc1d
fix(cloud): fallback to clikchouse when usage meter cannot be fetched from stripe ( #5232 )
...
* fix(cloud): fallback to clikchouse when usage meter cannot be fetched from stripe
* use error
2025-01-27 15:28:51 +00:00
marliessophie and GitHub
0576f01641
fix(experiments): improve error handling ( #5209 )
...
* fixup: execute trace creation callback handler
* chore: create trace for experimentation on error
* push
* chore: adjust test to new behaviour
* push
* push
2025-01-27 15:23:15 +00:00
Hassieb Pakzad and GitHub
9f6fccfbeb
fix(evals): remove system message ( #5231 )
2025-01-27 16:07:39 +01:00
Marc Klingen and GitHub
7cb9b75897
fix(ui): tabIndex on sign in page to skip password reset and cloud region info ( #5230 )
2025-01-27 14:36:46 +00:00
Marc Klingen and GitHub
5857a9e61d
feat(ui): scroll deeplinked observation into view in trace tree ( #5228 )
...
* refactor component to single out the node
* push
2025-01-27 14:22:14 +00:00
Hassieb Pakzad
a9a9136010
chore: release v3.17.1
2025-01-27 15:32:23 +01:00
Hassieb Pakzad and GitHub
e5c45e381e
fix(llm-api-key): extra header JSON parsing ( #5229 )
2025-01-27 15:19:24 +01:00
Steffen Schmitz and GitHub
cb00d463c7
feat: remove data beyond retention limit from clickhouse ( #5226 )
...
* feat: remove data beyond retention limit from clickhouse
* chore: lint
* chore: log statement
* chore: typo
2025-01-27 13:37:56 +00:00
Steffen Schmitz and GitHub
e18ac03b44
perf: use final for traces and observations api if no skip indexes are filtered ( #5223 )
...
* perf: use final for traces and observations api if no skip indexes are filtered
* chore: operator order
2025-01-27 13:16:10 +00:00
Marc Klingen
d54cbc6c9b
chore: release v3.17.0
2025-01-27 13:38:42 +01:00
Marc Klingen and GitHub
332f6658d9
ci: run codespell also on v2 branch and prs ( #5224 )
2025-01-27 13:20:58 +01:00
Hassieb Pakzad and GitHub
25a559293b
fix(media): base id gen on project ID + content hash ( #5222 )
2025-01-27 11:57:47 +01:00
Max Deichmann and GitHub
9ff8643489
chore: add client side logging for auth errors ( #5221 )
...
push
2025-01-27 10:03:02 +00:00
Steffen Schmitz and GitHub
dd7e4f344e
fix: align input/output and metadata parsing between GET /traces and /traces/:id ( #5218 )
...
* fix: align input/output and metadata parsing between GET /traces and /traces/:id
* chore: lint
* chore: lint
2025-01-27 09:53:33 +00:00
Marc Klingen and GitHub
fe089e15f2
fix(openapi): upgrade openapi spec generator to correctly specify /ingestion 207 status code ( #5217 )
2025-01-27 10:44:33 +01:00
Marc Klingen and GitHub
9f8793e26a
feat(auth): make checks and auth method configurable across SSO providers ( #5203 )
...
push
2025-01-27 09:12:58 +00:00
Hassieb Pakzad and GitHub
a1cb4c727b
fix(media): remove transactions ( #5211 )
2025-01-25 23:44:34 +01:00
Hassieb Pakzad and GitHub
b39eb5445a
fix(media): reduce tx level to RepeateableRead ( #5210 )
2025-01-25 21:09:14 +01:00
Hassieb Pakzad and GitHub
b611301658
fix(media-api): increase tx maxWait ( #5208 )
2025-01-25 16:12:34 +01:00
Hassieb Pakzad and GitHub
c3fd8a74dc
fix(trace-timeline): first token label ( #5202 )
2025-01-24 16:38:47 +01:00
steffen911
aff8421dde
chore: release v3.16.0
2025-01-24 16:12:52 +01:00
Steffen Schmitz and GitHub
c442c4290e
feat: add proxy support for oauth flows ( #5198 )
2025-01-24 14:32:46 +00:00
Max Deichmann
01bc983b97
chore: release v3.15.0
2025-01-24 15:02:59 +01:00
Max Deichmann and GitHub
e2015bc52b
feat: update prompt versions ( #5106 )
...
* feat: update prompt versions
* push
* fix: return 404 error instead of 500 for not found observations trpc route
* fix
* fix
* fix
* fix
* fix
* feat: update prompts and invalidate cache
* feat: update prompts and invalidate cache
* feat: update prompts and invalidate cache
* feat: update prompts and invalidate cache
2025-01-24 13:40:59 +00:00
Max Deichmann and GitHub
91589d20c6
chore: add error logs for trpc add prompts label ( #5195 )
...
push
2025-01-24 12:45:00 +00:00
50f9444c36
feat(auth): Add AUTH_CUSTOM_ID_TOKEN environment variable ( #5193 )
...
* Add AUTH_CUSTOM_ID_TOKEN environment variable
* add to multi-tenant-sso (ee)
* add comment
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-01-24 11:14:39 +00:00
marliessophie and GitHub
4432223fd2
fix(comments-api): increase comment character limit to 3,000 ( #5194 )
2025-01-24 10:59:25 +00:00
marliessophie and GitHub
e3d58ff920
feat(traces): display number of all log kinds on trace table ( #5165 )
...
* feat(traces): display number of all log kinds on trace table
* chore: lint
* tests: adjust
* push
* chore: rename `computed_level` to `aggregated_level`
* chore: adjust ui labels
* chore: include level counts in export
2025-01-24 09:57:21 +00:00
Hassieb Pakzad and GitHub
ded00e6fdf
feat(trace-timeline): add time to first token ( #5185 )
2025-01-24 10:02:05 +01:00
Max Deichmann and GitHub
3fd1cc021c
perf: add timestamp filter to observations join in eval queue ( #5192 )
...
* push
* chore: disable secondary queue
2025-01-23 23:50:40 +00:00
Steffen Schmitz and GitHub
4b2e68017b
feat: add support for media asset deletion based on retention settings ( #5181 )
...
* feat: allow data retention configuration in project settings
* chore: remove prefix
* chore: hide data retention on cloud
* chore: lint
* feat: add support for media asset deletion based on retention settings
* chore: fix naming
* chore: increase expiry schedule
* chore: add logging
* chore: revert to intended schedule
2025-01-23 16:54:33 +00:00
Marc Klingen and GitHub
a52f87c64a
chore(cloud): add login issue banner, allow to open support chat ( #5183 )
2025-01-23 16:07:03 +00:00
Hassieb Pakzad
7500575a96
chore: release v3.14.0
2025-01-23 16:24:10 +01:00
Steffen Schmitz and GitHub
105284d756
feat: allow data retention configuration in project settings ( #5178 )
...
* feat: allow data retention configuration in project settings
* chore: remove prefix
* chore: hide data retention on cloud
* chore: lint
* chore: disable box on missing entitlement and add integer enforcement
2025-01-23 14:42:24 +00:00
Hassieb Pakzad and GitHub
29f7ace2ce
feat(llm-api-keys): allow for extra headers ( #5167 )
2025-01-23 14:59:00 +01:00
Hassieb Pakzad and GitHub
8fd17b52d1
fix(prompt-diff-dialog): keep open on cursor leaving window ( #5176 )
2025-01-23 10:44:07 +01:00
marliessophie and GitHub
484af10463
feat(prompts): support in UI prompt duplication ( #5110 )
...
* feat(prompts): support in UI prompt duplication
* chore(ui-ds): make `children` in `ActionButton` optional
* fix: extract custom hook for prompt name validation
* eslint
* fix: insert correct prompt count
* chore: validate prompt name uniqueness; attach latest label for single version
* chore: refactor duplication approach to use createMany and save on network-roundtrips
* chore: revert changes on action button
* push
2025-01-22 17:53:09 +00:00
Hassieb Pakzad and GitHub
33d43ca9bd
fix(diff-view-ui): add line breaks ( #5168 )
2025-01-22 17:27:58 +01:00
Hassieb Pakzad and GitHub
3658620540
feat(prompts): add diff view on new prompt version ( #5163 )
2025-01-22 15:54:06 +01:00
Steffen Schmitz and GitHub
83e1c5a3df
chore: use a distribution metric for langfuse.ingestion.count_files ( #5164 )
...
* chore: use a distribution metric for langfuse.ingestion.count_files
* chore: update name
* chore: update name
* chore: remove outdated import
2025-01-22 11:53:31 +00:00
Steffen Schmitz and GitHub
5efcef593f
chore: add additional metrics into ingestion pipeline ( #5160 )
...
* chore: add additional metrics into ingestion pipeline
* chore: spellcheck
2025-01-22 11:03:56 +00:00
Marc Klingen and GitHub
6c84c54a4a
feat(cloud): switch between available plans ( #5153 )
...
* feat(cloud): switch between available plans
* push
* inline comments
* entitlement check
* improve error message
* remove unused ids
* fix spellcheck
2025-01-22 10:38:25 +00:00
Max Deichmann and GitHub
9b3d77e1de
chore: disable secondary queue ( #5156 )
2025-01-21 23:25:56 +01:00
steffen911
f10e896545
chore: release v3.13.0
2025-01-21 17:10:01 +01:00
0047cbb367
fix: use unix timestamp for batch export file name to avoid invalid characters ( #5092 )
...
Co-authored-by: hopkinx <hopkinx@yanxihuadeMac-mini.local >
2025-01-21 17:08:33 +01:00
Marc Klingen and GitHub
8df120c186
feat(ee): add audit log view to project settings ( #5150 )
...
* add audit logs table
* push
* fix pagination zod schema
* copy
* add check that user is in org
* simplify
2025-01-21 15:10:22 +00:00
Max Deichmann and GitHub
a12b5b5006
fix: correctly upgrade katex ( #5151 )
2025-01-21 14:57:48 +00:00
marliessophie and GitHub
91f360ae29
chore(models-ui): move models into settings ( #5124 )
...
* chore(models-ui): move models into settings
* style: add notification to manage models in settings
* chore: mv button
2025-01-21 14:54:58 +00:00
Steffen Schmitz and GitHub
026f7f1b4b
chore: allow skipping ingestion CH reads for projects created after cutoff date ( #5116 )
...
* chore: allow skipping ingestion CH reads for projects created after cutoff date
* chore: add in memory cache for project skips
2025-01-21 14:08:36 +00:00
Max Deichmann and GitHub
29ad2965e6
security: upgrade katex ( #5149 )
2025-01-21 14:01:37 +00:00
Steffen Schmitz and GitHub
ae3f84125b
chore: remove legacy/batched ingestion pipeline code ( #5121 )
...
* chore: remove legacy/batched ingestion pipeline code
* chore: remove js-tiktoken dependency
* chore: partially revert updates
* chore: typing in gitHubEnterpriseProvider.ts
* chore: remove model-match test
2025-01-21 12:57:43 +00:00
Steffen Schmitz and GitHub
507a0eb7f4
chore: skip re-builds for same tree hash ( #5135 )
...
* chore: skip re-builds for same tree hash
* dummy
* chore: include do not skip
* chore: skip push
2025-01-21 11:58:10 +00:00
Max Deichmann and GitHub
64b29bce24
fix: observation table type alignment ( #5146 )
2025-01-21 11:27:50 +00:00
marliessophie and GitHub
60d6c5359b
feat(dataset-runs): add product analytics events ( #5145 )
...
* feat(dataset-runs): add product analytics events
* push
* push
2025-01-21 11:25:45 +00:00
Steffen Schmitz and GitHub
7f94a29c48
chore: reduce default write interval for CH queue to 1000 ( #5144 )
2025-01-21 11:19:44 +00:00
steffen911
a26f16b090
chore: release v3.12.0
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-01-21 12:28:38 +01:00
Steffen Schmitz and GitHub
b34da5a0de
feat: add support for DATABASE_ARGS config ( #5143 )
2025-01-21 11:14:39 +00:00
marliessophie and GitHub
9684768346
chore(traces): remove unsued code pulling trace data from prisma [deprecated] ( #5139 )
2025-01-21 10:24:27 +00:00
Steffen Schmitz and GitHub
1c51a319fd
chore: remove postgres fallback for generations table calls ( #5137 )
2025-01-21 10:55:54 +01:00
Steffen Schmitz and GitHub
9dd7aa833b
chore: remove queryClickhouse toggles ( #5123 )
...
* chore: remove queryClickhouse toggles
* chore: linting
2025-01-21 08:01:57 +00:00
Marc Klingen and GitHub
e14f8587af
revert: ask for github star during onboarding ( #5127 )
...
Revert "feat(onboarding): add GitHub star prompt with badge (#5125 )"
This reverts commit ed743c1f76 .
2025-01-20 21:04:24 +00:00
ed743c1f76
feat(onboarding): add GitHub star prompt with badge ( #5125 )
...
* feat(onboarding): add GitHub star prompt with badge
* ui improvements
* add posthog tracking
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2025-01-20 19:27:46 +00:00
Hassieb Pakzad and GitHub
0ee21fb98e
fix(llm-api-keys): improve form dialog for bedrock ( #5122 )
2025-01-20 18:28:09 +01:00
Hassieb Pakzad and GitHub
78d74ccb4e
fix(trace-view): show disabled jump to playground instead of hiding ( #5120 )
2025-01-20 18:05:38 +01:00
Hassieb Pakzad and GitHub
4cb5af71d3
fix(ingestion): allow nullish tokens_details in openai usage schema ( #5117 )
2025-01-20 18:03:51 +01:00
steffen911
7111ebfbeb
chore: release v3.11.1
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-01-20 17:02:28 +01:00
Steffen Schmitz and GitHub
a9506b40ab
fix: allow field overwrites with null in ingestion api ( #5114 )
...
* fix: allow field overwrites with `null` in ingestion api
* chore: add undefined check
* chore: check undefined does not overwrite value
* chore: explicit undefined check
2025-01-20 15:24:09 +00:00
Max Deichmann
3cd82c97cf
chore: release v3.11.0
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-01-20 15:49:51 +01:00
Max Deichmann and GitHub
f55bee2d36
fix: route all links to new observations table ( #5112 )
2025-01-20 15:32:54 +01:00
Max Deichmann and GitHub
5391dd90f4
fix: correct the rate limiter header return types ( #5111 )
2025-01-20 15:16:56 +01:00
Max Deichmann and GitHub
a1e670a729
feat: convert generations to observations table ( #5099 )
...
* feat: convert generations to observations table
* feat: add type col to generations table
* feat: add type col to generations table
* feat: add type col to generations table
* feat: add type col to generations table
* feat: add type col to generations table
* fix: fix
2025-01-20 13:40:41 +00:00
Max Deichmann and GitHub
b6e21fc44b
fix: return 404 error instead of 500 for not found observations trpc … ( #5105 )
...
fix: return 404 error instead of 500 for not found observations trpc route
2025-01-19 14:23:15 +01:00
Max Deichmann and GitHub
eb59082bf7
fix: flaky session export test ( #5103 )
2025-01-18 19:03:57 +00:00
Max Deichmann
950f36b87d
chore: release v3.10.0
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2025-01-18 19:55:56 +01:00
Max Deichmann and GitHub
c55b70d119
fix: fix session ui table ordering ( #5102 )
2025-01-18 19:55:26 +01:00
Marc Klingen and GitHub
c1109c91f1
feat(ui): single user view, simpler metrics, link to dashboard ( #5097 )
2025-01-17 21:14:42 +00:00
Marc Klingen and GitHub
3b737934f9
chore(cloud): run analytics jobs daily ( #5096 )
2025-01-17 18:14:22 +00:00
Steffen Schmitz and GitHub
a12f3f675e
fix: update ordering for get traces calls to avoid stale results ( #5090 )
...
* fix: update ordering for get traces calls to avoid stale results
* chore: explanation
* chore: remove stale test
* chore: lint
* chore: update comment
* chore: cleanup
2025-01-17 16:30:07 +00:00
Marc Klingen and GitHub
30d5755c24
fix(ui): support menu button width ( #5094 )
...
push
2025-01-17 15:04:49 +00:00
Marc Klingen and GitHub
39762cb1c0
feat(cloud): export billing meter backup to s3 ( #5091 )
2025-01-17 15:22:41 +01:00
marliessophie and GitHub
8ac4176aaf
feat(datasets): upload dataset via csv import ( #4656 )
...
* fixup: add csv import for datasets
* feat: include DnD logic
* add: fastest-levenshtein dep
* fixup: upload & parse .csv file
* fixup: uploading file
* fix: allow uploading .csv file
* chore: add csv-parse
* eslint
* chore: include project id in temp storage logic
* chore: access checks
* push
* chore: use s3 signed url to upload .csv file temporarily
fixup: env credentials
* deps: fix circular dep
* fixup
* create import bucket for uploads
* push
* push
* push
* remove s3 config for import
* remove server side processing
* fix: metadata display for items
* style: fix css styling and add progress bar
* push
* push
* push
* refactor: extract helper function
* wrap in try catch block
* fix: button logic in case of no access
* analytics: add posthog events
2025-01-17 13:51:25 +00:00
marliessophie and GitHub
f87af4f675
feat(model): add playground and eval support for gemini-2.0-flash-exp ( #5087 )
2025-01-17 13:19:06 +00:00
Max Deichmann
bc323772c1
chore: release v3.9.0
2025-01-17 12:26:06 +01:00
Marc Klingen and GitHub
fcef737dc0
feat(cloud): snapshot usage metering to postgres db ( #5075 )
2025-01-17 12:13:46 +01:00
marliessophie and GitHub
4bf77d68ed
feat(model): add support for o1 model costs ( #5073 )
...
* feat(model): add support for o1 model costs
* order cost list by ID
* push
* update contributing
* push
2025-01-17 10:23:25 +00:00
Steffen Schmitz and GitHub
d7ec924ed8
chore: remove outdated postgres executions ( #5069 )
2025-01-17 11:10:20 +01:00
Marc Klingen and GitHub
cefaf56613
chore(cloud): region details ( #5080 )
2025-01-17 00:18:00 +01:00
Max Deichmann and GitHub
6aff9b0f4a
fix: quickly recover from metering queue errors ( #5077 )
...
fix: quickly reciver from metering queue errors
2025-01-16 22:11:55 +01:00
Max Deichmann and GitHub
815de149aa
fix: retry stripe apis ( #5076 )
...
push
2025-01-16 21:57:05 +01:00
Max Deichmann and GitHub
bc8923485e
fix: add race condition check to billing queue ( #5074 )
2025-01-16 20:40:59 +01:00
Max Deichmann and GitHub
1a60425692
fix: retry stripe in metering logic and meter again if error ocurred ( #5072 )
2025-01-16 19:42:10 +01:00
marliessophie and GitHub
1d3ac98123
style(ui): improve observation type label colors for readbility, accessibility ( #5071 )
...
* style(ui): adjust muted colors for readbility, accessibility
* style(ui): adjust comment labels given type
* margins
* push
2025-01-16 16:27:47 +00:00
Max Deichmann and GitHub
de67ec1a02
chore: add cloud meter event trigger ( #5068 )
...
* push
* push
* feat: add metering event
2025-01-16 15:22:59 +00:00
marliessophie and GitHub
9510995a67
fix(ui-tables): populate filter operator by default ( #5067 )
2025-01-16 14:21:48 +00:00
Marc Klingen and GitHub
4623d76155
fix(cloud): remove race condition check in metering cron job ( #5066 )
2025-01-16 11:31:00 +01:00
Steffen Schmitz and GitHub
6a6abc6bd8
chore: skip zod parse for json parsing ( #5063 )
...
* chore: skip zod parse for json parsing
* chore: lint
* chore: add JsonNested type
* chore: add one more test for invalid json
2025-01-16 09:32:41 +00:00
Max Deichmann and GitHub
ddee827e22
chore: update architecture diagram ( #5055 )
2025-01-15 22:07:16 +00:00
Max Deichmann and GitHub
e327db8bbd
chore: correct data region ( #5054 )
2025-01-15 22:01:58 +00:00
Max Deichmann and GitHub
9229d759e1
chore: add project_id to get clickhouse query ingestion ( #5051 )
2025-01-15 20:09:53 +01:00
Hassieb Pakzad and GitHub
d8d8ab7060
fix(jump-to-playground): hide button if message parsing will fail ( #5048 )
2025-01-15 16:55:58 +01:00
Steffen Schmitz and GitHub
b851359923
chore: remove legacy v3-migration env variables ( #5041 )
...
* chore: remove legacy v3-migration env variables
* chore: linting
* chore: move legacy files to current env
* chore: remove outdated tests
* chore: add async ingestion test
* chore: reduce delay for tests
* chore: lint
* chore: skip scores and enable redis on CI
* chore: remove outdated test classes
2025-01-15 15:39:20 +00:00
marliessophie and GitHub
b36ea74314
fix(ui-annoation): bug when re-submitting score comments on categorical scores ( #5045 )
...
fix(ui-annoation): re-submit score comments on categorical scores
2025-01-15 15:12:46 +00:00
Hassieb Pakzad and GitHub
b2f103549a
feat(trace-tree-iu): add hint for hidden obs ( #5044 )
2025-01-15 14:47:39 +01:00
marliessophie and GitHub
f660b80438
style(ui-tables): fix position of No results. text if table has no data ( #5043 )
...
* style(ui-tables): fix position of `No results.` text if table has no data
* fix: dom nesting
2025-01-15 13:18:23 +00:00
Steffen Schmitz and GitHub
5bbfffef50
chore: allow any value for input/output in ingestion endpoint ( #5040 )
...
* chore: allow any value for input/output in ingestion endpoint
* chore: add explanation
2025-01-15 10:36:13 +00:00
Hassieb Pakzad and GitHub
cb6f95dc93
feat(trace-detail-ui): filter by minObservationlvl ( #5039 )
2025-01-15 11:40:57 +01:00
Max Deichmann
8345ce48fc
chore: release v3.8.0
2025-01-15 10:26:15 +01:00
Max Deichmann and GitHub
f71d28900a
perf: use streaming for observation and trace list endpoints ( #5038 )
...
push
2025-01-15 10:25:28 +01:00
Hassieb Pakzad and GitHub
14eaf62e45
fix(ingestion): overwriting of observation level ( #5027 )
2025-01-15 09:43:41 +01:00
Steffen Schmitz and GitHub
f8e61c2659
chore: fallback to error.status for eval error handling ( #5037 )
2025-01-15 07:40:36 +00:00
marliessophie and GitHub
3b205b45ce
chore(ui-dashboard): save selected score graphs in the dashboard to localStorage (project-bound) ( #5029 )
...
* chore(ui-dashboard): save selected score graphs in the dashboard to `localStorage` (project-bound)
* add comment
* push
2025-01-14 19:14:17 +00:00
Max Deichmann and GitHub
7260c44486
fix: correctly order sessions by time ( #5028 )
...
* fix: correctly order sessions by time
* fix: correctly order sessions by time
* fix: correctly order sessions by time
2025-01-14 19:00:53 +00:00
marliessophie and GitHub
92ec2b60e2
feat(ui-tabels): Count of group selection on column visibility ( #5024 )
2025-01-14 16:26:01 +00:00
Steffen Schmitz and GitHub
a856488f2d
chore: upgrade bullmq to 5.34.10 ( #5022 )
...
* chore: upgrade bullmq to 5.34.10
* chore: adjust tests
2025-01-14 13:59:55 +00:00
Steffen Schmitz and GitHub
a18f09fd8d
fix: process status codes on eval execution errors ( #5013 )
...
* fix: process status codes on eval execution errors
* chore: error handling
2025-01-14 12:29:44 +00:00
Hassieb Pakzad and GitHub
2a95dd1da0
fix(openapi-models): modelusageunit to optional ( #5015 )
2025-01-14 10:25:07 +01:00
Hassieb Pakzad and GitHub
04ebd5994f
fix(fern-models): unit to optional commons.model ( #5014 )
2025-01-14 10:22:32 +01:00
Hassieb Pakzad and GitHub
268b741a3a
chore(models): update fern types startDate unit ( #5004 )
2025-01-13 19:53:41 +01:00
Steffen Schmitz and GitHub
8b686e9b31
fix: fail open on redis errors in ratelimitservice ( #5001 )
2025-01-13 17:29:17 +00:00
Max Deichmann
e802a5c23a
chore: release v3.7.1
2025-01-13 14:39:24 +01:00
Max Deichmann and GitHub
5180e2382e
fix: drop dataset run item temp tables from all CH nodes ( #4999 )
2025-01-13 14:38:11 +01:00
Max Deichmann and GitHub
2cae1253d3
fix: fix session table sorting ( #4995 )
...
* fix: fix session table sorting
* push
2025-01-13 12:18:37 +00:00
Clemo and GitHub
be2414a82c
docs: fix typo
2025-01-13 10:54:43 +01:00
Clemo and GitHub
95e63c6f78
docs: Update careers
2025-01-13 10:53:54 +01:00
Marc Klingen
32b6502d13
chore: release v3.7.0
2025-01-12 09:59:41 +01:00
Marc Klingen and GitHub
1bc33c7b92
fix: telemetry error "invalid input syntax for type interval" ( #4991 )
2025-01-12 09:57:46 +01:00
Marc Klingen and GitHub
4967b20478
fix(ui): support menu forwardref error, memo list of options, keys for separators ( #4989 )
...
fix(ui): support menu forwardref error
2025-01-12 03:33:37 +00:00
Marc Klingen and GitHub
1130894cdc
chore: remove old launch week notifications ( #4986 )
2025-01-12 03:18:13 +00:00
Marc Klingen and GitHub
af276e9e78
feat(cloud): add banner for status page announcement ( #4988 )
...
* wip
* fix(ui): "chatisvisble not a function"
* csp
* feat(cloud): add banner for status page announcement
2025-01-12 03:17:45 +00:00
Marc Klingen and GitHub
d69dbd81a2
fix(ui): chatIsVisible rendering issues ( #4987 )
...
fix(ui): "chatisvisble not a function"
2025-01-12 02:43:25 +00:00
Marc Klingen and GitHub
7e807c0de8
feat(annotation-queue): show "add to dataset" button on trace preview ( #4985 )
2025-01-12 02:24:57 +00:00
Marc Klingen and GitHub
cfa2ac6da9
chore(ui): improve button labels for playground and experiments on prompt view ( #4984 )
2025-01-12 02:11:49 +00:00
Marc Klingen and GitHub
952a550847
feat(ui): add support dropdown menu to replace /support page ( #4983 )
2025-01-12 02:05:46 +00:00
Marc Klingen and GitHub
6199903117
chore(ui): add descriptions to the setup onboarding flow ( #4982 )
2025-01-12 00:00:19 +00:00
Marc Klingen and GitHub
88cdb8999d
chore(ui): do not collapse chat messages on prompt view ( #4981 )
2025-01-11 23:48:35 +00:00
9ad2ef1f91
fix(ui): docs menu item should open in new tab ( #4980 )
...
* fix(ui): docs menu item should open in new tab
* Update web/src/components/nav-main.tsx
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-01-11 21:11:37 +00:00
Marc Klingen and GitHub
7a9717cb5e
chore(ui): remove introducing orgs banner ( #4979 )
2025-01-11 20:59:51 +00:00
Marc Klingen and GitHub
ce31a806c7
chore(cloud): improve ui of cloud region selection, remove login error notice ( #4978 )
...
chore(cloud): imrpove ui of cloud region selection, remove login error notice
2025-01-11 18:03:20 +00:00
Max Deichmann and GitHub
e7e6cf1b99
feat: script to replay missing events ( #4966 )
...
* feat: script to replay missing events
* feat: script to replay missing events
2025-01-10 15:40:49 +00:00
Steffen Schmitz and GitHub
9f76457f22
chore: stream clickhouse results to posthog to reduce memory consumption ( #4967 )
...
* chore: stream clickhouse results to posthog to reduce memory consumption
* chore: end span after streaming all results
* chore: tracing for clickhouse streaming
2025-01-10 13:42:03 +00:00
Marc Klingen
c79c84ea96
chore: release v3.6.2
2025-01-10 14:49:19 +01:00
Hassieb Pakzad and GitHub
4634669fcd
chore(docker-compose): add ingestion env vars ( #4969 )
2025-01-10 14:47:25 +01:00
Marc Klingen and GitHub
549e0eb629
chore: daily instead of hourly telemetry ( #4968 )
2025-01-10 14:10:51 +01:00
Steffen Schmitz and GitHub
80adf63fe6
fix: adjust deletion order for apikey invalidation on project delete ( #4964 )
2025-01-10 10:24:26 +00:00
Hassieb Pakzad
6c1d7534bb
chore: release v3.6.1
2025-01-10 09:15:57 +01:00
Max Deichmann and GitHub
23a4bbd2cb
fix: fix trace exports ( #4958 )
...
* fix: fix trace exports
* push
* fix: fix trace exports
2025-01-09 19:36:07 +00:00
Steffen Schmitz and GitHub
07d048d46f
chore: enable clickhouse cluster mode by default ( #4956 )
2025-01-09 16:32:55 +00:00
Hassieb Pakzad and GitHub
bd7226bbb8
fix(pubic-api): observations and traces FINAL ( #4951 )
2025-01-09 17:41:35 +01:00
Steffen Schmitz and GitHub
fe70d92211
chore: set created_at in ClickHouse based on min S3 timestamp ( #4955 )
...
* chore: set created_at in ClickHouse based on min S3 timestamp
* chore: fix worker tests
2025-01-09 16:12:23 +00:00
Max Deichmann and GitHub
bb3621f31d
fix: sessions metrics api performance ( #4954 )
2025-01-09 17:15:30 +01:00
Steffen Schmitz and GitHub
63225a9fd6
chore: accept projectId list which skips clickhouse reads during ingestion ( #4952 )
2025-01-09 14:13:23 +00:00
Max Deichmann and GitHub
947da9cc84
fix: sessions table id filter ( #4953 )
2025-01-09 14:33:09 +01:00
Max Deichmann and GitHub
93a0ab6f3a
fix: remove trace tracesession fk ( #4946 )
...
* fix: remove trace tracesession fk
* push
* push
* push
* fix: remove trace tracesession fk
* fix: remove trace tracesession fk
* fix: remove trace tracesession fk
2025-01-09 09:50:58 +00:00
Hassieb Pakzad and GitHub
68ad079d8c
fix(models-table): sorting across pages ( #4947 )
2025-01-09 10:30:00 +01:00
Max Deichmann and GitHub
cf29c6b7e4
feat: backup redis queues to postgres ( #4943 )
...
feat: backup redis queuer
2025-01-08 23:15:03 +00:00
Max Deichmann and GitHub
e4d2a5ec6c
perf: improve session all time search performance ( #4926 )
...
* push
* fix: correctly export categorical scores for trace exports
* fixes
* push
* Merge branch 'max/lfe-3345-fix-session-table-all-time-search' of https://github.com/langfuse/langfuse into max/lfe-3345-fix-session-table-all-time-search
* fix
* fixes
2025-01-08 16:54:01 +00:00
Steffen Schmitz and GitHub
35f3092a1c
feat: retry 429 errors for eval executions for up to 24h ( #4933 )
...
* feat: retry 429 errors for eval executions for up to 24h
* chore: skip type error retries for eval execution
2025-01-08 14:51:36 +00:00
Hassieb Pakzad and GitHub
7b222318e1
chore(cost): add langchain-compatible price keys ( #4932 )
2025-01-08 15:49:21 +01:00
Steffen Schmitz and GitHub
d9c077ea56
chore: add BUILD_ID to otel setup and exclude health from tracing ( #4930 )
...
* chore: add BUILD_ID to otel setup
* chore: remove comment
2025-01-08 13:17:00 +00:00
Hassieb Pakzad and GitHub
1ec7325b85
feat(models): lastUsed column to full lookback ( #4931 )
2025-01-08 14:21:07 +01:00
Steffen Schmitz and GitHub
96b2127f36
chore: reduce number of parsing iterations for observations and traces ( #4927 )
...
* chore: reduce number of parsing iterations for observations and traces
* chore: lint
2025-01-08 12:36:37 +00:00
Max Deichmann and GitHub
d3c2b8cf27
fix: correctly export categorical scores for trace exports ( #4928 )
...
* fix: correctly export categorical scores for trace exports
* push
2025-01-08 11:31:50 +00:00
Hassieb Pakzad and GitHub
beeef222e4
feat(models): sort models table by lastUsed ( #4925 )
2025-01-08 12:06:57 +01:00
steffen911
ee376f9cad
chore: release v3.6.0
2025-01-07 14:43:35 +01:00
c8936ec68d
feat: add CLICKHOUSE_DB support ( #4911 )
...
* take CLICKHOUSE_DB environment variable into account
Fixes : #4888
Signed-off-by: Aleksandar Pesic <peske.nis@gmail.com >
* chore: cleanup env usage
* chore: extend env.prod.example
---------
Signed-off-by: Aleksandar Pesic <peske.nis@gmail.com >
Co-authored-by: Aleksandar Pesic <peske.nis@gmail.com >
2025-01-07 13:18:03 +00:00
Max Deichmann and GitHub
8d8170c62c
security: prevent prototype pollution in dataset compare view ( #4910 )
2025-01-07 12:15:33 +00:00
Max Deichmann and GitHub
72e1a43192
security: upgrade nanoid ( #4909 )
2025-01-07 11:47:31 +00:00
Hassieb Pakzad and GitHub
a842625bd1
chore(media): increase rate-limit to use ingestion budget ( #4907 )
2025-01-07 11:42:07 +01:00
Max Deichmann and GitHub
890a542759
fix: do not error on 403 by model provider for eval executions ( #4905 )
...
* fix: do not error on 403 by model provider
* push
2025-01-07 10:23:58 +00:00
Steffen Schmitz and GitHub
1e8af5b821
chore: move sessions, traces, comments router logs to logger ( #4902 )
...
* chore: move sessions router logs to logger
* chore: adjust traces and comments
2025-01-07 07:45:44 +00:00
Hassieb Pakzad and GitHub
d3f3f354db
fix(models): allow string tokenizer config ( #4898 )
2025-01-06 16:24:49 +01:00
steffen911
18a7cb6684
chore: release v3.5.3
2025-01-06 13:43:19 +01:00
Steffen Schmitz and GitHub
2d70ca574e
chore: skip existence check for score deletion ( #4896 )
...
* chore: skip existence check for score deletion
* chore: lint
2025-01-06 11:03:51 +00:00
Steffen Schmitz and GitHub
1c980c78dd
fix: use singular unit in clickhouse datediff for 23.x support ( #4894 )
2025-01-06 10:35:53 +00:00
5170718aad
fix(prompt-experiments): do not restrict to evalModelsOnly in order to use anthropic, bedrock, vertex ( #4872 )
...
* fix(prompt-experiments): do not restrict to evalModelsOnly in order to use anthropic, bedrock, vertex
* chore(cloud): disable deletion of traces via UI as it caused performance issues (#4873 )
chore(cloud): disable deletion of traces via the UI as it caused performance issues
* docs: add link to data model documentation to api reference of ingestion endpoint (#4877 )
* fix: use database upserts correctly (#4884 )
* fix: use database upserts correctly
* fix: use database upserts correctly
* push
* fix: use database upserts correctly
* fix: use database upserts correctly
* push
* fix: use database upserts correctly
* chore(deps): bump next from 14.2.15 to 14.2.21 (#4887 )
Bumps [next](https://github.com/vercel/next.js ) from 14.2.15 to 14.2.21.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.15...v14.2.21 )
---
updated-dependencies:
- dependency-name: next
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore: release v3.5.2
* chore: remove postgres from ingestion merge (#4467 )
* chore: remove postgres from ingestion merge
* chore: remove pg tests
* chore: remove postgres tracing
* remove evalModelsOnly
---------
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
Co-authored-by: Hassieb Pakzad <68423100+hassiebp@users.noreply.github.com >
2025-01-06 10:29:57 +00:00
Steffen Schmitz and GitHub
a01c27f4cc
chore: remove postgres from ingestion merge ( #4467 )
...
* chore: remove postgres from ingestion merge
* chore: remove pg tests
* chore: remove postgres tracing
2025-01-06 09:29:26 +00:00
Max Deichmann
51354e6c6d
chore: release v3.5.2
2025-01-06 10:34:55 +01:00
10dd50cff0
chore(deps): bump next from 14.2.15 to 14.2.21 ( #4887 )
...
Bumps [next](https://github.com/vercel/next.js ) from 14.2.15 to 14.2.21.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.15...v14.2.21 )
---
updated-dependencies:
- dependency-name: next
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-06 09:19:47 +00:00
Max Deichmann and GitHub
d8783f8698
fix: use database upserts correctly ( #4884 )
...
* fix: use database upserts correctly
* fix: use database upserts correctly
* push
* fix: use database upserts correctly
* fix: use database upserts correctly
* push
* fix: use database upserts correctly
2025-01-03 21:45:56 +00:00
Marc Klingen and GitHub
16a572f51d
docs: add link to data model documentation to api reference of ingestion endpoint ( #4877 )
2025-01-02 21:10:26 +00:00
Marc Klingen and GitHub
947641cbbf
chore(cloud): disable deletion of traces via UI as it caused performance issues ( #4873 )
...
chore(cloud): disable deletion of traces via the UI as it caused performance issues
2025-01-02 19:03:40 +01:00
Marc Klingen and GitHub
249e161473
chore: remove beta label from evaluation menu ( #4871 )
2025-01-02 15:14:32 +00:00
Marc Klingen and GitHub
90bab4386f
fix(ui): improve /trace/:id redirect when trace is accessed while still being processed ( #4868 )
2025-01-02 13:51:56 +00:00
Max Deichmann and GitHub
33fddb1344
fix: support large amount of traces for sessions in session.byid ( #4847 )
2024-12-29 21:42:50 +00:00
Hassieb Pakzad and GitHub
c24dcb068a
fix(legacy-ingestion): usageDetails support ( #4841 )
2024-12-27 10:11:24 +01:00
Max Deichmann and GitHub
2986723254
fix: ensure idemptence of project deletion queue ( #4831 )
2024-12-24 11:49:29 +00:00
Max Deichmann and GitHub
b45b2fd8f8
chore: clean up error message bullmq endpoint ( #4826 )
2024-12-23 21:09:57 +00:00
Marc Klingen
8936fb4ad9
chore: release v3.5.0
2024-12-23 17:39:13 +01:00
Marc Klingen and GitHub
7d7e25b39c
fix: use clickhouse for tracing usage stats ( #4825 )
2024-12-23 17:07:50 +01:00
Marc Klingen and GitHub
138d2f1c09
feat(ui): switch to github discussions and issues for in-product feedback ( #4822 )
2024-12-21 14:16:27 +01:00
Steffen Schmitz and GitHub
51595eb15d
chore: export core information tables to S3 daily ( #4821 )
2024-12-21 12:23:10 +00:00
Marc Klingen and GitHub
6ee68cf508
chore: posthog integration out of beta ( #4820 )
...
chore: Posthog integration out of Beta
2024-12-21 12:03:30 +00:00
Marc Klingen and GitHub
308513e644
chore(ui): remove dateRangeFilter on prompt metrics table as no longer necessary on CH ( #4818 )
...
* chore(ui): remove dateRangeFilter on prompt metrics table as no longer necessary on CH
* fix lint
2024-12-21 11:49:03 +00:00
Marc Klingen and GitHub
155543bc93
feat(ui): enable the creation of a new LLM connection from the LLM selection dropdown ( #4819 )
...
feat(ui): allow to create new llm connection from llm selection dropdown
2024-12-21 11:46:34 +00:00
Marc Klingen and GitHub
8f961925d5
feat(ui): add export status table to project settings ( #4816 )
2024-12-21 04:38:03 +01:00
Marc Klingen and GitHub
7ddc844d7d
fix(ui): clarify what applying producation label to a new prompt does ( #4812 )
...
* fix(ui): clarify what applying producation label to a new prompt does
* fix lint and copy
2024-12-21 01:54:52 +00:00
Marc Klingen and GitHub
5381c5f19b
feat(cloud): improve open/close state of support chat ( #4815 )
...
chore(cloud): hide chat by default, show when opened manually or on incoming/unread messages, persist in session storage
2024-12-21 01:40:39 +00:00
Marc Klingen
dcd6060665
chore: release v3.4.0
2024-12-20 22:41:08 +01:00
Chris Tran and GitHub
0bfba7d690
feat(auth): add AUTH_CUSTOM_CLIENT_AUTH_METHOD to support PKCE code flow ( #4810 )
2024-12-20 22:34:02 +01:00
Hassieb Pakzad
25b363e1bc
chore: fix eslint error
2024-12-20 18:54:34 +01:00
Hassieb Pakzad and GitHub
0de37b0437
feat(models): add UI to add all usage types ( #4802 )
2024-12-20 18:49:44 +01:00
Max Deichmann and GitHub
ab5febb9c7
fix: include time filter into user metrics query ( #4808 )
...
* fixes: fix user table sorting and filters
* fixes: fix user table sorting and filters
* fixes: fix user table sorting and filters
2024-12-20 15:59:11 +00:00
marliessophie and GitHub
0e5cade9e7
chore(ui): toggle json editor for text prompts ( #4807 )
2024-12-20 15:22:28 +00:00
Max Deichmann and GitHub
1438e052df
fix: fix json parsing of trace / observation i/o ( #4805 )
...
* remove only
* push
* remove only
2024-12-20 12:54:47 +00:00
Max Deichmann and GitHub
9917aff8cf
fix: add latencies to trace exports ( #4804 )
...
* fix: add latencies to trace exports
* remove only
2024-12-20 12:23:52 +00:00
marliessophie and GitHub
c915c2b678
chore(ui): move dataset details into popover on runs table ( #4801 )
...
* chore(ui): move dataset details into popover on runs table
* push
2024-12-20 11:41:38 +00:00
marliessophie and GitHub
50379bd4b5
feat(datasets): support charts for scores and resource metrics ( #4754 )
...
* fixup: dataset run analytics; compare
* refactor: extract common timeseries component
* push
* fix: proper limit and offset settings
* chore: extend route to accept run ids
* eslint
* chore: order chart data ASC
* styles
* push
* push
* style: adjust multi-select component
* push
* push
* push
2024-12-20 10:14:37 +00:00
Marc Klingen and GitHub
8fd93ecff9
fix(cloud): remove unnecessary posthog events ( #4798 )
2024-12-20 01:59:39 +01:00
Max Deichmann and GitHub
046c6c6125
fix: fix tests ( #4797 )
2024-12-20 00:04:31 +01:00
Max Deichmann and GitHub
ba750a2d55
fix: fix time to first token in trace detail view ( #4796 )
2024-12-19 23:41:40 +01:00
Marc Klingen
485120806e
chore: release v3.3.0
2024-12-19 22:02:50 +01:00
87acc4f7f3
feat: redirect ingestion traffic for specific projects to secondary queue ( #4792 )
...
* feat: redirect specific projects to secondary ingestion queue
* feat: redirect specific projects to secondary ingestion queue
* push
* Update worker/src/queues/ingestionQueue.ts
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
* push
* push
---------
Co-authored-by: Steffen Schmitz <steffen@langfuse.com >
2024-12-19 16:06:20 +00:00
Steffen Schmitz and GitHub
21b1faa21b
fix: adjust clickhouse type mapping for session duration filter ( #4791 )
2024-12-19 13:04:39 +00:00
Max Deichmann and GitHub
76cfaf1069
chore: measure lookup hits in ingestion pipeline ( #4787 )
2024-12-19 10:20:10 +01:00
dbe808d520
feat(auth): add AUTH_IGNORE_ACCOUNT_FIELDS to sanitize IDP fields before creating an account ( #4728 )
...
* feat: Field sanitization before creating an Account
* add comments
---------
Co-authored-by: Marc Klingen <git@marcklingen.com >
2024-12-18 23:26:56 +00:00
6c977429c2
chore(deps-dev): bump tailwindcss from 3.4.13 to 3.4.17 ( #4784 )
...
Bumps [tailwindcss](https://github.com/tailwindlabs/tailwindcss ) from 3.4.13 to 3.4.17.
- [Release notes](https://github.com/tailwindlabs/tailwindcss/releases )
- [Changelog](https://github.com/tailwindlabs/tailwindcss/blob/v3.4.17/CHANGELOG.md )
- [Commits](https://github.com/tailwindlabs/tailwindcss/compare/v3.4.13...v3.4.17 )
---
updated-dependencies:
- dependency-name: tailwindcss
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-18 23:24:43 +00:00
Marc Klingen and GitHub
c42c6a0f91
chore: do not add latest, major, and major.minor tags to docker images of -rc versions ( #4781 )
2024-12-18 21:37:46 +01:00
Max Deichmann and GitHub
f14b69f68d
chore: add attributes to ingestion queue processing ( #4779 )
...
git push
2024-12-18 19:54:32 +00:00
marliessophie and GitHub
dd892459a4
chore(ui): order score names alphabetically in dropdowns ( #4776 )
...
* chore(ui): order score names alphabetically in dropdowns
* push
2024-12-18 16:40:04 +00:00
Marc Klingen and GitHub
3488b5c443
docs: Update README.md
2024-12-18 03:51:09 +01:00
Max Deichmann and GitHub
6e0f4483b4
chore: increase rate limits ( #4751 )
2024-12-17 15:55:18 +00:00
Marc Klingen and GitHub
b5d9fb3e63
chore(cloud): remove posthog metrics cron job ( #4753 )
2024-12-17 15:52:42 +00:00
Marc Klingen and GitHub
e087da6b6e
docs: update README.md
2024-12-17 12:53:21 +01:00
Marc Klingen and GitHub
ea8734d709
docs: update readme ( #4749 )
2024-12-17 12:49:14 +01:00
Hassieb Pakzad and GitHub
9cf4e57da1
fix(dashboard-modelUsage): none model name handling ( #4748 )
2024-12-17 10:52:36 +01:00
Marc Klingen and GitHub
292501b6dd
feat(ui): add organizations menu item link for all global pages ( #4741 )
2024-12-16 20:46:57 +00:00
Hassieb Pakzad and GitHub
2a1424e4d0
fix(dashboard-modelUsage): NaN handling on totals ( #4738 )
2024-12-16 18:28:19 +01:00
steffen911
fd37e2c35e
chore: release v3.2.0
2024-12-16 18:04:14 +01:00
marliessophie and GitHub
0352e7fad6
chore(annotation): return previous score props in delete method ( #4737 )
...
chore: return previous annotation score in delete method
2024-12-16 16:47:37 +00:00
Hassieb Pakzad and GitHub
6c4482ff56
feat(cost-tracking): allow additional cost and usage keys ( #4536 )
2024-12-16 17:30:24 +01:00
marliessophie and GitHub
cc62b32b82
fix(annotation): fail postgres upsert, delete silentley while Clickhouse is in lead ( #4733 )
...
* fix(annotation): fail postgres upsert, delete silentley while Clickhouse is in lead
* chore: disable deletion of score while update operation is in progress
2024-12-16 14:40:04 +00:00
Steffen Schmitz and GitHub
b421c2dec5
feat: add posthog integration processing ( #4685 )
...
* feat: add posthog integration processing
* chore: add times for query optimization
* chore: cleanups
* chore: remove unused join
* chore: run posthog integration every hour
* chore: rename to langfuse_event_version
* chore: add date workaround for initial sync
* chore: query updates
* chore: remove scheduling info
2024-12-16 13:43:07 +00:00
Marc Klingen and GitHub
3a67533ac8
feat(ui): new experiment modal to highlight prompt and custom experiments ( #4731 )
...
* feat(ui): new experiment modal to highlight prompt and custom experiments
* push
* fix lint
* fix lint
2024-12-16 12:00:22 +00:00
steffen911
21303a275a
chore: release v3.1.1
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2024-12-16 11:03:21 +01:00
Steffen Schmitz and GitHub
284494c62a
fix: use correct golang-migrate in build ( #4729 )
...
* fix: use correct golang-migrate in build
* chore: skip docker push
* chore: run docker build right away
* chore: add args for targetplatform and buildplatform
* chore: add TARGETPLATFORM args
2024-12-16 09:44:58 +00:00
Marc Klingen and GitHub
b37ec03483
fix(ui): redirect after org/project deletion when using custom base path ( #4727 )
2024-12-16 09:18:53 +00:00
Steffen Schmitz and GitHub
a49a410a04
chore: remove filterlist console log ( #4718 )
2024-12-13 15:48:09 +00:00
Steffen Schmitz and GitHub
1e9d8de305
fix: rate limit deletions globally to 1 per 3s ( #4715 )
2024-12-13 10:09:53 +00:00
Marc Klingen and GitHub
0fa88aea57
feat: in HF Spaces, prompt opening in new tab when running in iframe ( #4713 )
2024-12-13 02:41:37 +01:00
Max Deichmann and GitHub
61240d7c92
fix: fix pagination on public api ( #4710 )
...
* fix: fix pagination
* fix: fix pagination
* fix: fix pagination
* fix: fix pagination
* fix: fix pagination
* fix: fix pagination
2024-12-12 23:02:46 +00:00
marliessophie and GitHub
d54c888cd9
chore(evals/experiments): support retries via bullmq; set 2 minute LLM call completion timeouts ( #4709 )
...
* chore(eval/experiments): support job retries via bullmq instead of within worker
* chore: timeout model completion calls after 2 minutes
* chore: set retries on llm completion calls to 1
* chore: do not propogate expected error cases in experiment creation
* eslint
2024-12-12 20:53:56 +00:00
Max Deichmann and GitHub
b87a00fa03
fix: do not fetch dataset run items which are not active ( #4708 )
...
* fix
* fix
* push
* fix
2024-12-12 20:31:43 +00:00
marliessophie and GitHub
8b8d1086e5
fix(organizations): block org deletion in case of active projects ( #4707 )
...
* fix(organizations): block org deletion in case of active projects
* chore: count soft and hard deleted projects as
2024-12-12 19:23:27 +00:00
Max Deichmann and GitHub
d88902316b
fix: fix level filter on trace upsert queue ( #4704 )
2024-12-12 15:40:47 +01:00
Steffen Schmitz and GitHub
5dd5adf850
fix: use clickhouse for failIfRecentEvent condition in healthcheck ( #4701 )
2024-12-12 12:22:19 +00:00
Max Deichmann
a56246059c
chore: release v3.1.0
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2024-12-12 13:34:26 +01:00
Max Deichmann and GitHub
833f4165ce
chore: improve naming for observations by level chart ( #4700 )
...
* feat: add observations status chart
* fix: improve naming for observations by level chart
2024-12-12 12:20:18 +00:00
Max Deichmann and GitHub
ebe0c034fd
security: upgrade next-auth ( #4690 )
...
* upgrade next-auth
* push
* eval execution time
2024-12-12 12:14:33 +00:00
Max Deichmann and GitHub
64492f3002
feat: add observations status chart ( #4697 )
2024-12-12 12:56:53 +01:00
Max Deichmann and GitHub
27faebe244
chore: improve trace export tests ( #4694 )
2024-12-12 10:15:37 +00:00
Marc Klingen and GitHub
5e681e5a6d
feat(ui): add editable note for each api key ( #4686 )
...
* feat(ui): add editable note for each api key
* fix access scopes
2024-12-11 16:51:17 +00:00
marliessophie and GitHub
8af88a0cec
fix(playground): Model side menu in playground not scrollable ( #4687 )
2024-12-11 16:48:18 +00:00
marliessophie and GitHub
1770579fa6
feat(annotation): optimistic updates on annotation form ( #3859 )
...
* wip: optimistic updates on annotation form
* refactor to handle sequence of create, update operations correctly
* fix: don't check postgres for score existence when running on clickhouse
* disable annotation button while score updates are saving
* fix: await for all mutations to complete before opening modal again
* rm console log
* fix: update api response clickhouse
2024-12-11 12:39:05 +00:00
Max Deichmann and GitHub
273d29c383
fix: export i/o for traces ( #4673 )
2024-12-10 16:21:08 +01:00
marliessophie and GitHub
0047a3dec6
fix(experiments): don't require name in experiment creation ( #4659 )
...
* fix(experiments): don't require name in experiment creation
* push
* push
* push
* push
2024-12-10 15:00:15 +00:00
Hassieb Pakzad and GitHub
b63aeeeae7
fix(vertex): at least 1 user message always ( #4666 )
2024-12-10 10:46:17 +01:00
Marc Klingen and GitHub
f5dc7eea07
docs: update upgrade guide url in entrypoint ( #4655 )
2024-12-09 13:36:27 +00:00
Steffen Schmitz and GitHub
8560a10e53
fix: handle non-existent projects gracefully on delete ( #4654 )
...
* fix: handle non-existent projects gracefully on delete
* chore: return early on project does not exist
2024-12-09 13:14:20 +00:00
Marc Klingen and GitHub
609a330c37
chore: update default docker compose to use 3 docker tag ( #4653 )
2024-12-09 13:31:58 +01:00
Hassieb Pakzad and GitHub
07ad7e54e3
fix(model-form): increase max token limit to 16384 ( #4651 )
2024-12-09 11:52:18 +01:00
Max Deichmann and GitHub
4781b91e90
fix: always restart all docker services ( #4649 )
...
fix
2024-12-09 10:10:27 +00:00
marliessophie and GitHub
2c68223402
fix(experiments): ensure experiment runs on all valid inputs ( #4643 )
...
* fix(experiments): ensure experiment runs on all valid inputs
* refactor: extract common function
2024-12-09 10:01:18 +00:00
Max Deichmann
1211de3efb
chore: release v3.0.0
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
release.yml / release (push) Waiting to run
2024-12-09 11:15:37 +01:00
Zhiqiang ZHOU and GitHub
9b9fd35f13
fix(openapi): MediaContentType to enum ( #4627 )
...
Signed-off-by: STRRL <im@strrl.dev >
2024-12-09 11:13:00 +01:00
Steffen Schmitz and GitHub
407f5dd1ce
build: add latest tags to v3 tags ( #4648 )
2024-12-09 09:59:32 +00:00
Steffen Schmitz and GitHub
d7832336dd
fix: allow userId filter on /api/public/observations again ( #4644 )
...
* fix: allow userId filter on /api/public/observations again
* Update observation-api.servertest.ts
2024-12-09 09:46:51 +00:00
Max Deichmann and GitHub
6362d8bcc9
fix: always pull the project_id for generations queries ( #4641 )
...
push
2024-12-09 08:19:15 +00:00
Max Deichmann
35057ea443
chore: release v3.0.0-rc.6
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-12-09 08:52:46 +01:00
Max Deichmann and GitHub
9adc3bee5b
fix: default to empty string for csv export in case of null ( #4640 )
2024-12-08 22:56:48 +01:00
Max Deichmann and GitHub
e57af47d84
fix: fix trace tagging without postgres ( #4639 )
...
* fix: fix trace tagging without postgres
* fix: fix trace tagging without postgres
2024-12-08 21:43:00 +00:00
Max Deichmann and GitHub
8f0247d311
fix: fix trace bookmarking ( #4638 )
...
fix: fix trace publishing
2024-12-08 22:22:07 +01:00
Max Deichmann and GitHub
e96b2a4b0f
feat: move exports to ch ( #4634 )
2024-12-08 22:07:33 +01:00
Max Deichmann and GitHub
c389d4f01a
feat: move session tests to async suite ( #4636 )
...
* feat: move session tests to async suite
* feat: move session tests to async suite
* feat: move session tests to async suite
2024-12-08 13:21:14 +00:00
Max Deichmann
4d8bb0fb95
chore: release v3.0.0-rc.5
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-12-08 10:52:56 +01:00
Marc Klingen and GitHub
79068ef93f
chore: use s3 region auto in docker-compose.yml ( #4630 )
2024-12-07 17:26:43 +00:00
6c1c231ba7
fix: support reading observations from clickhouse for observations in annotation queue ( #4621 )
...
Co-authored-by: Max Deichmann <m.deichmann@tum.de >
2024-12-07 18:10:20 +01:00
Max Deichmann and GitHub
b722892c00
fix: check postgres negative flag ( #4624 )
...
* fix: check postgres negative flag
* improve dashboard
* improve dashboard
* improve dashboard
* improve dashboard
* perf: fetch observations using timestamps
* perf: fetch observations using timestamps
* perf: fetch observations using timestamps
* perf: fetch observations using timestamps
2024-12-07 14:52:55 +00:00
Max Deichmann and GitHub
4cd1d167da
perf: fetch observations using timestamps ( #4629 )
2024-12-07 13:35:45 +00:00
Steffen Schmitz and GitHub
c0f38a8eda
chore: hide background migrations on cloud and show queued status ( #4628 )
2024-12-07 07:59:02 +00:00
marliessophie and GitHub
6be87994a9
fix: only read trace and score from prisma if LANGFUSE_POSTGRES_INGESTION_ENABLED ( #4618 )
...
* chore: remove reading trace and score from prisma, only read from clickhouse
* fixup: keep create logic behind flag
* chore: only read from postgres for updating annoation score if `LANGFUSE_POSTGRES_INGESTION_ENABLED`
* chore: only read from postgres for deleting annoation score if `LANGFUSE_POSTGRES_INGESTION_ENABLED`
* chore: throw errors if scores not found in CH
* chore: add audit logs in clickhouse scenario
* only create audit log once on cloud
2024-12-06 18:42:01 +00:00
Max Deichmann and GitHub
e90bb60ec8
fix: fix traces publishing in V3 without postgres ( #4620 )
...
* make sleep great again
* make sleep great again
2024-12-06 18:22:53 +00:00
Max Deichmann and GitHub
439a65b926
fix: fix numeric chart for dashboards ( #4615 )
2024-12-06 18:15:25 +00:00
Max Deichmann and GitHub
11af1f4167
feat: increase trace upsert delay ( #4619 )
...
* fix: increase trace upsert delay
* fix: increase trace upsert delay
2024-12-06 17:15:23 +00:00
marliessophie and GitHub
2d265eb3f9
feat(comments): add support for comment button on each trace preview in session view ( #3848 )
...
* feat(comments): add support for comment button on each trace preview in single session view
* perf: manually timeout comment count query at 500ms without failing overall operation
* push
* chore: query comment reference objects in clickhouse if `env.clickhouse_url`
* remove: deprecated code
* chore: support fetching traces per session from clickhouse
* push
* refactor: adjust tests to populate traces and observations in clickhouse
* refactor: adjust tests and remove redundant code
* push
2024-12-06 16:35:15 +00:00
Max Deichmann and GitHub
a93b8ff119
chore: move eval to correct ee directory ( #4616 )
...
* chore: move eval to correct ee directory
* chore: move eval to correct ee directory
* chore: move eval to correct ee directory
2024-12-06 16:31:10 +00:00
Max Deichmann and GitHub
81cf48ddf0
feat: set v3 default variables ( #4613 )
2024-12-06 16:46:09 +01:00
816eec0f75
chore: drop FK v3 constraints ( #4612 )
...
* chore: drop FK v3 constraints
* make sleep great again
* make sleep great again
* make sleep great again
* make sleep great again
---------
Co-authored-by: steffen911 <steffen@langfuse.com >
2024-12-06 13:02:54 +00:00
steffen911
fa630d34de
chore: release v3.0.0-rc.4
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-12-06 14:01:36 +01:00
0eb129e186
feat: add ui for background migrations ( #4602 )
...
* feat: add ui for background migrations
* chore: add retry for background migrations
* chore: remove redundant import
* chore: invalidate correct state
* chore: unused import
* chore: update the popup text
* chore: add status icon
* chore: move to update menu
---------
Co-authored-by: steffen911 <steffen@langfuse.com >
2024-12-06 12:49:26 +00:00
marliessophie and GitHub
2defaf273a
fix(experiments): don't create experiment run items for archived dataset items ( #4611 )
...
* fix(experiments): don't create experiment run items for archived dataset items
* fix: type check for input, `typeof null === "object"` in js
2024-12-06 12:02:46 +00:00
Max Deichmann and GitHub
b9305e76f5
fix: fix front end confirmations to delete traces ( #4601 )
2024-12-05 16:55:28 +01:00
Max Deichmann and GitHub
241d1119f9
feat: adjust trace redirect to uniqueness of trace ids to projects ( #4598 )
2024-12-05 15:24:11 +00:00
Steffen Schmitz and GitHub
4a44adcedd
chore: add wait time during validation of clickhouse background migra… ( #4596 )
...
chore: add wait time during validation of clickhouse background migrations
2024-12-05 13:53:09 +00:00
Steffen Schmitz and GitHub
9a861dff37
chore: make project deletion asynchronous ( #4399 )
...
* chore: make project deletion asynchronous
* chore: delete projects on the worker
* chore: indicate in UI overview that project is being deleted
* chore: remove API keys from Postgres in project deletion call
2024-12-05 13:13:22 +00:00
Steffen Schmitz and GitHub
12ee00f273
chore: check early whether clickhouse url is configured ( #4595 )
...
* chore: check early whether clickhouse url is configured
* Update entrypoint.sh
2024-12-05 12:51:23 +00:00
Steffen Schmitz and GitHub
f2513fbebf
fix: return timestamps in API response as ISO strings ( #4593 )
2024-12-05 10:49:22 +00:00
marliessophie and GitHub
5be98906e3
feat(url): support AWS S3 signed images in trace/observation preview ( #4575 )
...
* feat(url): support AWS S3 signed images in trace/observation preview
* push
* push
* chore: also validate content-type of pre-signed urls
2024-12-05 09:35:20 +00:00
marliessophie and GitHub
4bac94e3fc
feat(comments): increase content character limit to 3,000 ( #4577 )
...
* feat(comments): increase content character limit to 3,000
* push
* push
* push
2024-12-05 08:38:43 +00:00
Max Deichmann and GitHub
86980da792
fix: show correct scores if dataset runs link same traces ( #4582 )
...
* fix: fix scores when dataset runs are linked to the same traces
* fix: fix scores when dataset runs are linked to the same traces
2024-12-04 22:14:18 +00:00
Max Deichmann and GitHub
f9be079d62
chore: add aggregateScores tests ( #4580 )
...
* chore: add aggregateScores tests
* chore: add aggregateScores tests
2024-12-04 21:06:43 +00:00
Marc Klingen and GitHub
d66fac5e29
chore: explicitly mention worker/src/ee ( #4581 )
2024-12-04 21:02:51 +00:00
Hassieb Pakzad and GitHub
83c01bb444
fix(media): add self host env vars ( #4578 )
2024-12-04 19:07:37 +01:00
Hassieb Pakzad and GitHub
c937fc7280
chore(cost-tracking): add gpt-4o-2024-11-20 prices ( #4576 )
2024-12-04 17:10:36 +00:00
Hassieb Pakzad and GitHub
c8aa4a2d70
chore(ingestion): add back async ingestion processing flag ( #4573 )
2024-12-04 17:28:18 +01:00
Marc Klingen and GitHub
5d459f0143
fix(cloud): only active evals count towards free plan limit ( #4572 )
...
* fix(cloud): only active evals count towards free plan limit
* remove log
2024-12-04 15:22:45 +00:00
Steffen Schmitz and GitHub
faa1b71f48
fix: perform batch trace deletion on clickhouse ( #4570 )
2024-12-04 14:17:09 +00:00
Max Deichmann and GitHub
99e9825e66
perf: improve user metrics for large projects ( #4568 )
...
* feat: improve user metrics
* feat: improve user metrics
* feat: improve user metrics
* feat: improve user metrics
* feat: improve user metrics
2024-12-04 14:11:28 +00:00
marliessophie and GitHub
11ad444632
fix(ui): show scrollbar for scores in column visibility ( #4569 )
2024-12-04 13:56:56 +00:00
f132aa3969
fix: convert json strings to json in traces api metadata field ( #4564 )
...
* fix: convert json strings to json in traces api metadata field
* Update web/src/__tests__/async/traces-api.servertest.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* chore: stupid ai
* chore: typing
* chore: lint
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2024-12-04 11:11:43 +00:00
Steffen Schmitz and GitHub
fa69d4dc75
chore: increase timeout for daily metrics query ( #4565 )
2024-12-04 10:46:52 +00:00
Max Deichmann and GitHub
6ef6fba4dc
chore: double ingestion API rate limits ( #4544 )
...
feat
2024-12-04 09:31:44 +00:00
Max Deichmann and GitHub
a5078ccbaf
chore: remove public users api ( #4553 )
2024-12-04 09:20:09 +00:00
Marc Klingen and GitHub
ba5c1cd70e
fix: disable x frame options header on Hugging Face ( #4558 )
2024-12-04 00:06:19 +01:00
Max Deichmann and GitHub
19ea989b5a
perf: add a user_id bloom filter ( #4554 )
...
* perf: add a user_id bloom filter
* push
* perf: add a user_id bloom filter
2024-12-03 21:28:52 +00:00
Max Deichmann and GitHub
ec0bf37d0b
chore: refactor tests async ( #4552 )
...
* chore: refactor tests
* chore: refactor tests
2024-12-03 20:03:57 +00:00
Max Deichmann and GitHub
3b4790270f
fix: fix time to first token ( #4549 )
...
* fix: fix time to first token
* fix: fix time to first token
* fix: fix time to first token
* push
* fix: fix time to first token
2024-12-03 18:05:40 +00:00
Marc Klingen
ca3b95312b
chore: release v3.0.0-rc.3
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-12-03 18:53:59 +01:00
b9aaf05acb
feat(auth): add KeyCloak authentication option ( #2866 )
...
---------
Co-authored-by: RTae <natthanan.bhu@doctorasa.co >
Co-authored-by: Marc Klingen <git@marcklingen.com >
2024-12-03 18:46:09 +01:00
Marc Klingen and GitHub
004aee9f35
feat(ui): add "not found" error page for unknown traces and sessions ( #4548 )
...
* feat(ui): add "not found" page for unknown trace ids
* also apply to session
2024-12-03 16:56:03 +00:00
Steffen Schmitz and GitHub
0c9070f78f
chore: migrate /metrics/daily API route to Clickhouse ( #4546 )
...
* chore: migrate /metrics/daily API route to Clickhouse
* chore: apply final
2024-12-03 16:35:09 +00:00
Marc Klingen and GitHub
a91357a958
fix: remove LANGFUSE_CSP_DISABLE (did not work) and disable csp headers on HF Spaces ( #4545 )
2024-12-03 17:31:18 +01:00
Hassieb Pakzad and GitHub
80050cee00
fix(media): add wait time before retries ( #4547 )
2024-12-03 17:24:43 +01:00
Steffen Schmitz and GitHub
b533b1dccd
chore: migrate traces all API route to Clickhouse ( #4542 )
...
* chore: migrate traces all API route to Clickhouse
* chore: lint
* chore: remove console logs
* chore: naming
2024-12-03 14:04:15 +00:00
Max Deichmann and GitHub
25657d11e4
perf: improve count query performance for scores public api ( #4538 )
...
feat
2024-12-03 10:38:41 +00:00
Max Deichmann and GitHub
3dd616a3dc
perf: improve single trace public API performance ( #4537 )
...
feat
2024-12-03 10:11:04 +00:00
Steffen Schmitz and GitHub
995ec498f4
chore: include projectId in event processing error message ( #4535 )
2024-12-03 09:22:56 +00:00
Max Deichmann and GitHub
12d7b7f753
perf: improve scores API query performance ( #4534 )
...
* feat
* feat
* feat
* push
* feat
* feat
* feat
2024-12-03 09:17:55 +00:00
Marc Klingen and GitHub
2630327a86
chore: add LANGFUSE_CSP_DISABLE to .env.prod.example ( #4533 )
2024-12-03 01:23:15 +01:00
Marc Klingen and GitHub
4a1fa69af7
feat: optionally disable csp headers via LANGFUSE_CSP_DISABLE=true ( #4529 )
2024-12-03 01:04:23 +01:00
Max Deichmann and GitHub
e53d101b49
fix: show dataset run if not run item exists yet ( #4528 )
...
feat
2024-12-02 21:46:54 +00:00
Marc Klingen and GitHub
39539300c1
fix: on cache schema change, delete cached api keys ( #4527 )
2024-12-02 20:36:12 +00:00
Hassieb Pakzad and GitHub
59982db267
fix(io-ui): padding additional input ( #4526 )
2024-12-02 19:29:37 +01:00
Hassieb Pakzad and GitHub
fe4299d30d
fix(IO-ui): render additional input in pretty view ( #4524 )
2024-12-02 18:58:25 +01:00
Marc Klingen and GitHub
304b290ab1
fix: no need to decode nextjs path variables, causes issues with special characters ( #4522 )
2024-12-02 17:09:06 +00:00
Hassieb Pakzad and GitHub
97423aa95d
fix(media): use db upserts instead of prisma ( #4521 )
2024-12-02 17:42:53 +01:00
Max Deichmann and GitHub
7aff8e0c26
fix: fix score source public api filter ( #4520 )
...
feat
2024-12-02 15:46:59 +00:00
Max Deichmann and GitHub
22761d55c3
chore: add logging for datasets router ( #4519 )
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-12-02 16:29:40 +01:00
steffen911
965cf1445d
chore: release v3.0.0-rc.2
2024-12-02 16:28:36 +01:00
Marc Klingen and GitHub
922bbb0ce1
docs: add list of dependents to readme ( #4518 )
...
* docs: add list of dependents to readme
* push
2024-12-02 15:05:56 +00:00
Max Deichmann and GitHub
d821423c6a
perf: improve dataset run item performance ( #4514 )
2024-12-02 15:57:20 +01:00
Steffen Schmitz and GitHub
84b0b7f680
chore: remove backend cloud version checks ( #4512 )
...
* chore: remove backend cloud version checks
* chore: lint
* chore: adjust clickhouse healthcheck
2024-12-02 14:41:18 +00:00
Steffen Schmitz and GitHub
fba7f4f0c3
build: cancel concurrent PR jobs on new commit ( #4517 )
...
* build: cancel concurrent PR jobs on new commit
* chore: adjust pattern
* chore: adjust pattern
2024-12-02 14:31:58 +00:00
Steffen Schmitz and GitHub
a9405a2e8b
chore: ignore latency for prompts-ui.servertest.ts ( #4513 )
2024-12-02 14:20:05 +00:00
Marc Klingen and GitHub
2cb3529707
fix(ui): disallow creation of projects if project name already exists in the org ( #4516 )
2024-12-02 14:12:46 +00:00
Marc Klingen and GitHub
2f13204836
fix(ui): overflow of session view on mobile ( #4515 )
2024-12-02 14:12:20 +00:00
Steffen Schmitz and GitHub
ae2a42bf80
chore: move batch export s3 env variable names into new naming pattern ( #4511 )
...
* chore: move batch export s3 env variable names into new naming pattern
* chore: add prefixes correctly
* chore: overwrite batch export feature in CI
2024-12-02 13:49:15 +00:00
Marc Klingen and GitHub
039dee045b
feat(cloud): update entitlements to account for limits, add self-hosted pro plan ( #3913 )
...
* wip
* push
* add migration
* render correct usage event type in settings
* render number of seats in settings
* wip
* add entitlement limits
* add new actionbutton
* migrate annotation queue create
* add to table date range selectors
* add limit to dashboard date range
* move migration
* fix usage preview in billing settings
* get seats from subscription instead of next invoice
* remove old console.log
* ad pro plan self-hosted
* fix
* readme
* rename / fixes
* push
* only alert on over 90% usage
* push
* push
* push
* push
* add new self host entitlements for v3
* drop batch-export entitlement
* push
* move logic to clickhouse
* push
* fix padding
* fix clickhouse logic
2024-12-02 13:39:02 +00:00
Max Deichmann and GitHub
9831bb8e44
fix: increase attempts for evals ( #4487 )
...
feat
2024-12-02 13:37:00 +00:00
Steffen Schmitz and GitHub
c6e3a12b08
chore: apply v3 defaults to environment variables ( #4498 )
2024-12-02 13:50:44 +01:00
Marc Klingen and GitHub
9b01b562a8
fix(ui): account for prereleases in update check ( #4503 )
2024-11-29 18:34:12 +00:00
Hassieb Pakzad
e5a0cec7d6
chore: add sha256 hash to media url span
2024-11-29 18:33:26 +01:00
Steffen Schmitz and GitHub
9375250c5a
chore: fix typo in ingestion queue concurrency and adjust default ( #4495 )
2024-11-29 10:30:11 +00:00
Hassieb Pakzad and GitHub
82e5f1a932
feat(playground+evals): add gemini and vertex support ( #4485 )
2024-11-29 10:07:33 +01:00
Max Deichmann and GitHub
64a62c9f6d
perf: improve datasets view ( #4486 )
2024-11-28 21:21:05 +01:00
44d856747a
feat(auth): add GitHub Enterprise Authentication Provider ( #4463 )
...
feat: Add GitHub Enterprise Authentication Provider
Co-authored-by: Marc Klingen <git@marcklingen.com >
2024-11-28 01:43:43 +00:00
Marc Klingen
e17bd364c9
chore: fix ci on fork prs
2024-11-28 02:30:08 +01:00
Marc Klingen and GitHub
f38c756244
fix: do not authenticate with Docker Hub for pull request CI ( #4477 )
2024-11-28 02:20:29 +01:00
6c62f4b31a
chore(deps): bump posthog-node from 3.6.3 to 4.3.1 ( #4450 )
...
* chore(deps): bump posthog-node from 3.6.3 to 4.3.1
Bumps [posthog-node](https://github.com/PostHog/posthog-js-lite/tree/HEAD/posthog-node ) from 3.6.3 to 4.3.1.
- [Release notes](https://github.com/PostHog/posthog-js-lite/releases )
- [Changelog](https://github.com/PostHog/posthog-js-lite/blob/main/posthog-node/CHANGELOG.md )
- [Commits](https://github.com/PostHog/posthog-js-lite/commits/posthog-node-v4.3.1/posthog-node )
---
updated-dependencies:
- dependency-name: posthog-node
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
* fix flush
* shutdown instead of shutdownasync
---------
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Marc Klingen <git@marcklingen.com >
2024-11-28 00:07:51 +00:00
fb686d45ee
chore(deps): bump stripe from 16.8.0 to 17.4.0 ( #4377 )
...
Bumps [stripe](https://github.com/stripe/stripe-node ) from 16.8.0 to 17.4.0.
- [Release notes](https://github.com/stripe/stripe-node/releases )
- [Changelog](https://github.com/stripe/stripe-node/blob/master/CHANGELOG.md )
- [Commits](https://github.com/stripe/stripe-node/compare/v16.8.0...v17.4.0 )
---
updated-dependencies:
- dependency-name: stripe
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-27 23:47:54 +00:00
1901c8cb39
chore(deps): bump lucide-react from 0.447.0 to 0.462.0 ( #4475 )
...
Bumps [lucide-react](https://github.com/lucide-icons/lucide/tree/HEAD/packages/lucide-react ) from 0.447.0 to 0.462.0.
- [Release notes](https://github.com/lucide-icons/lucide/releases )
- [Commits](https://github.com/lucide-icons/lucide/commits/0.462.0/packages/lucide-react )
---
updated-dependencies:
- dependency-name: lucide-react
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-27 23:47:05 +00:00
Marc Klingen
66d925ee1f
chore: do not run codeql on merge queue
2024-11-28 01:05:07 +01:00
Marc Klingen
1b06385111
chore: run ci on merge groups
2024-11-28 00:23:08 +01:00
Hassieb Pakzad and GitHub
6e290b9ad4
fix(media): increase retries ( #4474 )
2024-11-27 22:57:53 +00:00
Max Deichmann and GitHub
8b8afff705
fix: fix generations search in clickhouse ( #4472 )
2024-11-27 23:20:21 +01:00
Max Deichmann and GitHub
89fcf27f84
chore: add logs for media API ( #4471 )
2024-11-27 22:46:44 +01:00
Max Deichmann and GitHub
6717b16679
perf: add improved default performance to traces table ( #4469 )
...
* feat
* feat
2024-11-27 21:07:29 +00:00
Cole Winstanley and GitHub
98e29cb512
fix(auth): add nonce check for Cognito NextAuth provider ( #4401 )
2024-11-27 17:59:31 +01:00
Marc Klingen and GitHub
c7b7a784d7
feat(ui): add more explicit confirmation prompt before deleting a dataset ( #4424 )
2024-11-27 16:51:44 +00:00
Marc Klingen and GitHub
e778d04523
perf: single clickhouse query for cloud usage job across all orgs/projects ( #4453 )
2024-11-27 17:39:31 +01:00
Hassieb Pakzad and GitHub
2a2f50e2d9
feat(media): broaden content type support ( #4442 )
...
* feat(media): broaden content type support
* fix file extensions
* add media attachment view in pretty mode
2024-11-27 17:19:54 +01:00
Max Deichmann and GitHub
9d9820dacc
chore: remove log line ( #4466 )
2024-11-27 15:54:39 +01:00
Max Deichmann and GitHub
6e4065eff3
perf: extract traces table metrics from clickhouse traces.all query ( #4460 )
2024-11-27 14:24:15 +00:00
Marc Klingen and GitHub
993e2a8323
fix(ui): trace timeline peek drawer should not be full-width ( #4462 )
2024-11-27 14:04:45 +00:00
Steffen Schmitz and GitHub
f0c117b35b
chore: expand error logging for queue worker errors ( #4457 )
2024-11-27 12:29:59 +00:00
Max Deichmann and GitHub
b7d353a821
perf: increase performance for traces default table ( #4459 )
2024-11-27 11:36:14 +00:00
Hassieb Pakzad and GitHub
1bdc6a4068
fix(media): increase isolationLevel on concurrent upserts ( #4458 )
2024-11-27 12:23:08 +01:00
Marc Klingen and GitHub
851de49789
perf: prevent duplicated parallel executions of cloud metering job ( #4455 )
2024-11-27 01:27:07 +00:00
Max Deichmann and GitHub
202a9b715d
perf: improve clickhouse traces table perfromance ( #4451 )
2024-11-26 23:25:45 +00:00
Marc Klingen and GitHub
5fae362b29
refactor(cloud): move usage metering job to clickhouse ( #4448 )
2024-11-26 21:27:04 +00:00
Max Deichmann and GitHub
38e5c3fac7
Max/lfe 2988 adjust generations table default again ( #4446 )
2024-11-26 21:01:10 +00:00
Marc Klingen and GitHub
3d6d94fb16
chore(cloud): improve logs of usage metering job ( #4447 )
...
chore: improve logs of usage metering job
2024-11-26 20:27:14 +00:00
Marc Klingen and GitHub
cb7230ac41
fix: override score name when config is set ( #4445 )
2024-11-26 20:08:36 +00:00
Steffen Schmitz and GitHub
44ba6eaddf
chore: restrict trace.name length to 1000 characters ( #4441 )
2024-11-26 19:47:54 +01:00
Max Deichmann and GitHub
e566dfa5a9
feat: improve generations table default query time ( #4440 )
2024-11-26 18:12:13 +00:00
Steffen Schmitz and GitHub
f9c3f60d49
chore: make trace deletion asynchronous ( #4398 )
2024-11-26 16:26:31 +00:00
Steffen Schmitz and GitHub
aeb56ecde7
chore: explicitly cast names for traces table ( #4433 )
2024-11-26 17:15:32 +01:00
Marc Klingen and GitHub
9ac84fbd61
fix: do not log stack trace in trpc checkupdate when no internet access ( #4436 )
2024-11-26 16:33:33 +01:00
Hassieb Pakzad and GitHub
fe9af426dc
fix(playground): unique prompt names in save to prompt ( #4437 )
2024-11-26 16:22:44 +01:00
Marc Klingen and GitHub
583e90321e
fix(auth): improve name and password verification ( #4434 )
...
* fix(auth): improve name and password verification
* password complexity
* no url in name
* e2e test
2024-11-26 13:28:43 +00:00
Hassieb Pakzad
e52530351a
chore: update v3preview docker compose to main tagged images
2024-11-26 13:49:28 +01:00
Hassieb Pakzad
8a52c0b888
chore: update v3preview docker compose to 3 tagged images
2024-11-26 13:32:16 +01:00
Hassieb Pakzad
d02c9b4902
chore: release v3.0.0-rc.1
CI/CD / lint (push) Waiting to run
CI/CD / test-docker-build (push) Waiting to run
CI/CD / tests-web-sync (node20, pg12) (push) Waiting to run
CI/CD / tests-web-sync (node20, pg15) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-web-async (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-web-async (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode) (push) Waiting to run
CI/CD / tests-worker (node20, pg12, mode-azure) (push) Waiting to run
CI/CD / tests-worker (node20, pg15, mode-azure) (push) Waiting to run
CI/CD / e2e-tests (push) Waiting to run
CI/CD / e2e-server-tests (push) Waiting to run
CI/CD / all-ci-passed (push) Blocked by required conditions
CI/CD / push-docker-image (push) Blocked by required conditions
2024-11-26 12:20:20 +01:00
Hassieb Pakzad
014c3d9dad
chore: do not tag v3 tags as latest image
2024-11-26 12:17:51 +01:00
Max Deichmann and GitHub
1d3c74435b
fix: change the default of the migration script ( #4419 )
2024-11-26 09:48:37 +00:00