Commit Graph
82 Commits
Author SHA1 Message Date
VitalyandGitHub f6a48e2b30 Adding dual read/write for immutable metadata (#840) 2020-10-12 21:22:25 -07:00
wxing1292andGitHub 08eefd0741 Split overloaded SQL filters (#834)
* Split ActivityInfoMapsFilter into ActivityInfoMapsSelectFilter and ActivityInfoMapsDeleteFilter
* Split TimerInfoMapsFilter into TimerInfoMapsSelectFilter and TimerInfoMapsDeleteFilter
* Split ChildExecutionInfoMapsFilter into ChildExecutionInfoMapsSelectFilter and ChildExecutionInfoMapsDeleteFilter
* Split RequestCancelInfoMapsFilter into RequestCancelInfoMapsSelectFilter and RequestCancelInfoMapsDeleteFilter
* Split SignalInfoMapsFilter into SignalInfoMapsSelectFilter and SignalInfoMapsDeleteFilter
* Split SignalsRequestedSetsFilter into SignalsRequestedSetsSelectFilter and SignalsRequestedSetsDeleteFilter
2020-10-12 18:05:17 -07:00
wxing1292andGitHub 9ff4ba4d3c Reduce redundant history tree creation for workflow reset (#825)
* When performing workflow reset & terminating current workflow, one unnecessary create history tree API is called, this PR remove the redundant call to improve performance
2020-10-12 17:24:43 -07:00
Sergey BykovandGitHub 36faccb366 Enforce minimum TLS version of 1.2 (#831)
* Enforce minimum TLS version of 1.2
2020-10-12 11:04:11 -07:00
wxing1292andGitHub 7b086939f1 Enable PostgreSQL tests on github (#821)
* Enable PostgreSQL tests on Github
* Move some tests around to avoid import cycle
2020-10-09 17:16:40 -07:00
wxing1292andGitHub 33e374bbea Add SQL specific tests for history events (#820)
* Add history node tests
* Add history tree tests
2020-10-09 16:55:22 -07:00
wxing1292andGitHub a1369eeca6 Use timestamp instead of convert for time.Time pointer conversion (#819) 2020-10-08 15:40:59 -07:00
wxing1292andGitHub 9aee69ab46 Add SQL specific tests for executions (#814)
* Add history current execution tests
* Add history execution tests
2020-10-08 15:23:04 -07:00
wxing1292andGitHub e844e65f4b Change shard ID type from int to int32 (#811)
* Unify the shard ID type to int32
* Remove unused admin Kafka resend command
2020-10-07 23:46:48 -07:00
wxing1292andGitHub b802e5e67a Add SQL specific tests for visibility, part 2 (#813)
* Add visibility tests
* Add visibility pagination tests
2020-10-07 21:17:56 -07:00
wxing1292andGitHub 47ddc73ab1 Add SQL specific tests for visibility, part 1 (#809)
* Add visibility tests
* Unify the behavior on MySQL & PostgreSQL
2020-10-07 19:53:44 -07:00
VitalyandGitHub 25cde0971b Adding mutable metadata and cluster id (#803)
Adding mutable metadata and cluster id
2020-10-07 19:28:22 -07:00
wxing1292andGitHub bb46fa2649 Split overloaded transfer / timer task APIs (#806)
* Split TransferTasksFilter into TransferTasksFilter and TransferTasksRangeFilter
* Split SelectFromTransferTasks into SelectFromTransferTasks and RangeSelectFromTransferTasks
* Split DeleteFromTransferTasks into DeleteFromTransferTasks and RangeDeleteFromTransferTasks
* Split TimerTasksFilter into TimerTasksFilter and TimerTasksRangeFilter
* Split SelectFromTimerTasks into SelectFromTimerTasks and RangeSelectFromTimerTasks
* Split DeleteFromTimerTasks into DeleteFromTimerTasks and RangeDeleteFromTimerTasks
2020-10-07 15:47:31 -07:00
wxing1292andGitHub 8f7e868b56 Add SQL specific tests for transfer / timer tasks (#802)
* Add history transfer task tests
* Add history timer task tests
* Add missing functionalities
2020-10-06 12:51:55 -07:00
wxing1292andGitHub 0682f421f8 Add SQL specific tests for mutable state, part 2 (#800)
* Add history execution request cancel tests
* Add history execution signal tests
* Add history execution signal request tests
2020-10-06 12:08:05 -07:00
wxing1292andGitHub b28183f9b0 Add SQL specific tests for mutable state, part 1 (#799)
* Add history execution buffer tests
* Add history execution activity tests
* Add history execution child workflow tests
* Add history execution timer tests
2020-10-05 15:37:10 -07:00
wxing1292andGitHub c3f861e075 Add SQL specific tests (#796)
* Add history shard tests
2020-10-05 14:59:24 -07:00
wxing1292andGitHub 1f56c0492a Add SQL specific tests for namespace (#793)
* Add namespace tests
* Remove redundant select during creation of namespace
2020-10-05 14:34:04 -07:00
wxing1292andGitHub 845940ab38 Add SQL persistence specific tests (#790)
* Add matching task queue tests
2020-10-02 21:40:50 -07:00
wxing1292andGitHub c3d126b59a Add SQL persistence specific tests (#789)
* Add matching task tests
2020-10-02 17:58:59 -07:00
wxing1292andGitHub 35272a29e1 Split SQL storage interfaces & definitions (#788) 2020-10-02 11:47:09 -07:00
Quanzheng LongandAlex Shtin f5f781cbf7 [SQL]Fix upsert SQL template for Postgres plugin (#3498) 2020-09-25 18:54:08 -07:00
Samar AbbasandGitHub 6aeba03656 Fixes MySQL persistence for workflow reset (#713)
After 2dc removal we trigger a slightly different codepath on mysql
persistence when resetting workflows.
AppendHistoryNodes when called with IsNewBranch add both
history_tree metadata and history_node.  This caused the problem
because history_node is already added when fork was called so
adding it again failed with duplicate error.  Updated
AppendHistoryNodes api to upsert instead.

Another issue was with create workflow execution never expected
to be called with `CreateWorkflowModeContinueAsNew` mode.  With
NDC now workflow reset is implemented in similar fashion as
doing continue as new.  So removed the check to disallow
`CreateWorkflowModeContinueAsNew` on create execution and added
appropriate validation.
2020-09-05 18:53:19 -07:00
Shawn HathawayandGitHub 2db621446c Support time.Time in MutableState#ActivityWithTimerHeartbeat methods (#666) 2020-08-13 12:31:26 -07:00
Shawn HathawayandGitHub 02b201e55a Replace Insert Ignore in Execution (#658) 2020-08-09 00:35:22 -07:00
Alex ShtinandGitHub 97abc65ebc Replace time.Now() with time.Now().UTC() and time.Unix() with time.Unix().UTC() (#648) 2020-08-04 13:02:16 -07:00
Shawn HathawayandGitHub 55508de3f7 Convert ActivityInfo Persistence POGOs to Proto (#615) 2020-07-27 20:42:28 -07:00
Shawn HathawayandGitHub cbe7cab9ff Convert REPLACE INTO -> INSERT ON DUPLICATE KEY UPDATE (#601) 2020-07-24 03:10:22 -07:00
Shawn HathawayandGitHub 815cd8b09f Add pinned version_partition column to schema version tables (SQL) (#602) 2020-07-23 19:16:30 -07:00
Shawn HathawayandGitHub 7ae7ab205e ClusterMembership Partition Pin/AutoIncrement Removal (#583) 2020-07-22 10:08:41 -07:00
mastermanuandGitHub 3e4936d9c7 Changes ListClosedWorkflow result ordering for SQL-based visibility stores to be based off of workflow close time (#578)
This PR fixes the following issues:

SQL stores were using the Workflow Open Time instead of the Close Time for pagination, which is not aligned with Cassandra and is not the intention.

The SQL store pagination logic had a bug where the tie-breaker logic of using run_id for two rows with the same close_time was not implemented properly.

The SQL store pagination logic had a bug where it was using the MinStart time instead of the MaxStart time for pagination purposes (to be confirmed as to whether this is truly a bug or not, but it does appear that way)

Fixes Makefile so that schema installation for MySQL / Postgres functions properly.

Fixes Postgres username / password in postgres development environment.

Adds appropriate MySQL/Postgres indexes for querying by close_time
2020-07-21 12:23:10 -07:00
Shawn HathawayandGitHub 467131c5f6 Add Hash to Task Schema Key, compound TaskQueueId (#557) 2020-07-20 11:12:12 -07:00
Shawn HathawayandGitHub 888f942274 TaskQueue Schema Collapse (#500) 2020-07-16 20:35:41 -07:00
Alex ShtinandGitHub 8446bbfe7f Migrate to new vanity import URLs (#517) 2020-07-08 19:48:20 -07:00
Alex ShtinandGitHub 6a6909e92a Use vanity import package name go.temporal.io/server (#511) 2020-07-08 16:09:12 -07:00
Shawn HathawayandGitHub 6e6983240a NamespaceMetadata Partitioning Alignment (#486) 2020-07-08 12:59:11 -07:00
Alex ShtinandGitHub a7b4c34f49 Add proto generated go files (#506) 2020-07-08 09:25:23 -07:00
Alex ShtinandGitHub 5e90af33d3 Fix visibility execution status (#492) 2020-07-06 16:43:35 -07:00
Alex ShtinandGitHub 907f23f007 Rename task list to task queue (#480) 2020-06-27 12:11:25 -07:00
Mark MarkaryanandGitHub f002008b9f Allow for empty postgres db password (#461) 2020-06-18 07:50:10 -07:00
Alex Shtin df4456113a Merge tag 'v0.12.0' into merge/cadence-0.12.0
Cadence release v0.12.0

 Conflicts:
	.gen/go/admin/admin.go
	.gen/go/admin/adminserviceclient/client.go
	.gen/go/admin/adminserviceserver/server.go
	.gen/go/admin/adminservicetest/client.go
	.gen/go/replicator/replicator.go
	.gen/go/shared/shared.go
	client/admin/client.go
	common/cache/domainCache.go
	common/cache/domainCache_test.go
	common/client/versionChecker.go
	common/elasticsearch/validator/searchAttrValidator.go
	common/elasticsearch/validator/searchAttrValidator_test.go
	common/log/tag/tags.go
	common/membership/interfaces_mock.go
	common/membership/rpMonitor.go
	common/membership/rpServiceResolver.go
	common/metrics/defs.go
	common/mocks/ExecutionManager.go
	common/namespace/dlqMessageHandler.go
	common/namespace/dlqMessageHandler_mock.go
	common/namespace/dlqMessageHandler_test.go
	common/persistence/cassandra/cassandraPersistence.go
	common/persistence/dataInterfaces.go
	common/persistence/executionStore.go
	common/persistence/namespaceReplicationQueue.go
	common/persistence/namespaceReplicationQueue_mock.go
	common/persistence/persistence-tests/persistenceTestBase.go
	common/persistence/persistence-tests/queuePersistenceTest.go
	common/persistence/persistenceInterface.go
	common/resource/resourceImpl.go
	common/service/dynamicconfig/config.go
	common/service/dynamicconfig/constants.go
	common/util.go
	common/xdc/historyRereplicator.go
	common/xdc/nDCHistoryResender.go
	common/xdc/nDCHistoryResender_test.go
	docker/docker-compose-es.yml
	docker/docker-compose-mysql.yml
	docker/docker-compose-postgres.yml
	docker/docker-compose.yml
	go.mod
	go.sum
	host/continueasnew_test.go
	host/dynamicconfig.go
	host/integration_test.go
	idls
	schema/cassandra/cadence/schema.cql
	schema/cassandra/version.go
	service/frontend/accessControlledHandler.go
	service/frontend/adminHandler.go
	service/frontend/dcRedirectionHandler.go
	service/frontend/service.go
	service/frontend/workflowHandler.go
	service/frontend/workflowHandler_mock.go
	service/history/decisionChecker.go
	service/history/decisionChecker_test.go
	service/history/decisionHandler.go
	service/history/decisionTaskHandler.go
	service/history/handler.go
	service/history/historyBuilder.go
	service/history/historyBuilder_test.go
	service/history/historyEngine.go
	service/history/historyEngine2_test.go
	service/history/historyEngine_test.go
	service/history/historyReplicator.go
	service/history/mutableState.go
	service/history/mutableStateBuilder.go
	service/history/mutableState_mock.go
	service/history/nDCHistoryReplicator.go
	service/history/nDCTaskUtil.go
	service/history/queueProcessor.go
	service/history/replicatorQueueProcessor.go
	service/history/service.go
	service/history/shardContext.go
	service/history/shardController.go
	service/history/taskProcessor_test.go
	service/history/timerQueueActiveTaskExecutor.go
	service/history/timerQueueActiveTaskExecutor_test.go
	service/history/timerQueueStandbyTaskExecutor.go
	service/history/timerQueueStandbyTaskExecutor_test.go
	service/history/transferQueueActiveTaskExecutor_test.go
	service/history/transferQueueStandbyTaskExecutor_test.go
	service/history/workflowExecutionContext.go
	service/matching/service.go
	service/worker/archiver/util_test.go
	service/worker/replicator/replicationTask.go
	service/worker/replicator/replicationTask_test.go
	service/worker/replicator/replicator.go
	service/worker/service.go
	tools/cli/README.md
	tools/cli/admin.go
	tools/cli/adminCommands.go
	tools/cli/adminKafkaCommands.go
	tools/cli/flags.go
	tools/cli/workflowCommands.go
2020-06-16 19:10:17 -07:00
Alex ShtinandGitHub e398c4fe7d Fix buf lint warnings (#449) 2020-06-12 14:55:55 -07:00
Shawn HathawayandGitHub 8163f38c5d Represent UUIDs as String (#375) 2020-05-15 12:46:43 -07:00
Mark MarkaryanandGitHub be70643e67 Consolidate WorkflowState* int constants into WorkflowExecutionState .proto enum (#352) 2020-05-11 19:03:04 -07:00
Alex ShtinandGitHub 3b0f8b5eb1 Arrange dev docker-compose configs (#347) 2020-05-01 21:42:48 -07:00
Maxim FateevandGitHub 43829283f5 Removed RetryPolicy.expiration and refactored workflow timeouts (#339)
What?

Removed RetryPolicy.expiration
Renamed ExecutionStartToCloseTimeout to WorkflowRunTimeout
Added WorkflowExecutionTimeout
Why?
Removal of RetryPolicy.expiration eliminates confusion with activity ScheduleToClose timeout. Addition of WorkflowExecutionTimeout allows limiting workflow execution time not only for retries but also for workflows that call continue as new.

How did you test it?
Existing and a new unit test for continue as new timeout.

Potential risks
Retries and timeouts can be broken.
2020-04-30 10:39:10 -07:00
be5b3e6ff8 Wire postgress config: MaxConns, MaxIdleConns, MaxConnLifetime (#330)
The Mysql plugin has these exact lines.

Fixes https://github.com/temporalio/temporal/issues/325

Co-authored-by: Shawn Hathaway <[email protected]>
2020-04-28 15:00:55 -07:00
Alex ShtinandGitHub 6954ffedb4 Remove heartbeat fields from ActivityInfoRaw (#327) 2020-04-24 18:15:01 -07:00
Samar Abbas 888f52ebf3 Merges cadence commits to temporal 2020-04-20 11:27:56 -07:00
Bowei XuandAnish Adhikari ae8eeae75f Fix panic on get history API (#3188)
* Fix panic on get history API
2020-04-13 14:52:44 -07:00