Commit Graph
30 Commits
Author SHA1 Message Date
Alex ShtinandGitHub 5e90af33d3 Fix visibility execution status (#492) 2020-07-06 16:43:35 -07:00
Alex ShtinandGitHub 907f23f007 Rename task list to task queue (#480) 2020-06-27 12:11:25 -07:00
Alex ShtinandGitHub e398c4fe7d Fix buf lint warnings (#449) 2020-06-12 14:55:55 -07:00
Shawn HathawayandGitHub 8163f38c5d Represent UUIDs as String (#375) 2020-05-15 12:46:43 -07:00
Mark MarkaryanandGitHub be70643e67 Consolidate WorkflowState* int constants into WorkflowExecutionState .proto enum (#352) 2020-05-11 19:03:04 -07:00
Alex ShtinandGitHub 6954ffedb4 Remove heartbeat fields from ActivityInfoRaw (#327) 2020-04-24 18:15:01 -07:00
Samar Abbas 888f52ebf3 Merges cadence commits to temporal 2020-04-20 11:27:56 -07:00
Shawn HathawayandGitHub a75ba89bf1 Frozen Namespace to Proto (#281)
* Restructure NamespaceInfo Protos
* System namespace registration is moved to the immutableClusterMetadata path, rather than registering in schema
* Add NewUUID(), Fix Namespace test
* Remove unused import
* Serialization moved to Manager
2020-04-10 11:26:28 -07:00
Alex ShtinandGitHub 4a25002ccc Update LICENSE file and all go files with new license header (#285) 2020-04-08 20:39:01 -07:00
Alex ShtinandGitHub 91e17138bb Rearrange common and enum packages (#274) 2020-04-03 19:06:17 -07:00
Alex ShtinandGitHub 0ba363e940 Rename WorkflowExecutionCloseStatus to WorkflowExecutionStatus (#271) 2020-04-01 13:16:09 -07:00
Yu XiaandGitHub 52e63e6030 Change queue message id to big integer in Cas (#3149)
* Change queue message id to big integer
2020-03-30 23:18:26 -07:00
Samar AbbasandGitHub e1b5f8b51f Rename system workflows to be more temporal friendly (#263)
Rename all system artifacts created to power system workflows to use
'temporal' prefix.

Some more renaming from cadence to temporal.
2020-03-30 08:13:44 -07:00
Alex ShtinandGitHub 88548fcb42 Rename domain to namespace (#260) 2020-03-28 12:35:46 -07:00
Shawn HathawayandGitHub 43296ec291 shared.Thrift - WorkflowExecutionInfo & Memo proto conversion+ (#206)
* shared.WorkflowExecutionInfo and shared.WorkflowExecution usage has been moved to commonproto
  * enums.WorkflowExecutionCloseStatus default value of 0 is now WorkflowExecutionCloseStatusUnknown
  * CloseTime/StartTime are treated as nullable, requiring protobuf Int64Value wrappers
* dataInterfaces.go#WorkflowCloseStatus
  * default value None has been renamed to Running as that is what persistence/serialization was calling the previous 0 value
  * Running is also moved to value of 1 to match changes in protos, requiring it to be set
    * This found a bug where historyEngine.DescribeWorkflowExecution was not returning the CloseStatus
* shared.Memo usage has been moved to commonproto
* General /common/adapter and shared.Thrift removals
2020-03-11 12:48:11 -07:00
Shawn HathawayandGitHub 4b5c0fe07b WorkflowExecutionInfo/State Proto Persistence (#191)
- ProtoWorkflowExecutionInfo definition - Moves SQL from Thrift and Cassandra from frozen
- WorkflowExecutionInfo split into two objects (added WorkflowExecutionState) to support UpdateCurrentExecution workflows where the store layer wont want to fetch and manipulate an existing monolith proto. 
- Checksum proto introduced, Cassandra moves from frozen Checksum to proto
- This does not move any protos into the request layer and leaves InternalWorkflowMutableState, so common field mapping functions exist
- The go defined ReplicationInfo struct is consolidated to the proto replication package ReplicationInfo
2020-03-06 15:25:35 -08:00
Samar Abbas 8e55282c63 merge from cadence 02-18-2020 2020-02-23 01:29:24 -08:00
Shawn HathawayandGitHub 3fe1993c7a ReplicationTask Proto Persistence (#141)
- Convert sql thrift usage of sqlblobs.ReplicationTaskInfo to persistenceblobs.ReplicationTaskInfo proto
- Cassandra now uses data/encoding to persist the proto file
- Serialization still happens at store level and will need to be migrated to manager, so for now Cassandra imports the SQL serializer
- As ReplicationTask used to meet the queueTaskInfo interface, the interface was changed to meet the raw types of IDs (string uuid -> []byte uuid) and int types (int->int32).
  - The non-proto tasks needed (timer and transfer) to meet this new interface as well and runtime conversions were added, but they will eventually be converted to protos as well.
2020-02-13 16:30:24 -08:00
Yichao YangandGitHub db38e74f13 Task Priority Assigner (#3023) 2020-02-13 12:58:23 -08:00
Yu XiaandGitHub 221ea8d0f3 Add operation APIs for history replication DLQ (#3019)
* Integrate CLI with history replication DLQ

* Add history replication DLQ
2020-02-12 17:53:28 -08:00
Shawn HathawayandGitHub d897355e67 Add Pagination for GetClusterMembers (#127)
* ClusterMembership Pagination Needs Monotonic SQL Id
* ClusterMembership Pagination Fields on GetClusterMembers
* Expanded ClusterMembership tests to include pagination
2020-02-11 09:06:18 -08:00
Yu XiaandGitHub cfd83e3ed3 Add DLQ Admin APIs and Integrate with CLI (#3010)
*Domain DLQ implementation
*Admin APIs
*CLI for DLQ operations
2020-02-10 13:39:55 -08:00
Shawn HathawayandGitHub 4698cf4291 Add ClusterMembership Persistence Capabilities (#117)
This change adds three new apis to the ClusterMetadataManager persistence client across Mysql, Postgresql and Cassandra implementations:

- GetActiveClusterMembers
- UpsertClusterMembership
- PruneClusterMembership

This paves the way for a subsequent change to persist and coordinate cluster membership through this layer.
2020-02-07 17:34:54 -08:00
Alex Shtin 0e4ca57040 Merge from uber/cadence on 01-23-20. 2020-01-23 15:37:35 -08:00
Shawn HathawayandGitHub d7f9a4853a Immutable ClusterMetadata Persistence (#71)
This builds upon https://github.com/temporalio/temporal/pull/65 and implements the logic on top of the provided schemas to make the number of history shards and the cluster name read-only configuration.

See PR commits for step by step vertical implementation of a configuration value to the persistence layer.
2020-01-21 18:15:32 -08:00
Yu XiaandGitHub 23a5d6713d Add Domain Replication DLQ (#2964)
* Add Domain Replication DLQ

* Adding query range, limit and order on the DB dlq query
2020-01-13 20:52:04 -08:00
Alex Shtin b8169a84bf Merge remote-tracking branch 'cadence/master' into merge/cadence-12-19-19
Conflicts:
	.gen/go/history/history.go
	.gen/go/temporal/temporal.go
	cmd/server/cadence/cadence.go
	cmd/server/cadence/server.go
	cmd/tools/sql/main.go
	common/service/service.go
	docs/persistence.md
	go.mod
	go.sum
	service/frontend/dcRedirectionHandler.go
	service/frontend/service.go
	service/history/conflictResolver_test.go
	service/history/historyBuilder_test.go
	service/history/historyCache_test.go
	service/history/historyEngine.go
	service/history/historyEngine2_test.go
	service/history/historyEngine3_eventsv2_test.go
	service/history/historyEngine_test.go
	service/history/historyReplicator_test.go
	service/history/mutableStateBuilder_test.go
	service/history/nDCActivityReplicator_test.go
	service/history/nDCBranchMgr_test.go
	service/history/nDCConflictResolver_test.go
	service/history/nDCStateRebuilder_test.go
	service/history/nDCTransactionMgr_test.go
	service/history/nDCWorkflowResetter_test.go
	service/history/queueAckMgr_test.go
	service/history/replicatorQueueProcessor_test.go
	service/history/shardController_test.go
	service/history/stateBuilder_test.go
	service/history/taskProcessor_test.go
	service/history/timerQueueAckMgr_test.go
	service/history/timerQueueActiveProcessor_test.go
	service/history/timerQueueProcessorBase_test.go
	service/history/timerQueueStandbyProcessor_test.go
	service/history/transferQueueActiveProcessor_test.go
	service/history/transferQueueStandbyProcessor_test.go
	service/history/workflowResetor_test.go
	service/history/workflowResetter_test.go
	service/matching/handler.go
2019-12-19 16:07:20 -08:00
Yu XiaandGitHub 385dd85f24 [Kafka deprecation] Move ack level to source cluster (#2896)
* Add ack level to source cluster and source cluster can clean up replication task based on min ack level from all other clusters
* Add sync shard info from get replication messages API
2019-12-17 15:18:25 -08:00
Samar Abbas 34bd0a03c2 resolve all merge conflicts and unit tests to work again 2019-12-10 12:20:56 -08:00
Quanzheng LongandGitHub fdee70fac9 Persistence refactoring to be pluggable for any database (#2836) 2019-12-05 15:59:09 -08:00