Yu XiaandYichao Yang 04d6b6cb40 Handle data corruption in history resend (#5398) ...

Handle data corruption in history resend.

1. When source cluster has a data corruption issue, it can ship partial
data in resend history. With the two layers of resending (this is to
handle resend across different workflow runs), this will cause a chain
reaction.

Unit tests

<!-- Assuming the worst case, what can be broken when deploying this
change to production? -->

<!-- Is this PR a hotfix candidate or does it require a notification to
be sent to the broader community? (Yes/No) -->

2024-04-26 13:53:54 -07:00

..

ack_manager_mock.go

Wire replication stream E2E (#4097)

2023-03-29 11:45:25 -07:00

ack_manager_test.go

No shard lock on I/O: Use task key manager in shard context (#5029)

2023-11-22 15:43:34 -08:00

ack_manager.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

batchable_task_mock.go

Implement the batching functionality on history event replication task (#4916)

2023-10-16 19:02:02 +00:00

batchable_task_test.go

Implement the batching functionality on history event replication task (#4916)

2023-10-16 19:02:02 +00:00

batchable_task.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

bi_direction_stream_test.go

Bugfix: do not leak gRPC stream (#4368)

2023-05-19 01:07:47 -07:00

bi_direction_stream.go

Improve XDC Logging (#4917)

2023-10-02 11:58:50 -07:00

dlq_handler_mock.go

Return raw replication task info from read dlq api (#4007)

2023-03-06 09:12:56 -08:00

dlq_handler_test.go

Return raw replication task info from read dlq api (#4007)

2023-03-06 09:12:56 -08:00

dlq_handler.go

Return raw replication task info from read dlq api (#4007)

2023-03-06 09:12:56 -08:00

dlq_writer_test.go

Adding metrics when a task is enqueued to DLQ (#5120)

2023-11-15 23:19:24 +00:00

dlq_writer.go

Support re-enqueuing DLQ'd replication tasks (#5070)

2023-11-08 13:26:47 -08:00

eager_namespace_refresher_mock.go

Wire EagerNamespaceRefresher into the replication task processing logic (#4776)

2023-08-22 10:46:21 -07:00

eager_namespace_refresher_test.go

Wire EagerNamespaceRefresher into the replication task processing logic (#4776)

2023-08-22 10:46:21 -07:00

eager_namespace_refresher.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

executable_activity_state_task_test.go

Replace gogo/protobuf with google/protobuf (#5032)

2023-11-21 15:19:37 -08:00

executable_activity_state_task.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

executable_history_task_test.go

Fix eventsBatch in Batching logic (#5154)

2023-11-28 22:57:15 +00:00

executable_history_task.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

executable_noop_task_test.go

Support re-enqueuing DLQ'd replication tasks (#5070)

2023-11-08 13:26:47 -08:00

executable_noop_task.go

Wire EagerNamespaceRefresher into the replication task processing logic (#4776)

2023-08-22 10:46:21 -07:00

executable_task_converter.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

executable_task_mock.go

Add Import function to executableTask implementation (#5099)

2023-11-17 17:56:29 +00:00

executable_task_test.go

Handle data corruption in history resend (#5398)

2024-04-26 13:53:54 -07:00

executable_task_tool_box.go

Add Import function to executableTask implementation (#5099)

2023-11-17 17:56:29 +00:00

executable_task_tracker_mock.go

Bugfix: ExecutableTaskTracker LowWatermark funcion (#4343)

2023-05-15 15:47:48 -07:00

executable_task_tracker_test.go

Bugfix: ExecutableTaskTracker LowWatermark funcion (#4343)

2023-05-15 15:47:48 -07:00

executable_task_tracker.go

Bugfix: ExecutableTaskTracker LowWatermark funcion (#4343)

2023-05-15 15:47:48 -07:00

executable_task.go

Handle data corruption in history resend (#5398)

2024-04-26 13:53:54 -07:00

executable_unknown_task_test.go

Support re-enqueuing DLQ'd replication tasks (#5070)

2023-11-08 13:26:47 -08:00

executable_unknown_task.go

Wire EagerNamespaceRefresher into the replication task processing logic (#4776)

2023-08-22 10:46:21 -07:00

executable_workflow_state_task_test.go

Support re-enqueuing DLQ'd replication tasks (#5070)

2023-11-08 13:26:47 -08:00

executable_workflow_state_task.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

fx.go

Add Import function to executableTask implementation (#5099)

2023-11-17 17:56:29 +00:00

grpc_stream_client.go

Enforce uniqueness of replication stream (#4448)

2023-06-08 11:18:04 -07:00

metrics.go

Add additional metrics for stream replication (#4323)

2023-05-14 20:08:17 -07:00

noop_dlq_writer.go

Support re-enqueuing DLQ'd replication tasks (#5070)

2023-11-08 13:26:47 -08:00

poller_manager_test.go

Return error if cluster metadata is invalid (#3879)

2023-02-01 15:05:05 -08:00

poller_manager.go

Add util to map shard IDs (#4175)

2023-04-17 18:18:50 -07:00

raw_task_converter_mock.go

Make replication task convertor injectable by fx (#4635)

2023-07-18 10:13:15 -07:00

raw_task_converter_test.go

Replace gogo/protobuf with google/protobuf (#5032)

2023-11-21 15:19:37 -08:00

raw_task_converter.go

Fix nil panic (#5153)

2023-11-27 23:04:25 +00:00

remote_history_paginated_fetcher_mock.go

Add Import function to executableTask implementation (#5099)

2023-11-17 17:56:29 +00:00

remote_history_paginated_fetcher_test.go

Replace gogo/protobuf with google/protobuf (#5032)

2023-11-21 15:19:37 -08:00

remote_history_paginated_fetcher.go

Add Import function to executableTask implementation (#5099)

2023-11-17 17:56:29 +00:00

sequential_batch_queue_test.go

Implement the batching functionality on history event replication task (#4916)

2023-10-16 19:02:02 +00:00

sequential_batch_queue.go

Implement the batching functionality on history event replication task (#4916)

2023-10-16 19:02:02 +00:00

sequential_queue.go

Wf key hash (#4877)

2023-09-15 10:10:49 -07:00

stream_receiver_mock.go

Remove common.Daemon interface (#4573)

2023-07-03 10:30:11 -07:00

stream_receiver_monitor_test.go

Replace gogo/protobuf with google/protobuf (#5032)

2023-11-21 15:19:37 -08:00

stream_receiver_monitor.go

Split replication executable tool box and task converter (#4838)

2023-09-11 17:02:36 -07:00

stream_receiver_test.go

Add panic wrapper on replication stream (#5170)

2023-11-29 18:59:41 +00:00

stream_receiver.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

stream_sender_mock.go

Make replication task convertor injectable by fx (#4635)

2023-07-18 10:13:15 -07:00

stream_sender_test.go

Add panic wrapper on replication stream (#5170)

2023-11-29 18:59:41 +00:00

stream_sender.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

stream.go

Enforce uniqueness of replication stream (#4448)

2023-06-08 11:18:04 -07:00

task_executor_mock.go

Capture panic in replication task processing (#3799)

2023-01-11 16:25:52 -08:00

task_executor_test.go

Remove failover levels (#3854)

2023-01-26 16:56:55 -08:00

task_executor.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

task_fetcher_mock.go

Remove common.Daemon interface (#4573)

2023-07-03 10:30:11 -07:00

task_fetcher_test.go

Remove unused metrics.ServiceIdx (#4454)

2023-06-08 22:12:26 -07:00

task_fetcher.go

Remove common.Daemon interface (#4573)

2023-07-03 10:30:11 -07:00

task_processor_manager_test.go

No shard lock on I/O: Use task key manager in shard context (#5029)

2023-11-22 15:43:34 -08:00

task_processor_manager.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00

task_processor_mock.go

Refactor replication related components (#2816)

2022-05-09 22:49:18 -07:00

task_processor_test.go

Replace gogo/protobuf with google/protobuf (#5032)

2023-11-21 15:19:37 -08:00

task_processor.go

Rename metricDefinition getters to follow Go's guidelines (#5185)

2023-11-30 16:34:29 -08:00