Skipping 843 KB..
Full LogTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTest
check log contain failed 9-th time, retry later
[Thu May 30 15:48:15 CST 2024] <<<<<< start DM-035 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl1_1/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:16 CST 2024] <<<<<< finish DM-122 optimistic >>>>>>
dmctl test cmd: "query-status test"
got=2 expected=2
run tidb sql failed 1-th time, retry later
[Thu May 30 15:48:17 CST 2024] <<<<<< start DM-123 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-pessimistic.yaml --remove-meta"
check log contain failed 10-th time, retry later
dmctl test cmd: "stop-task test"
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
[Thu May 30 15:48:19 CST 2024] <<<<<< finish DM-035 optimistic >>>>>>
check log contain failed 11-th time, retry later
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
check log contain failed 12-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:21 CST 2024] <<<<<< finish DM-123 pessimistic >>>>>>
[Thu May 30 15:48:21 CST 2024] <<<<<< start DM-123 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
check log contain failed 13-th time, retry later
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:48:25 CST 2024] <<<<<< test case shardddl1_1 success! >>>>>>
start running case: [shardddl2] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:48:25 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
check log contain failed 14-th time, retry later
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:26 CST 2024] <<<<<< finish DM-123 optimistic >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
[Thu May 30 15:48:27 CST 2024] <<<<<< start DM-124 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
check log contain failed 15-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:48:28 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl2/source1.yaml"
[Thu May 30 15:48:29 CST 2024] <<<<<< finish DM-124 optimistic >>>>>>
[Thu May 30 15:48:29 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check log contain failed 16-th time, retry later
[Thu May 30 15:48:30 CST 2024] <<<<<< start DM-125 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl2/source2.yaml"
[Thu May 30 15:48:31 CST 2024] <<<<<< start DM-DROP_COLUMN_EXEC_ERROR optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 17-th time, retry later
check diff failed 1-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
restart dm-worker 1
check log contain failed 18-th time, retry later
wait process dm-worker1 exit...
check diff successfully
dmctl test cmd: "shard-ddl-lock"
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:34 CST 2024] <<<<<< finish DM-125 optimistic >>>>>>
wait process dm-worker1 exit...
process dm-worker1 already exit
[Thu May 30 15:48:35 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check log contain failed 19-th time, retry later
[Thu May 30 15:48:35 CST 2024] <<<<<< start DM-126 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8262 is alive
check log contain failed 1-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
dmctl test cmd: "query-status t-Ë!s`t"
check log contain failed 20-th time, retry later
dmctl test cmd: "query-status test"
got=1 expected=1
restart dm-master
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task t-Ë!s`t"
wait process dm-master exit...
check diff successfully
dmctl test cmd: "shard-ddl-lock"
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:39 CST 2024] <<<<<< finish DM-126 optimistic >>>>>>
check log contain failed 21-th time, retry later
wait process dm-master exit...
[Thu May 30 15:48:40 CST 2024] <<<<<< start DM-127 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master exit...
process dm-master already exit
check log contain failed 22-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
[Thu May 30 15:48:43 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
check log contain failed 23-th time, retry later
check diff successfully
dmctl test cmd: "shard-ddl-lock"
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:45 CST 2024] <<<<<< finish DM-127 optimistic >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
check log contain failed 24-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:48:46 CST 2024] <<<<<< start DM-128 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-pessimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 0-th time, will retry again
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-master.test exit...
process dm-master.test already exit
check log contain failed 25-th time, retry later
got=1 expected=1
got=1 expected=1
restart dm-worker 1
wait process dm-worker.test exit...
wait process dm-worker1 exit...
check log contain failed 26-th time, retry later
wait process dm-worker.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:50 CST 2024] <<<<<< finish DM-128 pessimistic >>>>>>
[Thu May 30 15:48:50 CST 2024] <<<<<< start DM-128 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker1 exit...
process dm-worker1 already exit
[Thu May 30 15:48:50 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:48:51 CST 2024] <<<<<< finish test_query_timeout >>>>>>
[Thu May 30 15:48:51 CST 2024] <<<<<< start test_regexpr_router regexpr-task.yaml >>>>>>
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:48:51 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "query-status test"
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 27-th time, retry later
got=3 expected=3
check diff successfully
dmctl test cmd: "stop-task test"
check diff failed 1-th time, retry later
[Thu May 30 15:48:52 CST 2024] <<<<<< finish DM-128 optimistic >>>>>>
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:48:52 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
[Thu May 30 15:48:53 CST 2024] <<<<<< start DM-129 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8262 is alive
[Thu May 30 15:48:53 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check log contain failed 28-th time, retry later
check diff failed 2-th time, retry later
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source1.yaml"
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source2.yaml"
check log contain failed 29-th time, retry later
dmctl test cmd: "start-task /tmp/dm_test/all_mode/regexpr-task.yaml --remove-meta"
check diff successfully
dmctl test cmd: "stop-task test"
dmctl test cmd: "start-task /tmp/dm_test/all_mode/regexpr-task.yaml --remove-meta"
[Thu May 30 15:48:56 CST 2024] <<<<<< finish DM-DROP_COLUMN_EXEC_ERROR optimistic >>>>>>
[Thu May 30 15:48:56 CST 2024] <<<<<< start DM-INIT_SCHEMA optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:57 CST 2024] <<<<<< finish DM-129 pessimistic >>>>>>
[Thu May 30 15:48:57 CST 2024] <<<<<< start DM-129 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
check diff successfully
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 1-th time, retry later
check log contain failed 1-th time, retry later
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:48:59 CST 2024] <<<<<< finish DM-129 optimistic >>>>>>
wait process dm-master.test exit...
check diff successfully
[Thu May 30 15:49:00 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
restart dm-master
[Thu May 30 15:49:00 CST 2024] <<<<<< start DM-130 pessimistic >>>>>>
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/duplicate_event/source2.yaml"
wait process dm-master exit...
wait process dm-worker.test exit...
use sync_diff_inspector to check increment data
check diff successfully
check diff successfully
data checked after one worker was killed
try to kill worker port 8263
wait process dm-worker2 exit...
wait process dm-worker2 exit...
process dm-worker2 already exit
worker2 was killed
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test2"
got=2 expected=2
[Thu May 30 15:48:59 CST 2024] <<<<<< finish test_multi_task_reduce_and_restart_worker >>>>>>
3 dm-master alive
3 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master exit...
process dm-master already exit
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-task-relay.yaml --remove-meta"
dmctl test cmd: "stop-task test"
[Thu May 30 15:49:02 CST 2024] <<<<<< finish DM-130 pessimistic >>>>>>
[Thu May 30 15:49:02 CST 2024] <<<<<< start DM-130 optimistic >>>>>>
wait process dm-master.test exit...
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:49:03 CST 2024] <<<<<< finish test_regexpr_router regexpr-task.yaml >>>>>>
[Thu May 30 15:49:03 CST 2024] <<<<<< start test_regexpr_router regexpr-task-lightning.yaml >>>>>>
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:49:03 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "start-relay -s mysql-replica-02 worker2"
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 1-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:49:04 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker1.toml >>>>>>
[Thu May 30 15:49:04 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master.test exit...
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
got=2 expected=2
dmctl test cmd: "query-status -s mysql-replica-02"
got=1 expected=1
check diff failed 1-th time, retry later
wait process dm-master.test exit...
rpc addr 127.0.0.1:8262 is alive
[Thu May 30 15:49:05 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
got=2 expected=2
got=1 expected=1
dmctl test cmd: "shard-ddl-lock unlock test-`shardddl`.`tb` -s mysql-replica-02 -d shardddl1 -t tb1 --action skip"
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
got=2 expected=2
got=1 expected=1
dmctl test cmd: "shard-ddl-lock unlock test-`shardddl`.`tb` -s mysql-replica-02 -d shardddl1 -t tb2 --action skip"
wait process dm-master.test exit...
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source1.yaml"
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source2.yaml"
dmctl test cmd: "query-status test"
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=3 expected=3
check diff successfully
dmctl test cmd: "stop-task test"
check diff successfully
dmctl test cmd: "stop-task test"
check diff failed 2-th time, retry later
[Thu May 30 15:49:07 CST 2024] <<<<<< finish DM-130 optimistic >>>>>>
wait process dm-master.test exit...
[Thu May 30 15:49:07 CST 2024] <<<<<< finish DM-INIT_SCHEMA optimistic >>>>>>
[Thu May 30 15:49:07 CST 2024] <<<<<< start DM-DROP_COLUMN_ALL_DONE optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "start-task /tmp/dm_test/all_mode/regexpr-task-lightning.yaml --remove-meta"
dmctl test cmd: "start-task /tmp/dm_test/all_mode/regexpr-task-lightning.yaml --remove-meta"
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:49:08 CST 2024] <<<<<< test case ha_cases2 success! >>>>>>
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tiflow-release-7.5-pull_dm_integration_test-545/tiflow-dm already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
dmctl test cmd: "query-status test"
got=2 expected=2
restart dm-worker 2
[Pipeline] }
[Pipeline] // container
[Pipeline] }
check diff failed 3-th time, retry later
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
check diff successfully
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
wait process dm-master.test exit...
wait process dm-worker2 exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-master.test exit...
check diff failed 4-th time, retry later
wait process dm-worker2 exit...
process dm-worker2 already exit
[Thu May 30 15:49:11 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait process dm-worker.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
rpc addr 127.0.0.1:8263 is alive
check log contain failed 1-th time, retry later
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:49:13 CST 2024] <<<<<< test case shardddl4 success! >>>>>>
start running case: [shardddl4_1] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/run.sh...
Verbose mode = false
check diff failed 5-th time, retry later
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
dmctl test cmd: "query-status test"
[Thu May 30 15:49:14 CST 2024] <<<<<< finish test_regexpr_router regexpr-task-lightning.yaml >>>>>>
[Thu May 30 15:49:15 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-master.toml >>>>>>
got=1 expected=1
restart dm-master
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:49:15 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
check diff failed 6-th time, retry later
wait process dm-master exit...
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:49:16 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
wait process dm-master exit...
process dm-master already exit
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:49:17 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source1.yaml"
[Thu May 30 15:49:17 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker2.toml >>>>>>
check diff successfully
binlog_pos: 2356 relay_log_size: 2356
============== run_with_prepared_source_config success ===================
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait process dm-master.test exit...
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl4_1/source1.yaml"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source2.yaml"
[Thu May 30 15:49:19 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
[Thu May 30 15:49:19 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "start-task /tmp/dm_test/all_mode/dm-task.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl4_1/source2.yaml"
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
wait process dm-worker.test exit...
dmctl test cmd: "query-status t-Ë!s`t"
got=1 expected=1
dmctl test cmd: "stop-task /tmp/dm_test/all_mode/dm-task.yaml"
dmctl test cmd: "start-task /tmp/dm_test/all_mode/dm-task.yaml --remove-meta"
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
restart dm-worker 2
wait process dm-worker.test exit...
[Thu May 30 15:49:21 CST 2024] <<<<<< start DM-TABLE_CHECKPOINT_BACKWARD optimistic >>>>>>
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
check diff successfully
[Thu May 30 15:49:22 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-worker2 exit...
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:49:23 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-worker1.toml >>>>>>
wait process dm-worker2 exit...
process dm-worker2 already exit
[Thu May 30 15:49:23 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status -s mysql-replica-01"
dmctl test cmd: "pause-task t-Ë!s`t"
dmctl test cmd: "operate-schema set -s mysql-replica-01 t-Ë!s`t -d all_mode -t no_diff /tmp/dm_test/all_mode/schema.sql"
dmctl test cmd: "resume-task t-Ë!s`t"
wait pattern dm-worker1.toml exit...
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "query-status test"
wait pattern dm-worker1.toml exit...
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/duplicate_event/source1.yaml"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
got=3 expected=3
check diff failed 1-th time, retry later
wait pattern dm-worker1.toml exit...
wait pattern dm-worker1.toml exit...
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-task.yaml --remove-meta"
wait pattern dm-worker1.toml exit...
wait pattern dm-worker1.toml exit...
wait pattern dm-worker1.toml exit...
pattern dm-worker1.toml already exit
[Thu May 30 15:49:25 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 1-th time, retry later
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "query-status t-Ë!s`t"
got=1 expected=1
wait pattern dm-worker2.toml exit...
wait pattern dm-worker2.toml exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:49:27 CST 2024] <<<<<< finish DM-DROP_COLUMN_ALL_DONE optimistic >>>>>>
[Thu May 30 15:49:27 CST 2024] <<<<<< start DM-RECOVER_LOCK optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait pattern dm-worker2.toml exit...
wait pattern dm-worker2.toml exit...
wait pattern dm-worker2.toml exit...
wait pattern dm-worker2.toml exit...
check log contain failed 2-th time, retry later
wait pattern dm-worker2.toml exit...
pattern dm-worker2.toml already exit
[Thu May 30 15:49:28 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/all_mode/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check log contain failed 1-th time, retry later
rpc addr 127.0.0.1:8263 is alive
check log contain failed 3-th time, retry later
check log contain failed 1-th time, retry later
check log contain failed 4-th time, retry later
restart dm-master
wait process dm-master exit...
check log contain failed 5-th time, retry later
wait process dm-master exit...
process dm-master already exit
check log contain failed 6-th time, retry later
[Thu May 30 15:49:37 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
check log contain failed 7-th time, retry later
rpc addr 127.0.0.1:8261 is alive
restart dm-master
after restart dm-worker, task should resume automatically
dmctl test cmd: "start-task /tmp/dm_test/all_mode/dm-task.yaml"
check log contain failed 8-th time, retry later
wait process dm-master exit...
wait process dm-master exit...
process dm-master already exit
HTTP 127.0.0.1:8261/apis/v1alpha1/status/t-Ë!s`t is alive
check log contain failed 9-th time, retry later
[Thu May 30 15:49:44 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
check log contain failed 10-th time, retry later
rpc addr 127.0.0.1:8261 is alive
check diff failed 1-th time, retry later
wait process tidb-server exit...
process tidb-server already exit
check log contain failed 11-th time, retry later
check diff successfully
dmctl test cmd: "shard-ddl-lock"
Starting TiDB on port 4000
Verifying TiDB is started...
ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)
got=1 expected=1
dmctl test cmd: "stop-task test"
[Thu May 30 15:49:49 CST 2024] <<<<<< finish DM-RECOVER_LOCK optimistic >>>>>>
run DM_DropAddColumn case #0
[Thu May 30 15:49:49 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
check log contain failed 12-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
VARIABLE_NAME VARIABLE_VALUE COMMENT
bootstrapped True Bootstrap flag. Do not delete.
tidb_server_version 180 Bootstrap version. Do not delete.
system_tz Asia/Shanghai TiDB Global System Timezone.
new_collation_enabled True If the new collations are enabled. Do not edit it.
ddl_table_version 3 DDL Table Version. Do not delete.
ERROR 1396 (HY000) at line 1: Operation CREATE USER failed for 'test'@'%'
check diff successfully
check log contain failed 1-th time, retry later
check log contain failed 13-th time, retry later
check diff failed 1-th time, retry later
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
check log contain failed 14-th time, retry later
check diff successfully
dmctl test cmd: "pause-relay -s mysql-replica-01"
dmctl test cmd: "resume-relay -s mysql-replica-01"
check log contain failed 15-th time, retry later
check diff failed 2-th time, retry later
check log contain failed 16-th time, retry later
relay logs dm-it-f736575a-2dc6-454c-841b-c486aca56cd8-rjd34-fwhg0-bin.000002
relay.meta
check diff successfully
check dump files have been cleaned
ls: cannot access /tmp/dm_test/all_mode/worker2/dumped_data.t-Ë!s`t: No such file or directory
worker2 auto removed dump files
check no password in log
dmctl test cmd: "query-status t-Ë!s`t"
got=1 expected=1
dmctl test cmd: "stop-task t-Ë!s`t"
check diff failed 3-th time, retry later
matched
matched
[Thu May 30 15:49:57 CST 2024] <<<<<< start test_source_and_target_with_empty_gtid >>>>>>
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
check log contain failed 17-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:50:00 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #1
[Thu May 30 15:50:00 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
process dm-master.test already exit
check log contain failed 18-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
restart dm-master
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:50:02 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /tmp/dm_test/all_mode/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master exit...
check log contain failed 19-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:50:03 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /tmp/dm_test/all_mode/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-master exit...
process dm-master already exit
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/all_mode/source1.yaml"
got=2 expected=2
got=1 expected=1
check master alive
dmctl test cmd: "list-member"
got=1 expected=1
gtid is empty
start task and check stage
dmctl test cmd: "start-task /tmp/dm_test/all_mode/dm-task-no-gtid.yaml --remove-meta=true"
check log contain failed 20-th time, retry later
[Thu May 30 15:50:06 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
got=2 expected=2
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
got=2 expected=2
check data
check diff successfully
ERROR 1146 (42S02) at line 1: Table 'all_mode.t2' doesn't exist
run tidb sql failed 1-th time, retry later
check log contain failed 21-th time, retry later
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
check log contain failed 1-th time, retry later
dmctl test cmd: "query-status test"
got=1 expected=1
check log contain failed 1-th time, retry later
check log contain failed 22-th time, retry later
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
check log contain failed 23-th time, retry later
check diff failed 1-th time, retry later
check diff failed 2-th time, retry later
check diff failed 3-th time, retry later
check diff failed 4-th time, retry later
check log contain failed 24-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
check diff failed 2-th time, retry later
[Thu May 30 15:50:14 CST 2024] <<<<<< finish DM-TABLE_CHECKPOINT_BACKWARD optimistic >>>>>>
[Thu May 30 15:50:14 CST 2024] <<<<<< start DM-RESYNC_NOT_FLUSHED optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
check log contain failed 25-th time, retry later
check diff failed 3-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
restart dm-worker1
wait process worker1 exit...
check log contain failed 26-th time, retry later
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
wait process worker1 exit...
process worker1 already exit
[Thu May 30 15:50:18 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
dmctl test cmd: "resume-task test"
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:50:18 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #2
[Thu May 30 15:50:18 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8262 is alive
restart dm-worker2
check log contain failed 27-th time, retry later
dmctl test cmd: "query-status test"
wait process worker2 exit...
got=2 expected=2
check diff successfully
restart dm-master
wait process dm-master exit...
wait process worker2 exit...
process worker2 already exit
[Thu May 30 15:50:21 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check log contain failed 28-th time, retry later
rpc addr 127.0.0.1:8263 is alive
wait process dm-master exit...
process dm-master already exit
check log contain failed 29-th time, retry later
[Thu May 30 15:50:24 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
check log contain failed 30-th time, retry later
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
check log contain failed 1-th time, retry later
check diff failed 2-th time, retry later
check diff successfully
[Thu May 30 15:50:29 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/duplicate_event/source2.yaml"
check diff failed 3-th time, retry later
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/duplicate_event/conf/dm-task-relay.yaml --remove-meta"
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
check diff successfully
dmctl test cmd: "start-relay -s mysql-replica-02 worker2"
dmctl test cmd: "resume-task test"
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:50:34 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #3
[Thu May 30 15:50:34 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
[Thu May 30 15:50:33 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
[Thu May 30 15:50:34 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
got=2 expected=2
dmctl test cmd: "query-status -s mysql-replica-02"
got=1 expected=1
check diff successfully
binlog_pos: 2356 relay_log_size: 2356
============== run_with_prepared_source_config success ===================
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
rpc addr 127.0.0.1:8263 is alive
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
check log contain failed 1-th time, retry later
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
restart dm-master
wait process dm-worker.test exit...
wait process dm-master exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:50:39 CST 2024] <<<<<< test case duplicate_event success! >>>>>>
start running case: [expression_filter] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:50:40 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
dmctl test cmd: "query-status test"
got=1 expected=1
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:50:41 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/source1.yaml"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-task2.yaml"
wait process dm-master exit...
wait process dm-master exit...
process dm-master already exit
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-task2.yaml "
[Thu May 30 15:50:45 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
got=0 expected=1
command: query-status test "synced": true count: 0 != expected: 1, failed the 0-th time, will retry again
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
got=2 expected=2
got=1 expected=1
dmctl test cmd: "stop-task test"
ls: cannot access /tmp/dm_test/expression_filter/worker1/schema-tracker*: No such file or directory
schema tracker path has been cleaned
1 dm-master alive
1 dm-worker alive
0 dm-syncer alive
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
check diff failed 2-th time, retry later
wait process dm-worker.test exit...
wait process dm-worker.test exit...
check diff failed 3-th time, retry later
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:50:52 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:50:53 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
check diff successfully
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/source1.yaml"
[Thu May 30 15:50:55 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #4
[Thu May 30 15:50:55 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/expression_filter/conf/dm-task.yaml "
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
check log contain failed 1-th time, retry later
check diff successfully
restart dm-worker1
wait process worker1 exit...
wait process worker1 exit...
process worker1 already exit
[Thu May 30 15:50:58 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
restart dm-master
rpc addr 127.0.0.1:8262 is alive
restart dm-worker2
wait process dm-master exit...
wait process worker2 exit...
wait process dm-master exit...
process dm-master already exit
wait process worker2 exit...
process worker2 already exit
[Thu May 30 15:51:01 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
1 dm-master alive
1 dm-worker alive
0 dm-syncer alive
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:03 CST 2024] <<<<<< finish DM-RESYNC_NOT_FLUSHED optimistic >>>>>>
[Thu May 30 15:51:03 CST 2024] <<<<<< start DM-RESYNC_TXN_INTERRUPT optimistic >>>>>>
wait process dm-master.test exit...
[Thu May 30 15:51:03 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "query-status test"
got=2 expected=2
restart dm-worker1
wait process dm-worker.test exit...
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
wait process worker1 exit...
wait process dm-worker.test exit...
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
wait process worker1 exit...
process worker1 already exit
[Thu May 30 15:51:06 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:06 CST 2024] <<<<<< test case expression_filter success! >>>>>>
start running case: [extend_column] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
running extend_column case with import_mode: sql
[Thu May 30 15:51:07 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
restart dm-worker2
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:51:08 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process worker2 exit...
check diff failed 2-th time, retry later
rpc addr 127.0.0.1:8262 is alive
[Thu May 30 15:51:09 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait process worker2 exit...
process worker2 already exit
[Thu May 30 15:51:09 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/extend_column/source1.yaml"
dmctl test cmd: "operate-source create /tmp/dm_test/extend_column/source2.yaml"
rpc addr 127.0.0.1:8263 is alive
begin;
insert into shardddl1.tb2 values (1,1);
insert into shardddl1.tb2 values (2,2);
insert into shardddl1.tb2 values (3,3);
insert into shardddl1.tb2 values (4,4);
insert into shardddl1.tb2 values (5,5);
insert into shardddl1.tb2 values (6,6);
insert into shardddl1.tb2 values (7,7);
insert into shardddl1.tb2 values (8,8);
insert into shardddl1.tb2 values (9,9);
insert into shardddl1.tb2 values (10,10);
commit;
begin;
insert into shardddl1.t_1 values (11,11);
insert into shardddl1.t_1 values (12,12);
insert into shardddl1.t_1 values (13,13);
insert into shardddl1.t_1 values (14,14);
insert into shardddl1.t_1 values (15,15);
insert into shardddl1.t_1 values (16,16);
insert into shardddl1.t_1 values (17,17);
insert into shardddl1.t_1 values (18,18);
insert into shardddl1.t_1 values (19,19);
insert into shardddl1.t_1 values (20,20);
insert into shardddl1.t_1 values (21,21);
insert into shardddl1.t_1 values (22,22);
insert into shardddl1.t_1 values (23,23);
insert into shardddl1.t_1 values (24,24);
insert into shardddl1.t_1 values (25,25);
insert into shardddl1.t_1 values (26,26);
insert into shardddl1.t_1 values (27,27);
insert into shardddl1.t_1 values (28,28);
insert into shardddl1.t_1 values (29,29);
insert into shardddl1.t_1 values (30,30);
insert into shardddl1.t_1 values (31,31);
insert into shardddl1.t_1 values (32,32);
insert into shardddl1.t_1 values (33,33);
insert into shardddl1.t_1 values (34,34);
insert into shardddl1.t_1 values (35,35);
insert into shardddl1.t_1 values (36,36);
insert into shardddl1.t_1 values (37,37);
insert into shardddl1.t_1 values (38,38);
insert into shardddl1.t_1 values (39,39);
insert into shardddl1.t_1 values (40,40);
insert into shardddl1.t_1 values (41,41);
insert into shardddl1.t_1 values (42,42);
insert into shardddl1.t_1 values (43,43);
insert into shardddl1.t_1 values (44,44);
insert into shardddl1.t_1 values (45,45);
insert into shardddl1.t_1 values (46,46);
insert into shardddl1.t_1 values (47,47);
insert into shardddl1.t_1 values (48,48);
insert into shardddl1.t_1 values (49,49);
insert into shardddl1.t_1 values (50,50);
commit;
begin;
insert into shardddl1.tb1 values (51,51);
insert into shardddl1.tb1 values (52,52);
insert into shardddl1.tb1 values (53,53);
insert into shardddl1.tb1 values (54,54);
insert into shardddl1.tb1 values (55,55);
insert into shardddl1.tb1 values (56,56);
insert into shardddl1.tb1 values (57,57);
insert into shardddl1.tb1 values (58,58);
insert into shardddl1.tb1 values (59,59);
insert into shardddl1.tb1 values (60,60);
commit;
begin;
insert into shardddl1.t_1 values (61,61);
insert into shardddl1.t_1 values (62,62);
insert into shardddl1.t_1 values (63,63);
insert into shardddl1.t_1 values (64,64);
insert into shardddl1.t_1 values (65,65);
insert into shardddl1.t_1 values (66,66);
insert into shardddl1.t_1 values (67,67);
insert into shardddl1.t_1 values (68,68);
insert into shardddl1.t_1 values (69,69);
insert into shardddl1.t_1 values (70,70);
commit;
check diff failed 1-th time, retry later
dmctl test cmd: "start-task /tmp/dm_test/extend_column/dm-task.yaml --remove-meta"
dmctl test cmd: "start-task /tmp/dm_test/extend_column/dm-task.yaml --remove-meta"
check diff failed 3-th time, retry later
check diff failed 2-th time, retry later
dmctl test cmd: "query-status test"
got=1 expected=1
run tidb sql failed 1-th time, retry later
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:15 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #5
[Thu May 30 15:51:15 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
check diff failed 3-th time, retry later
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
check log contain failed 1-th time, retry later
wait process dm-master.test exit...
check diff successfully
restart dm-worker1
wait process dm-master.test exit...
process dm-master.test already exit
wait process worker1 exit...
dmctl test cmd: "shard-ddl-lock"
wait process dm-worker.test exit...
got=1 expected=1
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
restart dm-master
wait process worker1 exit...
process worker1 already exit
[Thu May 30 15:51:19 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
wait process dm-master exit...
rpc addr 127.0.0.1:8262 is alive
restart dm-worker2
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
running extend_column case with import_mode: loader
[Thu May 30 15:51:20 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master exit...
process dm-master already exit
wait process worker2 exit...
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
wait process worker2 exit...
process worker2 already exit
[Thu May 30 15:51:22 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:51:22 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
[Thu May 30 15:51:23 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
begin;
insert into shardddl1.tb2 values (101,101);
insert into shardddl1.tb2 values (102,102);
insert into shardddl1.tb2 values (103,103);
insert into shardddl1.tb2 values (104,104);
insert into shardddl1.tb2 values (105,105);
insert into shardddl1.tb2 values (106,106);
insert into shardddl1.tb2 values (107,107);
insert into shardddl1.tb2 values (108,108);
insert into shardddl1.tb2 values (109,109);
insert into shardddl1.tb2 values (110,110);
commit;
begin;
insert into shardddl1.tb1 values (111,111);
insert into shardddl1.tb1 values (112,112);
insert into shardddl1.tb1 values (113,113);
insert into shardddl1.tb1 values (114,114);
insert into shardddl1.tb1 values (115,115);
insert into shardddl1.tb1 values (116,116);
insert into shardddl1.tb1 values (117,117);
insert into shardddl1.tb1 values (118,118);
insert into shardddl1.tb1 values (119,119);
insert into shardddl1.tb1 values (120,120);
commit;
begin;
insert into shardddl1.tb2 values (121,121);
insert into shardddl1.tb2 values (122,122);
insert into shardddl1.tb2 values (123,123);
insert into shardddl1.tb2 values (124,124);
insert into shardddl1.tb2 values (125,125);
insert into shardddl1.tb2 values (126,126);
insert into shardddl1.tb2 values (127,127);
insert into shardddl1.tb2 values (128,128);
insert into shardddl1.tb2 values (129,129);
insert into shardddl1.tb2 values (130,130);
commit;
begin;
insert into shardddl1.t_1 values (131,131);
insert into shardddl1.t_1 values (132,132);
insert into shardddl1.t_1 values (133,133);
insert into shardddl1.t_1 values (134,134);
insert into shardddl1.t_1 values (135,135);
insert into shardddl1.t_1 values (136,136);
insert into shardddl1.t_1 values (137,137);
insert into shardddl1.t_1 values (138,138);
insert into shardddl1.t_1 values (139,139);
insert into shardddl1.t_1 values (140,140);
commit;
check diff successfully
rpc addr 127.0.0.1:8262 is alive
[Thu May 30 15:51:24 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/extend_column/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
begin;
insert into shardddl1.tb2 values (201,201);
insert into shardddl1.tb2 values (202,202);
insert into shardddl1.tb2 values (203,203);
insert into shardddl1.tb2 values (204,204);
insert into shardddl1.tb2 values (205,205);
insert into shardddl1.tb2 values (206,206);
insert into shardddl1.tb2 values (207,207);
insert into shardddl1.tb2 values (208,208);
insert into shardddl1.tb2 values (209,209);
insert into shardddl1.tb2 values (210,210);
commit;
begin;
insert into shardddl1.tb1 values (211,211);
insert into shardddl1.tb1 values (212,212);
insert into shardddl1.tb1 values (213,213);
insert into shardddl1.tb1 values (214,214);
insert into shardddl1.tb1 values (215,215);
insert into shardddl1.tb1 values (216,216);
insert into shardddl1.tb1 values (217,217);
insert into shardddl1.tb1 values (218,218);
insert into shardddl1.tb1 values (219,219);
insert into shardddl1.tb1 values (220,220);
commit;
begin;
insert into shardddl1.tb2 values (221,221);
insert into shardddl1.tb2 values (222,222);
insert into shardddl1.tb2 values (223,223);
insert into shardddl1.tb2 values (224,224);
insert into shardddl1.tb2 values (225,225);
insert into shardddl1.tb2 values (226,226);
insert into shardddl1.tb2 values (227,227);
insert into shardddl1.tb2 values (228,228);
insert into shardddl1.tb2 values (229,229);
insert into shardddl1.tb2 values (230,230);
commit;
begin;
insert into shardddl1.t_1 values (231,231);
insert into shardddl1.t_1 values (232,232);
insert into shardddl1.t_1 values (233,233);
insert into shardddl1.t_1 values (234,234);
insert into shardddl1.t_1 values (235,235);
insert into shardddl1.t_1 values (236,236);
insert into shardddl1.t_1 values (237,237);
insert into shardddl1.t_1 values (238,238);
insert into shardddl1.t_1 values (239,239);
insert into shardddl1.t_1 values (240,240);
commit;
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/extend_column/source1.yaml"
dmctl test cmd: "operate-source create /tmp/dm_test/extend_column/source2.yaml"
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 0-th time, will retry again
check diff successfully
dmctl test cmd: "stop-task test"
dmctl test cmd: "start-task /tmp/dm_test/extend_column/dm-task.yaml --remove-meta"
dmctl test cmd: "start-task /tmp/dm_test/extend_column/dm-task.yaml --remove-meta"
[Thu May 30 15:51:26 CST 2024] <<<<<< finish DM-RESYNC_TXN_INTERRUPT optimistic >>>>>>
[Thu May 30 15:51:26 CST 2024] <<<<<< start DM-STRICT_OPTIMISTIC_SINGLE_SOURCE optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/single-source-strict-optimistic.yaml --remove-meta"
run tidb sql failed 1-th time, retry later
dmctl test cmd: "query-status test"
got=1 expected=1
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 1-th time, will retry again
[Thu May 30 15:51:28 CST 2024] <<<<<< finish DM-STRICT_OPTIMISTIC_SINGLE_SOURCE optimistic >>>>>>
[Thu May 30 15:51:28 CST 2024] <<<<<< start DM-STRICT_OPTIMISTIC_DOUBLE_SOURCE optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-strict-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 2-th time, will retry again
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
got=1 expected=1
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:31 CST 2024] <<<<<< finish DM-STRICT_OPTIMISTIC_DOUBLE_SOURCE optimistic >>>>>>
[Thu May 30 15:51:31 CST 2024] <<<<<< start DM-131 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 3-th time, will retry again
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:33 CST 2024] <<<<<< finish DM-131 optimistic >>>>>>
wait process dm-worker.test exit...
[Thu May 30 15:51:34 CST 2024] <<<<<< start DM-132 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-worker.test exit...
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 4-th time, will retry again
dmctl test cmd: "query-status test"
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:35 CST 2024] <<<<<< test case extend_column success! >>>>>>
start running case: [fake_rotate_event] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:35 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
got=2 expected=2
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:51:36 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 5-th time, will retry again
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/fake_rotate_event/source1.yaml"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/conf/dm-task.yaml --remove-meta"
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:38 CST 2024] <<<<<< finish DM-132 pessimistic >>>>>>
[Thu May 30 15:51:38 CST 2024] <<<<<< start DM-132 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 6-th time, will retry again
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
check diff successfully
kill dm-worker
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Thu May 30 15:51:40 CST 2024] <<<<<< finish DM-132 optimistic >>>>>>
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 7-th time, will retry again
wait process dm-worker1 exit...
process dm-worker1 already exit
[Thu May 30 15:51:41 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/fake_rotate_event/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
[Thu May 30 15:51:41 CST 2024] <<<<<< start DM-133 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8262 is alive
check diff successfully
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
1 dm-master alive
1 dm-worker alive
0 dm-syncer alive
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 8-th time, will retry again
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "query-status test"
got=1 expected=1
<<<<<< test_source_and_target_with_empty_gtid success! >>>>>>
1 dm-master alive
1 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
got=0 expected=1
command: query-status test because schema conflict detected count: 0 != expected: 1, failed the 9-th time, will retry again
wait process dm-worker.test exit...
[Thu May 30 15:51:46 CST 2024] <<<<<< finish DM-133 pessimistic >>>>>>
[Thu May 30 15:51:46 CST 2024] <<<<<< start DM-133 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:46 CST 2024] <<<<<< test case all_mode success! >>>>>>
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tiflow-release-7.5-pull_dm_integration_test-545/tiflow-dm already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
wait process dm-worker.test exit...
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
{
"result": true,
"msg": "",
"sources": [
{
"result": true,
"msg": "",
"sourceStatus": {
"source": "mysql-replica-01",
"worker": "worker1",
"result": null,
"relayStatus": null
},
"subTaskStatus": [
{
"name": "test",
"stage": "Paused",
"unit": "Sync",
"result": {
"isCanceled": false,
"errors": [
{
"ErrCode": 42501,
"ErrClass": "ha",
"ErrScope": "internal",
"ErrLevel": "high",
"Message": "startLocation: [position: (dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 42228), gtid-set: bc4e5ee7-1e57-11ef-83ce-667f93470dda:1-194], endLocation: [position: (dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 42353), gtid-set: bc4e5ee7-1e57-11ef-83ce-667f93470dda:1-195], origin SQL: [alter table shardddl1.tb1 add column b int after a]: fail to do etcd txn operation: txn commit failed",
"RawCause": "rpc error: code = Unavailable desc = error reading from server: EOF",
"Workaround": "Please check dm-master's node status and the network between this node and dm-master"
}
],
"detail": null
},
"unresolvedDDLLockID": "",
"sync": {
"totalEvents": "12",
"totalTps": "0",
"recentTps": "0",
"masterBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 42353)",
"masterBinlogGtid": "bc4e5ee7-1e57-11ef-83ce-667f93470dda:1-195",
"syncerBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 42163)",
"syncerBinlogGtid": "bc4e5ee7-1e57-11ef-83ce-667f93470dda:1-194",
"blockingDDLs": [
],
"unresolvedGroups": [
],
"synced": false,
"binlogType": "remote",
"secondsBehindMaster": "0",
"blockDDLOwner": "",
"conflictMsg": "",
"totalRows": "12",
"totalRps": "0",
"recentRps": "0"
},
"validation": null
}
]
},
{
"result": true,
"msg": "",
"sourceStatus": {
"source": "mysql-replica-02",
"worker": "worker2",
"result": null,
"relayStatus": {
"masterBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 39206)",
"masterBinlogGtid": "bed69e82-1e57-11ef-8248-667f93470dda:1-167",
"relaySubDir": "bed69e82-1e57-11ef-8248-667f93470dda.000001",
"relayBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 39206)",
"relayBinlogGtid": "bed69e82-1e57-11ef-8248-667f93470dda:1-167",
"relayCatchUpMaster": true,
"stage": "Running",
"result": null
}
},
"subTaskStatus": [
{
"name": "test",
"stage": "Running",
"unit": "Sync",
"result": null,
"unresolvedDDLLockID": "",
"sync": {
"totalEvents": "6",
"totalTps": "0",
"recentTps": "0",
"masterBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin.000001, 39206)",
"masterBinlogGtid": "bed69e82-1e57-11ef-8248-667f93470dda:1-167",
"syncerBinlog": "(dm-it-33c68001-94a4-4ffc-b622-0669e37e0319-3vxhq-w8gzs-bin|000001.000001, 38926)",
"syncerBinlogGtid": "bed69e82-1e57-11ef-8248-667f93470dda:1-166",
"blockingDDLs": [
],
"unresolvedGroups": [
],
"synced": false,
"binlogType": "local",
"secondsBehindMaster": "0",
"blockDDLOwner": "",
"conflictMsg": "",
"totalRows": "6",
"totalRps": "0",
"recentRps": "0"
},
"validation": null
}
]
}
]
}
PASS
coverage: 4.0% of statements in github.com/pingcap/tiflow/dm/...
curl: (7) Failed connect to 127.0.0.1:8361; Connection refused
curl: (7) Failed connect to 127.0.0.1:8461; Connection refused
curl: (7) Failed connect to 127.0.0.1:8561; Connection refused
curl: (7) Failed connect to 127.0.0.1:8661; Connection refused
curl: (7) Failed connect to 127.0.0.1:8761; Connection refused
curl: (7) Failed connect to 127.0.0.1:8264; Connection refused
curl: (7) Failed connect to 127.0.0.1:18262; Connection refused
curl: (7) Failed connect to 127.0.0.1:18263; Connection refused
make: *** [dm_integration_test_in_group] Error 1
dmctl test cmd: "query-status test"
got=2 expected=2
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // stage
[Pipeline] // cache
[Pipeline] }
[Pipeline] }
[Pipeline] // dir
check diff successfully
dmctl test cmd: "stop-task test"
Post stage
[Pipeline] sh
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:47 CST 2024] <<<<<< test case fake_rotate_event success! >>>>>>
start running case: [foreign_key] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/foreign_key/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/foreign_key/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Thu May 30 15:51:48 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/foreign_key/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
[Thu May 30 15:51:48 CST 2024] <<<<<< finish DM-133 optimistic >>>>>>
+ ls /tmp/dm_test
cov.shardddl1.dmctl.1717054894.644.out
cov.shardddl1.dmctl.1717054896.760.out
cov.shardddl1.dmctl.1717054900.1041.out
cov.shardddl1.dmctl.1717054901.1082.out
cov.shardddl1.dmctl.1717054926.4268.out
cov.shardddl1.dmctl.1717054929.4596.out
cov.shardddl1.dmctl.1717054931.4636.out
cov.shardddl1.dmctl.1717054962.5136.out
cov.shardddl1.dmctl.1717054965.5456.out
cov.shardddl1.dmctl.1717054966.5495.out
cov.shardddl1.dmctl.1717054984.6088.out
cov.shardddl1.dmctl.1717054987.6410.out
cov.shardddl1.dmctl.1717054988.6447.out
cov.shardddl1.dmctl.1717054989.6528.out
cov.shardddl1.dmctl.1717054989.6669.out
cov.shardddl1.dmctl.1717054990.6714.out
cov.shardddl1.dmctl.1717054993.6833.out
cov.shardddl1.dmctl.1717054993.6978.out
cov.shardddl1.dmctl.1717054994.7018.out
cov.shardddl1.dmctl.1717054995.7134.out
cov.shardddl1.dmctl.1717054995.7170.out
cov.shardddl1.dmctl.1717054995.7200.out
cov.shardddl1.dmctl.1717054995.7235.out
cov.shardddl1.dmctl.1717054996.7278.out
cov.shardddl1.dmctl.1717055008.7595.out
cov.shardddl1.dmctl.1717055014.7674.out
cov.shardddl1.dmctl.1717055015.7708.out
cov.shardddl1.dmctl.1717055015.7744.out
cov.shardddl1.dmctl.1717055015.7887.out
cov.shardddl1.dmctl.1717055016.7939.out
cov.shardddl1.dmctl.1717055019.8137.out
cov.shardddl1.dmctl.1717055019.8282.out
cov.shardddl1.dmctl.1717055020.8319.out
cov.shardddl1.dmctl.1717055021.8441.out
cov.shardddl1.dmctl.1717055021.8476.out
cov.shardddl1.dmctl.1717055021.8618.out
cov.shardddl1.dmctl.1717055023.8653.out
cov.shardddl1.dmctl.1717055023.8751.out
cov.shardddl1.dmctl.1717055026.8886.out
cov.shardddl1.dmctl.1717055026.8920.out
cov.shardddl1.dmctl.1717055026.8954.out
cov.shardddl1.dmctl.1717055031.9225.out
cov.shardddl1.dmctl.1717055031.9278.out
cov.shardddl1.dmctl.1717055033.9315.out
cov.shardddl1.dmctl.1717055037.9453.out
cov.shardddl1.dmctl.1717055038.9597.out
cov.shardddl1.dmctl.1717055039.9631.out
cov.shardddl1.dmctl.1717055043.9773.out
cov.shardddl1.dmctl.1717055078.10062.out
cov.shardddl1.dmctl.1717055078.10105.out
cov.shardddl1.dmctl.1717055080.10154.out
cov.shardddl1.dmctl.1717055082.10246.out
cov.shardddl1.dmctl.1717055082.10282.out
cov.shardddl1.dmctl.1717055089.10467.out
cov.shardddl1.dmctl.1717055090.10505.out
cov.shardddl1.dmctl.1717055090.10539.out
cov.shardddl1.dmctl.1717055090.10680.out
cov.shardddl1.dmctl.1717055091.10732.out
cov.shardddl1.dmctl.1717055094.10830.out
cov.shardddl1.dmctl.1717055094.10868.out
cov.shardddl1.dmctl.1717055100.11060.out
cov.shardddl1.dmctl.1717055100.11098.out
cov.shardddl1.dmctl.1717055100.11137.out
cov.shardddl1.dmctl.1717055101.11282.out
cov.shardddl1.dmctl.1717055102.11324.out
cov.shardddl1.dmctl.1717055111.11857.out
cov.shardddl1.dmctl.1717055112.11999.out
cov.shardddl1.dmctl.1717055113.12037.out
cov.shardddl1.dmctl.1717055118.12484.out
cov.shardddl1.dmctl.1717055118.12627.out
cov.shardddl1.dmctl.1717055120.12661.out
cov.shardddl1.dmctl.1717055122.12963.out
cov.shardddl1.dmctl.1717055123.13106.out
cov.shardddl1.dmctl.1717055124.13140.out
cov.shardddl1.dmctl.1717055125.13403.out
cov.shardddl1.dmctl.1717055128.13721.out
cov.shardddl1.dmctl.1717055129.13761.out
cov.shardddl1.dmctl.1717055132.13812.out
cov.shardddl1.dmctl.1717055132.13847.out
cov.shardddl1.dmctl.1717055135.14178.out
cov.shardddl1.dmctl.1717055136.14231.out
cov.shardddl1.dmctl.1717055137.14363.out
cov.shardddl1.dmctl.1717055140.14696.out
cov.shardddl1.dmctl.1717055142.14735.out
cov.shardddl1.dmctl.1717055142.14779.out
cov.shardddl1.dmctl.1717055142.14818.out
cov.shardddl1.dmctl.1717055143.14957.out
cov.shardddl1.dmctl.1717055145.14991.out
cov.shardddl1.dmctl.1717055145.15063.out
cov.shardddl1.dmctl.1717055146.15202.out
cov.shardddl1.dmctl.1717055147.15243.out
cov.shardddl1.dmctl.1717055155.15445.out
cov.shardddl1.dmctl.1717055157.15589.out
cov.shardddl1.dmctl.1717055158.15618.out
cov.shardddl1.dmctl.1717055160.15721.out
cov.shardddl1.dmctl.1717055162.15859.out
cov.shardddl1.dmctl.1717055163.15894.out
cov.shardddl1.dmctl.1717055163.15981.out
cov.shardddl1.master.out
cov.shardddl1.worker.8262.1717054893.out
cov.shardddl1.worker.8262.1717054899.out
cov.shardddl1.worker.8262.1717054928.out
cov.shardddl1.worker.8262.1717054964.out
cov.shardddl1.worker.8262.1717054986.out
cov.shardddl1.worker.8262.1717055127.out
cov.shardddl1.worker.8262.1717055134.out
cov.shardddl1.worker.8262.1717055139.out
cov.shardddl1.worker.8263.1717054895.out
cov.shardddl1.worker.8263.1717054899.out
cov.shardddl1.worker.8263.1717054928.out
cov.shardddl1.worker.8263.1717054964.out
cov.shardddl1.worker.8263.1717054986.out
cov.shardddl1.worker.8263.1717055127.out
cov.shardddl1.worker.8263.1717055134.out
cov.shardddl1.worker.8263.1717055139.out
cov.shardddl1_1.dmctl.1717055173.16435.out
cov.shardddl1_1.dmctl.1717055175.16553.out
cov.shardddl1_1.dmctl.1717055176.16645.out
cov.shardddl1_1.dmctl.1717055177.16693.out
cov.shardddl1_1.dmctl.1717055180.17037.out
cov.shardddl1_1.dmctl.1717055180.17172.out
cov.shardddl1_1.dmctl.1717055182.17201.out
cov.shardddl1_1.dmctl.1717055182.17476.out
cov.shardddl1_1.dmctl.1717055183.17622.out
cov.shardddl1_1.dmctl.1717055184.17680.out
cov.shardddl1_1.dmctl.1717055186.17798.out
cov.shardddl1_1.dmctl.1717055188.17938.out
cov.shardddl1_1.dmctl.1717055189.17985.out
cov.shardddl1_1.dmctl.1717055191.18102.out
cov.shardddl1_1.dmctl.1717055193.18242.out
cov.shardddl1_1.dmctl.1717055194.18273.out
cov.shardddl1_1.dmctl.1717055196.18400.out
cov.shardddl1_1.dmctl.1717055198.18548.out
cov.shardddl1_1.dmctl.1717055199.18577.out
cov.shardddl1_1.dmctl.1717055201.18698.out
cov.shardddl1_1.dmctl.1717055202.18838.out
cov.shardddl1_1.dmctl.1717055204.18862.out
cov.shardddl1_1.dmctl.1717055206.18997.out
cov.shardddl1_1.dmctl.1717055207.19136.out
cov.shardddl1_1.dmctl.1717055209.19171.out
cov.shardddl1_1.dmctl.1717055209.19241.out
cov.shardddl1_1.dmctl.1717055210.19382.out
cov.shardddl1_1.dmctl.1717055212.19417.out
cov.shardddl1_1.dmctl.1717055212.19484.out
cov.shardddl1_1.dmctl.1717055213.19625.out
cov.shardddl1_1.dmctl.1717055214.19652.out
cov.shardddl1_1.dmctl.1717055215.19750.out
cov.shardddl1_1.dmctl.1717055216.19892.out
cov.shardddl1_1.dmctl.1717055217.19923.out
cov.shardddl1_1.dmctl.1717055220.20003.out
cov.shardddl1_1.dmctl.1717055221.20139.out
cov.shardddl1_1.dmctl.1717055222.20171.out
cov.shardddl1_1.dmctl.1717055224.20229.out
cov.shardddl1_1.dmctl.1717055226.20364.out
cov.shardddl1_1.dmctl.1717055227.20402.out
cov.shardddl1_1.dmctl.1717055229.20457.out
cov.shardddl1_1.dmctl.1717055231.20596.out
cov.shardddl1_1.dmctl.1717055232.20625.out
cov.shardddl1_1.dmctl.1717055234.20677.out
cov.shardddl1_1.dmctl.1717055235.20813.out
cov.shardddl1_1.dmctl.1717055237.20856.out
cov.shardddl1_1.dmctl.1717055239.20912.out
cov.shardddl1_1.dmctl.1717055240.21050.out
cov.shardddl1_1.dmctl.1717055241.21081.out
cov.shardddl1_1.dmctl.1717055241.21124.out
cov.shardddl1_1.dmctl.1717055242.21256.out
cov.shardddl1_1.dmctl.1717055243.21286.out
cov.shardddl1_1.dmctl.1717055243.21327.out
cov.shardddl1_1.dmctl.1717055244.21463.out
cov.shardddl1_1.dmctl.1717055246.21495.out
cov.shardddl1_1.dmctl.1717055248.21553.out
cov.shardddl1_1.dmctl.1717055249.21694.out
cov.shardddl1_1.dmctl.1717055250.21724.out
cov.shardddl1_1.dmctl.1717055253.21774.out
cov.shardddl1_1.dmctl.1717055254.21911.out
cov.shardddl1_1.dmctl.1717055255.21944.out
cov.shardddl1_1.dmctl.1717055257.21996.out
cov.shardddl1_1.dmctl.1717055259.22140.out
cov.shardddl1_1.dmctl.1717055261.22174.out
cov.shardddl1_1.dmctl.1717055261.22207.out
cov.shardddl1_1.dmctl.1717055261.22242.out
cov.shardddl1_1.dmctl.1717055262.22385.out
cov.shardddl1_1.dmctl.1717055264.22415.out
cov.shardddl1_1.dmctl.1717055264.22507.out
cov.shardddl1_1.dmctl.1717055265.22648.out
cov.shardddl1_1.dmctl.1717055266.22682.out
cov.shardddl1_1.dmctl.1717055267.22740.out
cov.shardddl1_1.dmctl.1717055267.22775.out
cov.shardddl1_1.dmctl.1717055268.22918.out
cov.shardddl1_1.dmctl.1717055269.22948.out
cov.shardddl1_1.dmctl.1717055269.22985.out
cov.shardddl1_1.dmctl.1717055269.23017.out
cov.shardddl1_1.dmctl.1717055271.23156.out
cov.shardddl1_1.dmctl.1717055272.23186.out
cov.shardddl1_1.dmctl.1717055274.23320.out
cov.shardddl1_1.dmctl.1717055275.23460.out
cov.shardddl1_1.dmctl.1717055276.23492.out
cov.shardddl1_1.dmctl.1717055276.23588.out
cov.shardddl1_1.dmctl.1717055278.23730.out
cov.shardddl1_1.dmctl.1717055279.23765.out
cov.shardddl1_1.dmctl.1717055279.23825.out
cov.shardddl1_1.dmctl.1717055279.23966.out
cov.shardddl1_1.dmctl.1717055281.23998.out
cov.shardddl1_1.dmctl.1717055281.24056.out
cov.shardddl1_1.dmctl.1717055281.24094.out
cov.shardddl1_1.dmctl.1717055282.24241.out
cov.shardddl1_1.dmctl.1717055284.24271.out
cov.shardddl1_1.dmctl.1717055284.24400.out
cov.shardddl1_1.dmctl.1717055285.24546.out
cov.shardddl1_1.dmctl.1717055287.24576.out
cov.shardddl1_1.dmctl.1717055289.24717.out
cov.shardddl1_1.dmctl.1717055290.24861.out
cov.shardddl1_1.dmctl.1717055292.24896.out
cov.shardddl1_1.dmctl.1717055292.24960.out
cov.shardddl1_1.dmctl.1717055292.24993.out
cov.shardddl1_1.dmctl.1717055292.25137.out
cov.shardddl1_1.dmctl.1717055293.25168.out
cov.shardddl1_1.dmctl.1717055294.25233.out
cov.shardddl1_1.dmctl.1717055294.25269.out
cov.shardddl1_1.dmctl.1717055295.25417.out
cov.shardddl1_1.dmctl.1717055296.25447.out
cov.shardddl1_1.dmctl.1717055299.25553.out
cov.shardddl1_1.master.out
cov.shardddl1_1.worker.8262.1717055172.out
cov.shardddl1_1.worker.8263.1717055174.out
cov.shardddl2.dmctl.1717055309.26019.out
cov.shardddl2.dmctl.1717055310.26146.out
cov.shardddl2.dmctl.1717055311.26234.out
cov.shardddl2.dmctl.1717055312.26308.out
cov.shardddl2.dmctl.1717055318.26502.out
cov.shardddl2.dmctl.1717055326.26697.out
cov.shardddl2.dmctl.1717055331.26916.out
cov.shardddl2.dmctl.1717055336.27060.out
cov.shardddl2.dmctl.1717055336.27201.out
cov.shardddl2.dmctl.1717055337.27238.out
cov.shardddl2.dmctl.1717055347.27514.out
cov.shardddl2.dmctl.1717055347.27575.out
cov.shardddl2.dmctl.1717055347.27711.out
cov.shardddl2.dmctl.1717055349.27756.out
cov.shardddl2.dmctl.1717055354.27945.out
cov.shardddl2.dmctl.1717055361.28148.out
cov.shardddl2.dmctl.1717055364.28313.out
cov.shardddl2.dmctl.1717055367.28416.out
cov.shardddl2.dmctl.1717055367.28553.out
cov.shardddl2.dmctl.1717055368.28611.out
cov.shardddl2.dmctl.1717055388.29119.out
cov.shardddl2.dmctl.1717055388.29150.out
cov.shardddl2.dmctl.1717055389.29290.out
cov.shardddl2.dmctl.1717055390.29332.out
cov.shardddl2.dmctl.1717055392.29440.out
cov.shardddl2.dmctl.1717055393.29491.out
cov.shardddl2.dmctl.1717055393.29535.out
cov.shardddl2.dmctl.1717055399.29708.out
cov.shardddl2.dmctl.1717055399.29741.out
cov.shardddl2.dmctl.1717055399.29774.out
cov.shardddl2.dmctl.1717055400.29869.out
cov.shardddl2.dmctl.1717055400.30007.out
cov.shardddl2.dmctl.1717055401.30049.out
cov.shardddl2.dmctl.1717055411.30303.out
cov.shardddl2.dmctl.1717055411.30352.out
cov.shardddl2.dmctl.1717055411.30391.out
cov.shardddl2.dmctl.1717055418.30552.out
cov.shardddl2.dmctl.1717055418.30591.out
cov.shardddl2.dmctl.1717055418.30625.out
cov.shardddl2.dmctl.1717055418.30712.out
cov.shardddl2.dmctl.1717055418.30851.out
cov.shardddl2.dmctl.1717055420.30904.out
cov.shardddl2.dmctl.1717055426.31143.out
cov.shardddl2.dmctl.1717055426.31192.out
cov.shardddl2.dmctl.1717055427.31233.out
cov.shardddl2.dmctl.1717055433.31393.out
cov.shardddl2.dmctl.1717055433.31430.out
cov.shardddl2.dmctl.1717055433.31465.out
cov.shardddl2.dmctl.1717055434.31560.out
cov.shardddl2.dmctl.1717055434.31699.out
cov.shardddl2.dmctl.1717055435.31748.out
cov.shardddl2.dmctl.1717055438.31854.out
cov.shardddl2.dmctl.1717055447.32058.out
cov.shardddl2.dmctl.1717055447.32099.out
cov.shardddl2.dmctl.1717055454.32248.out
cov.shardddl2.dmctl.1717055454.32285.out
cov.shardddl2.dmctl.1717055454.32319.out
cov.shardddl2.dmctl.1717055454.32409.out
cov.shardddl2.dmctl.1717055455.32549.out
cov.shardddl2.dmctl.1717055456.32590.out
cov.shardddl2.dmctl.1717055458.32700.out
cov.shardddl2.dmctl.1717055466.32892.out
cov.shardddl2.dmctl.1717055466.32935.out
cov.shardddl2.dmctl.1717055474.33086.out
cov.shardddl2.dmctl.1717055474.33123.out
cov.shardddl2.dmctl.1717055474.33158.out
cov.shardddl2.dmctl.1717055474.33260.out
cov.shardddl2.dmctl.1717055475.33398.out
cov.shardddl2.dmctl.1717055476.33439.out
cov.shardddl2.dmctl.1717055478.33540.out
cov.shardddl2.dmctl.1717055478.33593.out
cov.shardddl2.dmctl.1717055485.33750.out
cov.shardddl2.master.out
cov.shardddl2.worker.8262.1717055308.out
cov.shardddl2.worker.8262.1717055315.out
cov.shardddl2.worker.8263.1717055309.out
cov.shardddl2.worker.8263.1717055351.out
downstream
goroutines
shardddl1
shardddl1_1
shardddl2
sql_res.shardddl1.txt
sql_res.shardddl1_1.txt
sql_res.shardddl2.txt
tidb.toml
++ find /tmp/dm_test/ -type f -name '*.log'
+ tar -cvzf log-G07.tar.gz /tmp/dm_test/shardddl1/dmctl.1717055123.log /tmp/dm_test/shardddl1/dmctl.1717055145.log /tmp/dm_test/shardddl1/dmctl.1717055118.log /tmp/dm_test/shardddl1/dmctl.1717054962.log /tmp/dm_test/shardddl1/dmctl.1717055158.log /tmp/dm_test/shardddl1/dmctl.1717054900.log /tmp/dm_test/shardddl1/dmctl.1717055101.log /tmp/dm_test/shardddl1/dmctl.1717055019.log /tmp/dm_test/shardddl1/dmctl.1717054990.log /tmp/dm_test/shardddl1/dmctl.1717055160.log /tmp/dm_test/shardddl1/dmctl.1717055008.log /tmp/dm_test/shardddl1/dmctl.1717055021.log /tmp/dm_test/shardddl1/dmctl.1717055111.log /tmp/dm_test/shardddl1/dmctl.1717054996.log /tmp/dm_test/shardddl1/dmctl.1717055147.log /tmp/dm_test/shardddl1/dmctl.1717054988.log /tmp/dm_test/shardddl1/dmctl.1717054995.log /tmp/dm_test/shardddl1/dmctl.1717055129.log /tmp/dm_test/shardddl1/dmctl.1717055082.log /tmp/dm_test/shardddl1/dmctl.1717055142.log /tmp/dm_test/shardddl1/worker1/log/stdout.log /tmp/dm_test/shardddl1/worker1/log/dm-worker.log /tmp/dm_test/shardddl1/dmctl.1717055023.log /tmp/dm_test/shardddl1/dmctl.1717054966.log /tmp/dm_test/shardddl1/dmctl.1717054994.log /tmp/dm_test/shardddl1/dmctl.1717054894.log /tmp/dm_test/shardddl1/dmctl.1717055020.log /tmp/dm_test/shardddl1/dmctl.1717055113.log /tmp/dm_test/shardddl1/dmctl.1717055163.log /tmp/dm_test/shardddl1/dmctl.1717055136.log /tmp/dm_test/shardddl1/dmctl.1717055162.log /tmp/dm_test/shardddl1/dmctl.1717055089.log /tmp/dm_test/shardddl1/dmctl.1717054965.log /tmp/dm_test/shardddl1/dmctl.1717055037.log /tmp/dm_test/shardddl1/dmctl.1717055140.log /tmp/dm_test/shardddl1/dmctl.1717055033.log /tmp/dm_test/shardddl1/dmctl.1717055014.log /tmp/dm_test/shardddl1/dmctl.1717055039.log /tmp/dm_test/shardddl1/dmctl.1717054901.log /tmp/dm_test/shardddl1/dmctl.1717055137.log /tmp/dm_test/shardddl1/dmctl.1717055157.log /tmp/dm_test/shardddl1/dmctl.1717055122.log /tmp/dm_test/shardddl1/dmctl.1717055094.log /tmp/dm_test/shardddl1/dmctl.1717055100.log /tmp/dm_test/shardddl1/dmctl.1717055124.log /tmp/dm_test/shardddl1/dmctl.1717055078.log /tmp/dm_test/shardddl1/dmctl.1717054931.log /tmp/dm_test/shardddl1/dmctl.1717054896.log /tmp/dm_test/shardddl1/dmctl.1717054929.log /tmp/dm_test/shardddl1/dmctl.1717055135.log /tmp/dm_test/shardddl1/dmctl.1717055143.log /tmp/dm_test/shardddl1/dmctl.1717055091.log /tmp/dm_test/shardddl1/dmctl.1717055080.log /tmp/dm_test/shardddl1/dmctl.1717054987.log /tmp/dm_test/shardddl1/dmctl.1717054993.log /tmp/dm_test/shardddl1/dmctl.1717054984.log /tmp/dm_test/shardddl1/dmctl.1717055120.log /tmp/dm_test/shardddl1/dmctl.1717055016.log /tmp/dm_test/shardddl1/dmctl.1717055038.log /tmp/dm_test/shardddl1/dmctl.1717055031.log /tmp/dm_test/shardddl1/dmctl.1717055155.log /tmp/dm_test/shardddl1/dmctl.1717055146.log /tmp/dm_test/shardddl1/dmctl.1717055026.log /tmp/dm_test/shardddl1/dmctl.1717055102.log /tmp/dm_test/shardddl1/worker2/log/stdout.log /tmp/dm_test/shardddl1/worker2/log/dm-worker.log /tmp/dm_test/shardddl1/dmctl.1717055112.log /tmp/dm_test/shardddl1/dmctl.1717055125.log /tmp/dm_test/shardddl1/sync_diff_stdout.log /tmp/dm_test/shardddl1/dmctl.1717055043.log /tmp/dm_test/shardddl1/dmctl.1717055015.log /tmp/dm_test/shardddl1/dmctl.1717054989.log /tmp/dm_test/shardddl1/dmctl.1717055128.log /tmp/dm_test/shardddl1/dmctl.1717055090.log /tmp/dm_test/shardddl1/dmctl.1717054926.log /tmp/dm_test/shardddl1/dmctl.1717055132.log /tmp/dm_test/shardddl1/master/log/stdout.log /tmp/dm_test/shardddl1/master/log/dm-master.log /tmp/dm_test/shardddl1_1/dmctl.1717055191.log /tmp/dm_test/shardddl1_1/dmctl.1717055199.log /tmp/dm_test/shardddl1_1/dmctl.1717055243.log /tmp/dm_test/shardddl1_1/dmctl.1717055188.log /tmp/dm_test/shardddl1_1/dmctl.1717055217.log /tmp/dm_test/shardddl1_1/dmctl.1717055276.log /tmp/dm_test/shardddl1_1/dmctl.1717055244.log /tmp/dm_test/shardddl1_1/dmctl.1717055196.log /tmp/dm_test/shardddl1_1/dmctl.1717055274.log /tmp/dm_test/shardddl1_1/dmctl.1717055272.log /tmp/dm_test/shardddl1_1/dmctl.1717055246.log /tmp/dm_test/shardddl1_1/dmctl.1717055206.log /tmp/dm_test/shardddl1_1/dmctl.1717055255.log /tmp/dm_test/shardddl1_1/dmctl.1717055216.log /tmp/dm_test/shardddl1_1/dmctl.1717055213.log /tmp/dm_test/shardddl1_1/dmctl.1717055186.log /tmp/dm_test/shardddl1_1/dmctl.1717055202.log /tmp/dm_test/shardddl1_1/dmctl.1717055299.log /tmp/dm_test/shardddl1_1/dmctl.1717055269.log /tmp/dm_test/shardddl1_1/dmctl.1717055295.log /tmp/dm_test/shardddl1_1/dmctl.1717055229.log /tmp/dm_test/shardddl1_1/dmctl.1717055224.log /tmp/dm_test/shardddl1_1/dmctl.1717055293.log /tmp/dm_test/shardddl1_1/dmctl.1717055175.log /tmp/dm_test/shardddl1_1/worker1/log/stdout.log /tmp/dm_test/shardddl1_1/worker1/log/dm-worker.log /tmp/dm_test/shardddl1_1/dmctl.1717055189.log /tmp/dm_test/shardddl1_1/dmctl.1717055193.log /tmp/dm_test/shardddl1_1/dmctl.1717055214.log /tmp/dm_test/shardddl1_1/dmctl.1717055241.log /tmp/dm_test/shardddl1_1/dmctl.1717055257.log /tmp/dm_test/shardddl1_1/dmctl.1717055212.log /tmp/dm_test/shardddl1_1/dmctl.1717055289.log /tmp/dm_test/shardddl1_1/dmctl.1717055184.log /tmp/dm_test/shardddl1_1/dmctl.1717055292.log /tmp/dm_test/shardddl1_1/dmctl.1717055281.log /tmp/dm_test/shardddl1_1/dmctl.1717055201.log /tmp/dm_test/shardddl1_1/dmctl.1717055232.log /tmp/dm_test/shardddl1_1/dmctl.1717055227.log /tmp/dm_test/shardddl1_1/dmctl.1717055182.log /tmp/dm_test/shardddl1_1/dmctl.1717055240.log /tmp/dm_test/shardddl1_1/dmctl.1717055222.log /tmp/dm_test/shardddl1_1/dmctl.1717055173.log /tmp/dm_test/shardddl1_1/dmctl.1717055268.log /tmp/dm_test/shardddl1_1/dmctl.1717055265.log /tmp/dm_test/shardddl1_1/dmctl.1717055278.log /tmp/dm_test/shardddl1_1/dmctl.1717055226.log /tmp/dm_test/shardddl1_1/dmctl.1717055290.log /tmp/dm_test/shardddl1_1/dmctl.1717055235.log /tmp/dm_test/shardddl1_1/dmctl.1717055275.log /tmp/dm_test/shardddl1_1/dmctl.1717055204.log /tmp/dm_test/shardddl1_1/dmctl.1717055285.log /tmp/dm_test/shardddl1_1/dmctl.1717055242.log /tmp/dm_test/shardddl1_1/dmctl.1717055234.log /tmp/dm_test/shardddl1_1/dmctl.1717055253.log /tmp/dm_test/shardddl1_1/dmctl.1717055198.log /tmp/dm_test/shardddl1_1/dmctl.1717055267.log /tmp/dm_test/shardddl1_1/dmctl.1717055294.log /tmp/dm_test/shardddl1_1/dmctl.1717055259.log /tmp/dm_test/shardddl1_1/dmctl.1717055262.log /tmp/dm_test/shardddl1_1/dmctl.1717055248.log /tmp/dm_test/shardddl1_1/dmctl.1717055183.log /tmp/dm_test/shardddl1_1/dmctl.1717055282.log /tmp/dm_test/shardddl1_1/dmctl.1717055249.log /tmp/dm_test/shardddl1_1/dmctl.1717055237.log /tmp/dm_test/shardddl1_1/dmctl.1717055231.log /tmp/dm_test/shardddl1_1/dmctl.1717055177.log /tmp/dm_test/shardddl1_1/dmctl.1717055266.log /tmp/dm_test/shardddl1_1/dmctl.1717055279.log /tmp/dm_test/shardddl1_1/dmctl.1717055254.log /tmp/dm_test/shardddl1_1/dmctl.1717055210.log /tmp/dm_test/shardddl1_1/dmctl.1717055239.log /tmp/dm_test/shardddl1_1/dmctl.1717055296.log /tmp/dm_test/shardddl1_1/dmctl.1717055209.log /tmp/dm_test/shardddl1_1/dmctl.1717055180.log /tmp/dm_test/shardddl1_1/dmctl.1717055215.log /tmp/dm_test/shardddl1_1/dmctl.1717055250.log /tmp/dm_test/shardddl1_1/worker2/log/stdout.log /tmp/dm_test/shardddl1_1/worker2/log/dm-worker.log /tmp/dm_test/shardddl1_1/dmctl.1717055287.log /tmp/dm_test/shardddl1_1/dmctl.1717055194.log /tmp/dm_test/shardddl1_1/sync_diff_stdout.log /tmp/dm_test/shardddl1_1/dmctl.1717055264.log /tmp/dm_test/shardddl1_1/dmctl.1717055271.log /tmp/dm_test/shardddl1_1/dmctl.1717055207.log /tmp/dm_test/shardddl1_1/dmctl.1717055261.log /tmp/dm_test/shardddl1_1/dmctl.1717055220.log /tmp/dm_test/shardddl1_1/dmctl.1717055284.log /tmp/dm_test/shardddl1_1/dmctl.1717055221.log /tmp/dm_test/shardddl1_1/dmctl.1717055176.log /tmp/dm_test/shardddl1_1/master/log/stdout.log /tmp/dm_test/shardddl1_1/master/log/dm-master.log /tmp/dm_test/shardddl2/dmctl.1717055392.log /tmp/dm_test/shardddl2/dmctl.1717055309.log /tmp/dm_test/shardddl2/dmctl.1717055347.log /tmp/dm_test/shardddl2/dmctl.1717055420.log /tmp/dm_test/shardddl2/dmctl.1717055400.log /tmp/dm_test/shardddl2/dmctl.1717055454.log /tmp/dm_test/shardddl2/dmctl.1717055401.log /tmp/dm_test/shardddl2/dmctl.1717055311.log /tmp/dm_test/shardddl2/dmctl.1717055336.log /tmp/dm_test/shardddl2/dmctl.1717055418.log /tmp/dm_test/shardddl2/dmctl.1717055393.log /tmp/dm_test/shardddl2/dmctl.1717055326.log /tmp/dm_test/shardddl2/worker1/log/stdout.log /tmp/dm_test/shardddl2/worker1/log/dm-worker.log /tmp/dm_test/shardddl2/dmctl.1717055485.log /tmp/dm_test/shardddl2/dmctl.1717055433.log /tmp/dm_test/shardddl2/dmctl.1717055466.log /tmp/dm_test/shardddl2/dmctl.1717055367.log /tmp/dm_test/shardddl2/dmctl.1717055435.log /tmp/dm_test/shardddl2/dmctl.1717055474.log /tmp/dm_test/shardddl2/dmctl.1717055427.log /tmp/dm_test/shardddl2/dmctl.1717055411.log /tmp/dm_test/shardddl2/dmctl.1717055361.log /tmp/dm_test/shardddl2/dmctl.1717055354.log /tmp/dm_test/shardddl2/dmctl.1717055364.log /tmp/dm_test/shardddl2/dmctl.1717055447.log /tmp/dm_test/shardddl2/dmctl.1717055458.log /tmp/dm_test/shardddl2/dmctl.1717055312.log /tmp/dm_test/shardddl2/dmctl.1717055318.log /tmp/dm_test/shardddl2/dmctl.1717055390.log /tmp/dm_test/shardddl2/dmctl.1717055426.log /tmp/dm_test/shardddl2/dmctl.1717055455.log /tmp/dm_test/shardddl2/dmctl.1717055475.log /tmp/dm_test/shardddl2/dmctl.1717055310.log /tmp/dm_test/shardddl2/worker2/log/stdout.log /tmp/dm_test/shardddl2/worker2/log/dm-worker.log /tmp/dm_test/shardddl2/dmctl.1717055349.log /tmp/dm_test/shardddl2/dmctl.1717055399.log /tmp/dm_test/shardddl2/sync_diff_stdout.log /tmp/dm_test/shardddl2/dmctl.1717055389.log /tmp/dm_test/shardddl2/dmctl.1717055388.log /tmp/dm_test/shardddl2/dmctl.1717055434.log /tmp/dm_test/shardddl2/dmctl.1717055456.log /tmp/dm_test/shardddl2/dmctl.1717055476.log /tmp/dm_test/shardddl2/dmctl.1717055368.log /tmp/dm_test/shardddl2/dmctl.1717055438.log /tmp/dm_test/shardddl2/dmctl.1717055331.log /tmp/dm_test/shardddl2/dmctl.1717055478.log /tmp/dm_test/shardddl2/dmctl.1717055337.log /tmp/dm_test/shardddl2/master/log/stdout.log /tmp/dm_test/shardddl2/master/log/dm-master.log /tmp/dm_test/downstream/tidb/log/tidb.log /tmp/dm_test/goroutines/stack/log/worker-8264.log /tmp/dm_test/goroutines/stack/log/master-8561.log /tmp/dm_test/goroutines/stack/log/worker-18262.log /tmp/dm_test/goroutines/stack/log/master-8461.log /tmp/dm_test/goroutines/stack/log/master-8761.log /tmp/dm_test/goroutines/stack/log/worker-8262.log /tmp/dm_test/goroutines/stack/log/master-8261.log /tmp/dm_test/goroutines/stack/log/worker-8263.log /tmp/dm_test/goroutines/stack/log/worker-18263.log /tmp/dm_test/goroutines/stack/log/master-8661.log /tmp/dm_test/goroutines/stack/log/master-8361.log
tar: Removing leading `/' from member names
/tmp/dm_test/shardddl1/dmctl.1717055123.log
/tmp/dm_test/shardddl1/dmctl.1717055145.log
/tmp/dm_test/shardddl1/dmctl.1717055118.log
/tmp/dm_test/shardddl1/dmctl.1717054962.log
/tmp/dm_test/shardddl1/dmctl.1717055158.log
/tmp/dm_test/shardddl1/dmctl.1717054900.log
/tmp/dm_test/shardddl1/dmctl.1717055101.log
/tmp/dm_test/shardddl1/dmctl.1717055019.log
/tmp/dm_test/shardddl1/dmctl.1717054990.log
/tmp/dm_test/shardddl1/dmctl.1717055160.log
/tmp/dm_test/shardddl1/dmctl.1717055008.log
/tmp/dm_test/shardddl1/dmctl.1717055021.log
/tmp/dm_test/shardddl1/dmctl.1717055111.log
/tmp/dm_test/shardddl1/dmctl.1717054996.log
/tmp/dm_test/shardddl1/dmctl.1717055147.log
/tmp/dm_test/shardddl1/dmctl.1717054988.log
/tmp/dm_test/shardddl1/dmctl.1717054995.log
/tmp/dm_test/shardddl1/dmctl.1717055129.log
/tmp/dm_test/shardddl1/dmctl.1717055082.log
/tmp/dm_test/shardddl1/dmctl.1717055142.log
/tmp/dm_test/shardddl1/worker1/log/stdout.log
/tmp/dm_test/shardddl1/worker1/log/dm-worker.log
/tmp/dm_test/shardddl1/dmctl.1717055023.log
/tmp/dm_test/shardddl1/dmctl.1717054966.log
/tmp/dm_test/shardddl1/dmctl.1717054994.log
/tmp/dm_test/shardddl1/dmctl.1717054894.log
/tmp/dm_test/shardddl1/dmctl.1717055020.log
/tmp/dm_test/shardddl1/dmctl.1717055113.log
/tmp/dm_test/shardddl1/dmctl.1717055163.log
/tmp/dm_test/shardddl1/dmctl.1717055136.log
/tmp/dm_test/shardddl1/dmctl.1717055162.log
/tmp/dm_test/shardddl1/dmctl.1717055089.log
/tmp/dm_test/shardddl1/dmctl.1717054965.log
/tmp/dm_test/shardddl1/dmctl.1717055037.log
/tmp/dm_test/shardddl1/dmctl.1717055140.log
/tmp/dm_test/shardddl1/dmctl.1717055033.log
/tmp/dm_test/shardddl1/dmctl.1717055014.log
/tmp/dm_test/shardddl1/dmctl.1717055039.log
/tmp/dm_test/shardddl1/dmctl.1717054901.log
/tmp/dm_test/shardddl1/dmctl.1717055137.log
/tmp/dm_test/shardddl1/dmctl.1717055157.log
/tmp/dm_test/shardddl1/dmctl.1717055122.log
/tmp/dm_test/shardddl1/dmctl.1717055094.log
/tmp/dm_test/shardddl1/dmctl.1717055100.log
/tmp/dm_test/shardddl1/dmctl.1717055124.log
/tmp/dm_test/shardddl1/dmctl.1717055078.log
/tmp/dm_test/shardddl1/dmctl.1717054931.log
/tmp/dm_test/shardddl1/dmctl.1717054896.log
/tmp/dm_test/shardddl1/dmctl.1717054929.log
/tmp/dm_test/shardddl1/dmctl.1717055135.log
/tmp/dm_test/shardddl1/dmctl.1717055143.log
/tmp/dm_test/shardddl1/dmctl.1717055091.log
/tmp/dm_test/shardddl1/dmctl.1717055080.log
/tmp/dm_test/shardddl1/dmctl.1717054987.log
/tmp/dm_test/shardddl1/dmctl.1717054993.log
/tmp/dm_test/shardddl1/dmctl.1717054984.log
/tmp/dm_test/shardddl1/dmctl.1717055120.log
/tmp/dm_test/shardddl1/dmctl.1717055016.log
/tmp/dm_test/shardddl1/dmctl.1717055038.log
/tmp/dm_test/shardddl1/dmctl.1717055031.log
/tmp/dm_test/shardddl1/dmctl.1717055155.log
/tmp/dm_test/shardddl1/dmctl.1717055146.log
/tmp/dm_test/shardddl1/dmctl.1717055026.log
/tmp/dm_test/shardddl1/dmctl.1717055102.log
/tmp/dm_test/shardddl1/worker2/log/stdout.log
/tmp/dm_test/shardddl1/worker2/log/dm-worker.log
/tmp/dm_test/shardddl1/dmctl.1717055112.log
/tmp/dm_test/shardddl1/dmctl.1717055125.log
/tmp/dm_test/shardddl1/sync_diff_stdout.log
/tmp/dm_test/shardddl1/dmctl.1717055043.log
/tmp/dm_test/shardddl1/dmctl.1717055015.log
/tmp/dm_test/shardddl1/dmctl.1717054989.log
/tmp/dm_test/shardddl1/dmctl.1717055128.log
/tmp/dm_test/shardddl1/dmctl.1717055090.log
/tmp/dm_test/shardddl1/dmctl.1717054926.log
/tmp/dm_test/shardddl1/dmctl.1717055132.log
/tmp/dm_test/shardddl1/master/log/stdout.log
/tmp/dm_test/shardddl1/master/log/dm-master.log
/tmp/dm_test/shardddl1_1/dmctl.1717055191.log
/tmp/dm_test/shardddl1_1/dmctl.1717055199.log
/tmp/dm_test/shardddl1_1/dmctl.1717055243.log
/tmp/dm_test/shardddl1_1/dmctl.1717055188.log
/tmp/dm_test/shardddl1_1/dmctl.1717055217.log
/tmp/dm_test/shardddl1_1/dmctl.1717055276.log
/tmp/dm_test/shardddl1_1/dmctl.1717055244.log
/tmp/dm_test/shardddl1_1/dmctl.1717055196.log
/tmp/dm_test/shardddl1_1/dmctl.1717055274.log
/tmp/dm_test/shardddl1_1/dmctl.1717055272.log
/tmp/dm_test/shardddl1_1/dmctl.1717055246.log
/tmp/dm_test/shardddl1_1/dmctl.1717055206.log
/tmp/dm_test/shardddl1_1/dmctl.1717055255.log
/tmp/dm_test/shardddl1_1/dmctl.1717055216.log
/tmp/dm_test/shardddl1_1/dmctl.1717055213.log
/tmp/dm_test/shardddl1_1/dmctl.1717055186.log
/tmp/dm_test/shardddl1_1/dmctl.1717055202.log
/tmp/dm_test/shardddl1_1/dmctl.1717055299.log
/tmp/dm_test/shardddl1_1/dmctl.1717055269.log
/tmp/dm_test/shardddl1_1/dmctl.1717055295.log
/tmp/dm_test/shardddl1_1/dmctl.1717055229.log
/tmp/dm_test/shardddl1_1/dmctl.1717055224.log
/tmp/dm_test/shardddl1_1/dmctl.1717055293.log
/tmp/dm_test/shardddl1_1/dmctl.1717055175.log
/tmp/dm_test/shardddl1_1/worker1/log/stdout.log
/tmp/dm_test/shardddl1_1/worker1/log/dm-worker.log
/tmp/dm_test/shardddl1_1/dmctl.1717055189.log
/tmp/dm_test/shardddl1_1/dmctl.1717055193.log
/tmp/dm_test/shardddl1_1/dmctl.1717055214.log
/tmp/dm_test/shardddl1_1/dmctl.1717055241.log
/tmp/dm_test/shardddl1_1/dmctl.1717055257.log
/tmp/dm_test/shardddl1_1/dmctl.1717055212.log
/tmp/dm_test/shardddl1_1/dmctl.1717055289.log
/tmp/dm_test/shardddl1_1/dmctl.1717055184.log
/tmp/dm_test/shardddl1_1/dmctl.1717055292.log
/tmp/dm_test/shardddl1_1/dmctl.1717055281.log
/tmp/dm_test/shardddl1_1/dmctl.1717055201.log
/tmp/dm_test/shardddl1_1/dmctl.1717055232.log
/tmp/dm_test/shardddl1_1/dmctl.1717055227.log
/tmp/dm_test/shardddl1_1/dmctl.1717055182.log
/tmp/dm_test/shardddl1_1/dmctl.1717055240.log
/tmp/dm_test/shardddl1_1/dmctl.1717055222.log
/tmp/dm_test/shardddl1_1/dmctl.1717055173.log
/tmp/dm_test/shardddl1_1/dmctl.1717055268.log
/tmp/dm_test/shardddl1_1/dmctl.1717055265.log
/tmp/dm_test/shardddl1_1/dmctl.1717055278.log
/tmp/dm_test/shardddl1_1/dmctl.1717055226.log
/tmp/dm_test/shardddl1_1/dmctl.1717055290.log
/tmp/dm_test/shardddl1_1/dmctl.1717055235.log
/tmp/dm_test/shardddl1_1/dmctl.1717055275.log
/tmp/dm_test/shardddl1_1/dmctl.1717055204.log
/tmp/dm_test/shardddl1_1/dmctl.1717055285.log
/tmp/dm_test/shardddl1_1/dmctl.1717055242.log
/tmp/dm_test/shardddl1_1/dmctl.1717055234.log
/tmp/dm_test/shardddl1_1/dmctl.1717055253.log
/tmp/dm_test/shardddl1_1/dmctl.1717055198.log
/tmp/dm_test/shardddl1_1/dmctl.1717055267.log
/tmp/dm_test/shardddl1_1/dmctl.1717055294.log
/tmp/dm_test/shardddl1_1/dmctl.1717055259.log
/tmp/dm_test/shardddl1_1/dmctl.1717055262.log
/tmp/dm_test/shardddl1_1/dmctl.1717055248.log
/tmp/dm_test/shardddl1_1/dmctl.1717055183.log
/tmp/dm_test/shardddl1_1/dmctl.1717055282.log
/tmp/dm_test/shardddl1_1/dmctl.1717055249.log
/tmp/dm_test/shardddl1_1/dmctl.1717055237.log
/tmp/dm_test/shardddl1_1/dmctl.1717055231.log
/tmp/dm_test/shardddl1_1/dmctl.1717055177.log
/tmp/dm_test/shardddl1_1/dmctl.1717055266.log
/tmp/dm_test/shardddl1_1/dmctl.1717055279.log
/tmp/dm_test/shardddl1_1/dmctl.1717055254.log
/tmp/dm_test/shardddl1_1/dmctl.1717055210.log
/tmp/dm_test/shardddl1_1/dmctl.1717055239.log
/tmp/dm_test/shardddl1_1/dmctl.1717055296.log
/tmp/dm_test/shardddl1_1/dmctl.1717055209.log
/tmp/dm_test/shardddl1_1/dmctl.1717055180.log
/tmp/dm_test/shardddl1_1/dmctl.1717055215.log
/tmp/dm_test/shardddl1_1/dmctl.1717055250.log
/tmp/dm_test/shardddl1_1/worker2/log/stdout.log
/tmp/dm_test/shardddl1_1/worker2/log/dm-worker.log
/tmp/dm_test/shardddl1_1/dmctl.1717055287.log
/tmp/dm_test/shardddl1_1/dmctl.1717055194.log
/tmp/dm_test/shardddl1_1/sync_diff_stdout.log
/tmp/dm_test/shardddl1_1/dmctl.1717055264.log
/tmp/dm_test/shardddl1_1/dmctl.1717055271.log
/tmp/dm_test/shardddl1_1/dmctl.1717055207.log
/tmp/dm_test/shardddl1_1/dmctl.1717055261.log
/tmp/dm_test/shardddl1_1/dmctl.1717055220.log
/tmp/dm_test/shardddl1_1/dmctl.1717055284.log
/tmp/dm_test/shardddl1_1/dmctl.1717055221.log
/tmp/dm_test/shardddl1_1/dmctl.1717055176.log
/tmp/dm_test/shardddl1_1/master/log/stdout.log
/tmp/dm_test/shardddl1_1/master/log/dm-master.log
/tmp/dm_test/shardddl2/dmctl.1717055392.log
/tmp/dm_test/shardddl2/dmctl.1717055309.log
/tmp/dm_test/shardddl2/dmctl.1717055347.log
/tmp/dm_test/shardddl2/dmctl.1717055420.log
/tmp/dm_test/shardddl2/dmctl.1717055400.log
/tmp/dm_test/shardddl2/dmctl.1717055454.log
/tmp/dm_test/shardddl2/dmctl.1717055401.log
/tmp/dm_test/shardddl2/dmctl.1717055311.log
/tmp/dm_test/shardddl2/dmctl.1717055336.log
/tmp/dm_test/shardddl2/dmctl.1717055418.log
/tmp/dm_test/shardddl2/dmctl.1717055393.log
/tmp/dm_test/shardddl2/dmctl.1717055326.log
/tmp/dm_test/shardddl2/worker1/log/stdout.log
/tmp/dm_test/shardddl2/worker1/log/dm-worker.log
/tmp/dm_test/shardddl2/dmctl.1717055485.log
/tmp/dm_test/shardddl2/dmctl.1717055433.log
/tmp/dm_test/shardddl2/dmctl.1717055466.log
/tmp/dm_test/shardddl2/dmctl.1717055367.log
/tmp/dm_test/shardddl2/dmctl.1717055435.log
/tmp/dm_test/shardddl2/dmctl.1717055474.log
/tmp/dm_test/shardddl2/dmctl.1717055427.log
/tmp/dm_test/shardddl2/dmctl.1717055411.log
/tmp/dm_test/shardddl2/dmctl.1717055361.log
/tmp/dm_test/shardddl2/dmctl.1717055354.log
/tmp/dm_test/shardddl2/dmctl.1717055364.log
/tmp/dm_test/shardddl2/dmctl.1717055447.log
/tmp/dm_test/shardddl2/dmctl.1717055458.log
/tmp/dm_test/shardddl2/dmctl.1717055312.log
/tmp/dm_test/shardddl2/dmctl.1717055318.log
/tmp/dm_test/shardddl2/dmctl.1717055390.log
/tmp/dm_test/shardddl2/dmctl.1717055426.log
/tmp/dm_test/shardddl2/dmctl.1717055455.log
/tmp/dm_test/shardddl2/dmctl.1717055475.log
/tmp/dm_test/shardddl2/dmctl.1717055310.log
/tmp/dm_test/shardddl2/worker2/log/stdout.log
/tmp/dm_test/shardddl2/worker2/log/dm-worker.log
/tmp/dm_test/shardddl2/dmctl.1717055349.log
/tmp/dm_test/shardddl2/dmctl.1717055399.log
/tmp/dm_test/shardddl2/sync_diff_stdout.log
/tmp/dm_test/shardddl2/dmctl.1717055389.log
/tmp/dm_test/shardddl2/dmctl.1717055388.log
/tmp/dm_test/shardddl2/dmctl.1717055434.log
/tmp/dm_test/shardddl2/dmctl.1717055456.log
/tmp/dm_test/shardddl2/dmctl.1717055476.log
/tmp/dm_test/shardddl2/dmctl.1717055368.log
/tmp/dm_test/shardddl2/dmctl.1717055438.log
/tmp/dm_test/shardddl2/dmctl.1717055331.log
/tmp/dm_test/shardddl2/dmctl.1717055478.log
/tmp/dm_test/shardddl2/dmctl.1717055337.log
/tmp/dm_test/shardddl2/master/log/stdout.log
/tmp/dm_test/shardddl2/master/log/dm-master.log
/tmp/dm_test/downstream/tidb/log/tidb.log
/tmp/dm_test/goroutines/stack/log/worker-8264.log
/tmp/dm_test/goroutines/stack/log/master-8561.log
/tmp/dm_test/goroutines/stack/log/worker-18262.log
/tmp/dm_test/goroutines/stack/log/master-8461.log
/tmp/dm_test/goroutines/stack/log/master-8761.log
/tmp/dm_test/goroutines/stack/log/worker-8262.log
/tmp/dm_test/goroutines/stack/log/master-8261.log
/tmp/dm_test/goroutines/stack/log/worker-8263.log
/tmp/dm_test/goroutines/stack/log/worker-18263.log
/tmp/dm_test/goroutines/stack/log/master-8661.log
/tmp/dm_test/goroutines/stack/log/master-8361.log
+ ls -alh log-G07.tar.gz
-rw-r--r-- 1 jenkins jenkins 672K May 30 15:51 log-G07.tar.gz
[Pipeline] archiveArtifacts
Archiving artifacts
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
rpc addr 127.0.0.1:8261 is alive
[Thu May 30 15:51:49 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/foreign_key/conf/dm-worker1.toml >>>>>>
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G07'
[Thu May 30 15:51:49 CST 2024] <<<<<< start DM-134 pessimistic >>>>>>
Sending interrupt signal to process
Killing processes
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl4_1/conf/double-source-pessimistic.yaml --remove-meta"
kill finished with exit code 0
Sending interrupt signal to process
Killing processes
make: *** [dm_integration_test_in_group] Terminated
script returned exit code 143
kill finished with exit code 0
make: *** [dm_integration_test_in_group] Terminated
script returned exit code 143
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // cache
[Pipeline] // cache
[Pipeline] }
[Pipeline] }
[Pipeline] // dir
[Pipeline] // dir
[Pipeline] }
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] }
[Pipeline] // timeout
[Pipeline] // timeout
[Pipeline] }
[Pipeline] }
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] }
[Pipeline] }
[Pipeline] // container
[Pipeline] // container
[Pipeline] }
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] }
[Pipeline] // node
[Pipeline] // node
[Pipeline] }
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] }
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G08'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G11'
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] End of Pipeline
ERROR: script returned exit code 2
Finished: FAILURE
![[Jenkins]](/jenkins/static/62b7ca6c/images/svgs/logo.svg){kind=logo}
