Skip to content

Console Output

Skipping 994 KB.. Full Log
[Sun Apr 28 11:36:35 CST 2024] <<<<<< test case gbk success! >>>>>>
start running case: [gtid] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:36:35 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-master.test exit...
process dm-master.test already exit
check diff failed 2-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:36:36 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/gtid/source1.yaml"
wait process dm-worker.test exit...
[Sun Apr 28 11:36:37 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check diff failed 3-th time, retry later
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:36:38 CST 2024] <<<<<< test case sharding success! >>>>>>
start running case: [sequence_sharding] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:36:38 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/gtid/source2.yaml"
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:36:39 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-task.yaml --remove-meta"
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:36:40 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #4
[Sun Apr 28 11:36:40 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8262 is alive
[Sun Apr 28 11:36:40 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check diff successfully
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/sequence_sharding/source1.yaml"
check diff successfully
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "operate-source create /tmp/dm_test/sequence_sharding/source2.yaml"
check log contain failed 1-th time, retry later
wait process dm-master.test exit...
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/sequence_sharding/conf/dm-task.yaml "
wait process dm-master.test exit...
process dm-master.test already exit
dmctl test cmd: "shard-ddl-lock"
check diff successfully
got=1 expected=1
restart dm-master
wait process dm-worker.test exit...
wait process dm-master exit...
wait process dm-worker.test exit...
wait process dm-master exit...
process dm-master already exit
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:36:46 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:36:47 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check diff successfully
dmctl test cmd: "query-status sequence_sharding"
got=0 expected=2
command: query-status sequence_sharding detect inconsistent DDL sequence count: 0 != expected: 2, failed the 0-th time, will retry again
[Sun Apr 28 11:36:48 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/gtid/source1.yaml"
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
[Sun Apr 28 11:36:50 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
got=2 expected=2
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/gtid/source2.yaml"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-task.yaml --remove-meta"
check diff failed 2-th time, retry later
check diff successfully
new_gtid1 6ae80621-050e-11ef-8d2c-32f9c45f8ec5:6 new_gtid2 6b5ecad3-050e-11ef-81ba-32f9c45f8ec5:6
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:36:54 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker1.toml >>>>>>
[Sun Apr 28 11:36:54 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-task.yaml"
check diff failed 3-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:36:58 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
run DM_DropAddColumn case #5
[Sun Apr 28 11:36:58 CST 2024] <<<<<< start DM-DropAddColumn optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
[Sun Apr 28 11:36:58 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker1.toml >>>>>>
[Sun Apr 28 11:36:58 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
check log contain failed 1-th time, retry later
rpc addr 127.0.0.1:8262 is alive
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/gtid/conf/dm-task.yaml"
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
dmctl test cmd: "resume-task sequence_sharding"
dmctl test cmd: "query-status sequence_sharding"
got=2 expected=2
dmctl test cmd: "stop-task sequence_sharding"
dmctl test cmd: "start-task /tmp/dm_test/sequence_sharding/task.yaml"
dmctl test cmd: "shard-ddl-lock"
got=1 expected=1
dmctl test cmd: "query-status test"
got=3 expected=3
got=2 expected=2
restart dm-master
wait process dm-master.test exit...
dmctl test cmd: "query-status sequence_sharding"
got=2 expected=2
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-master exit...
process dm-master already exit
wait process dm-master.test exit...
wait process dm-worker.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:37:06 CST 2024] <<<<<< test case gtid success! >>>>>>
start running case: [ha_cases] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:37:06 CST 2024] <<<<<< start test_exclusive_relay >>>>>>
start DM worker and master cluster
[Sun Apr 28 11:37:06 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-standalone.toml >>>>>>
[Sun Apr 28 11:37:06 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait process dm-worker.test exit...
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:37:07 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:37:08 CST 2024] <<<<<< test case sequence_sharding success! >>>>>>
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tiflow-release-7.5-pull_dm_integration_test-284/tiflow-dm already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source1.yaml"
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Sun Apr 28 11:37:08 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
check diff failed 1-th time, retry later
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "start-relay -s mysql-replica-01 worker1 worker2"
got=3 expected=3
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source2.yaml"
dmctl test cmd: "list-member --worker"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "operate-source show -s mysql-replica-02"
got=1 expected=1
1 dm-master alive
check diff failed 2-th time, retry later
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
check diff failed 3-th time, retry later
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
check diff failed at last
dmctl test cmd: "binlog skip test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "pause-task test"
dmctl test cmd: "resume-task test"
check diff successfully
dmctl test cmd: "stop-task test"
wait process dm-worker.test exit...
[Sun Apr 28 11:37:15 CST 2024] <<<<<< finish DM-DropAddColumn optimistic >>>>>>
[Sun Apr 28 11:37:15 CST 2024] <<<<<< start DM-ADD_DROP_PARTITIONS optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
clean source table
dmctl test cmd: "query-status test"
got=2 expected=2
run tidb sql failed 1-th time, retry later
[Sun Apr 28 11:37:18 CST 2024] <<<<<< finish test_exclusive_relay >>>>>>
[Sun Apr 28 11:37:18 CST 2024] <<<<<< start test_exclusive_relay_2 >>>>>>
start DM worker and master cluster
[Sun Apr 28 11:37:18 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-standalone.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
run tidb sql failed 1-th time, retry later
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:37:20 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source1.yaml"
[Sun Apr 28 11:37:21 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
[Sun Apr 28 11:37:21 CST 2024] <<<<<< finish DM-ADD_DROP_PARTITIONS optimistic >>>>>>
[Sun Apr 28 11:37:21 CST 2024] <<<<<< start DM-036 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source2.yaml"
dmctl test cmd: "query-status test"
got=2 expected=2
run tidb sql failed 1-th time, retry later
dmctl test cmd: "start-relay -s mysql-replica-01 worker1"
got=2 expected=2
dmctl test cmd: "start-relay -s mysql-replica-02 worker2"
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:37:25 CST 2024] <<<<<< finish DM-036 optimistic >>>>>>
got=2 expected=2
[Sun Apr 28 11:37:26 CST 2024] <<<<<< START DM-WORKER on port 8264, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker3.toml >>>>>>
wait for rpc addr 127.0.0.1:8264 alive the 1-th time
[Sun Apr 28 11:37:26 CST 2024] <<<<<< start DM-037 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8264 is alive
kill dm-worker1
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
wait process dm-worker1 exit...
[Sun Apr 28 11:37:28 CST 2024] <<<<<< finish DM-037 pessimistic >>>>>>
[Sun Apr 28 11:37:28 CST 2024] <<<<<< start DM-037 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker1 exit...
process dm-worker1 already exit
dmctl test cmd: "list-member --name worker3"
got=1 expected=1
[Sun Apr 28 11:37:29 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "list-member --name worker3"
[Sun Apr 28 11:37:30 CST 2024] <<<<<< finish DM-037 optimistic >>>>>>
got=1 expected=1
dmctl test cmd: "list-member --name worker1"
got=1 expected=1
kill dm-worker2
[Sun Apr 28 11:37:31 CST 2024] <<<<<< start DM-038 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-worker2 exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "operate-source show -s mysql-replica-02"
got=1 expected=1
[Sun Apr 28 11:37:33 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "list-member --name worker2"
got=1 expected=1
1 dm-master alive
3 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
check diff failed 1-th time, retry later
wait process dm-worker.test exit...
check diff failed 2-th time, retry later
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
clean source table
check diff failed 3-th time, retry later
[Sun Apr 28 11:37:41 CST 2024] <<<<<< finish test_exclusive_relay_2 >>>>>>
[Sun Apr 28 11:37:41 CST 2024] <<<<<< start test_last_bound >>>>>>
[Sun Apr 28 11:37:41 CST 2024] <<<<<< start test_running >>>>>>
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
clean source table
check diff failed at last
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:37:42 CST 2024] <<<<<< finish DM-038 pessimistic >>>>>>
[Sun Apr 28 11:37:42 CST 2024] <<<<<< start DM-038 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
import prepare data
start DM worker and master cluster
[Sun Apr 28 11:37:43 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master1.toml >>>>>>
[Sun Apr 28 11:37:43 CST 2024] <<<<<< START DM-MASTER on port 8361, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master2.toml >>>>>>
[Sun Apr 28 11:37:43 CST 2024] <<<<<< START DM-MASTER on port 8461, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master3.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
rpc addr 127.0.0.1:8261 is alive
rpc addr 127.0.0.1:8361 is alive
rpc addr 127.0.0.1:8461 is alive
start worker and operate mysql config to worker
[Sun Apr 28 11:37:44 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source1.yaml"
[Sun Apr 28 11:37:46 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source2.yaml"
start DM task
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-task.yaml "
check diff failed 2-th time, retry later
dmctl test cmd: "query-status test"
got=2 expected=2
got=2 expected=2
use sync_diff_inspector to check full dump loader
check diff successfully
flush logs to force rotate binlog file
apply increment data before restart dm-worker to ensure entering increment phase
check diff failed 3-th time, retry later
use sync_diff_inspector to check increment data
check diff successfully
[Sun Apr 28 11:37:53 CST 2024] <<<<<< finish test_running >>>>>>
worker1bound  "mysql-replica-01"
worker2bound  "mysql-replica-02"
dmctl test cmd: "start-relay -s mysql-replica-01 worker1"
check diff failed at last
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:37:53 CST 2024] <<<<<< finish DM-038 optimistic >>>>>>
[Sun Apr 28 11:37:54 CST 2024] <<<<<< start DM-039 pessimistic >>>>>>
got=2 expected=2
dmctl test cmd: "start-relay -s mysql-replica-02 worker2"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
got=2 expected=2
dmctl test cmd: "query-status test"
got=4 expected=4
kill dm-worker1
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-worker1 exit...
wait process dm-worker1 exit...
process dm-worker1 already exit
kill dm-worker2
check diff successfully
dmctl test cmd: "stop-task test"
wait process dm-worker2 exit...
[Sun Apr 28 11:37:58 CST 2024] <<<<<< finish DM-039 pessimistic >>>>>>
[Sun Apr 28 11:37:58 CST 2024] <<<<<< start DM-039 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "list-member --name worker1 --name worker2"
got=2 expected=2
start worker1
[Sun Apr 28 11:38:00 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:00 CST 2024] <<<<<< finish DM-039 optimistic >>>>>>
rpc addr 127.0.0.1:8262 is alive
start worker2
[Sun Apr 28 11:38:01 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
[Sun Apr 28 11:38:01 CST 2024] <<<<<< start DM-040 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "list-member --name worker1 --name worker2"
got=1 expected=1
got=1 expected=1
kill dm-worker1
wait process dm-worker1 exit...
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:03 CST 2024] <<<<<< finish DM-040 pessimistic >>>>>>
[Sun Apr 28 11:38:03 CST 2024] <<<<<< start DM-040 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker1 exit...
process dm-worker1 already exit
kill dm-worker2
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
wait process dm-worker2 exit...
[Sun Apr 28 11:38:05 CST 2024] <<<<<< finish DM-040 optimistic >>>>>>
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "list-member --name worker1 --name worker2"
got=2 expected=2
start worker2
[Sun Apr 28 11:38:06 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
[Sun Apr 28 11:38:06 CST 2024] <<<<<< start DM-041 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
start worker1
[Sun Apr 28 11:38:07 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "list-member --name worker2 --name worker1"
got=1 expected=1
got=1 expected=1
kill dm-worker1
wait process dm-worker1 exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:11 CST 2024] <<<<<< finish DM-041 pessimistic >>>>>>
[Sun Apr 28 11:38:11 CST 2024] <<<<<< start DM-041 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker1 exit...
process dm-worker1 already exit
kill dm-worker2
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-worker2 exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:13 CST 2024] <<<<<< finish DM-041 optimistic >>>>>>
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "list-member --name worker1 --name worker2"
got=2 expected=2
start worker3
[Sun Apr 28 11:38:13 CST 2024] <<<<<< START DM-WORKER on port 8264, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker3.toml >>>>>>
wait for rpc addr 127.0.0.1:8264 alive the 1-th time
[Sun Apr 28 11:38:14 CST 2024] <<<<<< start DM-043 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-pessimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8264 is alive
start worker4
[Sun Apr 28 11:38:14 CST 2024] <<<<<< START DM-WORKER on port 18262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker4.toml >>>>>>
wait for rpc addr 127.0.0.1:18262 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:18262 is alive
dmctl test cmd: "list-member --name worker3 --name worker4"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "start-relay -s mysql-replica-01 worker3"
[Sun Apr 28 11:38:16 CST 2024] <<<<<< finish DM-043 pessimistic >>>>>>
[Sun Apr 28 11:38:16 CST 2024] <<<<<< start DM-043 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2/conf/double-source-optimistic.yaml --remove-meta"
got=2 expected=2
dmctl test cmd: "start-relay -s mysql-replica-02 worker4"
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
dmctl test cmd: "stop-task test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=4 expected=4
check diff successfully
kill dm-worker3
[Sun Apr 28 11:38:18 CST 2024] <<<<<< finish DM-043 optimistic >>>>>>
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-worker3 exit...
wait process dm-master.test exit...
wait process dm-worker3 exit...
process dm-worker3 already exit
kill dm-worker4
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker4 exit...
wait process dm-worker.test exit...
wait process dm-worker4 exit...
process dm-worker4 already exit
dmctl test cmd: "list-member --name worker3 --name worker4"
got=2 expected=2
start worker1
[Sun Apr 28 11:38:22 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait process dm-worker.test exit...
rpc addr 127.0.0.1:8262 is alive
start worker2
[Sun Apr 28 11:38:23 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:38:24 CST 2024] <<<<<< test case shardddl2 success! >>>>>>
start running case: [shardddl2_1] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:38:24 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "list-member --name worker1 --name worker2"
got=1 expected=1
got=1 expected=1
num1 1 num2 2
[Sun Apr 28 11:38:25 CST 2024] <<<<<< finish test_last_bound >>>>>>
[Sun Apr 28 11:38:25 CST 2024] <<<<<< start test_config_name >>>>>>
[Sun Apr 28 11:38:25 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join1.toml >>>>>>
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:38:25 CST 2024] <<<<<< START DM-MASTER on port 8361, config: /tmp/dm_test/ha_cases/dm-master-join2.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:38:26 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
check log contain failed 1-th time (file not exist), retry later
[Sun Apr 28 11:38:27 CST 2024] <<<<<< START DM-MASTER on port 8361, config: /tmp/dm_test/ha_cases/dm-master-join2.toml >>>>>>
rpc addr 127.0.0.1:8361 is alive
[Sun Apr 28 11:38:27 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
rpc addr 127.0.0.1:8262 is alive
[Sun Apr 28 11:38:27 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /tmp/dm_test/ha_cases/dm-worker2.toml >>>>>>
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl2_1/source1.yaml"
[Sun Apr 28 11:38:28 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/shardddl2_1/source2.yaml"
[Sun Apr 28 11:38:29 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /tmp/dm_test/ha_cases/dm-worker2.toml >>>>>>
rpc addr 127.0.0.1:8263 is alive
[Sun Apr 28 11:38:29 CST 2024] <<<<<< finish test_config_name >>>>>>
[Sun Apr 28 11:38:29 CST 2024] <<<<<< start test_join_masters_and_worker >>>>>>
3 dm-master alive
3 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
[Sun Apr 28 11:38:31 CST 2024] <<<<<< start DM-046 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:33 CST 2024] <<<<<< finish DM-046 pessimistic >>>>>>
[Sun Apr 28 11:38:33 CST 2024] <<<<<< start DM-046 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-worker.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
wait process dm-worker.test exit...
[Sun Apr 28 11:38:36 CST 2024] <<<<<< finish DM-046 optimistic >>>>>>
wait process dm-worker.test exit...
[Sun Apr 28 11:38:37 CST 2024] <<<<<< start DM-047 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-worker.test exit...
wait process dm-worker.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
clean source table
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:41 CST 2024] <<<<<< finish DM-047 pessimistic >>>>>>
[Sun Apr 28 11:38:41 CST 2024] <<<<<< start DM-047 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
[Sun Apr 28 11:38:41 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join1.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:43 CST 2024] <<<<<< finish DM-047 optimistic >>>>>>
rpc addr 127.0.0.1:8261 is alive
query-status from unique master
dmctl test cmd: "query-status"
got=1 expected=1
[Sun Apr 28 11:38:43 CST 2024] <<<<<< START DM-MASTER on port 8361, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join2.toml >>>>>>
wait for rpc addr 127.0.0.1:8361 alive the 1-th time
[Sun Apr 28 11:38:44 CST 2024] <<<<<< start DM-048 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:48 CST 2024] <<<<<< finish DM-048 pessimistic >>>>>>
[Sun Apr 28 11:38:48 CST 2024] <<<<<< start DM-048 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:50 CST 2024] <<<<<< finish DM-048 optimistic >>>>>>
[Sun Apr 28 11:38:51 CST 2024] <<<<<< start DM-049 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
wait for rpc addr 127.0.0.1:8361 alive the 2-th time
rpc addr 127.0.0.1:8361 is alive
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:38:56 CST 2024] <<<<<< finish DM-049 pessimistic >>>>>>
[Sun Apr 28 11:38:56 CST 2024] <<<<<< start DM-049 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
[Sun Apr 28 11:38:59 CST 2024] <<<<<< START DM-MASTER on port 8461, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join3.toml >>>>>>
wait for rpc addr 127.0.0.1:8461 alive the 1-th time
rpc addr 127.0.0.1:8461 is alive
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:01 CST 2024] <<<<<< finish DM-049 optimistic >>>>>>
[Sun Apr 28 11:39:02 CST 2024] <<<<<< start DM-050 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:04 CST 2024] <<<<<< finish DM-050 pessimistic >>>>>>
[Sun Apr 28 11:39:04 CST 2024] <<<<<< start DM-050 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
[Sun Apr 28 11:39:05 CST 2024] <<<<<< START DM-MASTER on port 8561, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join4.toml >>>>>>
wait for rpc addr 127.0.0.1:8561 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
rpc addr 127.0.0.1:8561 is alive
[Sun Apr 28 11:39:06 CST 2024] <<<<<< finish DM-050 optimistic >>>>>>
[Sun Apr 28 11:39:07 CST 2024] <<<<<< start DM-051 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:09 CST 2024] <<<<<< finish DM-051 pessimistic >>>>>>
[Sun Apr 28 11:39:09 CST 2024] <<<<<< start DM-051 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:11 CST 2024] <<<<<< START DM-MASTER on port 8661, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master-join5.toml >>>>>>
wait for rpc addr 127.0.0.1:8661 alive the 1-th time
[Sun Apr 28 11:39:11 CST 2024] <<<<<< finish DM-051 optimistic >>>>>>
rpc addr 127.0.0.1:8661 is alive
dmctl test cmd: "query-status"
got=1 expected=1
dmctl test cmd: "query-status"
[Sun Apr 28 11:39:12 CST 2024] <<<<<< start DM-056 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
got=1 expected=1
dmctl test cmd: "query-status"
got=1 expected=1
dmctl test cmd: "query-status"
got=1 expected=1
join worker with dm-master1 endpoint
[Sun Apr 28 11:39:13 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker-join2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:14 CST 2024] <<<<<< finish DM-056 pessimistic >>>>>>
[Sun Apr 28 11:39:14 CST 2024] <<<<<< start DM-056 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "list-member --worker --name=worker2"
got=1 expected=1
kill dm-master-join1
wait process dm-master-join1 exit...
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=3 expected=3
wait process dm-master-join1 exit...
wait process dm-master-join1 exit...
process dm-master-join1 already exit
dmctl test cmd: "list-member --worker --name=worker2"
got=1 expected=1
join worker with 5 masters endpoint
[Sun Apr 28 11:39:17 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker-join1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
wait for rpc addr 127.0.0.1:8262 alive the 2-th time
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:19 CST 2024] <<<<<< finish DM-056 optimistic >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 3-th time
[Sun Apr 28 11:39:20 CST 2024] <<<<<< start DM-057 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait for rpc addr 127.0.0.1:8262 alive the 4-th time
rpc addr 127.0.0.1:8262 is alive
query-status from master2
dmctl test cmd: "query-status"
got=1 expected=1
[Sun Apr 28 11:39:22 CST 2024] <<<<<< finish test_join_masters_and_worker >>>>>>
[Sun Apr 28 11:39:22 CST 2024] <<<<<< start test_standalone_running >>>>>>
4 dm-master alive
2 dm-worker alive
0 dm-syncer alive
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:25 CST 2024] <<<<<< finish DM-057 pessimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:39:26 CST 2024] <<<<<< start DM-058 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
wait process dm-master.test exit...
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:27 CST 2024] <<<<<< finish DM-058 pessimistic >>>>>>
[Sun Apr 28 11:39:27 CST 2024] <<<<<< start DM-058 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:30 CST 2024] <<<<<< finish DM-058 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:39:31 CST 2024] <<<<<< start DM-059 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
clean source table
dmctl test cmd: "query-status test"
got=2 expected=2
import prepare data
start DM worker and master standalone cluster
[Sun Apr 28 11:39:34 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master1.toml >>>>>>
[Sun Apr 28 11:39:34 CST 2024] <<<<<< START DM-MASTER on port 8361, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master2.toml >>>>>>
[Sun Apr 28 11:39:34 CST 2024] <<<<<< START DM-MASTER on port 8461, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-master3.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
check diff failed 1-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:37 CST 2024] <<<<<< finish DM-059 pessimistic >>>>>>
[Sun Apr 28 11:39:37 CST 2024] <<<<<< start DM-059 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
rpc addr 127.0.0.1:8361 is alive
dmctl test cmd: "query-status test"
got=2 expected=2
rpc addr 127.0.0.1:8461 is alive
[Sun Apr 28 11:39:38 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
operate mysql config to worker
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source1.yaml"
start DM task
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/standalone-task.yaml "
check diff failed 1-th time, retry later
use sync_diff_inspector to check full dump loader
check diff successfully
flush logs to force rotate binlog file
apply increment data before restart dm-worker to ensure entering increment phase
use sync_diff_inspector to check increment data
check diff failed 1-th time, retry later
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:43 CST 2024] <<<<<< finish DM-059 optimistic >>>>>>
[Sun Apr 28 11:39:44 CST 2024] <<<<<< start DM-062 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
check diff successfully
dmctl test cmd: "operate-source create /tmp/dm_test/ha_cases/source2.yaml"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/standalone-task2.yaml"
[Sun Apr 28 11:39:44 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/standalone-task2.yaml"
dmctl test cmd: "query-status"
got=2 expected=2
kill worker2
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:48 CST 2024] <<<<<< finish DM-062 pessimistic >>>>>>
[Sun Apr 28 11:39:48 CST 2024] <<<<<< start DM-062 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-worker2 exit...
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "query-status"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test2"
dmctl test cmd: "query-status test"
got=2 expected=2
got=1 expected=1
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/ha_cases/conf/standalone-task2.yaml"
check diff successfully
dmctl test cmd: "stop-task test"
got=1 expected=1
dmctl test cmd: "query-status test"
got=1 expected=1
[Sun Apr 28 11:39:50 CST 2024] <<<<<< finish test_standalone_running >>>>>>
3 dm-master alive
1 dm-worker alive
0 dm-syncer alive
[Sun Apr 28 11:39:50 CST 2024] <<<<<< finish DM-062 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:39:51 CST 2024] <<<<<< start DM-063 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:53 CST 2024] <<<<<< finish DM-063 pessimistic >>>>>>
[Sun Apr 28 11:39:53 CST 2024] <<<<<< start DM-063 optimistic >>>>>>
wait process dm-master.test exit...
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
run tidb sql failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
run tidb sql failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:39:59 CST 2024] <<<<<< finish DM-063 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:40:00 CST 2024] <<<<<< start DM-064 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:04 CST 2024] <<<<<< finish DM-064 pessimistic >>>>>>
[Sun Apr 28 11:40:04 CST 2024] <<<<<< start DM-064 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
wait process dm-master.test exit...
[Sun Apr 28 11:40:06 CST 2024] <<<<<< finish DM-064 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:40:07 CST 2024] <<<<<< start DM-065 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:09 CST 2024] <<<<<< finish DM-065 pessimistic >>>>>>
[Sun Apr 28 11:40:09 CST 2024] <<<<<< start DM-065 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
run tidb sql failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:13 CST 2024] <<<<<< finish DM-065 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:40:14 CST 2024] <<<<<< start DM-066 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-master.test exit...
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:18 CST 2024] <<<<<< finish DM-066 pessimistic >>>>>>
[Sun Apr 28 11:40:18 CST 2024] <<<<<< start DM-066 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:20 CST 2024] <<<<<< finish DM-066 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:40:21 CST 2024] <<<<<< start DM-067 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-master.test exit...
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:22 CST 2024] <<<<<< finish DM-067 pessimistic >>>>>>
[Sun Apr 28 11:40:22 CST 2024] <<<<<< start DM-067 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:24 CST 2024] <<<<<< finish DM-067 optimistic >>>>>>
wait process dm-master.test exit...
[Sun Apr 28 11:40:25 CST 2024] <<<<<< start DM-068 pessimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-pessimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
check diff failed 1-th time, retry later
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:30 CST 2024] <<<<<< finish DM-068 pessimistic >>>>>>
[Sun Apr 28 11:40:30 CST 2024] <<<<<< start DM-068 optimistic >>>>>>
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/shardddl2_1/conf/double-source-optimistic.yaml --remove-meta"
wait process dm-master.test exit...
dmctl test cmd: "query-status test"
got=2 expected=2
wait process dm-master.test exit...
check diff successfully
dmctl test cmd: "stop-task test"
[Sun Apr 28 11:40:31 CST 2024] <<<<<< finish DM-068 optimistic >>>>>>
wait process dm-master.test exit...
1 dm-master alive
2 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-master.test exit...
wait process dm-worker.test exit...
wait process dm-master.test exit...
wait process dm-worker.test exit...
wait process dm-master.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:40:38 CST 2024] <<<<<< test case shardddl2_1 success! >>>>>>
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tiflow-release-7.5-pull_dm_integration_test-284/tiflow-dm already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
wait process dm-master.test exit...
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:40:52 CST 2024] <<<<<< test case ha_cases success! >>>>>>
start running case: [http_proxies] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
test dm grpc proxy env setting checking for http_proxy=http://127.0.0.1:8080
[Sun Apr 28 11:40:52 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
[Sun Apr 28 11:40:53 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
./tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
./tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
dmctl test cmd: "query-status test"
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
test dm grpc proxy env setting checking for https_proxy=https://127.0.0.1:8080
[Sun Apr 28 11:41:02 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
./tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
./tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
[Sun Apr 28 11:41:04 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
./tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
./tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
dmctl test cmd: "query-status test"
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
test dm grpc proxy env setting checking for no_proxy=localhost,127.0.0.1
[Sun Apr 28 11:41:13 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
./tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
./tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
[Sun Apr 28 11:41:15 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/http_proxies/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
./tests/_utils/check_log_contains: line 15: [: proxy: integer expression expected
./tests/_utils/check_log_contains: line 21: [: proxy: integer expression expected
dmctl test cmd: "query-status test"
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:41:23 CST 2024] <<<<<< test case http_proxies success! >>>>>>
start running case: [lightning_load_task] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
import prepare data
start DM master, workers and sources
[Sun Apr 28 11:41:23 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:41:24 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/lightning_load_task/source1.yaml"
[Sun Apr 28 11:41:26 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/lightning_load_task/source2.yaml"
[Sun Apr 28 11:41:28 CST 2024] <<<<<< START DM-WORKER on port 8264, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker3.toml >>>>>>
wait for rpc addr 127.0.0.1:8264 alive the 1-th time
rpc addr 127.0.0.1:8264 is alive
start DM task
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-task.yaml --remove-meta"
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-task2.yaml --remove-meta"
dmctl test cmd: "query-status load_task1"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status load_task2"
got=1 expected=1
got=1 expected=1
test worker restart
wait process dm-worker1 exit...
wait process dm-worker1 exit...
process dm-worker1 already exit
dmctl test cmd: "list-member -w -n worker3"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "list-member -w -n worker1"
got=1 expected=1
dmctl test cmd: "query-status load_task1"
got=1 expected=1
got=1 expected=1
[Sun Apr 28 11:41:34 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "list-member -w -n worker3"
got=1 expected=1
dmctl test cmd: "list-member -w -n worker1"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status load_task1"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status load_task2"
got=1 expected=1
got=1 expected=1
test_transfer_two_sources
wait process dm-worker2 exit...
wait process dm-worker2 exit...
process dm-worker2 already exit
dmctl test cmd: "list-member -w -n worker3"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status load_task2"
got=1 expected=1
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-task3.yaml --remove-meta"
got=2 expected=2
dmctl test cmd: "query-status load_task3"
got=1 expected=1
[Sun Apr 28 11:41:39 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "list-member -w -n worker2"
got=1 expected=1
wait process dm-worker1 exit...
wait process dm-worker1 exit...
process dm-worker1 already exit
dmctl test cmd: "list-member -w -n worker2"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-task4.yaml --remove-meta"
got=2 expected=2
dmctl test cmd: "query-status load_task4"
got=1 expected=1
[Sun Apr 28 11:41:44 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "list-member -w -n worker1"
got=1 expected=1
wait process dm-worker3 exit...
wait process dm-worker3 exit...
process dm-worker3 already exit
dmctl test cmd: "list-member -w -n worker1"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status load_task1"
got=1 expected=1
dmctl test cmd: "query-status load_task2"
got=1 expected=1
dmctl test cmd: "list-member -w -n worker1"
got=1 expected=1
got=0 expected=1
command: list-member -w -n worker1 "source": "mysql-replica-01" count: 0 != expected: 1, failed the 0-th time, will retry again
got=1 expected=1
got=0 expected=1
command: list-member -w -n worker1 "source": "mysql-replica-01" count: 0 != expected: 1, failed the 1-th time, will retry again
got=1 expected=1
got=0 expected=1
command: list-member -w -n worker1 "source": "mysql-replica-01" count: 0 != expected: 1, failed the 2-th time, will retry again
got=1 expected=1
got=0 expected=1
command: list-member -w -n worker1 "source": "mysql-replica-01" count: 0 != expected: 1, failed the 3-th time, will retry again
got=1 expected=1
got=0 expected=1
command: list-member -w -n worker1 "source": "mysql-replica-01" count: 0 != expected: 1, failed the 4-th time, will retry again
got=1 expected=1
got=1 expected=1
dmctl test cmd: "list-member -w -n worker2"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status"
got=3 expected=3
got=1 expected=1
[Sun Apr 28 11:41:59 CST 2024] <<<<<< START DM-WORKER on port 8264, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_load_task/conf/dm-worker3.toml >>>>>>
wait for rpc addr 127.0.0.1:8264 alive the 1-th time
rpc addr 127.0.0.1:8264 is alive
dmctl test cmd: "list-member -w -n worker2"
got=1 expected=1
got=1 expected=1
dmctl test cmd: "query-status"
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 0-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 1-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 2-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 3-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 4-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 5-th time, will retry again
got=3 expected=4
command: query-status "taskStatus": "Running" count: 3 != expected: 4, failed the 6-th time, will retry again
got=4 expected=4
check diff successfully
check diff successfully
check diff successfully
check diff successfully
1 dm-master alive
3 dm-worker alive
0 dm-syncer alive
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
wait process dm-worker.test exit...
wait process dm-worker.test exit...
wait process dm-worker.test exit...
process dm-worker.test already exit
process dm-syncer.test already exit
[Sun Apr 28 11:42:21 CST 2024] <<<<<< test case lightning_load_task success! >>>>>>
start running case: [lightning_mode] script: [/home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/run.sh]
Running test /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/run.sh...
Verbose mode = false
0 dm-master alive
0 dm-worker alive
0 dm-syncer alive
process dm-master.test already exit
process dm-worker.test already exit
process dm-syncer.test already exit
Starting PD...
Release Version: v7.5.1-5-g584533652
Edition: Community
Git Commit Hash: 58453365285465cd90bc4472cff2bad7ce4d764b
Git Branch: release-7.5
UTC Build Time:  2024-04-03 10:04:14
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (7) Failed connect to 127.0.0.1:2379; Connection refused
2024-04-28 11:42:21.475304 W | pkg/fileutil: check file permission: directory "/tmp/dm_test/lightning_mode/pd" exist, but the permission is "drwxr-xr-x". The recommended permission is "-rwx------" to prevent possible unprivileged access to the data.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   107  100   107    0     0  85874      0 --:--:-- --:--:-- --:--:--  104k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   121  100   121    0     0  88774      0 --:--:-- --:--:-- --:--:--  118k
  "is_initialized": true,
Starting TiDB...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (7) Failed connect to 127.0.0.1:10080; Connection refused
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (7) Failed connect to 127.0.0.1:10080; Connection refused
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   117  100   117    0     0   156k      0 --:--:-- --:--:-- --:--:--  114k
{"connections":0,"version":"8.0.11-TiDB-v7.5.1-43-ge406d5780b","git_hash":"e406d5780b18a1f2aaf6230cde4b6403991e228d"}[Sun Apr 28 11:42:35 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
rpc addr 127.0.0.1:8261 is alive
[Sun Apr 28 11:42:36 CST 2024] <<<<<< START DM-WORKER on port 8262, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-worker1.toml >>>>>>
wait for rpc addr 127.0.0.1:8262 alive the 1-th time
rpc addr 127.0.0.1:8262 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/lightning_mode/source1.yaml"
[Sun Apr 28 11:42:38 CST 2024] <<<<<< START DM-WORKER on port 8263, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-worker2.toml >>>>>>
wait for rpc addr 127.0.0.1:8263 alive the 1-th time
rpc addr 127.0.0.1:8263 is alive
dmctl test cmd: "operate-source create /tmp/dm_test/lightning_mode/source2.yaml"
dmctl test cmd: "check-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-task.yaml"
wait process dm-master.test exit...
wait process dm-master.test exit...
process dm-master.test already exit
[Sun Apr 28 11:42:43 CST 2024] <<<<<< START DM-MASTER on port 8261, config: /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-master.toml >>>>>>
wait for rpc addr 127.0.0.1:8261 alive the 1-th time
wait for rpc addr 127.0.0.1:8261 alive the 2-th time
rpc addr 127.0.0.1:8261 is alive
dmctl test cmd: "start-task /home/jenkins/agent/workspace/pingcap/tiflow/release-7.5/pull_dm_integration_test/tiflow/dm/tests/lightning_mode/conf/dm-task-dup.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=0 expected=1
command: query-status test "stage": "Paused" count: 0 != expected: 1, failed the 0-th time, will retry again
got=0 expected=1
command: query-status test "stage": "Paused" count: 0 != expected: 1, failed the 1-th time, will retry again
got=0 expected=1
command: query-status test "stage": "Paused" count: 0 != expected: 1, failed the 2-th time, will retry again
got=1 expected=1
got=2 expected=2
got=1 expected=1
dmctl test cmd: "resume-task test"
dmctl test cmd: "query-status test"
got=0 expected=2
command: query-status test unit": "Sync" count: 0 != expected: 2, failed the 0-th time, will retry again
got=0 expected=2
command: query-status test unit": "Sync" count: 0 != expected: 2, failed the 1-th time, will retry again
got=1 expected=2
command: query-status test unit": "Sync" count: 1 != expected: 2, failed the 2-th time, will retry again
got=2 expected=2
dmctl test cmd: "stop-task test"
dmctl test cmd: "start-task /tmp/dm_test/lightning_mode/dm-task-dup.yaml --remove-meta"
dmctl test cmd: "query-status test"
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 0-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 1-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 2-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 3-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 4-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 5-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 6-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 7-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 8-th time, will retry again
got=0 expected=1
command: query-status test checksum mismatched, KV number in source files: 6, KV number in TiDB cluster: 3 count: 0 != expected: 1, failed the 9-th time, will retry again
{
    "result": true,
    "msg": "",
    "sources": [
        {
            "result": true,
            "msg": "",
            "sourceStatus": {
                "source": "mysql-replica-01",
                "worker": "worker1",
                "result": null,
                "relayStatus": {
                    "masterBinlog": "(dm-it-f32f4f3c-409d-4a37-9b18-bdb5214819e3-w08qz-1t845-bin.000001, 2946)",
                    "masterBinlogGtid": "6ae80621-050e-11ef-8d2c-32f9c45f8ec5:1-12",
                    "relaySubDir": "6ae80621-050e-11ef-8d2c-32f9c45f8ec5.000001",
                    "relayBinlog": "(dm-it-f32f4f3c-409d-4a37-9b18-bdb5214819e3-w08qz-1t845-bin.000001, 2946)",
                    "relayBinlogGtid": "6ae80621-050e-11ef-8d2c-32f9c45f8ec5:1-12",
                    "relayCatchUpMaster": true,
                    "stage": "Running",
                    "result": null
                }
            },
            "subTaskStatus": [
                {
                    "name": "test",
                    "stage": "Paused",
                    "unit": "Load",
                    "result": {
                        "isCanceled": false,
                        "errors": [
                            {
                                "ErrCode": 34019,
                                "ErrClass": "load-unit",
                                "ErrScope": "internal",
                                "ErrLevel": "high",
                                "Message": "",
                                "RawCause": "[Lightning:MetaMgr:ErrMetaMgrUnknown]unknown error occur on meta manager: check whether this task has started before failed: fetch task meta failed: Error 1146 (42S02): Table 'lightning_metadata.task_meta_v2' doesn't exist",
                                "Workaround": ""
                            }
                        ],
                        "detail": null
                    },
                    "unresolvedDDLLockID": "",
                    "load": {
                        "finishedBytes": "0",
                        "totalBytes": "416",
                        "progress": "0.00 %",
                        "metaBinlog": "(dm-it-f32f4f3c-409d-4a37-9b18-bdb5214819e3-w08qz-1t845-bin.000001, 2946)",
                        "metaBinlogGTID": "6ae80621-050e-11ef-8d2c-32f9c45f8ec5:1-12",
                        "bps": "0"
                    },
                    "validation": null
                }
            ]
        },
        {
            "result": true,
            "msg": "",
            "sourceStatus": {
                "source": "mysql-replica-02",
                "worker": "worker2",
                "result": null,
                "relayStatus": null
            },
            "subTaskStatus": [
                {
                    "name": "test",
                    "stage": "Running",
                    "unit": "Load",
                    "result": null,
                    "unresolvedDDLLockID": "",
                    "load": {
                        "finishedBytes": "141",
                        "totalBytes": "141",
                        "progress": "100.00 %",
                        "metaBinlog": "(dm-it-f32f4f3c-409d-4a37-9b18-bdb5214819e3-w08qz-1t845-bin.000001, 1816)",
                        "metaBinlogGTID": "6b5ecad3-050e-11ef-81ba-32f9c45f8ec5:1-7",
                        "bps": "18"
                    },
                    "validation": null
                }
            ]
        }
    ]
}
PASS
coverage: 3.8% of statements in github.com/pingcap/tiflow/dm/...
curl: (7) Failed connect to 127.0.0.1:8361; Connection refused
curl: (7) Failed connect to 127.0.0.1:8461; Connection refused
curl: (7) Failed connect to 127.0.0.1:8561; Connection refused
curl: (7) Failed connect to 127.0.0.1:8661; Connection refused
curl: (7) Failed connect to 127.0.0.1:8761; Connection refused
curl: (7) Failed connect to 127.0.0.1:8264; Connection refused
curl: (7) Failed connect to 127.0.0.1:18262; Connection refused
curl: (7) Failed connect to 127.0.0.1:18263; Connection refused
make: *** [dm_integration_test_in_group] Error 1
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
Post stage
[Pipeline] sh
+ ls /tmp/dm_test
adjust_gtid
async_checkpoint_flush
binlog_parse
case_sensitive
check_task
checkpoint_transaction
cov.adjust_gtid.dmctl.1714274712.670.out
cov.adjust_gtid.dmctl.1714274714.793.out
cov.adjust_gtid.dmctl.1714274715.839.out
cov.adjust_gtid.dmctl.1714274716.965.out
cov.adjust_gtid.dmctl.1714274726.1008.out
cov.adjust_gtid.dmctl.1714274729.1228.out
cov.adjust_gtid.master.out
cov.adjust_gtid.worker.8262.1714274711.out
cov.adjust_gtid.worker.8262.1714274726.out
cov.adjust_gtid.worker.8262.1714274738.out
cov.adjust_gtid.worker.8263.1714274713.out
cov.adjust_gtid.worker.8263.1714274728.out
cov.adjust_gtid.worker.8263.1714274740.out
cov.async_checkpoint_flush.dmctl.1714274749.1856.out
cov.async_checkpoint_flush.dmctl.1714274749.1906.out
cov.async_checkpoint_flush.master.out
cov.async_checkpoint_flush.worker.8262.1714274748.out
cov.binlog_parse.dmctl.1714274788.10892.out
cov.binlog_parse.dmctl.1714274788.10939.out
cov.binlog_parse.dmctl.1714274790.11011.out
cov.binlog_parse.dmctl.1714274790.11096.out
cov.binlog_parse.dmctl.1714274791.11148.out
cov.binlog_parse.master.out
cov.binlog_parse.worker.8262.1714274787.out
cov.case_sensitive.dmctl.1714274799.11548.out
cov.case_sensitive.dmctl.1714274801.11677.out
cov.case_sensitive.dmctl.1714274803.11719.out
cov.case_sensitive.dmctl.1714274807.11933.out
cov.case_sensitive.dmctl.1714274824.12211.out
cov.case_sensitive.dmctl.1714274824.12249.out
cov.case_sensitive.dmctl.1714274824.12291.out
cov.case_sensitive.dmctl.1714274833.12667.out
cov.case_sensitive.dmctl.1714274835.12787.out
cov.case_sensitive.dmctl.1714274836.12828.out
cov.case_sensitive.dmctl.1714274841.13041.out
cov.case_sensitive.dmctl.1714274858.13306.out
cov.case_sensitive.dmctl.1714274858.13359.out
cov.case_sensitive.dmctl.1714274858.13403.out
cov.case_sensitive.master.out
cov.case_sensitive.worker.8262.1714274798.out
cov.case_sensitive.worker.8262.1714274806.out
cov.case_sensitive.worker.8262.1714274832.out
cov.case_sensitive.worker.8262.1714274840.out
cov.case_sensitive.worker.8263.1714274800.out
cov.case_sensitive.worker.8263.1714274808.out
cov.case_sensitive.worker.8263.1714274834.out
cov.case_sensitive.worker.8263.1714274842.out
cov.check_task.dmctl.1714274937.15050.out
cov.check_task.dmctl.1714274937.15270.out
cov.check_task.dmctl.1714274938.15327.out
cov.check_task.dmctl.1714274938.15405.out
cov.check_task.dmctl.1714274940.15511.out
cov.check_task.dmctl.1714274941.15584.out
cov.check_task.dmctl.1714274941.15649.out
cov.check_task.dmctl.1714274941.15698.out
cov.check_task.dmctl.1714274941.15752.out
cov.check_task.master.out
cov.check_task.worker.8262.1714274936.out
cov.checkpoint_transaction.dmctl.1714274866.13780.out
cov.checkpoint_transaction.dmctl.1714274866.13822.out
cov.checkpoint_transaction.dmctl.1714274896.14305.out
cov.checkpoint_transaction.dmctl.1714274909.14352.out
cov.checkpoint_transaction.dmctl.1714274910.14416.out
cov.checkpoint_transaction.dmctl.1714274910.14455.out
cov.checkpoint_transaction.dmctl.1714274913.14605.out
cov.checkpoint_transaction.dmctl.1714274913.14650.out
cov.checkpoint_transaction.master.out
cov.checkpoint_transaction.worker.8262.1714274865.out
cov.checkpoint_transaction.worker.8262.1714274912.out
cov.dm_syncer.dmctl.1714274950.16200.out
cov.dm_syncer.dmctl.1714274950.16238.out
cov.dm_syncer.dmctl.1714274951.16284.out
cov.dm_syncer.dmctl.1714274953.16380.out
cov.dm_syncer.master.out
cov.dm_syncer.syncer.out
cov.dm_syncer.worker.8262.1714274948.out
cov.dm_syncer.worker.8263.1714274949.out
cov.downstream_diff_index.dmctl.1714274970.16970.out
cov.downstream_diff_index.dmctl.1714274971.17097.out
cov.downstream_diff_index.dmctl.1714274972.17139.out
cov.downstream_diff_index.master.out
cov.downstream_diff_index.worker.8262.1714274969.out
cov.downstream_diff_index.worker.8263.1714274970.out
cov.downstream_more_column.dmctl.1714274983.17574.out
cov.downstream_more_column.dmctl.1714274983.17617.out
cov.downstream_more_column.dmctl.1714274985.17678.out
cov.downstream_more_column.dmctl.1714274985.17715.out
cov.downstream_more_column.dmctl.1714274986.17766.out
cov.downstream_more_column.dmctl.1714274986.17809.out
cov.downstream_more_column.dmctl.1714274986.17852.out
cov.downstream_more_column.dmctl.1714274986.17887.out
cov.downstream_more_column.master.out
cov.downstream_more_column.worker.8262.1714274982.out
cov.drop_column_with_index.dmctl.1714274994.18225.out
cov.drop_column_with_index.dmctl.1714274994.18265.out
cov.drop_column_with_index.dmctl.1714274995.18307.out
cov.drop_column_with_index.dmctl.1714274996.18388.out
cov.drop_column_with_index.dmctl.1714274996.18434.out
cov.drop_column_with_index.dmctl.1714274996.18472.out
cov.drop_column_with_index.dmctl.1714275001.18522.out
cov.drop_column_with_index.dmctl.1714275001.18595.out
cov.drop_column_with_index.master.out
cov.drop_column_with_index.worker.8262.1714274993.out
cov.duplicate_event.dmctl.1714275011.18992.out
cov.duplicate_event.dmctl.1714275012.19035.out
cov.duplicate_event.dmctl.1714275076.19366.out
cov.duplicate_event.dmctl.1714275078.19414.out
cov.duplicate_event.dmctl.1714275079.19499.out
cov.duplicate_event.dmctl.1714275080.19540.out
cov.duplicate_event.dmctl.1714275100.20057.out
cov.duplicate_event.dmctl.1714275101.20098.out
cov.duplicate_event.dmctl.1714275166.20439.out
cov.duplicate_event.dmctl.1714275167.20488.out
cov.duplicate_event.dmctl.1714275168.20568.out
cov.duplicate_event.dmctl.1714275170.20611.out
cov.duplicate_event.master.out
cov.duplicate_event.worker.8262.1714275010.out
cov.duplicate_event.worker.8262.1714275099.out
cov.duplicate_event.worker.8263.1714275075.out
cov.duplicate_event.worker.8263.1714275165.out
cov.expression_filter.dmctl.1714275178.21023.out
cov.expression_filter.dmctl.1714275179.21068.out
cov.expression_filter.dmctl.1714275181.21113.out
cov.expression_filter.dmctl.1714275181.21153.out
cov.expression_filter.dmctl.1714275181.21188.out
cov.expression_filter.dmctl.1714275182.21236.out
cov.expression_filter.dmctl.1714275185.21400.out
cov.expression_filter.dmctl.1714275192.21689.out
cov.expression_filter.dmctl.1714275192.21734.out
cov.expression_filter.dmctl.1714275198.21789.out
cov.expression_filter.master.out
cov.expression_filter.worker.8262.1714275177.out
cov.expression_filter.worker.8262.1714275191.out
cov.extend_column.dmctl.1714275207.22249.out
cov.extend_column.dmctl.1714275207.22292.out
cov.extend_column.dmctl.1714275208.22342.out
cov.extend_column.dmctl.1714275209.22397.out
cov.extend_column.dmctl.1714275219.23015.out
cov.extend_column.dmctl.1714275219.23057.out
cov.extend_column.dmctl.1714275220.23108.out
cov.extend_column.dmctl.1714275220.23163.out
cov.extend_column.master.out
cov.extend_column.worker.8262.1714275205.out
cov.extend_column.worker.8262.1714275217.out
cov.extend_column.worker.8263.1714275206.out
cov.extend_column.worker.8263.1714275218.out
cov.fake_rotate_event.dmctl.1714275231.23729.out
cov.fake_rotate_event.dmctl.1714275232.23773.out
cov.fake_rotate_event.dmctl.1714275233.23821.out
cov.fake_rotate_event.dmctl.1714275236.24064.out
cov.fake_rotate_event.master.out
cov.fake_rotate_event.worker.8262.1714275230.out
cov.fake_rotate_event.worker.8262.1714275235.out
cov.foreign_key.dmctl.1714275245.24439.out
cov.foreign_key.dmctl.1714275245.24478.out
cov.foreign_key.dmctl.1714275247.24526.out
cov.foreign_key.dmctl.1714275247.24605.out
cov.foreign_key.master.out
cov.foreign_key.worker.8262.1714275244.out
cov.full_mode.dmctl.1714275254.24993.out
cov.full_mode.dmctl.1714275256.25106.out
cov.full_mode.dmctl.1714275257.25148.out
cov.full_mode.dmctl.1714275259.25201.out
cov.full_mode.dmctl.1714275268.25633.out
cov.full_mode.dmctl.1714275268.25675.out
cov.full_mode.dmctl.1714275269.25717.out
cov.full_mode.dmctl.1714275280.26131.out
cov.full_mode.dmctl.1714275281.26245.out
cov.full_mode.dmctl.1714275282.26294.out
cov.full_mode.dmctl.1714275285.26375.out
cov.full_mode.dmctl.1714275292.26699.out
cov.full_mode.dmctl.1714275294.26821.out
cov.full_mode.dmctl.1714275295.26864.out
cov.full_mode.dmctl.1714275297.26908.out
cov.full_mode.dmctl.1714275305.27368.out
cov.full_mode.dmctl.1714275306.27409.out
cov.full_mode.dmctl.1714275307.27448.out
cov.full_mode.dmctl.1714275308.27499.out
cov.full_mode.master.out
cov.full_mode.worker.8262.1714275253.out
cov.full_mode.worker.8262.1714275266.out
cov.full_mode.worker.8262.1714275279.out
cov.full_mode.worker.8262.1714275291.out
cov.full_mode.worker.8262.1714275303.out
cov.full_mode.worker.8263.1714275255.out
cov.full_mode.worker.8263.1714275267.out
cov.full_mode.worker.8263.1714275280.out
cov.full_mode.worker.8263.1714275293.out
cov.full_mode.worker.8263.1714275304.out
cov.gbk.dmctl.1714275317.28001.out
cov.gbk.dmctl.1714275318.28048.out
cov.gbk.dmctl.1714275319.28100.out
cov.gbk.dmctl.1714275356.29552.out
cov.gbk.dmctl.1714275358.29631.out
cov.gbk.dmctl.1714275387.30912.out
cov.gbk.master.out
cov.gbk.worker.8262.1714275315.out
cov.gbk.worker.8262.1714275335.out
cov.gbk.worker.8262.1714275340.out
cov.gbk.worker.8262.1714275344.out
cov.gbk.worker.8262.1714275350.out
cov.gbk.worker.8262.1714275354.out
cov.gbk.worker.8262.1714275361.out
cov.gbk.worker.8262.1714275367.out
cov.gbk.worker.8262.1714275373.out
cov.gbk.worker.8262.1714275379.out
cov.gbk.worker.8262.1714275385.out
cov.gbk.worker.8263.1714275316.out
cov.gbk.worker.8263.1714275336.out
cov.gbk.worker.8263.1714275341.out
cov.gbk.worker.8263.1714275345.out
cov.gbk.worker.8263.1714275351.out
cov.gbk.worker.8263.1714275355.out
cov.gbk.worker.8263.1714275362.out
cov.gbk.worker.8263.1714275368.out
cov.gbk.worker.8263.1714275374.out
cov.gbk.worker.8263.1714275380.out
cov.gbk.worker.8263.1714275386.out
cov.gtid.dmctl.1714275397.31299.out
cov.gtid.dmctl.1714275398.31414.out
cov.gtid.dmctl.1714275399.31466.out
cov.gtid.dmctl.1714275401.31584.out
cov.gtid.dmctl.1714275401.31628.out
cov.gtid.dmctl.1714275409.31971.out
cov.gtid.dmctl.1714275411.32094.out
cov.gtid.dmctl.1714275412.32136.out
cov.gtid.dmctl.1714275413.32318.out
cov.gtid.dmctl.1714275415.32512.out
cov.gtid.dmctl.1714275416.32593.out
cov.gtid.dmctl.1714275419.32805.out
cov.gtid.dmctl.1714275421.32849.out
cov.gtid.master.out
cov.gtid.worker.8262.1714275396.out
cov.gtid.worker.8262.1714275407.out
cov.gtid.worker.8262.1714275414.out
cov.gtid.worker.8262.1714275418.out
cov.gtid.worker.8263.1714275397.out
cov.gtid.worker.8263.1714275410.out
cov.gtid.worker.8263.1714275414.out
cov.gtid.worker.8263.1714275418.out
cov.ha_cases.dmctl.1714275428.33214.out
cov.ha_cases.dmctl.1714275429.33333.out
cov.ha_cases.dmctl.1714275431.33373.out
cov.ha_cases.dmctl.1714275431.33413.out
cov.ha_cases.dmctl.1714275431.33455.out
cov.ha_cases.dmctl.1714275441.33796.out
cov.ha_cases.dmctl.1714275443.33920.out
cov.ha_cases.dmctl.1714275444.33965.out
cov.ha_cases.dmctl.1714275445.34005.out
cov.ha_cases.dmctl.1714275449.34158.out
cov.ha_cases.dmctl.1714275450.34278.out
cov.ha_cases.dmctl.1714275450.34319.out
cov.ha_cases.dmctl.1714275452.34388.out
cov.ha_cases.dmctl.1714275454.34505.out
cov.ha_cases.dmctl.1714275465.35034.out
cov.ha_cases.dmctl.1714275467.35151.out
cov.ha_cases.dmctl.1714275468.35195.out
cov.ha_cases.dmctl.1714275469.35264.out
cov.ha_cases.dmctl.1714275473.35469.out
cov.ha_cases.dmctl.1714275474.35524.out
cov.ha_cases.dmctl.1714275475.35566.out
cov.ha_cases.dmctl.1714275479.35655.out
cov.ha_cases.dmctl.1714275482.35877.out
cov.ha_cases.dmctl.1714275486.36046.out
cov.ha_cases.dmctl.1714275488.36259.out
cov.ha_cases.dmctl.1714275493.36429.out
cov.ha_cases.dmctl.1714275495.36648.out
cov.ha_cases.dmctl.1714275495.36763.out
cov.ha_cases.dmctl.1714275496.36812.out
cov.ha_cases.dmctl.1714275497.36855.out
cov.ha_cases.dmctl.1714275502.36992.out
cov.ha_cases.dmctl.1714275504.37209.out
cov.ha_cases.dmctl.1714275523.37864.out
cov.ha_cases.dmctl.1714275552.38315.out
cov.ha_cases.dmctl.1714275552.38352.out
cov.ha_cases.dmctl.1714275553.38388.out
cov.ha_cases.dmctl.1714275553.38431.out
cov.ha_cases.dmctl.1714275554.38543.out
cov.ha_cases.dmctl.1714275557.38613.out
cov.ha_cases.dmctl.1714275562.38802.out
cov.ha_cases.dmctl.1714275579.39313.out
cov.ha_cases.dmctl.1714275580.39357.out
cov.ha_cases.dmctl.1714275584.39507.out
cov.ha_cases.dmctl.1714275584.39547.out
cov.ha_cases.dmctl.1714275586.39676.out
cov.ha_cases.dmctl.1714275587.39765.out
cov.ha_cases.dmctl.1714275589.39827.out
cov.ha_cases.dmctl.1714275589.39867.out
cov.ha_cases.dmctl.1714275589.39905.out
cov.ha_cases.dmctl.1714275590.39946.out
cov.ha_cases.master.out
cov.ha_cases.worker.18262.1714275494.out
cov.ha_cases.worker.8262.1714275427.out
cov.ha_cases.worker.8262.1714275440.out
cov.ha_cases.worker.8262.1714275449.out
cov.ha_cases.worker.8262.1714275464.out
cov.ha_cases.worker.8262.1714275480.out
cov.ha_cases.worker.8262.1714275487.out
cov.ha_cases.worker.8262.1714275502.out
cov.ha_cases.worker.8262.1714275557.out
cov.ha_cases.worker.8262.1714275578.out
cov.ha_cases.worker.8263.1714275428.out
cov.ha_cases.worker.8263.1714275441.out
cov.ha_cases.worker.8263.1714275453.out
cov.ha_cases.worker.8263.1714275466.out
cov.ha_cases.worker.8263.1714275481.out
cov.ha_cases.worker.8263.1714275486.out
cov.ha_cases.worker.8263.1714275503.out
cov.ha_cases.worker.8263.1714275553.out
cov.ha_cases.worker.8263.1714275584.out
cov.ha_cases.worker.8264.1714275446.out
cov.ha_cases.worker.8264.1714275493.out
cov.http_proxies.dmctl.1714275654.40640.out
cov.http_proxies.dmctl.1714275665.40949.out
cov.http_proxies.dmctl.1714275676.41263.out
cov.http_proxies.master.out
cov.http_proxies.worker.8262.1714275653.out
cov.http_proxies.worker.8262.1714275664.out
cov.http_proxies.worker.8262.1714275675.out
cov.lightning_load_task.dmctl.1714275685.41678.out
cov.lightning_load_task.dmctl.1714275687.41801.out
cov.lightning_load_task.dmctl.1714275689.41925.out
cov.lightning_load_task.dmctl.1714275690.41982.out
cov.lightning_load_task.dmctl.1714275692.42063.out
cov.lightning_load_task.dmctl.1714275692.42105.out
cov.lightning_load_task.dmctl.1714275694.42181.out
cov.lightning_load_task.dmctl.1714275694.42223.out
cov.lightning_load_task.dmctl.1714275694.42260.out
cov.lightning_load_task.dmctl.1714275695.42399.out
cov.lightning_load_task.dmctl.1714275695.42437.out
cov.lightning_load_task.dmctl.1714275696.42475.out
cov.lightning_load_task.dmctl.1714275696.42522.out
cov.lightning_load_task.dmctl.1714275698.42597.out
cov.lightning_load_task.dmctl.1714275698.42636.out
cov.lightning_load_task.dmctl.1714275698.42673.out
cov.lightning_load_task.dmctl.1714275699.42719.out
cov.lightning_load_task.dmctl.1714275701.42835.out
cov.lightning_load_task.dmctl.1714275703.42903.out
cov.lightning_load_task.dmctl.1714275703.42946.out
cov.lightning_load_task.dmctl.1714275704.42990.out
cov.lightning_load_task.dmctl.1714275705.43103.out
cov.lightning_load_task.dmctl.1714275707.43174.out
cov.lightning_load_task.dmctl.1714275708.43219.out
cov.lightning_load_task.dmctl.1714275708.43257.out
cov.lightning_load_task.dmctl.1714275708.43300.out
cov.lightning_load_task.dmctl.1714275719.43534.out
cov.lightning_load_task.dmctl.1714275719.43580.out
cov.lightning_load_task.dmctl.1714275720.43709.out
cov.lightning_load_task.dmctl.1714275720.43753.out
cov.lightning_load_task.master.out
cov.lightning_load_task.worker.8262.1714275684.out
cov.lightning_load_task.worker.8262.1714275694.out
cov.lightning_load_task.worker.8262.1714275704.out
cov.lightning_load_task.worker.8263.1714275686.out
cov.lightning_load_task.worker.8263.1714275699.out
cov.lightning_load_task.worker.8264.1714275688.out
cov.lightning_load_task.worker.8264.1714275719.out
cov.lightning_mode.dmctl.1714275757.44821.out
cov.lightning_mode.dmctl.1714275759.44937.out
cov.lightning_mode.dmctl.1714275761.44975.out
cov.lightning_mode.dmctl.1714275766.45162.out
cov.lightning_mode.dmctl.1714275767.45219.out
cov.lightning_mode.dmctl.1714275774.45403.out
cov.lightning_mode.dmctl.1714275774.45439.out
cov.lightning_mode.dmctl.1714275780.45596.out
cov.lightning_mode.dmctl.1714275781.45636.out
cov.lightning_mode.dmctl.1714275783.45689.out
cov.lightning_mode.master.out
dm_syncer
downstream
downstream_diff_index
downstream_more_column
drop_column_with_index
duplicate_event
expression_filter
extend_column
fake_rotate_event
foreign_key
full_mode
gbk
goroutines
gtid
ha_cases
http_proxies
lightning_load_task
lightning_mode
sql_res.adjust_gtid.txt
sql_res.async_checkpoint_flush.txt
sql_res.binlog_parse.txt
sql_res.case_sensitive.txt
sql_res.check_task.txt
sql_res.checkpoint_transaction.txt
sql_res.dm_syncer.txt
sql_res.downstream_diff_index.txt
sql_res.downstream_more_column.txt
sql_res.drop_column_with_index.txt
sql_res.duplicate_event.txt
sql_res.expression_filter.txt
sql_res.extend_column.txt
sql_res.fake_rotate_event.txt
sql_res.foreign_key.txt
sql_res.full_mode.txt
sql_res.gbk.txt
sql_res.gtid.txt
sql_res.ha_cases.txt
sql_res.http_proxies.txt
sql_res.lightning_load_task.txt
sql_res.lightning_mode.txt
tidb.toml
++ find /tmp/dm_test/ -type f -name '*.log'
+ tar -cvzf log-G11.tar.gz /tmp/dm_test/async_checkpoint_flush/sync_diff_stdout.log /tmp/dm_test/async_checkpoint_flush/worker1/log/dm-worker.log /tmp/dm_test/async_checkpoint_flush/worker1/log/stdout.log /tmp/dm_test/async_checkpoint_flush/dmctl.1714274749.log /tmp/dm_test/async_checkpoint_flush/master/log/stdout.log /tmp/dm_test/async_checkpoint_flush/master/log/dm-master.log /tmp/dm_test/lightning_load_task/sync_diff_stdout.log /tmp/dm_test/lightning_load_task/dmctl.1714275695.log /tmp/dm_test/lightning_load_task/dmctl.1714275708.log /tmp/dm_test/lightning_load_task/dmctl.1714275699.log /tmp/dm_test/lightning_load_task/dmctl.1714275707.log /tmp/dm_test/lightning_load_task/dmctl.1714275687.log /tmp/dm_test/lightning_load_task/dmctl.1714275719.log /tmp/dm_test/lightning_load_task/worker1/log/dm-worker.log /tmp/dm_test/lightning_load_task/worker1/log/stdout.log /tmp/dm_test/lightning_load_task/dmctl.1714275689.log /tmp/dm_test/lightning_load_task/dmctl.1714275701.log /tmp/dm_test/lightning_load_task/dmctl.1714275694.log /tmp/dm_test/lightning_load_task/worker3/log/dm-worker.log /tmp/dm_test/lightning_load_task/worker3/log/stdout.log /tmp/dm_test/lightning_load_task/dmctl.1714275705.log /tmp/dm_test/lightning_load_task/dmctl.1714275690.log /tmp/dm_test/lightning_load_task/dmctl.1714275704.log /tmp/dm_test/lightning_load_task/dmctl.1714275692.log /tmp/dm_test/lightning_load_task/master/log/stdout.log /tmp/dm_test/lightning_load_task/master/log/dm-master.log /tmp/dm_test/lightning_load_task/dmctl.1714275698.log /tmp/dm_test/lightning_load_task/dmctl.1714275696.log /tmp/dm_test/lightning_load_task/worker2/log/dm-worker.log /tmp/dm_test/lightning_load_task/worker2/log/stdout.log /tmp/dm_test/lightning_load_task/dmctl.1714275685.log /tmp/dm_test/lightning_load_task/dmctl.1714275720.log /tmp/dm_test/lightning_load_task/dmctl.1714275703.log /tmp/dm_test/expression_filter/dmctl.1714275192.log /tmp/dm_test/expression_filter/worker1/log/dm-worker.log /tmp/dm_test/expression_filter/worker1/log/stdout.log /tmp/dm_test/expression_filter/dmctl.1714275198.log /tmp/dm_test/expression_filter/master/log/stdout.log /tmp/dm_test/expression_filter/master/log/dm-master.log /tmp/dm_test/dm_syncer/sync_diff_stdout.log /tmp/dm_test/dm_syncer/dmctl.1714274951.log /tmp/dm_test/dm_syncer/worker1/log/dm-worker.log /tmp/dm_test/dm_syncer/worker1/log/stdout.log /tmp/dm_test/dm_syncer/dmctl.1714274953.log /tmp/dm_test/dm_syncer/syncer2/log/dm-syncer.log /tmp/dm_test/dm_syncer/syncer2/log/stdout.log /tmp/dm_test/dm_syncer/dmctl.1714274950.log /tmp/dm_test/dm_syncer/master/log/stdout.log /tmp/dm_test/dm_syncer/master/log/dm-master.log /tmp/dm_test/dm_syncer/syncer1/log/dm-syncer.log /tmp/dm_test/dm_syncer/syncer1/log/stdout.log /tmp/dm_test/dm_syncer/worker2/log/dm-worker.log /tmp/dm_test/dm_syncer/worker2/log/stdout.log /tmp/dm_test/binlog_parse/sync_diff_stdout.log /tmp/dm_test/binlog_parse/dmctl.1714274788.log /tmp/dm_test/binlog_parse/dmctl.1714274791.log /tmp/dm_test/binlog_parse/worker1/log/dm-worker.log /tmp/dm_test/binlog_parse/worker1/log/stdout.log /tmp/dm_test/binlog_parse/master/log/stdout.log /tmp/dm_test/binlog_parse/master/log/dm-master.log /tmp/dm_test/binlog_parse/dmctl.1714274790.log /tmp/dm_test/http_proxies/dmctl.1714275665.log /tmp/dm_test/http_proxies/dmctl.1714275654.log /tmp/dm_test/http_proxies/worker1/log/dm-worker.log /tmp/dm_test/http_proxies/worker1/log/stdout.log /tmp/dm_test/http_proxies/master/log/stdout.log /tmp/dm_test/http_proxies/master/log/dm-master.log /tmp/dm_test/http_proxies/dmctl.1714275676.log /tmp/dm_test/drop_column_with_index/sync_diff_stdout.log /tmp/dm_test/drop_column_with_index/dmctl.1714274995.log /tmp/dm_test/drop_column_with_index/dmctl.1714274994.log /tmp/dm_test/drop_column_with_index/worker1/log/dm-worker.log /tmp/dm_test/drop_column_with_index/worker1/log/stdout.log /tmp/dm_test/drop_column_with_index/master/log/stdout.log /tmp/dm_test/drop_column_with_index/master/log/dm-master.log /tmp/dm_test/drop_column_with_index/dmctl.1714275001.log /tmp/dm_test/drop_column_with_index/dmctl.1714274996.log /tmp/dm_test/lightning_mode/tikv.log /tmp/dm_test/lightning_mode/dmctl.1714275757.log /tmp/dm_test/lightning_mode/pd.log /tmp/dm_test/lightning_mode/pd/region-meta/000001.log /tmp/dm_test/lightning_mode/pd/hot-region/000001.log /tmp/dm_test/lightning_mode/dmctl.1714275781.log /tmp/dm_test/lightning_mode/worker1/log/dm-worker.log /tmp/dm_test/lightning_mode/worker1/log/stdout.log /tmp/dm_test/lightning_mode/tidb.log /tmp/dm_test/lightning_mode/dmctl.1714275780.log /tmp/dm_test/lightning_mode/dmctl.1714275767.log /tmp/dm_test/lightning_mode/dmctl.1714275766.log /tmp/dm_test/lightning_mode/master/log/stdout.log /tmp/dm_test/lightning_mode/master/log/dm-master.log /tmp/dm_test/lightning_mode/tikv/db/000005.log /tmp/dm_test/lightning_mode/dmctl.1714275783.log /tmp/dm_test/lightning_mode/worker2/log/dm-worker.log /tmp/dm_test/lightning_mode/worker2/log/stdout.log /tmp/dm_test/lightning_mode/dmctl.1714275759.log /tmp/dm_test/lightning_mode/dmctl.1714275761.log /tmp/dm_test/lightning_mode/dmctl.1714275774.log /tmp/dm_test/gbk/sync_diff_stdout.log /tmp/dm_test/gbk/dmctl.1714275319.log /tmp/dm_test/gbk/dmctl.1714275317.log /tmp/dm_test/gbk/dmctl.1714275387.log /tmp/dm_test/gbk/worker1/log/dm-worker.log /tmp/dm_test/gbk/worker1/log/stdout.log /tmp/dm_test/gbk/dmctl.1714275356.log /tmp/dm_test/gbk/master/log/stdout.log /tmp/dm_test/gbk/master/log/dm-master.log /tmp/dm_test/gbk/dmctl.1714275318.log /tmp/dm_test/gbk/dmctl.1714275358.log /tmp/dm_test/gbk/worker2/log/dm-worker.log /tmp/dm_test/gbk/worker2/log/stdout.log /tmp/dm_test/downstream/tidb/log/tidb.log /tmp/dm_test/foreign_key/sync_diff_stdout.log /tmp/dm_test/foreign_key/worker1/log/dm-worker.log /tmp/dm_test/foreign_key/worker1/log/stdout.log /tmp/dm_test/foreign_key/dmctl.1714275247.log /tmp/dm_test/foreign_key/master/log/stdout.log /tmp/dm_test/foreign_key/master/log/dm-master.log /tmp/dm_test/foreign_key/dmctl.1714275245.log /tmp/dm_test/full_mode/sync_diff_stdout.log /tmp/dm_test/full_mode/worker1/log/dm-worker.log /tmp/dm_test/full_mode/worker1/log/stdout.log /tmp/dm_test/full_mode/dmctl.1714275305.log /tmp/dm_test/full_mode/master/log/stdout.log /tmp/dm_test/full_mode/master/log/dm-master.log /tmp/dm_test/full_mode/dmctl.1714275308.log /tmp/dm_test/full_mode/worker2/log/dm-worker.log /tmp/dm_test/full_mode/worker2/log/stdout.log /tmp/dm_test/full_mode/dmctl.1714275307.log /tmp/dm_test/full_mode/dmctl.1714275306.log /tmp/dm_test/extend_column/worker1/log/dm-worker.log /tmp/dm_test/extend_column/worker1/log/stdout.log /tmp/dm_test/extend_column/dmctl.1714275220.log /tmp/dm_test/extend_column/master/log/stdout.log /tmp/dm_test/extend_column/master/log/dm-master.log /tmp/dm_test/extend_column/dmctl.1714275219.log /tmp/dm_test/extend_column/worker2/log/dm-worker.log /tmp/dm_test/extend_column/worker2/log/stdout.log /tmp/dm_test/ha_cases/dmctl.1714275584.log /tmp/dm_test/ha_cases/dmctl.1714275590.log /tmp/dm_test/ha_cases/sync_diff_stdout.log /tmp/dm_test/ha_cases/master1/log/stdout.log /tmp/dm_test/ha_cases/master1/log/dm-master.log /tmp/dm_test/ha_cases/master3/log/stdout.log /tmp/dm_test/ha_cases/master3/log/dm-master.log /tmp/dm_test/ha_cases/master2/log/stdout.log /tmp/dm_test/ha_cases/master2/log/dm-master.log /tmp/dm_test/ha_cases/dmctl.1714275580.log /tmp/dm_test/ha_cases/worker1/log/dm-worker.log /tmp/dm_test/ha_cases/worker1/log/stdout.log /tmp/dm_test/ha_cases/dmctl.1714275579.log /tmp/dm_test/ha_cases/dmctl.1714275589.log /tmp/dm_test/ha_cases/dmctl.1714275586.log /tmp/dm_test/ha_cases/worker2/log/dm-worker.log /tmp/dm_test/ha_cases/worker2/log/stdout.log /tmp/dm_test/ha_cases/dmctl.1714275587.log /tmp/dm_test/gtid/dmctl.1714275412.log /tmp/dm_test/gtid/dmctl.1714275409.log /tmp/dm_test/gtid/sync_diff_stdout.log /tmp/dm_test/gtid/dmctl.1714275415.log /tmp/dm_test/gtid/worker1/log/dm-worker.log /tmp/dm_test/gtid/worker1/log/stdout.log /tmp/dm_test/gtid/dmctl.1714275413.log /tmp/dm_test/gtid/dmctl.1714275419.log /tmp/dm_test/gtid/dmctl.1714275421.log /tmp/dm_test/gtid/dmctl.1714275416.log /tmp/dm_test/gtid/master/log/stdout.log /tmp/dm_test/gtid/master/log/dm-master.log /tmp/dm_test/gtid/dmctl.1714275411.log /tmp/dm_test/gtid/worker2/log/dm-worker.log /tmp/dm_test/gtid/worker2/log/stdout.log /tmp/dm_test/fake_rotate_event/sync_diff_stdout.log /tmp/dm_test/fake_rotate_event/dmctl.1714275236.log /tmp/dm_test/fake_rotate_event/dmctl.1714275232.log /tmp/dm_test/fake_rotate_event/dmctl.1714275231.log /tmp/dm_test/fake_rotate_event/worker1/log/dm-worker.log /tmp/dm_test/fake_rotate_event/worker1/log/stdout.log /tmp/dm_test/fake_rotate_event/dmctl.1714275233.log /tmp/dm_test/fake_rotate_event/master/log/stdout.log /tmp/dm_test/fake_rotate_event/master/log/dm-master.log /tmp/dm_test/checkpoint_transaction/dmctl.1714274866.log /tmp/dm_test/checkpoint_transaction/sync_diff_stdout.log /tmp/dm_test/checkpoint_transaction/dmctl.1714274913.log /tmp/dm_test/checkpoint_transaction/dmctl.1714274896.log /tmp/dm_test/checkpoint_transaction/worker1/log/dm-worker.log /tmp/dm_test/checkpoint_transaction/worker1/log/stdout.log /tmp/dm_test/checkpoint_transaction/dmctl.1714274909.log /tmp/dm_test/checkpoint_transaction/master/log/stdout.log /tmp/dm_test/checkpoint_transaction/master/log/dm-master.log /tmp/dm_test/checkpoint_transaction/dmctl.1714274910.log /tmp/dm_test/duplicate_event/dmctl.1714275168.log /tmp/dm_test/duplicate_event/sync_diff_stdout.log /tmp/dm_test/duplicate_event/dmctl.1714275166.log /tmp/dm_test/duplicate_event/worker1/log/dm-worker.log /tmp/dm_test/duplicate_event/worker1/log/stdout.log /tmp/dm_test/duplicate_event/dmctl.1714275100.log /tmp/dm_test/duplicate_event/dmctl.1714275167.log /tmp/dm_test/duplicate_event/master/log/stdout.log /tmp/dm_test/duplicate_event/master/log/dm-master.log /tmp/dm_test/duplicate_event/dmctl.1714275101.log /tmp/dm_test/duplicate_event/worker2/log/dm-worker.log /tmp/dm_test/duplicate_event/worker2/log/stdout.log /tmp/dm_test/duplicate_event/dmctl.1714275170.log /tmp/dm_test/goroutines/stack/log/master-8461.log /tmp/dm_test/goroutines/stack/log/master-8361.log /tmp/dm_test/goroutines/stack/log/master-8661.log /tmp/dm_test/goroutines/stack/log/worker-8264.log /tmp/dm_test/goroutines/stack/log/master-8761.log /tmp/dm_test/goroutines/stack/log/master-8561.log /tmp/dm_test/goroutines/stack/log/master-8261.log /tmp/dm_test/goroutines/stack/log/worker-18263.log /tmp/dm_test/goroutines/stack/log/worker-8263.log /tmp/dm_test/goroutines/stack/log/worker-8262.log /tmp/dm_test/goroutines/stack/log/worker-18262.log /tmp/dm_test/downstream_more_column/dmctl.1714274985.log /tmp/dm_test/downstream_more_column/dmctl.1714274983.log /tmp/dm_test/downstream_more_column/worker1/log/dm-worker.log /tmp/dm_test/downstream_more_column/worker1/log/stdout.log /tmp/dm_test/downstream_more_column/dmctl.1714274986.log /tmp/dm_test/downstream_more_column/master/log/stdout.log /tmp/dm_test/downstream_more_column/master/log/dm-master.log /tmp/dm_test/downstream_diff_index/dmctl.1714274972.log /tmp/dm_test/downstream_diff_index/worker1/log/dm-worker.log /tmp/dm_test/downstream_diff_index/worker1/log/stdout.log /tmp/dm_test/downstream_diff_index/dmctl.1714274971.log /tmp/dm_test/downstream_diff_index/master/log/stdout.log /tmp/dm_test/downstream_diff_index/master/log/dm-master.log /tmp/dm_test/downstream_diff_index/dmctl.1714274970.log /tmp/dm_test/downstream_diff_index/worker2/log/dm-worker.log /tmp/dm_test/downstream_diff_index/worker2/log/stdout.log /tmp/dm_test/adjust_gtid/dmctl.1714274716.log /tmp/dm_test/adjust_gtid/dmctl.1714274726.log /tmp/dm_test/adjust_gtid/sync_diff_stdout.log /tmp/dm_test/adjust_gtid/dmctl.1714274729.log /tmp/dm_test/adjust_gtid/dmctl.1714274715.log /tmp/dm_test/adjust_gtid/worker1/log/dm-worker.log /tmp/dm_test/adjust_gtid/worker1/log/stdout.log /tmp/dm_test/adjust_gtid/dmctl.1714274714.log /tmp/dm_test/adjust_gtid/dmctl.1714274712.log /tmp/dm_test/adjust_gtid/master/log/stdout.log /tmp/dm_test/adjust_gtid/master/log/dm-master.log /tmp/dm_test/adjust_gtid/worker2/log/dm-worker.log /tmp/dm_test/adjust_gtid/worker2/log/stdout.log
tar: Removing leading `/' from member names
/tmp/dm_test/async_checkpoint_flush/sync_diff_stdout.log
/tmp/dm_test/async_checkpoint_flush/worker1/log/dm-worker.log
/tmp/dm_test/async_checkpoint_flush/worker1/log/stdout.log
/tmp/dm_test/async_checkpoint_flush/dmctl.1714274749.log
/tmp/dm_test/async_checkpoint_flush/master/log/stdout.log
/tmp/dm_test/async_checkpoint_flush/master/log/dm-master.log
/tmp/dm_test/lightning_load_task/sync_diff_stdout.log
/tmp/dm_test/lightning_load_task/dmctl.1714275695.log
/tmp/dm_test/lightning_load_task/dmctl.1714275708.log
/tmp/dm_test/lightning_load_task/dmctl.1714275699.log
/tmp/dm_test/lightning_load_task/dmctl.1714275707.log
/tmp/dm_test/lightning_load_task/dmctl.1714275687.log
/tmp/dm_test/lightning_load_task/dmctl.1714275719.log
/tmp/dm_test/lightning_load_task/worker1/log/dm-worker.log
/tmp/dm_test/lightning_load_task/worker1/log/stdout.log
/tmp/dm_test/lightning_load_task/dmctl.1714275689.log
/tmp/dm_test/lightning_load_task/dmctl.1714275701.log
/tmp/dm_test/lightning_load_task/dmctl.1714275694.log
/tmp/dm_test/lightning_load_task/worker3/log/dm-worker.log
/tmp/dm_test/lightning_load_task/worker3/log/stdout.log
/tmp/dm_test/lightning_load_task/dmctl.1714275705.log
/tmp/dm_test/lightning_load_task/dmctl.1714275690.log
/tmp/dm_test/lightning_load_task/dmctl.1714275704.log
/tmp/dm_test/lightning_load_task/dmctl.1714275692.log
/tmp/dm_test/lightning_load_task/master/log/stdout.log
/tmp/dm_test/lightning_load_task/master/log/dm-master.log
/tmp/dm_test/lightning_load_task/dmctl.1714275698.log
/tmp/dm_test/lightning_load_task/dmctl.1714275696.log
/tmp/dm_test/lightning_load_task/worker2/log/dm-worker.log
/tmp/dm_test/lightning_load_task/worker2/log/stdout.log
/tmp/dm_test/lightning_load_task/dmctl.1714275685.log
/tmp/dm_test/lightning_load_task/dmctl.1714275720.log
/tmp/dm_test/lightning_load_task/dmctl.1714275703.log
/tmp/dm_test/expression_filter/dmctl.1714275192.log
/tmp/dm_test/expression_filter/worker1/log/dm-worker.log
/tmp/dm_test/expression_filter/worker1/log/stdout.log
/tmp/dm_test/expression_filter/dmctl.1714275198.log
/tmp/dm_test/expression_filter/master/log/stdout.log
/tmp/dm_test/expression_filter/master/log/dm-master.log
/tmp/dm_test/dm_syncer/sync_diff_stdout.log
/tmp/dm_test/dm_syncer/dmctl.1714274951.log
/tmp/dm_test/dm_syncer/worker1/log/dm-worker.log
/tmp/dm_test/dm_syncer/worker1/log/stdout.log
/tmp/dm_test/dm_syncer/dmctl.1714274953.log
/tmp/dm_test/dm_syncer/syncer2/log/dm-syncer.log
/tmp/dm_test/dm_syncer/syncer2/log/stdout.log
/tmp/dm_test/dm_syncer/dmctl.1714274950.log
/tmp/dm_test/dm_syncer/master/log/stdout.log
/tmp/dm_test/dm_syncer/master/log/dm-master.log
/tmp/dm_test/dm_syncer/syncer1/log/dm-syncer.log
/tmp/dm_test/dm_syncer/syncer1/log/stdout.log
/tmp/dm_test/dm_syncer/worker2/log/dm-worker.log
/tmp/dm_test/dm_syncer/worker2/log/stdout.log
/tmp/dm_test/binlog_parse/sync_diff_stdout.log
/tmp/dm_test/binlog_parse/dmctl.1714274788.log
/tmp/dm_test/binlog_parse/dmctl.1714274791.log
/tmp/dm_test/binlog_parse/worker1/log/dm-worker.log
/tmp/dm_test/binlog_parse/worker1/log/stdout.log
/tmp/dm_test/binlog_parse/master/log/stdout.log
/tmp/dm_test/binlog_parse/master/log/dm-master.log
/tmp/dm_test/binlog_parse/dmctl.1714274790.log
/tmp/dm_test/http_proxies/dmctl.1714275665.log
/tmp/dm_test/http_proxies/dmctl.1714275654.log
/tmp/dm_test/http_proxies/worker1/log/dm-worker.log
/tmp/dm_test/http_proxies/worker1/log/stdout.log
/tmp/dm_test/http_proxies/master/log/stdout.log
/tmp/dm_test/http_proxies/master/log/dm-master.log
/tmp/dm_test/http_proxies/dmctl.1714275676.log
/tmp/dm_test/drop_column_with_index/sync_diff_stdout.log
/tmp/dm_test/drop_column_with_index/dmctl.1714274995.log
/tmp/dm_test/drop_column_with_index/dmctl.1714274994.log
/tmp/dm_test/drop_column_with_index/worker1/log/dm-worker.log
/tmp/dm_test/drop_column_with_index/worker1/log/stdout.log
/tmp/dm_test/drop_column_with_index/master/log/stdout.log
/tmp/dm_test/drop_column_with_index/master/log/dm-master.log
/tmp/dm_test/drop_column_with_index/dmctl.1714275001.log
/tmp/dm_test/drop_column_with_index/dmctl.1714274996.log
/tmp/dm_test/lightning_mode/tikv.log
/tmp/dm_test/lightning_mode/dmctl.1714275757.log
/tmp/dm_test/lightning_mode/pd.log
/tmp/dm_test/lightning_mode/pd/region-meta/000001.log
/tmp/dm_test/lightning_mode/pd/hot-region/000001.log
/tmp/dm_test/lightning_mode/dmctl.1714275781.log
/tmp/dm_test/lightning_mode/worker1/log/dm-worker.log
/tmp/dm_test/lightning_mode/worker1/log/stdout.log
/tmp/dm_test/lightning_mode/tidb.log
/tmp/dm_test/lightning_mode/dmctl.1714275780.log
/tmp/dm_test/lightning_mode/dmctl.1714275767.log
/tmp/dm_test/lightning_mode/dmctl.1714275766.log
/tmp/dm_test/lightning_mode/master/log/stdout.log
/tmp/dm_test/lightning_mode/master/log/dm-master.log
/tmp/dm_test/lightning_mode/tikv/db/000005.log
/tmp/dm_test/lightning_mode/dmctl.1714275783.log
/tmp/dm_test/lightning_mode/worker2/log/dm-worker.log
/tmp/dm_test/lightning_mode/worker2/log/stdout.log
/tmp/dm_test/lightning_mode/dmctl.1714275759.log
/tmp/dm_test/lightning_mode/dmctl.1714275761.log
/tmp/dm_test/lightning_mode/dmctl.1714275774.log
/tmp/dm_test/gbk/sync_diff_stdout.log
/tmp/dm_test/gbk/dmctl.1714275319.log
/tmp/dm_test/gbk/dmctl.1714275317.log
/tmp/dm_test/gbk/dmctl.1714275387.log
/tmp/dm_test/gbk/worker1/log/dm-worker.log
/tmp/dm_test/gbk/worker1/log/stdout.log
/tmp/dm_test/gbk/dmctl.1714275356.log
/tmp/dm_test/gbk/master/log/stdout.log
/tmp/dm_test/gbk/master/log/dm-master.log
/tmp/dm_test/gbk/dmctl.1714275318.log
/tmp/dm_test/gbk/dmctl.1714275358.log
/tmp/dm_test/gbk/worker2/log/dm-worker.log
/tmp/dm_test/gbk/worker2/log/stdout.log
/tmp/dm_test/downstream/tidb/log/tidb.log
/tmp/dm_test/foreign_key/sync_diff_stdout.log
/tmp/dm_test/foreign_key/worker1/log/dm-worker.log
/tmp/dm_test/foreign_key/worker1/log/stdout.log
/tmp/dm_test/foreign_key/dmctl.1714275247.log
/tmp/dm_test/foreign_key/master/log/stdout.log
/tmp/dm_test/foreign_key/master/log/dm-master.log
/tmp/dm_test/foreign_key/dmctl.1714275245.log
/tmp/dm_test/full_mode/sync_diff_stdout.log
/tmp/dm_test/full_mode/worker1/log/dm-worker.log
/tmp/dm_test/full_mode/worker1/log/stdout.log
/tmp/dm_test/full_mode/dmctl.1714275305.log
/tmp/dm_test/full_mode/master/log/stdout.log
/tmp/dm_test/full_mode/master/log/dm-master.log
/tmp/dm_test/full_mode/dmctl.1714275308.log
/tmp/dm_test/full_mode/worker2/log/dm-worker.log
/tmp/dm_test/full_mode/worker2/log/stdout.log
/tmp/dm_test/full_mode/dmctl.1714275307.log
/tmp/dm_test/full_mode/dmctl.1714275306.log
/tmp/dm_test/extend_column/worker1/log/dm-worker.log
/tmp/dm_test/extend_column/worker1/log/stdout.log
/tmp/dm_test/extend_column/dmctl.1714275220.log
/tmp/dm_test/extend_column/master/log/stdout.log
/tmp/dm_test/extend_column/master/log/dm-master.log
/tmp/dm_test/extend_column/dmctl.1714275219.log
/tmp/dm_test/extend_column/worker2/log/dm-worker.log
/tmp/dm_test/extend_column/worker2/log/stdout.log
/tmp/dm_test/ha_cases/dmctl.1714275584.log
/tmp/dm_test/ha_cases/dmctl.1714275590.log
/tmp/dm_test/ha_cases/sync_diff_stdout.log
/tmp/dm_test/ha_cases/master1/log/stdout.log
/tmp/dm_test/ha_cases/master1/log/dm-master.log
/tmp/dm_test/ha_cases/master3/log/stdout.log
/tmp/dm_test/ha_cases/master3/log/dm-master.log
/tmp/dm_test/ha_cases/master2/log/stdout.log
/tmp/dm_test/ha_cases/master2/log/dm-master.log
/tmp/dm_test/ha_cases/dmctl.1714275580.log
/tmp/dm_test/ha_cases/worker1/log/dm-worker.log
/tmp/dm_test/ha_cases/worker1/log/stdout.log
/tmp/dm_test/ha_cases/dmctl.1714275579.log
/tmp/dm_test/ha_cases/dmctl.1714275589.log
/tmp/dm_test/ha_cases/dmctl.1714275586.log
/tmp/dm_test/ha_cases/worker2/log/dm-worker.log
/tmp/dm_test/ha_cases/worker2/log/stdout.log
/tmp/dm_test/ha_cases/dmctl.1714275587.log
/tmp/dm_test/gtid/dmctl.1714275412.log
/tmp/dm_test/gtid/dmctl.1714275409.log
/tmp/dm_test/gtid/sync_diff_stdout.log
/tmp/dm_test/gtid/dmctl.1714275415.log
/tmp/dm_test/gtid/worker1/log/dm-worker.log
/tmp/dm_test/gtid/worker1/log/stdout.log
/tmp/dm_test/gtid/dmctl.1714275413.log
/tmp/dm_test/gtid/dmctl.1714275419.log
/tmp/dm_test/gtid/dmctl.1714275421.log
/tmp/dm_test/gtid/dmctl.1714275416.log
/tmp/dm_test/gtid/master/log/stdout.log
/tmp/dm_test/gtid/master/log/dm-master.log
/tmp/dm_test/gtid/dmctl.1714275411.log
/tmp/dm_test/gtid/worker2/log/dm-worker.log
/tmp/dm_test/gtid/worker2/log/stdout.log
/tmp/dm_test/fake_rotate_event/sync_diff_stdout.log
/tmp/dm_test/fake_rotate_event/dmctl.1714275236.log
/tmp/dm_test/fake_rotate_event/dmctl.1714275232.log
/tmp/dm_test/fake_rotate_event/dmctl.1714275231.log
/tmp/dm_test/fake_rotate_event/worker1/log/dm-worker.log
/tmp/dm_test/fake_rotate_event/worker1/log/stdout.log
/tmp/dm_test/fake_rotate_event/dmctl.1714275233.log
/tmp/dm_test/fake_rotate_event/master/log/stdout.log
/tmp/dm_test/fake_rotate_event/master/log/dm-master.log
/tmp/dm_test/checkpoint_transaction/dmctl.1714274866.log
/tmp/dm_test/checkpoint_transaction/sync_diff_stdout.log
/tmp/dm_test/checkpoint_transaction/dmctl.1714274913.log
/tmp/dm_test/checkpoint_transaction/dmctl.1714274896.log
/tmp/dm_test/checkpoint_transaction/worker1/log/dm-worker.log
/tmp/dm_test/checkpoint_transaction/worker1/log/stdout.log
/tmp/dm_test/checkpoint_transaction/dmctl.1714274909.log
/tmp/dm_test/checkpoint_transaction/master/log/stdout.log
/tmp/dm_test/checkpoint_transaction/master/log/dm-master.log
/tmp/dm_test/checkpoint_transaction/dmctl.1714274910.log
/tmp/dm_test/duplicate_event/dmctl.1714275168.log
/tmp/dm_test/duplicate_event/sync_diff_stdout.log
/tmp/dm_test/duplicate_event/dmctl.1714275166.log
/tmp/dm_test/duplicate_event/worker1/log/dm-worker.log
/tmp/dm_test/duplicate_event/worker1/log/stdout.log
/tmp/dm_test/duplicate_event/dmctl.1714275100.log
/tmp/dm_test/duplicate_event/dmctl.1714275167.log
/tmp/dm_test/duplicate_event/master/log/stdout.log
/tmp/dm_test/duplicate_event/master/log/dm-master.log
/tmp/dm_test/duplicate_event/dmctl.1714275101.log
/tmp/dm_test/duplicate_event/worker2/log/dm-worker.log
/tmp/dm_test/duplicate_event/worker2/log/stdout.log
/tmp/dm_test/duplicate_event/dmctl.1714275170.log
/tmp/dm_test/goroutines/stack/log/master-8461.log
/tmp/dm_test/goroutines/stack/log/master-8361.log
/tmp/dm_test/goroutines/stack/log/master-8661.log
/tmp/dm_test/goroutines/stack/log/worker-8264.log
/tmp/dm_test/goroutines/stack/log/master-8761.log
/tmp/dm_test/goroutines/stack/log/master-8561.log
/tmp/dm_test/goroutines/stack/log/master-8261.log
/tmp/dm_test/goroutines/stack/log/worker-18263.log
/tmp/dm_test/goroutines/stack/log/worker-8263.log
/tmp/dm_test/goroutines/stack/log/worker-8262.log
/tmp/dm_test/goroutines/stack/log/worker-18262.log
/tmp/dm_test/downstream_more_column/dmctl.1714274985.log
/tmp/dm_test/downstream_more_column/dmctl.1714274983.log
/tmp/dm_test/downstream_more_column/worker1/log/dm-worker.log
/tmp/dm_test/downstream_more_column/worker1/log/stdout.log
/tmp/dm_test/downstream_more_column/dmctl.1714274986.log
/tmp/dm_test/downstream_more_column/master/log/stdout.log
/tmp/dm_test/downstream_more_column/master/log/dm-master.log
/tmp/dm_test/downstream_diff_index/dmctl.1714274972.log
/tmp/dm_test/downstream_diff_index/worker1/log/dm-worker.log
/tmp/dm_test/downstream_diff_index/worker1/log/stdout.log
/tmp/dm_test/downstream_diff_index/dmctl.1714274971.log
/tmp/dm_test/downstream_diff_index/master/log/stdout.log
/tmp/dm_test/downstream_diff_index/master/log/dm-master.log
/tmp/dm_test/downstream_diff_index/dmctl.1714274970.log
/tmp/dm_test/downstream_diff_index/worker2/log/dm-worker.log
/tmp/dm_test/downstream_diff_index/worker2/log/stdout.log
/tmp/dm_test/adjust_gtid/dmctl.1714274716.log
/tmp/dm_test/adjust_gtid/dmctl.1714274726.log
/tmp/dm_test/adjust_gtid/sync_diff_stdout.log
/tmp/dm_test/adjust_gtid/dmctl.1714274729.log
/tmp/dm_test/adjust_gtid/dmctl.1714274715.log
/tmp/dm_test/adjust_gtid/worker1/log/dm-worker.log
/tmp/dm_test/adjust_gtid/worker1/log/stdout.log
/tmp/dm_test/adjust_gtid/dmctl.1714274714.log
/tmp/dm_test/adjust_gtid/dmctl.1714274712.log
/tmp/dm_test/adjust_gtid/master/log/stdout.log
/tmp/dm_test/adjust_gtid/master/log/dm-master.log
/tmp/dm_test/adjust_gtid/worker2/log/dm-worker.log
/tmp/dm_test/adjust_gtid/worker2/log/stdout.log
+ ls -alh log-G11.tar.gz
-rw-r--r--. 1 jenkins jenkins 3.0M Apr 28 11:43 log-G11.tar.gz
[Pipeline] archiveArtifacts
Archiving artifacts
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G11'
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] End of Pipeline
ERROR: script returned exit code 2
Finished: FAILURE