Skipping 15,853 KB.. Full Log

[2024/05/30 17:17:11.771 +08:00] [DEBUG] [diff.go:263] ["all consume tasks finished"]
[2024/05/30 17:17:11.796 +08:00] [DEBUG] [diff.go:762] ["insert node"] ["chunk index"="{\"table-index\":0,\"bucket-index-left\":0,\"bucket-index-right\":0,\"chunk-index\":0,\"chunk-count\":0}"]
[2024/05/30 17:17:11.796 +08:00] [INFO] [diff.go:732] ["write sql channel closed"]
[2024/05/30 17:17:11.796 +08:00] [INFO] [diff.go:723] ["close writeSQLs goroutine"]
[2024/05/30 17:17:11.796 +08:00] [INFO] [diff.go:405] ["Stop do checkpoint"]
[2024/05/30 17:17:11.796 +08:00] [INFO] [checkpoints.go:225] ["save checkpoint"] [chunk="{\"state\":\"failed\",\"chunk-range\":{\"index\":{\"table-index\":0,\"bucket-index-left\":0,\"bucket-index-right\":0,\"chunk-index\":0,\"chunk-count\":0},\"type\":2,\"bounds\":[],\"is-first\":false,\"is-last\":false,\"where\":\"((TRUE) AND (TRUE))\",\"args\":null},\"index-id\":0}"] [state=failed]
[2024/05/30 17:17:11.796 +08:00] [INFO] [diff.go:379] ["close handleCheckpoint goroutine"]
[2024/05/30 17:17:11.797 +08:00] [WARN] [report.go:164] ["fail to get the correct size of table, if you want to get the correct size, please analyze the corresponding tables"] [table=`kafka_big_messages`.`test`] []
[2024/05/30 17:17:11.798 +08:00] [INFO] [main.go:114] ["check data finished"] [cost=257.977034ms]
[2024/05/30 17:17:11.798 +08:00] [WARN] [main.go:105] ["check failed!!!"]

table sink_retry.finish_mark_1 not exists for 30-th check, retry later
table test.finish_mark_for_ddl not exists for 1-th check, retry later
table row_format.finish_mark not exists for 50-th check, retry later
check diff failed 29-th time, retry later
table sink_retry.finish_mark_1 not exists for 31-th check, retry later
table row_format.finish_mark not exists for 51-th check, retry later
table test.finish_mark_for_ddl not exists for 2-th check, retry later
table sink_retry.finish_mark_1 not exists for 32-th check, retry later
table row_format.finish_mark not exists for 52-th check, retry later
check diff failed 30-th time, retry later
table test.finish_mark_for_ddl not exists for 3-th check, retry later
table sink_retry.finish_mark_1 not exists for 33-th check, retry later
check diff failed at last
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'
A total of 1 tables need to be compared


Comparing the table structure of ``kafka_big_messages`.`test`` ... equivalent
Comparing the table data of ``kafka_big_messages`.`test`` ...
_____________________________________________________________________________
Progress [>------------------------------------------------------------] 0% 0/1
Comparing the table data of ``kafka_big_messages`.`test`` ... failure
_____________________________________________________________________________
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
Progress [============================================================>] 100% 0/0
The data of `kafka_big_messages`.`test` is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in 
	'/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/fix-on-tidb0/'
You can view the comparision details through '/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log'

cat: /tmp/tidb_cdc_test/kafka_big_messages_v2/sync_diff/output/sync_diff.log: No such file or directory

table test.finish_mark_for_ddl not exists for 4-th check, retry later
table row_format.finish_mark not exists for 53-th check, retry later
table sink_retry.finish_mark_1 not exists for 34-th check, retry later
table test.finish_mark_for_ddl exists
+ cdc.test -test.coverprofile=/tmp/tidb_cdc_test/cov.kafka_simple_basic.cli.7097.out cli changefeed pause -c simple-basic
PASS
coverage: 2.0% of statements in github.com/pingcap/tiflow/...
table row_format.finish_mark not exists for 54-th check, retry later
table sink_retry.finish_mark_1 not exists for 35-th check, retry later
+ set +x
+ cdc.test -test.coverprofile=/tmp/tidb_cdc_test/cov.kafka_simple_basic.cli.7118.out cli changefeed resume -c simple-basic
PASS
coverage: 2.1% of statements in github.com/pingcap/tiflow/...
table row_format.finish_mark not exists for 55-th check, retry later
table sink_retry.finish_mark_1 not exists for 36-th check, retry later
+ set +x
table row_format.finish_mark not exists for 56-th check, retry later
table sink_retry.finish_mark_1 not exists for 37-th check, retry later
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
Post stage
[Pipeline] sh
table row_format.finish_mark not exists for 57-th check, retry later
+ ls /tmp/tidb_cdc_test/
kafka_big_messages
sql_res.kafka_big_messages.txt
++ find /tmp/tidb_cdc_test/ -type f -name '*.log'
+ tar -cvzf log-G00.tar.gz /tmp/tidb_cdc_test/kafka_big_messages/tikv2.log /tmp/tidb_cdc_test/kafka_big_messages/tikv3/db/000005.log /tmp/tidb_cdc_test/kafka_big_messages/tikv2/db/000005.log /tmp/tidb_cdc_test/kafka_big_messages/stdout.log /tmp/tidb_cdc_test/kafka_big_messages/tidb_down.log /tmp/tidb_cdc_test/kafka_big_messages/tikv_down/db/000005.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_kafka_consumer_stdout.log /tmp/tidb_cdc_test/kafka_big_messages/tiflash/db/proxy/db/000005.log /tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/error.log /tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/proxy.log /tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/server.log /tmp/tidb_cdc_test/kafka_big_messages/down_pd.log /tmp/tidb_cdc_test/kafka_big_messages/pd1.log /tmp/tidb_cdc_test/kafka_big_messages/tikv3.log /tmp/tidb_cdc_test/kafka_big_messages/tikv_down.log /tmp/tidb_cdc_test/kafka_big_messages/tikv1/db/000005.log /tmp/tidb_cdc_test/kafka_big_messages/cdc.log /tmp/tidb_cdc_test/kafka_big_messages/tidb.log /tmp/tidb_cdc_test/kafka_big_messages/sync_diff_inspector.log /tmp/tidb_cdc_test/kafka_big_messages/pd1/region-meta/000001.log /tmp/tidb_cdc_test/kafka_big_messages/pd1/hot-region/000001.log /tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log /tmp/tidb_cdc_test/kafka_big_messages/tikv1.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0006/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0007/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0002/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0000/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0005/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0003/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0004/000002.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000007.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000012.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000005.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000008.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000010.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000006.log /tmp/tidb_cdc_test/kafka_big_messages/down_pd/region-meta/000001.log /tmp/tidb_cdc_test/kafka_big_messages/down_pd/hot-region/000001.log /tmp/tidb_cdc_test/kafka_big_messages/cdc_kafka_consumer.log /tmp/tidb_cdc_test/kafka_big_messages/tidb_other.log
tar: Removing leading `/' from member names
/tmp/tidb_cdc_test/kafka_big_messages/tikv2.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv3/db/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv2/db/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/stdout.log
/tmp/tidb_cdc_test/kafka_big_messages/tidb_down.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv_down/db/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_kafka_consumer_stdout.log
/tmp/tidb_cdc_test/kafka_big_messages/tiflash/db/proxy/db/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/error.log
/tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/proxy.log
/tmp/tidb_cdc_test/kafka_big_messages/tiflash/log/server.log
/tmp/tidb_cdc_test/kafka_big_messages/down_pd.log
/tmp/tidb_cdc_test/kafka_big_messages/pd1.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv3.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv_down.log
table sink_retry.finish_mark_1 not exists for 38-th check, retry later
/tmp/tidb_cdc_test/kafka_big_messages/tikv1/db/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc.log
/tmp/tidb_cdc_test/kafka_big_messages/tidb.log
/tmp/tidb_cdc_test/kafka_big_messages/sync_diff_inspector.log
/tmp/tidb_cdc_test/kafka_big_messages/pd1/region-meta/000001.log
/tmp/tidb_cdc_test/kafka_big_messages/pd1/hot-region/000001.log
/tmp/tidb_cdc_test/kafka_big_messages/sync_diff/output/sync_diff.log
/tmp/tidb_cdc_test/kafka_big_messages/tikv1.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0006/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0007/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0002/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0000/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0005/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0003/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0004/000002.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000007.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000012.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000005.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000008.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000010.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_data/tmp/sorter/0001/000006.log
/tmp/tidb_cdc_test/kafka_big_messages/down_pd/region-meta/000001.log
/tmp/tidb_cdc_test/kafka_big_messages/down_pd/hot-region/000001.log
/tmp/tidb_cdc_test/kafka_big_messages/cdc_kafka_consumer.log
/tmp/tidb_cdc_test/kafka_big_messages/tidb_other.log
+ ls -alh log-G00.tar.gz
-rw-r--r-- 1 jenkins jenkins 3.6M May 30 17:17 log-G00.tar.gz
[Pipeline] archiveArtifacts
Archiving artifacts
Recording fingerprints
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
table row_format.finish_mark not exists for 58-th check, retry later
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
table sink_retry.finish_mark_1 not exists for 39-th check, retry later
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G00'
Sending interrupt signal to process
Killing processes
kill finished with exit code 0
Sending interrupt signal to process
Killing processes
kill finished with exit code 0
Sending interrupt signal to process
Killing processes
kill finished with exit code 0
Sending interrupt signal to process
Killing processes
script returned exit code 143
{"level":"warn","ts":1717060655.9386976,"caller":"v3@v3.5.12/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc0007e0c40/127.0.0.1:2379","attempt":0,"error":"rpc error: code = Unavailable desc = error reading from server: read tcp 127.0.0.1:33512->127.0.0.1:2379: read: connection reset by peer"}
script returned exit code 143
kill finished with exit code 0
[Pipeline] // node
table row_format.finish_mark not exists for 59-th check, retry later
{"level":"warn","ts":1717060656.6083,"caller":"v3@v3.5.12/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc001471880/127.0.0.1:2379","attempt":0,"error":"rpc error: code = Unavailable desc = error reading from server: EOF"}
script returned exit code 143
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] // node
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] }
[Pipeline] }
[Pipeline] }
{"level":"warn","ts":1717060656.879358,"caller":"v3@v3.5.12/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc002b9b180/127.0.0.1:2379","attempt":0,"error":"rpc error: code = Unavailable desc = error reading from server: EOF"}
script returned exit code 143
[Pipeline] }
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // cache
[Pipeline] // cache
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
Cache not saved (inner-step execution failed)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // dir
[Pipeline] // dir
[Pipeline] // cache
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // withCredentials
[Pipeline] // withCredentials
[Pipeline] // dir
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G04'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G05'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G07'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G08'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G09'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G10'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G11'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G12'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G13'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G14'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G15'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G16'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G17'
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // timeout
[Pipeline] // timeout
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // timeout
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] // container
[Pipeline] // stage
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // container
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] // node
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] // podTemplate
[Pipeline] // node
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] // withEnv
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] }
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] // stage
[Pipeline] // withEnv
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G01'
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G02'
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G03'
[Pipeline] // stage
[Pipeline] }
Failed in branch Matrix - TEST_GROUP = 'G06'
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] End of Pipeline
ERROR: script returned exit code 1
Finished: FAILURE