Console Output

Skipping 1,056 KB.. Full Log
+ '[' 1 = 0 ']'
+ verify_detected_rows tf
+ table=tf
+ mapfile -t rows
++ sed 's/^.*(//'
++ grep insert /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection/data/dup_detect.tf.0.sql /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection/data/dup_detect.tf.1.sql
++ sed 's/).*$//'
++ sed 's/'\''//g'
++ sed 's/, */,/g'
+ set +x
TiFlash started.
selected test cases: lightning_partitioned-table
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:20 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table --backend' 'tidb >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_partitioned-table.17556.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table/data --sorted-kv-dir /tmp/lightning_test/lightning_partitioned-table.sorted --enable-checkpoint=0 --check-requirements=0 --backend tidb
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 14.8% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: a
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 0
 Avg_row_length: 0
    Data_length: 0
Max_data_length: 0
   Index_length: 0
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:20
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: range
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 0
 Avg_row_length: 0
    Data_length: 0
Max_data_length: 0
   Index_length: 0
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:20
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: list
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 0
 Avg_row_length: 0
    Data_length: 0
Max_data_length: 0
   Index_length: 0
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:20
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: defaultlist
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 0
 Avg_row_length: 0
    Data_length: 0
Max_data_length: 0
   Index_length: 0
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:20
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection/run.sh: line 55: expect_rows[@]: unbound variable
+ '[' 1 = 0 ']'
+ verify_detected_rows tg
+ table=tg
+ mapfile -t rows
++ sed 's/^.*(//'
++ grep insert /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection/data/dup_detect.tg.0.sql /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection/data/dup_detect.tg.1.sql
++ sed 's/).*$//'
++ sed 's/'\''//g'
++ sed 's/, */,/g'
+ set +x
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:21 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table --backend' 'local >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_partitioned-table.17656.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_partitioned-table/data --sorted-kv-dir /tmp/lightning_test/lightning_partitioned-table.sorted --enable-checkpoint=0 --check-requirements=0 --backend local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 23.1% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: a
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 8
 Avg_row_length: 16
    Data_length: 128
Max_data_length: 0
   Index_length: 64
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:21
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: range
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 8
 Avg_row_length: 16
    Data_length: 128
Max_data_length: 0
   Index_length: 64
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:21
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: list
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 8
 Avg_row_length: 16
    Data_length: 128
Max_data_length: 0
   Index_length: 64
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:21
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*************************** 1. row ***************************
count(1): 8
  sum(a): 277151781
*************************** 1. row ***************************
           Name: defaultlist
         Engine: InnoDB
        Version: 10
     Row_format: Compact
           Rows: 8
 Avg_row_length: 16
    Data_length: 128
Max_data_length: 0
   Index_length: 64
      Data_free: 0
 Auto_increment: NULL
    Create_time: 2024-05-06 17:25:21
    Update_time: NULL
     Check_time: NULL
      Collation: utf8mb4_bin
       Checksum: 
 Create_options: partitioned
        Comment: 
*===== TEST: [lightning_partitioned-table] success! =====*
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
Run cases: lightning_record_network
+ '[' 1 = 0 ']'
*===== TEST: [lightning_duplicate_detection] success! =====*
TiFlash started.
selected test cases: lightning_alter_random
Starting PD...
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:29 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random --backend' 'tidb >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_alter_random.24948.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random/data --sorted-kv-dir /tmp/lightning_test/lightning_alter_random.sorted --enable-checkpoint=0 --check-requirements=0 --backend tidb
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 14.7% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
*************************** 1. row ***************************
count(*): 3
*************************** 1. row ***************************
inc: 1
*************************** 2. row ***************************
inc: 3
*************************** 3. row ***************************
inc: 2
*************************** 1. row ***************************
inc: 30002
*************************** 2. row ***************************
inc: 1
*************************** 3. row ***************************
inc: 3
*************************** 4. row ***************************
inc: 2
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:30 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random --backend' 'local >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_alter_random.25012.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_alter_random/data --sorted-kv-dir /tmp/lightning_test/lightning_alter_random.sorted --enable-checkpoint=0 --check-requirements=0 --backend local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 22.8% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
*************************** 1. row ***************************
count(*): 3
*************************** 1. row ***************************
inc: 1
*************************** 2. row ***************************
inc: 3
*************************** 3. row ***************************
inc: 2
*************************** 1. row ***************************
inc: 1
*************************** 2. row ***************************
inc: 4
*************************** 3. row ***************************
inc: 3
*************************** 4. row ***************************
inc: 2
*===== TEST: [lightning_alter_random] success! =====*
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
Run cases: lightning_duplicate_detection_new
Run cases: lightning_auto_columns
Starting PD...
Starting PD...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_record_network
TiFlash started.
selected test cases: lightning_auto_columns
TiFlash started.
selected test cases: lightning_duplicate_detection_new
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_record_network/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:53 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_record_network  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_record_network.19544.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_record_network/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_record_network/data --sorted-kv-dir /tmp/lightning_test/lightning_record_network.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 14.5% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
[2024/05/06 17:25:53.471 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.481 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.491 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.501 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.512 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.522 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.532 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.542 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.552 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=5847]
[2024/05/06 17:25:53.563 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.573 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.584 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.594 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.604 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.615 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.625 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.635 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.645 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6381]
[2024/05/06 17:25:53.656 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.666 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.676 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.686 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.696 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.707 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.717 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.727 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.737 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=6797]
[2024/05/06 17:25:53.748 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.758 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.768 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.779 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.789 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.799 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.809 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.819 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.830 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=7157]
[2024/05/06 17:25:53.840 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=8412]
[2024/05/06 17:25:53.851 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=9983]
[2024/05/06 17:25:53.861 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=10738]
[2024/05/06 17:25:53.872 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=10738]
[2024/05/06 17:25:53.882 +08:00] [INFO] [lightning.go:369] [IOTotalBytes] [IOTotalBytes=10738]
*===== TEST: [lightning_record_network] success! =====*
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_auto_columns/run.sh... =====*
+ run_sql 'DROP DATABASE IF EXISTS lightning_auto_cols;'
+ run_lightning
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:54 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_auto_columns  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_auto_columns.26855.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_auto_columns/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_auto_columns/data --sorted-kv-dir /tmp/lightning_test/lightning_auto_columns.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 23.5% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT CONCAT_WS('\'':'\'', id, c) AS row_data FROM lightning_auto_cols.t_auto_incr;'
*************************** 1. row ***************************
row_data: 1:normal_pk_01
*************************** 2. row ***************************
row_data: 2:null_pk_02
*************************** 3. row ***************************
row_data: 3:null_pk_03
*************************** 4. row ***************************
row_data: 4:normal_pk_04
+ check_contains 'row_data: 1:normal_pk_01'
+ check_contains 'row_data: 2:null_pk_02'
+ check_contains 'row_data: 3:null_pk_03'
+ check_contains 'row_data: 4:normal_pk_04'
+ run_sql 'SELECT COUNT(*) AS row_count FROM lightning_auto_cols.t_auto_incr;'
*************************** 1. row ***************************
row_count: 4
+ check_contains 'row_count: 4'
+ run_sql 'SELECT CONCAT_WS('\'':'\'', id, c) AS row_data FROM lightning_auto_cols.t_auto_random;'
*************************** 1. row ***************************
row_data: 1:normal_pk_01
*************************** 2. row ***************************
row_data: 4:normal_pk_04
*************************** 3. row ***************************
row_data: 1152921504606846978:null_pk_02
*************************** 4. row ***************************
row_data: 1152921504606846979:null_pk_03
+ check_contains 'row_data: 1:normal_pk_01'
+ check_contains :null_pk_02
+ check_not_contains 'row_data: 0:null_pk_02'
+ check_contains :null_pk_03
+ check_not_contains 'row_data: 0:null_pk_03'
+ check_contains 'row_data: 4:normal_pk_04'
+ run_sql 'SELECT COUNT(*) AS row_count FROM lightning_auto_cols.t_auto_random;'
*************************** 1. row ***************************
row_count: 4
+ check_contains 'row_count: 4'
*===== TEST: [lightning_auto_columns] success! =====*
Run cases: lightning_reload_cert
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/run.sh
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new
++ pwd
+ CUR=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new
+ LOG_FILE=/tmp/lightning_test/lightning-duplicate-detection-new.log
+ cleanup
+ run_sql 'DROP DATABASE IF EXISTS test'
+ run_sql 'DROP DATABASE IF EXISTS lightning_task_info'
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning --backend tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:55 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new --backend' tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-replace.toml --log-file '/tmp/lightning_test/lightning-duplicate-detection-new.log >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_detection_new.86646.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --backend tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-detection-new.log


Import Data Error Summary: 
+---+---------------------+-------------+------------------------------------------+
| # | ERROR TYPE          | ERROR COUNT | ERROR DATA TABLE                         |
+---+---------------------+-------------+------------------------------------------+
|[31m 1 [0m|[31m Unique Key Conflict [0m|[31m         227 [0m|[31m `lightning_task_info`.`conflict_records` [0m|
+---+---------------------+-------------+------------------------------------------+

tidb lightning exit successfully
PASS
coverage: 15.0% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
++ run_sql 'SELECT count(*) AS total_count FROM test.dup_detect'
++ grep total_count
++ awk '{print $2}'
+ expected_rows=174
++ run_sql 'SELECT group_concat(col1 ORDER BY col1) AS pks FROM test.dup_detect'
++ grep pks
++ awk '{print $2}'
+ expected_pks=1,2,3,4,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,24,25,26,27,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,46,47,48,49,50,51,52,53,54,55,56,57,58,59,61,62,63,65,66,67,68,69,70,72,74,75,76,77,78,80,81,83,86,87,88,89,90,91,92,93,94,95,96,98,99,100,101,102,103,104,106,107,108,110,111,112,113,114,115,116,117,118,120,121,122,123,124,125,126,127,128,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,157,158,159,160,161,162,164,165,166,167,168,169,170,171,172,174,175,176,177,178,179,180,181,182,183,185,186,188,189,190,192,193,194,195,196,197,199,987
+ cleanup
+ run_sql 'DROP DATABASE IF EXISTS test'
+ run_sql 'DROP DATABASE IF EXISTS lightning_task_info'
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:56 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new --backend' local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file '/tmp/lightning_test/lightning-duplicate-detection-new.log >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_detection_new.86708.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-detection-new.log

[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tidb-merged_integration_lightning_test-535/lightning-tests already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }

Import Data Error Summary: 
+---+---------------------+-------------+---------------------------------------+
| # | ERROR TYPE          | ERROR COUNT | ERROR DATA TABLE                      |
+---+---------------------+-------------+---------------------------------------+
|[31m 1 [0m|[31m Unique Key Conflict [0m|[31m         227 [0m|[31m `lightning_task_info`.`conflict_view` [0m|
+---+---------------------+-------------+---------------------------------------+

tidb lightning exit successfully
PASS
coverage: 28.0% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
[Pipeline] // timeout
[Pipeline] }
Starting PD...
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
++ run_sql 'SELECT count(*) AS total_count FROM test.dup_detect'
++ grep total_count
++ awk '{print $2}'
+ actual_rows=174
++ run_sql 'SELECT group_concat(col1 ORDER BY col1) AS pks FROM test.dup_detect'
++ grep pks
++ awk '{print $2}'
+ actual_pks=1,2,3,4,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,24,25,26,27,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,46,47,48,49,50,51,52,53,54,55,56,57,58,59,61,62,63,65,66,67,68,69,70,72,74,75,76,77,78,80,81,83,86,87,88,89,90,91,92,93,94,95,96,98,99,100,101,102,103,104,106,107,108,110,111,112,113,114,115,116,117,118,120,121,122,123,124,125,126,127,128,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,157,158,159,160,161,162,164,165,166,167,168,169,170,171,172,174,175,176,177,178,179,180,181,182,183,185,186,188,189,190,192,193,194,195,196,197,199,987
+ '[' 174 '!=' 174 ']'
+ '[' 1,2,3,4,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,24,25,26,27,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,46,47,48,49,50,51,52,53,54,55,56,57,58,59,61,62,63,65,66,67,68,69,70,72,74,75,76,77,78,80,81,83,86,87,88,89,90,91,92,93,94,95,96,98,99,100,101,102,103,104,106,107,108,110,111,112,113,114,115,116,117,118,120,121,122,123,124,125,126,127,128,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,157,158,159,160,161,162,164,165,166,167,168,169,170,171,172,174,175,176,177,178,179,180,181,182,183,185,186,188,189,190,192,193,194,195,196,197,199,987 '!=' 1,2,3,4,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,24,25,26,27,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,46,47,48,49,50,51,52,53,54,55,56,57,58,59,61,62,63,65,66,67,68,69,70,72,74,75,76,77,78,80,81,83,86,87,88,89,90,91,92,93,94,95,96,98,99,100,101,102,103,104,106,107,108,110,111,112,113,114,115,116,117,118,120,121,122,123,124,125,126,127,128,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,157,158,159,160,161,162,164,165,166,167,168,169,170,171,172,174,175,176,177,178,179,180,181,182,183,185,186,188,189,190,192,193,194,195,196,197,199,987 ']'
+ run_sql 'SELECT count(*) FROM lightning_task_info.conflict_records'
*************************** 1. row ***************************
count(*): 227
+ check_contains 'count(*): 227'
+ run_sql 'SELECT count(*) FROM lightning_task_info.conflict_records WHERE error = '\'''\'''
*************************** 1. row ***************************
count(*): 0
+ check_contains 'count(*): 0'
+ run_sql 'SELECT * FROM lightning_task_info.conflict_records WHERE row_id = 12'
*************************** 1. row ***************************
    task_id: 1714987556894343602
create_time: 2024-05-06 17:25:57.752882
 table_name: `test`.`dup_detect`
       path: test.dup_detect.1.sql
     offset: 797
      error: [kv:1062]Duplicate entry '171' for key 'dup_detect.PRIMARY'
     row_id: 12
   row_data: (171,'yRxZE',9201592769833450947,'xs3d',5,4,283270321)
+ check_contains '(171,'\''yRxZE'\'',9201592769833450947,'\''xs3d'\'',5,4,283270321)'
+ check_contains '[kv:1062]Duplicate entry '\''171'\'' for key '\''dup_detect.PRIMARY'\'''
+ run_sql 'SELECT * FROM lightning_task_info.conflict_records WHERE row_id = 1'
*************************** 1. row ***************************
    task_id: 1714987556894343602
create_time: 2024-05-06 17:25:57.730759
 table_name: `test`.`dup_detect`
       path: test.dup_detect.1.sql
     offset: 90
      error: [kv:1062]Duplicate entry '0-177543185' for key 'dup_detect.uniq_col6_col7'
     row_id: 1
   row_data: (87,'nEoKu',7836621565948506759,'y6',48,0,177543185)
+ check_contains '(87,'\''nEoKu'\'',7836621565948506759,'\''y6'\'',48,0,177543185)'
+ check_contains '[kv:1062]Duplicate entry '\''0-177543185'\'' for key '\''dup_detect.uniq_col6_col7'\'''
+ cleanup
+ run_sql 'DROP DATABASE IF EXISTS test'
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
+ run_sql 'DROP DATABASE IF EXISTS lightning_task_info'
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning --backend tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-ignore.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:25:59 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new --backend' tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-ignore.toml --log-file '/tmp/lightning_test/lightning-duplicate-detection-new.log >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_detection_new.86823.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --backend tidb --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/tidb-ignore.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-detection-new.log


Import Data Error Summary: 
+---+---------------------+-------------+------------------------------------------+
| # | ERROR TYPE          | ERROR COUNT | ERROR DATA TABLE                         |
+---+---------------------+-------------+------------------------------------------+
|[31m 1 [0m|[31m Unique Key Conflict [0m|[31m         228 [0m|[31m `lightning_task_info`.`conflict_records` [0m|
+---+---------------------+-------------+------------------------------------------+

tidb lightning exit successfully
PASS
coverage: 15.2% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
++ run_sql 'SELECT count(*) AS total_count FROM test.dup_detect'
++ grep total_count
++ awk '{print $2}'
+ expected_rows=173
++ run_sql 'SELECT group_concat(col1 ORDER BY col1) AS pks FROM test.dup_detect'
++ grep pks
++ awk '{print $2}'
+ expected_pks=1,2,3,4,5,6,7,8,9,11,12,13,14,15,16,17,19,20,21,22,23,24,25,26,27,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,46,47,48,49,50,51,52,53,54,55,56,57,58,59,61,62,63,65,66,67,68,69,70,72,74,75,76,77,78,80,81,83,86,87,88,89,90,91,92,93,94,95,96,98,99,100,101,102,103,104,106,107,108,110,111,112,113,114,115,116,117,118,120,121,122,123,124,125,126,127,128,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,157,158,159,160,161,162,164,165,166,167,168,169,170,171,172,174,175,176,177,178,179,180,181,182,183,185,186,188,189,190,192,193,194,195,196,197,199
+ cleanup
+ run_sql 'DROP DATABASE IF EXISTS test'
+ run_sql 'DROP DATABASE IF EXISTS lightning_task_info'
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-error.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+ grep -q 'duplicate key in table `test`.`dup_detect` caused by index .*, but because checkpoint is off we can'\''t have more details'
+ grep -q 'duplicate key in table `test`.`dup_detect` caused by index .*, but because checkpoint is off we can'\''t have more details' /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_sql 'SELECT * FROM lightning_task_info.conflict_records'
*************************** 1. row ***************************
    task_id: 1714987560833532185
create_time: 2024-05-06 17:26:01.480747
 table_name: `test`.`dup_detect`
       path: <unknown-path>
     offset: -1
      error: duplicate key in table `test`.`dup_detect` caused by index `uniq_col6_col7`, but because checkpoint is off we can't have more details
     row_id: -1
   row_data: <unknown-data>
+ check_contains 'error: duplicate key in table `test`.`dup_detect`'
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-error.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log --enable-checkpoint=1
+ grep -q 'duplicate entry for key '\''uniq_col6_col7'\'', a pair of conflicting rows are (row 1 counting from offset 0 in file test.dup_detect.1.sql, row 101 counting from offset 0 in file test.dup_detect.4.sql)'
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
+ grep -q 'duplicate entry for key '\''uniq_col6_col7'\'', a pair of conflicting rows are (row 1 counting from offset 0 in file test.dup_detect.1.sql, row 101 counting from offset 0 in file test.dup_detect.4.sql)' /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_sql 'SELECT * FROM lightning_task_info.conflict_records'
*************************** 1. row ***************************
    task_id: 1714987560833532185
create_time: 2024-05-06 17:26:01.480747
 table_name: `test`.`dup_detect`
       path: <unknown-path>
     offset: -1
      error: duplicate key in table `test`.`dup_detect` caused by index `uniq_col6_col7`, but because checkpoint is off we can't have more details
     row_id: -1
   row_data: <unknown-data>
*************************** 2. row ***************************
    task_id: 1714987561588712457
create_time: 2024-05-06 17:26:02.308519
 table_name: `test`.`dup_detect`
       path: test.dup_detect.4.sql
     offset: -1
      error: duplicate entry for key 'uniq_col6_col7', a pair of conflicting rows are (row 1 counting from offset 0 in file test.dup_detect.1.sql, row 101 counting from offset 0 in file test.dup_detect.4.sql)
     row_id: 2256
   row_data: <unknown-data>
+ check_contains 'error: duplicate entry for key '\''uniq_col6_col7'\'', a pair of conflicting rows are'
+ check_contains 'restore table `test`.`dup_detect` failed: duplicate entry for key '\''uniq_col6_col7'\'', a pair of conflicting rows are (row 1 counting from offset 0 in file test.dup_detect.1.sql, row 101 counting from offset 0 in file test.dup_detect.4.sql)' /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning_ctl --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-error.toml '--checkpoint-error-destroy=`test`.`dup_detect`'
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning_ctl
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
+ tidb-lightning-ctl.test -test.coverprofile=/tmp/group_cover/cov.ctl.lightning_duplicate_detection_new.86994.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-error.toml '--checkpoint-error-destroy=`test`.`dup_detect`'
[2024/05/06 17:26:02.414 +08:00] [INFO] [pd_service_discovery.go:1016] ["[pd] switch leader"] [new-leader=https://127.0.0.1:2379] [old-leader=]
[2024/05/06 17:26:02.414 +08:00] [INFO] [pd_service_discovery.go:498] ["[pd] init cluster id"] [cluster-id=7365815378681894969]
Dropping table: `test`.`dup_detect`
Closing and cleaning up engine: `test`.`dup_detect` -1
Closing and cleaning up engine: `test`.`dup_detect` 0
[2024/05/06 17:26:02.681 +08:00] [INFO] [pd_service_discovery.go:637] ["[pd] close pd service discovery client"]
[2024/05/06 17:26:02.681 +08:00] [INFO] [pd_service_discovery.go:550] ["[pd] exit member loop due to context canceled"]
[2024/05/06 17:26:02.681 +08:00] [INFO] [client.go:329] ["[pd] http client closed"] [source=lightning-ctl]
PASS
coverage: 2.9% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
++ ls /tmp/lightning_test/lightning_duplicate_detection_new.sorted
++ wc -l
+ files_left=0
+ '[' 0 -ne 0 ']'
+ rm -rf /tmp/lightning_test/lightning_duplicate_detection_new.sorted
+ cleanup
+ run_sql 'DROP DATABASE IF EXISTS test'
+ run_sql 'DROP DATABASE IF EXISTS lightning_task_info'
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ export 'GO_FAILPOINTS=github.com/pingcap/tidb/lightning/pkg/importer/FailAfterDuplicateDetection=return()'
+ GO_FAILPOINTS='github.com/pingcap/tidb/lightning/pkg/importer/FailAfterDuplicateDetection=return()'
+ run_lightning --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:26:03 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new --enable-checkpoint=1' --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file '/tmp/lightning_test/lightning-duplicate-detection-new.log >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_detection_new.87046.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-detection-new.log

panic: forcing failure after duplicate detection

goroutine 509 [running]:
github.com/pingcap/tidb/lightning/pkg/importer.(*TableImporter).importTable(0xc00079fe00, {0x64fc828, 0xc0015cd080}, 0xc000505800, 0xc0013ddae0)
	/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/pkg/importer/table_import.go:239 +0x1271
github.com/pingcap/tidb/lightning/pkg/importer.(*Controller).importTables.func6()
	/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/pkg/importer/import.go:1437 +0x172
created by github.com/pingcap/tidb/lightning/pkg/importer.(*Controller).importTables in goroutine 120
	/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/pkg/importer/import.go:1432 +0x9dc
+ true
+ unset GO_FAILPOINTS
+ rm -f /tmp/lightning_test/lightning-duplicate-detection-new.log
+ run_lightning_ctl --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml '--checkpoint-error-ignore=`test`.`dup_detect`'
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning_ctl
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
+ tidb-lightning-ctl.test -test.coverprofile=/tmp/group_cover/cov.ctl.lightning_duplicate_detection_new.87093.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml '--checkpoint-error-ignore=`test`.`dup_detect`'
[2024/05/06 17:26:04.114 +08:00] [INFO] [pd_service_discovery.go:1016] ["[pd] switch leader"] [new-leader=https://127.0.0.1:2379] [old-leader=]
[2024/05/06 17:26:04.114 +08:00] [INFO] [pd_service_discovery.go:498] ["[pd] init cluster id"] [cluster-id=7365815378681894969]
[2024/05/06 17:26:04.126 +08:00] [INFO] [pd_service_discovery.go:637] ["[pd] close pd service discovery client"]
[2024/05/06 17:26:04.126 +08:00] [INFO] [pd_service_discovery.go:550] ["[pd] exit member loop due to context canceled"]
[2024/05/06 17:26:04.126 +08:00] [INFO] [client.go:329] ["[pd] http client closed"] [source=lightning-ctl]
PASS
coverage: 2.5% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_lightning --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:26:04 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new --enable-checkpoint=1' --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file '/tmp/lightning_test/lightning-duplicate-detection-new.log >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_detection_new.87130.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_detection_new.sorted --enable-checkpoint=0 --check-requirements=0 --enable-checkpoint=1 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_detection_new/local-replace.toml --log-file /tmp/lightning_test/lightning-duplicate-detection-new.log
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-detection-new.log

2024/05/06 17:26:04 [JOB 1] WAL file /tmp/lightning_test/lightning_duplicate_detection_new.sorted/duplicates/000002.log with log number 000002 stopped reading at offset: 0; replayed 0 keys in 0 batches

Import Data Error Summary: 
+---+---------------------+-------------+---------------------------------------+
| # | ERROR TYPE          | ERROR COUNT | ERROR DATA TABLE                      |
+---+---------------------+-------------+---------------------------------------+
|[31m 1 [0m|[31m Unique Key Conflict [0m|[31m         227 [0m|[31m `lightning_task_info`.`conflict_view` [0m|
+---+---------------------+-------------+---------------------------------------+

tidb lightning exit successfully
PASS
coverage: 27.0% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT count(*) FROM test.dup_detect'
*************************** 1. row ***************************
count(*): 174
+ check_contains 'count(*): 174'
+ run_sql 'SELECT count(*) FROM lightning_task_info.conflict_records'
*************************** 1. row ***************************
count(*): 227
+ check_contains 'count(*): 227'
+ check_not_contains 'duplicate detection start' /tmp/lightning_test/lightning-duplicate-detection-new.log
*===== TEST: [lightning_duplicate_detection_new] success! =====*
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
Run cases: lightning_duplicate_resolution_error
Starting PD...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_reload_cert
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert/run.sh... =====*
+ cp /tmp/lightning_test/certs/lightning.pem /tmp/lightning_test/certs/lightning-valid.pem
+ trap 'mv "$TEST_DIR/certs/lightning-valid.pem" "$TEST_DIR/certs/lightning.pem"' EXIT
+ export 'GO_FAILPOINTS=github.com/pingcap/tidb/lightning/pkg/server/SetCertExpiredSoon=return("/tmp/lightning_test/certs/ca.key")'
+ GO_FAILPOINTS='github.com/pingcap/tidb/lightning/pkg/server/SetCertExpiredSoon=return("/tmp/lightning_test/certs/ca.key")'
+ export 'GO_FAILPOINTS=github.com/pingcap/tidb/lightning/pkg/server/SetCertExpiredSoon=return("/tmp/lightning_test/certs/ca.key");github.com/pingcap/tidb/lightning/pkg/importer/SlowDownWriteRows=sleep(15000)'
+ GO_FAILPOINTS='github.com/pingcap/tidb/lightning/pkg/server/SetCertExpiredSoon=return("/tmp/lightning_test/certs/ca.key");github.com/pingcap/tidb/lightning/pkg/importer/SlowDownWriteRows=sleep(15000)'
+ shpid=21356
+ sleep 15
+ run_lightning --backend=local
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:26:17 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert --backend=local >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_reload_cert.21356.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert/data --sorted-kv-dir /tmp/lightning_test/lightning_reload_cert.sorted --enable-checkpoint=0 --check-requirements=0 --backend=local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_duplicate_resolution_error
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/run.sh... =====*
+ check_cluster_version 5 2 0 'duplicate detection'
++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/run.sh
+ mydir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error
+ run_sql 'DROP TABLE IF EXISTS dup_resolve.a'
+ run_sql 'DROP TABLE IF EXISTS lightning_task_info.conflict_error_v3'
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/config.toml
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:26:32 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error --backend' local --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/config.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_error.88998.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_error.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error/config.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

+ ok=0
+ for _ in '{0..60}'
+ grep -Fq 'tls: expired certificate' /tmp/lightning_test/lightning.log
+ sleep 1
tidb lightning encountered error: [Lightning:Restore:ErrFoundDataConflictRecords]found data conflict records in table a, primary key is '3', row data is '(3, 3, "3.csv")'
warning: GOCOVERDIR not set, no coverage data emitted
+ '[' 0 -eq 0 ']'
+ tail -n 10 /tmp/lightning_test/lightning.log
+ grep ERROR
+ tail -n 1
+ grep -Fq '[Lightning:Restore:ErrFoundDataConflictRecords]found data conflict records in table a, primary key is '\''3'\'', row data is '\''(3, 3, \"3.csv\")'\'''
+ check_not_contains 'the whole procedure completed' /tmp/lightning_test/lightning.log
*===== TEST: [lightning_duplicate_resolution_error] success! =====*
+ for _ in '{0..60}'
+ grep -Fq 'tls: expired certificate' /tmp/lightning_test/lightning.log
+ ok=1
+ break
++ pstree -p 21356
++ grep -Eo 'tidb-lightning\.\([0-9]*\)'
++ grep -Eo '[0-9]*'
+ pid=21362
+ '[' -n 21362 ']'
+ kill -9 21362
+ '[' 1 = 0 ']'
+ cp /tmp/lightning_test/certs/lightning-valid.pem /tmp/lightning_test/certs/lightning.pem
+ rm -rf /tmp/lightning_test/lightning_reload_cert.sorted /tmp/lightning_test/lightning.log
+ run_lightning --backend=local
+ sleep 10
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning: line 34: 21362 Killed                  tidb-lightning.test -test.coverprofile="$COV_DIR/cov.$TEST_NAME.$$.out" DEVEL --ca "$TEST_DIR/certs/ca.pem" --cert "$TEST_DIR/certs/lightning.pem" --key "$TEST_DIR/certs/lightning.key" --log-file "$TEST_DIR/lightning.log" --tidb-port 4000 --pd-urls '127.0.0.1:2379' --config "$TESTS_ROOT/$TEST_NAME/config.toml" -d "$TESTS_ROOT/$TEST_NAME/data" --sorted-kv-dir "$TEST_DIR/$TEST_NAME.sorted" --enable-checkpoint=0 --check-requirements=0 "$@"
+ echo '[Mon May  6 17:26:33 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert --backend=local >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_reload_cert.21428.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_reload_cert/data --sorted-kv-dir /tmp/lightning_test/lightning_reload_cert.sorted --enable-checkpoint=0 --check-requirements=0 --backend=local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

Run cases: lightning_duplicate_resolution_error_pk_multiple_files
Starting PD...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
+ cp /tmp/lightning_test/certs/lightning-valid.pem /tmp/lightning_test/certs/lightning.pem
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
tidb lightning exit successfully
PASS
coverage: 22.3% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ mv /tmp/lightning_test/certs/lightning-valid.pem /tmp/lightning_test/certs/lightning.pem
*===== TEST: [lightning_reload_cert] success! =====*
Run cases: lightning_restore
Starting PD...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_duplicate_resolution_error_pk_multiple_files
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/run.sh... =====*
+ check_cluster_version 5 2 0 'duplicate detection'
++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/run.sh
+ mydir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files
+ run_sql 'DROP TABLE IF EXISTS dup_resolve.a'
+ run_sql 'DROP TABLE IF EXISTS lightning_task_info.conflict_error_v3'
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/config.toml
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:00 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files --backend' local --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/config.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_error_pk_multiple_files.90848.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_error_pk_multiple_files.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_pk_multiple_files/config.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning encountered error: failed to record conflict errors: [Lightning:Restore:ErrFoundDataConflictRecords]found data conflict records in table a, primary key is '1', row data is '(1, 10, "10.csv")'
warning: GOCOVERDIR not set, no coverage data emitted
+ '[' 0 -eq 0 ']'
+ tail -n 10 /tmp/lightning_test/lightning.log
+ grep ERROR
+ tail -n 1
+ grep -Fq '[Lightning:Restore:ErrFoundDataConflictRecords]found data conflict records in table a'
+ check_not_contains 'the whole procedure completed' /tmp/lightning_test/lightning.log
*===== TEST: [lightning_duplicate_resolution_error_pk_multiple_files] success! =====*
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
Run cases: lightning_duplicate_resolution_error_uk_multiple_files
Starting PD...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
TiFlash started.
selected test cases: lightning_restore
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:15 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore -d' '/tmp/lightning_test/restore.mydump >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_restore.23256.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore/data --sorted-kv-dir /tmp/lightning_test/lightning_restore.sorted --enable-checkpoint=0 --check-requirements=0 -d /tmp/lightning_test/restore.mydump
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
tidb lightning exit successfully
PASS
coverage: 22.8% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
Import finished
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:21 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_restore.23581.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_restore/data --sorted-kv-dir /tmp/lightning_test/lightning_restore.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
tidb lightning exit successfully
PASS
coverage: 25.0% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
Import finished
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*************************** 1. row ***************************
sum(i): 1
*===== TEST: [lightning_restore] success! =====*
TiFlash started.
selected test cases: lightning_duplicate_resolution_error_uk_multiple_files
Run cases: lightning_routes
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/run.sh... =====*
+ check_cluster_version 5 2 0 'duplicate detection'
++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/run.sh
+ mydir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files
+ run_sql 'DROP TABLE IF EXISTS dup_resolve.a'
+ run_sql 'DROP TABLE IF EXISTS lightning_task_info.conflict_error_v3'
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/config.toml
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:29 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files --backend' local --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/config.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_error_uk_multiple_files.92698.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_error_uk_multiple_files.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files/config.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning encountered error: [Lightning:Restore:ErrFoundIndexConflictRecords]found index conflict records in table a, index name is 'a.key_b', unique key is '[101]', primary key is '1'
warning: GOCOVERDIR not set, no coverage data emitted
+ '[' 0 -eq 0 ']'
+ tail -n 10 /tmp/lightning_test/lightning.log
+ grep ERROR
+ tail -n 1
+ grep -Fq '[Lightning:Restore:ErrFoundIndexConflictRecords]found index conflict records in table a, index name is '\''a.key_b'\'', unique key is '\''[101]'\'', primary key is '\''1'\'''
+ check_not_contains 'the whole procedure completed' /tmp/lightning_test/lightning.log
*===== TEST: [lightning_duplicate_resolution_error_uk_multiple_files] success! =====*
Starting PD...
Run cases: lightning_duplicate_resolution_error_uk_multiple_files_multicol_index
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
Starting PD...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
TiFlash started.
selected test cases: lightning_routes
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes/run.sh... =====*
+ echo 'testing checksum-error...'
testing checksum-error...
+ export 'GO_FAILPOINTS=github.com/pingcap/tidb/lightning/pkg/importer/checksum-error=1*return()'
+ GO_FAILPOINTS='github.com/pingcap/tidb/lightning/pkg/importer/checksum-error=1*return()'
+ run_sql 'DROP DATABASE IF EXISTS routes_a0;'
+ run_sql 'DROP DATABASE IF EXISTS routes_a1;'
+ run_sql 'DROP DATABASE IF EXISTS routes_b;'
+ run_lightning
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:53 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_routes.25676.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes/data --sorted-kv-dir /tmp/lightning_test/lightning_routes.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 23.3% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ echo 'test checksum-error success!'
test checksum-error success!
+ run_sql 'SELECT count(1), sum(x) FROM routes_b.u;'
*************************** 1. row ***************************
count(1): 4
  sum(x): 259
+ check_contains 'count(1): 4'
+ check_contains 'sum(x): 259'
+ run_sql 'SELECT count(1), sum(x) FROM routes_a1.s1;'
*************************** 1. row ***************************
count(1): 1
  sum(x): 1296
+ check_contains 'count(1): 1'
+ check_contains 'sum(x): 1296'
+ run_sql 'SHOW TABLES IN routes_a1;'
*************************** 1. row ***************************
Tables_in_routes_a1: s1
+ check_not_contains 'Tables_in_routes_a1: t2'
*===== TEST: [lightning_routes] success! =====*
TiFlash started.
selected test cases: lightning_duplicate_resolution_error_uk_multiple_files_multicol_index
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/run.sh... =====*
+ check_cluster_version 5 2 0 'duplicate detection'
++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/run.sh
+ mydir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index
+ run_sql 'DROP TABLE IF EXISTS dup_resolve.a'
+ run_sql 'DROP TABLE IF EXISTS lightning_task_info.conflict_error_v3'
+ run_lightning --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/config.toml
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:27:56 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index --backend' local --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/config.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_error_uk_multiple_files_multicol_index.94539.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_error_uk_multiple_files_multicol_index/config.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

Run cases: lightning_routes_panic
tidb lightning encountered error: [Lightning:Restore:ErrFoundIndexConflictRecords]found index conflict records in table a, index name is 'a.key_bd', unique key is '[101 9]', primary key is '1'
warning: GOCOVERDIR not set, no coverage data emitted
+ '[' 0 -eq 0 ']'
+ tail -n 10 /tmp/lightning_test/lightning.log
+ grep ERROR
+ tail -n 1
+ grep -Fq '[Lightning:Restore:ErrFoundIndexConflictRecords]found index conflict records in table a, index name is '\''a.key_bd'\'', unique key is '\''[101 9]'\'', primary key is '\''1'\'''
+ check_not_contains 'the whole procedure completed' /tmp/lightning_test/lightning.log
*===== TEST: [lightning_duplicate_resolution_error_uk_multiple_files_multicol_index] success! =====*
Starting PD...
Run cases: lightning_duplicate_resolution_incremental
Starting PD...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_routes_panic
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes_panic/run.sh... =====*
+ run_sql 'DROP DATABASE IF EXISTS test1;'
+ run_sql 'DROP DATABASE IF EXISTS test;'
+ run_sql 'CREATE DATABASE test1;'
+ run_sql 'CREATE DATABASE test;'
+ run_sql 'CREATE TABLE test1.dump_test (x real primary key);'
+ run_sql 'CREATE TABLE test.u (x real primary key);'
+ run_lightning
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:28:22 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes_panic  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_routes_panic.27536.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes_panic/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_routes_panic/data --sorted-kv-dir /tmp/lightning_test/lightning_routes_panic.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 22.7% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT sum(x) FROM test.u;'
*************************** 1. row ***************************
sum(x): 43
+ check_contains 'sum(x): 43'
*===== TEST: [lightning_routes_panic] success! =====*
TiFlash seems doesn't started, retrying...
Run cases: lightning_row-format-v2
TiFlash started.
selected test cases: lightning_duplicate_resolution_incremental
Starting PD...
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/run.sh... =====*
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/run.sh
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental
++ pwd
+ CUR=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental
+ check_cluster_version 5 2 0 'duplicate detection'
+ LOG_FILE1=/tmp/lightning_test/lightning-duplicate-resolution1.log
+ LOG_FILE2=/tmp/lightning_test/lightning-duplicate-resolution2.log
+ export 'GO_FAILPOINTS=github.com/pingcap/tidb/lightning/pkg/importer/SlowDownCheckDupe=return(10)'
+ GO_FAILPOINTS='github.com/pingcap/tidb/lightning/pkg/importer/SlowDownCheckDupe=return(10)'
+ counter=0
+ '[' 0 -lt 10 ']'
+ grep -Fq 'start to sleep several seconds before checking other dupe' /tmp/lightning_test/lightning-duplicate-resolution1.log
+ run_lightning --backend local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted1 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution1.log --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config1.toml
grep: /tmp/lightning_test/lightning-duplicate-resolution1.log: No such file or directory
+ (( counter += 1 ))
+ echo 'waiting for lightning 1 starts'
waiting for lightning 1 starts
+ sleep 1
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:28:27 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental --backend' local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted1 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution1.log --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config1.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_incremental.96362.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted1 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution1.log --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config1.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-resolution1.log

+ '[' 1 -lt 10 ']'
+ grep -Fq 'start to sleep several seconds before checking other dupe' /tmp/lightning_test/lightning-duplicate-resolution1.log
+ (( counter += 1 ))
+ echo 'waiting for lightning 1 starts'
waiting for lightning 1 starts
+ sleep 1
+ '[' 2 -lt 10 ']'
+ grep -Fq 'start to sleep several seconds before checking other dupe' /tmp/lightning_test/lightning-duplicate-resolution1.log
+ echo 'lightning 1 already starts waiting for dupe'
lightning 1 already starts waiting for dupe
+ break
+ '[' 2 -ge 10 ']'
+ wait
+ run_lightning --backend local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted2 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution2.log --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config2.toml
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:28:29 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental --backend' local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted2 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution2.log --config '/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config2.toml >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_duplicate_resolution_incremental.96418.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/data --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted --enable-checkpoint=0 --check-requirements=0 --backend local --sorted-kv-dir /tmp/lightning_test/lightning_duplicate_resolution_incremental.sorted2 --enable-checkpoint=1 --log-file /tmp/lightning_test/lightning-duplicate-resolution2.log --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_duplicate_resolution_incremental/config2.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning-duplicate-resolution2.log

{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...

Import Data Error Summary: 
+---+---------------------+-------------+--------------------------------------------+
| # | ERROR TYPE          | ERROR COUNT | ERROR DATA TABLE                           |
+---+---------------------+-------------+--------------------------------------------+
|[31m 1 [0m|[31m Unique Key Conflict [0m|[31m          10 [0m|[31m `lightning_task_info_dupe_resolve_incremen [0m|
|[31m   [0m|[31m                     [0m|[31m             [0m|[31m tal`.`conflict_error_v3`                   [0m|
+---+---------------------+-------------+--------------------------------------------+

tidb lightning exit successfully
PASS
coverage: 27.2% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
tidb lightning exit successfully
PASS
coverage: 28.3% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ export GO_FAILPOINTS=
+ GO_FAILPOINTS=
+ run_sql 'admin check table dup_resolve_detect.ta'
+ run_sql 'select count(*), sum(id) from dup_resolve_detect.ta where id < 100'
*************************** 1. row ***************************
count(*): 15
 sum(id): 120
+ check_contains 'count(*): 15'
+ check_contains 'sum(id): 120'
+ run_sql 'select count(*), sum(id) from dup_resolve_detect.ta where id > 100'
*************************** 1. row ***************************
count(*): 16
 sum(id): 1896
+ check_contains 'count(*): 16'
+ check_contains 'sum(id): 1896'
*===== TEST: [lightning_duplicate_resolution_incremental] success! =====*
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tidb-merged_integration_lightning_test-535/lightning-tests already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
TiFlash started.
selected test cases: lightning_row-format-v2
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_row-format-v2/run.sh... =====*
+ run_sql 'show variables like "%tidb_row_format_version%";'
*************************** 1. row ***************************
Variable_name: tidb_row_format_version
        Value: 2
++ grep 'Value: [0-9]' /tmp/lightning_test/sql_res.lightning_row-format-v2.txt
++ awk '{print $2}'
+ row_format=2
+ '[' 2 -ne 2 ']'
+ run_sql 'DROP DATABASE IF EXISTS rowformatv2;'
+ run_lightning
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils/run_lightning
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/../../tests/_utils
++ pwd
+ cur_dir=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/tests/_utils
++ date
+ echo '[Mon May  6 17:28:46 CST 2024] <<<<<< RUNNING TEST FOR: /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_row-format-v2  >>>>>>'
+ tidb-lightning.test -test.coverprofile=/tmp/group_cover/cov.lightning_row-format-v2.29379.out DEVEL --ca /tmp/lightning_test/certs/ca.pem --cert /tmp/lightning_test/certs/lightning.pem --key /tmp/lightning_test/certs/lightning.key --log-file /tmp/lightning_test/lightning.log --tidb-port 4000 --pd-urls 127.0.0.1:2379 --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_row-format-v2/config.toml -d /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_row-format-v2/data --sorted-kv-dir /tmp/lightning_test/lightning_row-format-v2.sorted --enable-checkpoint=0 --check-requirements=0
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 22.8% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT count(1) FROM rowformatv2.t1;'
*************************** 1. row ***************************
count(1): 50
+ check_contains 'count(1): 50'
+ run_sql 'SELECT DISTINCT col14 FROM rowformatv2.t1;'
*************************** 1. row ***************************
col14: 39
*************************** 2. row ***************************
col14: NULL
+ check_contains 'col14: NULL'
+ check_contains 'col14: 39'
+ '[' 2 -ne 2 ']'
*===== TEST: [lightning_row-format-v2] success! =====*
Run cases: lightning_s3
Starting PD...
{
  "version": "v8.2.0-alpha-15-gf83febabe",
  "build_time": "",
  "hash": "",
  "branch": ""
}
Starting TiKV(1)...
Starting TiKV(2)...
Starting TiKV(3)...
Waiting initializing TiKV...
  "is_initialized": true,
Starting TiDB...
Verifying TiDB is started...
{"connections":0,"version":"8.0.11-TiDB-v8.2.0-alpha-83-g17d3f7fd45-dirty","git_hash":"17d3f7fd4599c86fed367db1051156abc0b3cd5b"}Starting TiFlash...
TiFlash seems doesn't started, retrying...
Logging debug to /tmp/lightning_test/tiflash-stdout.log
Logging errors to /tmp/lightning_test/tiflash-stderr.log
arg matches is ArgMatches { args: {"engine-addr": MatchedArg { occurs: 1, indices: [14], vals: ["127.0.0.1:3930"] }, "pd-endpoints": MatchedArg { occurs: 1, indices: [6], vals: ["127.0.0.1:2379"] }, "engine-git-hash": MatchedArg { occurs: 1, indices: [12], vals: ["8e50de84e6d6ecdcc108990217b70b6bb3f50271"] }, "config": MatchedArg { occurs: 1, indices: [8], vals: ["/tmp/lightning_test/tiflash-learner.toml"] }, "engine-label": MatchedArg { occurs: 1, indices: [4], vals: ["tiflash"] }, "log-file": MatchedArg { occurs: 1, indices: [2], vals: ["/tmp/lightning_test/tiflash-proxy.log"] }, "engine-version": MatchedArg { occurs: 1, indices: [10], vals: ["v8.2.0-alpha-17-g8e50de84e"] }}, subcommand: None, usage: Some("USAGE:\n    TiFlash Proxy [FLAGS] [OPTIONS] --engine-git-hash <engine-git-hash> --engine-label <engine-label> --engine-version <engine-version>") }
TiFlash started.
selected test cases: lightning_s3
*===== Running test /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3/run.sh... =====*
+ DB=s3_test
+ TABLE=tbl
+++ dirname /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3/run.sh
++ cd /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3
++ pwd
+ CUR=/home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3
+ check_cluster_version 4 0 0 'local backend'
+ set -euE
+ [[ -z /tmp/lightning_test ]]
+ DBPATH=/tmp/lightning_test/s3.mydump
+ export MINIO_ACCESS_KEY=s3accesskey
+ MINIO_ACCESS_KEY=s3accesskey
+ export MINIO_SECRET_KEY=s3secretkey
+ MINIO_SECRET_KEY=s3secretkey
+ export MINIO_BROWSER=off
+ MINIO_BROWSER=off
+ export S3_ENDPOINT=127.0.0.1:9900
+ S3_ENDPOINT=127.0.0.1:9900
+ rm -rf /tmp/lightning_test/s3_test
+ mkdir -p /tmp/lightning_test/s3_test
+ i=0
+ curl -o /dev/null -v -s http://127.0.0.1:9900/
+ minio server --address 127.0.0.1:9900 /tmp/lightning_test/s3.mydump
* About to connect() to 127.0.0.1 port 9900 (#0)
*   Trying 127.0.0.1...
* Connection refused
* Failed connect to 127.0.0.1:9900; Connection refused
* Closing connection 0
+ i=1
+ '[' 1 -gt 30 ']'
+ sleep 2

 You are running an older version of MinIO released 3 years ago 
 Update: Run `mc admin update` 


Attempting encryption of all config, IAM users and policies on MinIO backend
Endpoint: http://127.0.0.1:9900 

Object API (Amazon S3 compatible):
   Go:         https://docs.min.io/docs/golang-client-quickstart-guide
   Java:       https://docs.min.io/docs/java-client-quickstart-guide
   Python:     https://docs.min.io/docs/python-client-quickstart-guide
   JavaScript: https://docs.min.io/docs/javascript-client-quickstart-guide
   .NET:       https://docs.min.io/docs/dotnet-client-quickstart-guide
+ curl -o /dev/null -v -s http://127.0.0.1:9900/
* About to connect() to 127.0.0.1 port 9900 (#0)
*   Trying 127.0.0.1...
* Connected to 127.0.0.1 (127.0.0.1) port 9900 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.29.0
> Host: 127.0.0.1:9900
> Accept: */*
> 
< HTTP/1.1 403 Forbidden
< Accept-Ranges: bytes
< Content-Length: 226
< Content-Security-Policy: block-all-mixed-content
< Content-Type: application/xml
< Server: MinIO
< Vary: Origin
< X-Amz-Request-Id: 17CCDC46B34910D9
< X-Xss-Protection: 1; mode=block
< Date: Mon, 06 May 2024 09:29:14 GMT
< 
{ [data not shown]
* Connection #0 to host 127.0.0.1 left intact
+ BUCKET=test-bucket
+ DATA_PATH=/tmp/lightning_test/s3.mydump/test-bucket
+ mkdir -p /tmp/lightning_test/s3.mydump/test-bucket
+ echo 'CREATE DATABASE s3_test;'
+ echo 'CREATE TABLE t(i INT, s varchar(32));'
+ echo 'INSERT INTO tbl (i, s) VALUES (1, "1"),(2, "test2"), (3, "qqqtest");'
+ cat
+ final_ret_code=0
+ test_import_non_existing_path
+ rm -f /tmp/lightning_test/lightning.log
+ local 'SOURCE_DIR=s3://test-bucket/not-exist-path?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true'
+ run_lightning -d 's3://test-bucket/not-exist-path?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true' --backend local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

+ grep -Eq 'data-source-dir .* doesn'\''t exist or contains no files' /tmp/lightning_test/lightning.log
+ return 0
+ test_import_empty_dir
+ rm -f /tmp/lightning_test/lightning.log
+ local emptyPath=empty-bucket/empty-path
+ mkdir -p /tmp/lightning_test/s3.mydump/empty-bucket/empty-path
+ local 'SOURCE_DIR=s3://empty-bucket/empty-path/not-exist-path?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true'
+ run_lightning -d 's3://empty-bucket/empty-path/not-exist-path?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true' --backend local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

+ grep -Eq 'data-source-dir .* doesn'\''t exist or contains no files' /tmp/lightning_test/lightning.log
+ return 0
+ test_normal_import
+ rm -f /tmp/lightning_test/lightning.log
+ cleanup_db_and_table
+ run_sql 'DROP DATABASE IF EXISTS s3_test;'
+ run_sql 'DROP TABLE IF EXISTS s3_test.tbl;'
+ local 'SOURCE_DIR=s3://test-bucket/?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true'
+ run_lightning -d 's3://test-bucket/?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true' --backend local
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 24.9% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT count(*), sum(i) FROM `s3_test`.tbl'
*************************** 1. row ***************************
count(*): 7
  sum(i): 413
+ check_contains 'count(*): 7'
+ check_contains 'sum(i): 413'
+ return 0
+ test_import_with_checkpoint
+ rm -f /tmp/lightning_test/lightning.log
+ cleanup_db_and_table
+ run_sql 'DROP DATABASE IF EXISTS s3_test;'
+ run_sql 'DROP TABLE IF EXISTS s3_test.tbl;'
+ local 'SOURCE_DIR=s3://test-bucket/?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true'
+ run_lightning -d 's3://test-bucket/?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true' --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3/config_s3_checkpoint.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 25.1% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT count(*), sum(i) FROM `s3_test`.tbl'
*************************** 1. row ***************************
count(*): 7
  sum(i): 413
+ check_contains 'count(*): 7'
+ check_contains 'sum(i): 413'
+ test_import_using_manual_path_config
+ rm -f /tmp/lightning_test/lightning.log
+ cleanup_db_and_table
+ run_sql 'DROP DATABASE IF EXISTS s3_test;'
+ run_sql 'DROP TABLE IF EXISTS s3_test.tbl;'
+ local bucket_02=test-bucket-02
+ local sub_path_02=to-be-imported
+ local base_path_02=/tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported
+ rm -rf /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported
+ mkdir -p /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported
+ touch /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/s3_test-schema-create.sql
+ cp /tmp/lightning_test/s3.mydump/test-bucket/s3_test.tbl-schema.sql /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/
+ local sql_data_path_02=/tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-sql
+ local csv_data_path_02=/tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-csv
+ local parquet_data_path_02=/tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-parquet
+ mkdir -p /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-sql/empty-dir
+ cp /tmp/lightning_test/s3.mydump/test-bucket/s3_test.tbl.sql /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-sql/
+ touch /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-sql/dummy.sql
+ mkdir -p /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-csv/empty-dir
+ cp /tmp/lightning_test/s3.mydump/test-bucket/s3_test.tbl.0.csv /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-csv/
+ touch /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-csv/dummy.csv
+ mkdir -p /tmp/lightning_test/s3.mydump/test-bucket-02/to-be-imported/data-parquet/empty-dir
+ local 'SOURCE_DIR=s3://test-bucket-02/to-be-imported?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true'
+ run_lightning -d 's3://test-bucket-02/to-be-imported?endpoint=http%3A//127.0.0.1%3A9900&access_key=s3accesskey&secret_access_key=s3secretkey&force_path_style=true' --backend local --config /home/jenkins/agent/workspace/pingcap/tidb/merged_integration_lightning_test/tidb/lightning/tests/lightning_s3/config_manual_files.toml
Verbose debug logs will be written to /tmp/lightning_test/lightning.log

tidb lightning exit successfully
PASS
coverage: 24.9% of statements in github.com/pingcap/tidb/lightning/..., github.com/pingcap/tidb/pkg/lightning/...
+ run_sql 'SELECT count(*), sum(i) FROM `s3_test`.tbl'
*************************** 1. row ***************************
count(*): 7
  sum(i): 413
+ check_contains 'count(*): 7'
+ check_contains 'sum(i): 413'
+ return 0
+ exit 0
*===== TEST: [lightning_s3] success! =====*
[Pipeline] }
Cache not saved (ws/jenkins-pingcap-tidb-merged_integration_lightning_test-535/lightning-tests already exists)
[Pipeline] // cache
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // parallel
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] End of Pipeline
Finished: SUCCESS