Skipping 244 KB..
Full LogTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTestTest
PASS [ 1.823s] tests::integrations raftstore::test_snap::test_concurrent_snap::test_raftstore_new_node_cluster
PASS [ 2.329s] tests::integrations raftstore::test_snap::test_cf_snapshot::test_raftstore_new_node_cluster
PASS [ 2.486s] tests::integrations raftstore::test_snap::test_concurrent_snap_v2::test_raftstore_v2_new_node_cluster
PASS [ 2.247s] tests::integrations raftstore::test_snap::test_node_snapshot_with_append::test_raftstore_new_node_cluster
PASS [ 3.290s] tests::integrations raftstore::test_snap::test_node_snapshot_with_append::test_raftstore_v2_new_node_cluster
PASS [ 3.462s] tests::integrations raftstore::test_snap::test_node_stale_snap::test_raftstore_new_node_cluster
PASS [ 1.781s] tests::integrations raftstore::test_snap::test_snapshot_clean_up_logs_with_log_gc::test_raftstore_new_node_cluster
PASS [ 8.870s] tests::integrations raftstore::test_snap::test_cf_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 8.732s] tests::integrations raftstore::test_snap::test_correct_snapshot_term::test_raftstore_new_server_cluster
PASS [ 5.348s] tests::integrations raftstore::test_snap::test_v1_apply_snap_from_v2
PASS [ 8.235s] tests::integrations raftstore::test_snap::test_server_snap_gc
PASS [ 7.115s] tests::integrations raftstore::test_snap_recovery::test_check_pending_admin
TRY 1 TRMNTG [>120.000s] tests::integrations raftstore::test_compact_log::test_node_compact_log
TRY 1 TMT [ 120.083s] tests::integrations raftstore::test_compact_log::test_node_compact_log
RETRY 2/3 [ ] tests::integrations raftstore::test_compact_log::test_node_compact_log
PASS [ 19.157s] tests::integrations raftstore::test_snap::test_server_huge_snapshot
PASS [ 17.631s] tests::integrations raftstore::test_split_region::test_apply_new_version_snapshot::test_raftstore_new_node_cluster
PASS [ 17.446s] tests::integrations raftstore::test_split_region::test_apply_new_version_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 23.194s] tests::integrations raftstore::test_split_region::test_apply_new_version_snapshot::test_raftstore_new_server_cluster
PASS [ 22.149s] tests::integrations raftstore::test_split_region::test_auto_split_region::test_raftstore_new_incompatible_node_cluster
PASS [ 7.055s] tests::integrations raftstore::test_split_region::test_catch_up_peers_after_split::test_raftstore_new_server_cluster_with_hybrid_engine
PASS [ 22.120s] tests::integrations raftstore::test_split_region::test_auto_split_region::test_raftstore_new_node_cluster_with_hybrid_engine
PASS [ 2.032s] tests::integrations raftstore::test_split_region::test_node_quick_election_after_split::test_raftstore_new_node_cluster
PASS [ 6.687s] tests::integrations raftstore::test_split_region::test_delay_split_region::test_raftstore_new_server_cluster
PASS [ 3.852s] tests::integrations raftstore::test_split_region::test_node_quick_election_after_split::test_raftstore_v2_new_node_cluster
PASS [ 8.786s] tests::integrations raftstore::test_split_region::test_delay_split_region::test_raftstore_v2_new_server_cluster
PASS [ 6.625s] tests::integrations raftstore::test_split_region::test_node_quick_election_after_split::test_raftstore_new_server_cluster
PASS [ 5.989s] tests::integrations raftstore::test_split_region::test_node_slow_split_does_not_cause_snapshot::test_raftstore_new_node_cluster
PASS [ 2.715s] tests::integrations raftstore::test_split_region::test_node_split_epoch_not_match_left_derive
PASS [ 20.596s] tests::integrations raftstore::test_split_region::test_auto_split_region::test_raftstore_v2_new_server_cluster
PASS [ 7.454s] tests::integrations raftstore::test_split_region::test_node_slow_split_does_not_cause_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 5.965s] tests::integrations raftstore::test_split_region::test_node_split_overlap_snapshot::test_raftstore_new_node_cluster
PASS [ 8.528s] tests::integrations raftstore::test_split_region::test_node_slow_split_does_not_prevent_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 3.375s] tests::integrations raftstore::test_split_region::test_node_split_region::test_raftstore_new_node_cluster
PASS [ 30.735s] tests::integrations raftstore::test_split_region::test_auto_split_region::test_raftstore_new_server_cluster_with_hybrid_engine
PASS [ 7.615s] tests::integrations raftstore::test_split_region::test_node_split_overlap_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 3.918s] tests::integrations raftstore::test_split_region::test_node_split_region_after_reboot_with_config_change::test_raftstore_new_server_cluster
PASS [ 11.078s] tests::integrations raftstore::test_split_region::test_node_split_overlap_snapshot::test_raftstore_new_server_cluster
PASS [ 3.973s] tests::integrations raftstore::test_split_region::test_node_split_region_after_reboot_with_config_change::test_raftstore_v2_new_server_cluster
PASS [ 2.931s] tests::integrations raftstore::test_split_region::test_node_split_update_region_right_derive::test_raftstore_new_node_cluster_with_hybrid_engine
PASS [ 6.897s] tests::integrations raftstore::test_split_region::test_node_split_region::test_raftstore_v2_new_node_cluster
TRY 1 SLOW [> 60.000s] tests::integrations raftstore::test_snap::test_gen_during_heavy_recv
PASS [ 10.344s] tests::integrations raftstore::test_split_region::test_node_split_region::test_raftstore_new_server_cluster
PASS [ 5.021s] tests::integrations raftstore::test_split_region::test_server_split_epoch_not_match_left_derive
PASS [ 62.278s] tests::integrations raftstore::test_snap::test_gen_during_heavy_recv
PASS [ 8.021s] tests::integrations raftstore::test_split_region::test_refresh_region_bucket_keys
PASS [ 2.515s] tests::integrations raftstore::test_split_region::test_split_region_diff_check::test_raftstore_new_node_cluster
PASS [ 1.230s] tests::integrations raftstore::test_split_region::test_split_region_keep_records::test_raftstore_v2_new_node_cluster
PASS [ 1.904s] tests::integrations raftstore::test_split_region::test_split_region_diff_check::test_raftstore_v2_new_node_cluster
PASS [ 7.969s] tests::integrations raftstore::test_split_region::test_server_split_region_twice::test_raftstore_v2_new_server_cluster
PASS [ 3.187s] tests::integrations raftstore::test_split_region::test_split_region_diff_check::test_raftstore_new_server_cluster
PASS [ 6.048s] tests::integrations raftstore::test_split_region::test_server_split_with_stale_peer::test_raftstore_new_server_cluster_with_hybrid_engine
TRY 1 ABRT [ 10.782s] tests::integrations raftstore::test_split_region::test_server_split_region_twice::test_raftstore_new_server_cluster
RETRY 2/3 [ ] tests::integrations raftstore::test_split_region::test_server_split_region_twice::test_raftstore_new_server_cluster
PASS [ 2.995s] tests::integrations raftstore::test_split_region::test_split_with_epoch_not_match::test_raftstore_new_server_cluster_with_hybrid_engine
PASS [ 4.371s] tests::integrations raftstore::test_split_region::test_split_with_in_memory_pessimistic_locks::test_raftstore_new_server_cluster
PASS [ 5.457s] tests::integrations raftstore::test_split_region::test_split_with_in_memory_pessimistic_locks::test_raftstore_v2_new_server_cluster
PASS [ 6.115s] tests::integrations raftstore::test_stale_peer::test_node_stale_peer_out_of_region
PASS [ 5.173s] tests::integrations raftstore::test_stale_peer::test_node_stale_peer_without_data_right_derive_when_split
PASS [ 1.224s] tests::integrations raftstore::test_stale_read::test_resolved_ts_after_destroy_peer::test_raftstore_new_node_cluster
PASS [ 16.738s] tests::integrations raftstore::test_split_region::test_server_base_split_region::test_raftstore_new_server_cluster_with_hybrid_engine
PASS [ 1.061s] tests::integrations raftstore::test_stats::test_node_simple_store_stats
PASS [ 2.120s] tests::integrations raftstore::test_stats::test_store_heartbeat_report_hotspots
PASS [ 6.154s] tests::integrations raftstore::test_stale_peer::test_stale_learner
PASS [ 4.578s] tests::integrations raftstore::test_stale_read::test_stale_read_with_ts0::test_raftstore_new_server_cluster
TRY 2 PASS [ 9.046s] tests::integrations raftstore::test_split_region::test_server_split_region_twice::test_raftstore_new_server_cluster
PASS [ 9.258s] tests::integrations raftstore::test_stale_peer::test_server_stale_peer_without_data_left_derive_when_split
TRY 2 SLOW [> 60.000s] tests::integrations raftstore::test_compact_log::test_node_compact_log
PASS [ 5.990s] tests::integrations raftstore::test_stale_read::test_stale_read_resolved_ts_advance::test_raftstore_new_server_cluster
PASS [ 3.748s] tests::integrations raftstore::test_tombstone::test_destroy_clean_up_logs_with_log_gc
PASS [ 3.530s] tests::integrations raftstore::test_tombstone::test_node_tombstone
PASS [ 7.371s] tests::integrations raftstore::test_status_command::test_region_detail
PASS [ 2.155s] tests::integrations raftstore::test_transfer_leader::test_server_basic_transfer_leader::test_raftstore_new_node_cluster
PASS [ 7.210s] tests::integrations raftstore::test_tombstone::test_server_fast_destroy
PASS [ 5.998s] tests::integrations raftstore::test_transfer_leader::test_propose_in_memory_pessimistic_locks::test_raftstore_new_server_cluster
PASS [ 7.459s] tests::integrations raftstore::test_transfer_leader::test_memory_pessimistic_locks_status_after_transfer_leader_failure::test_raftstore_new_server_cluster
PASS [ 5.429s] tests::integrations raftstore::test_transfer_leader::test_server_pd_transfer_leader::test_raftstore_new_server_cluster
PASS [ 8.487s] tests::integrations raftstore::test_tombstone::test_server_stale_meta
PASS [ 4.861s] tests::integrations raftstore::test_transfer_leader::test_server_pd_transfer_leader_multi_target::test_raftstore_new_server_cluster
PASS [ 3.137s] tests::integrations raftstore::test_transport::test_node_partition_write
PASS [ 5.599s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_multiple_election_rounds::test_raftstore_v2_new_node_cluster
PASS [ 5.143s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_healthy_region::test_raftstore_v2_new_node_cluster
PASS [ 8.168s] tests::integrations raftstore::test_transport::test_server_partition_write
PASS [ 8.772s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_five_nodes::test_raftstore_v2_new_node_cluster
PASS [ 11.409s] tests::integrations raftstore::test_transfer_leader::test_sync_max_ts_after_leader_transfer::test_raftstore_new_server_cluster_with_api_ver
PASS [ 10.960s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_for_learner::test_raftstore_v2_new_node_cluster
TRY 1 FAIL [ 3.443s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_twice_on_different_peers::test_raftstore_v2_new_node_cluster
RETRY 2/3 [ ] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_twice_on_different_peers::test_raftstore_v2_new_node_cluster
TRY 1 FAIL [ 8.609s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
RETRY 2/3 [ ] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
PASS [ 7.869s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_three_nodes::test_raftstore_v2_new_node_cluster
PASS [ 5.462s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_twice_on_same_peer::test_raftstore_v2_new_node_cluster
PASS [ 8.660s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_trigger_snapshot::test_raftstore_v2_new_node_cluster
PASS [ 3.770s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_with_uncommitted_conf_change::test_raftstore_v2_new_node_cluster
PASS [ 14.205s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_wrong_leader::test_raftstore_v2_new_node_cluster
TRY 2 FAIL [ 8.472s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
RETRY 3/3 [ ] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
PASS [ 6.643s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_auto_promote_learner::test_raftstore_v2_new_node_cluster
PASS [ 7.482s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_already_in_joint_state::test_raftstore_v2_new_node_cluster
PASS [ 3.351s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_create_region::test_raftstore_v2_new_node_cluster
PASS [ 6.737s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_create_destroy_reentrancy::test_raftstore_v2_new_node_cluster
PASS [ 2.960s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_create_region_reentrancy::test_raftstore_v2_new_node_cluster
TRY 3 PASS [ 4.250s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
TRY 2 PASS [ 14.804s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_twice_on_different_peers::test_raftstore_v2_new_node_cluster
PASS [ 1.722s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_has_commit_merge::test_raftstore_new_node_cluster
PASS [ 6.802s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_demote_failed_voters::test_raftstore_v2_new_node_cluster
PASS [ 6.778s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_demote_non_exist_voters::test_raftstore_v2_new_node_cluster
PASS [ 4.937s] tests::integrations raftstore::test_witness::test_witness_apply_snapshot_with_network_isolation
PASS [ 37.964s] tests::integrations raftstore::test_transfer_leader::test_server_transfer_leader_during_snapshot::test_raftstore_new_server_cluster
PASS [ 7.811s] tests::integrations raftstore::test_unsafe_recovery::test_unsafe_recovery_early_return_after_exit_joint_state::test_raftstore_new_node_cluster
PASS [ 3.310s] tests::integrations raftstore::test_witness::test_witness_leader
PASS [ 7.208s] tests::integrations raftstore::test_v1_v2_mixed::test_v1_receive_snap_from_v2
TRY 1 FAIL [ 7.383s] tests::integrations raftstore::test_witness::test_witness_election_priority
RETRY 2/3 [ ] tests::integrations raftstore::test_witness::test_witness_election_priority
PASS [ 3.054s] tests::integrations raftstore::test_witness::test_witness_replica_read
PASS [ 3.048s] tests::integrations raftstore::test_witness::test_witness_switch_witness
PASS [ 3.364s] tests::integrations resource_metering::test_cpu::test_batch_get_command
PASS [ 3.361s] tests::integrations resource_metering::test_cpu::test_get
PASS [ 3.302s] tests::integrations resource_metering::test_cpu::test_reschedule_coprocessor
PASS [ 7.409s] tests::integrations resource_metering::test_dynamic_config::test_report_interval
PASS [ 10.636s] tests::integrations server::debugger::test_compact
PASS [ 12.652s] tests::integrations resource_metering::test_dynamic_config::test_max_resource_groups
PASS [ 12.710s] tests::integrations resource_metering::test_pubsub::test_multiple_subscribers
TRY 2 PASS [ 13.916s] tests::integrations raftstore::test_witness::test_witness_election_priority
PASS [ 1.889s] tests::integrations server::kv_service::test_async_commit_check_txn_status::test_raftstore_must_new_cluster_and_kv_client
PASS [ 2.609s] tests::integrations server::gc_worker::test_gc_bypass_raft::test_raftstore_must_new_cluster_mul
PASS [ 1.154s] tests::integrations server::kv_service::test_batch_get_memory_lock::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.422s] tests::integrations server::kv_service::test_batch_commands::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.890s] tests::integrations server::kv_service::test_commands_write_detail::test_raftstore_must_new_and_configure_cluster_and_kv_client
PASS [ 1.278s] tests::integrations server::kv_service::test_check_cluster_id::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.258s] tests::integrations server::kv_service::test_check_txn_status_with_max_ts::test_raftstore_must_new_cluster_and_kv_client
TRY 2 TRMNTG [>120.000s] tests::integrations raftstore::test_compact_log::test_node_compact_log
TRY 2 TMT [ 120.089s] tests::integrations raftstore::test_compact_log::test_node_compact_log
RETRY 3/3 [ ] tests::integrations raftstore::test_compact_log::test_node_compact_log
TRY 1 FAIL [ 1.533s] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
RETRY 2/3 [ ] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.681s] tests::integrations server::kv_service::test_coprocessor::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.667s] tests::integrations server::kv_service::test_debug_fail_point
PASS [ 0.848s] tests::integrations server::kv_service::test_debug_get::test_raftstore_v2_must_new_cluster_and_debug_client
TRY 2 FAIL [ 1.298s] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
RETRY 3/3 [ ] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.031s] tests::integrations server::kv_service::test_debug_region_info_v2
PASS [ 1.160s] tests::integrations server::kv_service::test_debug_raft_log::test_raftstore_v2_must_new_cluster_and_debug_client
PASS [ 1.110s] tests::integrations server::kv_service::test_debug_region_size_v2
TRY 3 FAIL [ 1.362s] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.530s] tests::integrations server::kv_service::test_debug_scan_mvcc::test_raftstore_v2_must_new_cluster_and_debug_client
PASS [ 1.271s] tests::integrations server::kv_service::test_empty_commands::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.990s] tests::integrations server::kv_service::test_debug_store::test_raftstore_v2_must_new_cluster_and_debug_client
PASS [ 18.478s] tests::integrations resource_metering::test_receiver::test_receiver_blocking
PASS [ 0.907s] tests::integrations server::kv_service::test_get_lock_wait_info_api::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.450s] tests::integrations server::kv_service::test_health_check::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.840s] tests::integrations server::kv_service::test_mvcc_basic::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.327s] tests::integrations server::kv_service::test_kv_scan_memory_lock::test_raftstore_must_new_cluster_and_kv_client
PASS [ 2.291s] tests::integrations server::kv_service::test_health_feedback::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.120s] tests::integrations server::kv_service::test_mvcc_flashback_block_rw::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.643s] tests::integrations server::kv_service::test_mvcc_flashback_block_scheduling::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.520s] tests::integrations server::kv_service::test_mvcc_flashback_unprepared::test_raftstore_must_new_cluster_and_kv_client
TRY 3 PASS [ 7.452s] tests::integrations raftstore::test_compact_log::test_node_compact_log
PASS [ 1.271s] tests::integrations server::kv_service::test_mvcc_flashback_with_unlimited_range::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.082s] tests::integrations server::kv_service::test_mvcc_rollback_and_cleanup::test_raftstore_must_new_cluster_and_kv_client
PASS [ 6.042s] tests::integrations server::kv_service::test_forwarding_reconnect::test_raftstore_setup_cluster
PASS [ 1.517s] tests::integrations server::kv_service::test_mvcc_resolve_lock_gc_and_delete::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.476s] tests::integrations server::kv_service::test_pessimistic_lock_execution_tracking::test_raftstore_must_new_cluster_and_kv_client
PASS [ 31.841s] tests::integrations raftstore::test_witness::test_witness_raftlog_gc_lagged_follower
PASS [ 2.274s] tests::integrations server::kv_service::test_pessimistic_lock_resumable::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.215s] tests::integrations server::kv_service::test_pipelined_dml_buffer_get_other_key::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.312s] tests::integrations server::kv_service::test_pipelined_dml_buffer_get_unordered_keys::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.146s] tests::integrations server::kv_service::test_pipelined_dml_flush::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.965s] tests::integrations server::kv_service::test_pipelined_dml_read_write_conflict::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.964s] tests::integrations server::kv_service::test_prewrite_check_max_commit_ts::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.038s] tests::integrations server::kv_service::test_rawkv::test_raftstore_must_new_cluster_and_kv_client
PASS [ 7.234s] tests::integrations server::kv_service::test_pessimistic_lock::test_raftstore_must_new_cluster_and_kv_client
PASS [ 1.085s] tests::integrations server::kv_service::test_rpc_wall_time::test_raftstore_must_new_cluster_and_kv_client
PASS [ 4.189s] tests::integrations server::kv_service::test_pipelined_dml_write_conflict::test_raftstore_must_new_cluster_and_kv_client
PASS [ 2.300s] tests::integrations server::kv_service::test_rawkv_ttl::test_raftstore_must_new_and_configure_cluster
PASS [ 1.031s] tests::integrations server::kv_service::test_storage_with_quota_limiter_disable::test_raftstore_v2_must_new_and_configure_cluster
PASS [ 1.470s] tests::integrations server::kv_service::test_storage_with_quota_limiter_enable::test_raftstore_v2_must_new_and_configure_cluster
PASS [ 3.589s] tests::integrations server::kv_service::test_split_region
PASS [ 0.933s] tests::integrations server::kv_service::test_txn_heart_beat::test_raftstore_v2_must_new_cluster_and_kv_client
PASS [ 14.438s] tests::integrations server::kv_service::test_mvcc_scan_memory_and_cf_locks::test_raftstore_must_new_cluster_and_kv_client
PASS [ 5.452s] tests::integrations server::kv_service::test_tikv_forwarding::test_raftstore_v2_setup_cluster
PASS [ 3.358s] tests::integrations server::lock_manager::test_detect_deadlock_when_updating_wait_info
PASS [ 4.999s] tests::integrations server::lock_manager::test_detect_deadlock_when_transfer_leader
PASS [ 0.187s] tests::integrations server::raft_client::test_raft_client_reconnect
PASS [ 0.601s] tests::integrations server::raft_client::test_batch_size_edge_limit
PASS [ 0.953s] tests::integrations server::security::test_check_cn_success
PASS [ 1.381s] tests::integrations server::raft_client::test_tombstone_block_list
PASS [ 0.814s] tests::integrations server::status_server::test_region_meta_endpoint
PASS [ 1.830s] tests::integrations server_encryption::test_server_snapshot_encryption
PASS [ 9.977s] tests::integrations server::lock_manager::test_detect_deadlock_when_merge_region
PASS [ 1.128s] tests::integrations storage::test_raft_storage::test_raft_storage
PASS [ 1.461s] tests::integrations storage::test_raft_storage::test_raft_storage_rollback_before_prewrite
PASS [ 22.545s] tests::integrations server::kv_service::test_pessimistic_rollback_with_read_first::test_raftstore_must_new_and_configure_cluster
PASS [ 1.407s] tests::integrations storage::test_raftkv::test_invalid_read_index_when_no_leader
PASS [ 2.391s] tests::integrations storage::test_raftkv::test_read_leader_in_lease
PASS [ 2.057s] tests::integrations storage::test_raftkv::test_read_on_replica_check_memory_locks
PASS [ 29.973s] tests::integrations server::kv_service::test_mvcc_flashback_failed_after_first_batch::test_raftstore_must_new_cluster_and_kv_client
PASS [ 3.550s] tests::integrations storage::test_raftkv::test_raftkv_precheck_write_with_ctx
PASS [ 1.019s] tests::integrations storage::test_storage::bench_txn_store_rocksdb_inc_x100
PASS [ 0.940s] tests::integrations storage::test_storage::test_store_resolve_with_illegal_tso
PASS [ 1.216s] tests::integrations storage::test_storage::test_txn_store_batch_get
PASS [ 9.475s] tests::integrations storage::test_raft_storage::test_auto_gc
PASS [ 0.800s] tests::integrations storage::test_storage::test_txn_store_cleanup_commit
PASS [ 0.691s] tests::integrations storage::test_storage::test_txn_store_commit_illegal_tso
PASS [ 4.752s] tests::integrations storage::test_region_info_accessor::test_region_collection_get_regions_in_range
PASS [ 4.731s] tests::integrations storage::test_region_info_accessor::test_region_collection_seek_region
PASS [ 1.128s] tests::integrations storage::test_storage::test_txn_store_for_point_get_with_pk
PASS [ 0.759s] tests::integrations storage::test_storage::test_txn_store_get_with_type_lock
PASS [ 5.620s] tests::integrations storage::test_storage::test_isolation_inc
PASS [ 0.785s] tests::integrations storage::test_storage::test_txn_store_rawkv
PASS [ 23.372s] tests::integrations server::kv_service::test_txn_api_version::test_raftstore_v2_must_new_and_configure_cluster
PASS [ 0.812s] tests::integrations storage::test_storage::test_txn_store_rawkv_cf
PASS [ 0.867s] tests::integrations storage::test_storage::test_txn_store_scan_key_only
PASS [ 1.137s] tests::integrations storage::test_storage::test_txn_store_reverse_scan
PASS [ 0.017s] tests::bench/misc _bench_check_requirement
PASS [ 0.017s] tests::bench/misc coprocessor::codec::bench_record_prefix_equal_check
PASS [ 0.018s] tests::bench/misc coprocessor::codec::bench_record_prefix_start_with
PASS [ 0.018s] tests::bench/misc coprocessor::codec::bench_table_prefix_start_with
PASS [ 0.022s] tests::bench/misc coprocessor::dag::expr::scalar::bench_get_scalar_args_with_match
PASS [ 0.019s] tests::bench/misc keybuilder::bench_keybuilder::bench_key_builder_from_slice
PASS [ 0.071s] tests::bench/misc raftkv::bench_async_snapshots_noop
PASS [ 0.018s] tests::bench/misc serialization::bench_serialization::bench_decode_one
PASS [ 0.017s] tests::bench/misc serialization::bench_serialization::bench_encode_one
PASS [ 4.216s] tests::integrations storage::test_storage::test_txn_store_gc2_with_less_keys
PASS [ 0.032s] tests::bench/misc storage::key::bench_index_key_gen_hash
PASS [ 4.234s] tests::integrations storage::test_storage::test_txn_store_gc3
PASS [ 0.019s] tests::bench/misc util::slice_compare::bench_slice_compare_greater_128
PASS [ 0.017s] tests::bench/misc util::slice_compare::bench_slice_compare_greater_64
PASS [ 0.018s] tests::bench/misc util::slice_compare::bench_slice_compare_less_32
PASS [ 0.118s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_1
PASS [ 0.045s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_128
PASS [ 0.083s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_2
PASS [ 0.562s] tests::bench/misc storage::mvcc_reader::bench_get_txn_commit_record_100
PASS [ 0.046s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_32
PASS [ 0.042s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_512
PASS [ 0.053s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_8
PASS [ 0.024s] tests::bench/misc writebatch::bench_writebatch::bench_writebatch_without_capacity
PASS [ 0.011s] tidb_query_aggr impl_avg::tests::test_update
PASS [ 0.022s] tidb_query_aggr impl_avg::tests::test_illegal_request
PASS [ 0.015s] tidb_query_aggr impl_avg::tests::test_update_set
PASS [ 0.015s] tidb_query_aggr impl_bit_op::tests::test_bit_or
PASS [ 0.014s] tidb_query_aggr impl_bit_op::tests::test_integration
PASS [ 0.014s] tidb_query_aggr impl_count::tests::test_update_enum
PASS [ 0.013s] tidb_query_aggr impl_first::tests::test_illegal_request
PASS [ 0.012s] tidb_query_aggr impl_first::tests::test_update_enum
PASS [ 0.013s] tidb_query_aggr impl_first::tests::test_update_set
PASS [ 0.013s] tidb_query_aggr impl_max_min::tests::test_aggr_unsigned_signed_int
PASS [ 0.013s] tidb_query_aggr impl_max_min::tests::test_illegal_request
PASS [ 0.015s] tidb_query_aggr impl_max_min::tests::test_max
PASS [ 0.016s] tidb_query_aggr impl_max_min::tests::test_max_set
PASS [ 0.013s] tidb_query_aggr impl_sum::tests::test_illegal_request
PASS [ 0.012s] tidb_query_aggr impl_sum::tests::test_sum_enum
PASS [ 0.014s] tidb_query_aggr impl_variance::tests::test_illegal_request
PASS [ 0.017s] tidb_query_aggr impl_variance::tests::test_variance_enum
PASS [ 0.017s] tidb_query_aggr tests::test_type_match
PASS [ 0.013s] tidb_query_common storage::ranges_iter::tests::test_basic
PASS [ 0.014s] tidb_query_common storage::scanner::tests::test_scanned_range_backward
PASS [ 0.015s] tidb_query_common storage::scanner::tests::test_scanned_range_forward
PASS [ 0.013s] tidb_query_common storage::scanner::tests::test_scanned_rows
PASS [ 0.013s] tidb_query_common util::tests::test_is_prefix_next
PASS [ 0.013s] tidb_query_datatype codec::batch::lazy_column::benches::bench_lazy_batch_column_by_vec_clone
PASS [ 0.014s] tidb_query_datatype codec::batch::lazy_column::benches::bench_lazy_batch_column_clone_and_decode
PASS [ 0.013s] tidb_query_datatype codec::batch::lazy_column::benches::bench_lazy_batch_column_clone_decoded
PASS [ 0.013s] tidb_query_datatype codec::batch::lazy_column::tests::test_basic
PASS [ 0.013s] tidb_query_datatype codec::chunk::chunk::tests::bench_encode_from_raw_decimal_datum
PASS [ 0.014s] tidb_query_datatype codec::chunk::chunk::tests::bench_encode_from_raw_json_datum
PASS [ 0.014s] tidb_query_datatype codec::chunk::chunk::tests::test_append_lazy_col
PASS [ 0.013s] tidb_query_datatype codec::chunk::column::tests::test_column_bytes
PASS [ 0.015s] tidb_query_datatype codec::chunk::column::tests::test_column_duration
PASS [ 0.014s] tidb_query_datatype codec::chunk::column::tests::test_column_f64
PASS [ 0.020s] tidb_query_datatype codec::chunk::column::tests::test_column_json
PASS [ 0.017s] tidb_query_datatype codec::chunk::column::tests::test_column_u64
PASS [ 0.016s] tidb_query_datatype codec::collation::collator::tests::test_latin1_bin
PASS [ 0.016s] tidb_query_datatype codec::collation::encoding::unicode_letter::tests::test_case
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_bytes_to_f64_invalid_utf8
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_bytes_to_int_overflow
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_bytes_to_int_without_context
PASS [ 0.015s] tidb_query_datatype codec::convert::tests::test_bytes_to_uint_truncated
PASS [ 0.013s] tidb_query_datatype codec::convert::tests::test_cast_err_when_json_array_or_object_to_int
PASS [ 0.013s] tidb_query_datatype codec::convert::tests::test_datatype_to_int_overflow
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_float_to_int
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_get_valid_float_prefix
PASS [ 0.015s] tidb_query_datatype codec::convert::tests::test_int_to_uint
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_json_to_int
PASS [ 0.013s] tidb_query_datatype codec::convert::tests::test_produce_dec_with_specified_tp
PASS [ 0.014s] tidb_query_datatype codec::convert::tests::test_produce_str_with_specified_tp
PASS [ 0.019s] tidb_query_datatype codec::convert::tests::test_truncate_binary
PASS [ 0.018s] tidb_query_datatype codec::convert::tests::test_uint_into_int
PASS [ 0.016s] tidb_query_datatype codec::convert::tests::test_valid_get_valid_int_prefix
PASS [ 0.016s] tidb_query_datatype codec::data_type::bit_vec::tests::test_bit_and_iterator
PASS [ 0.014s] tidb_query_datatype codec::data_type::bit_vec::tests::test_len_is_empty
PASS [ 0.015s] tidb_query_datatype codec::data_type::bit_vec::tests::test_push_all_combinations
PASS [ 0.014s] tidb_query_datatype codec::data_type::bit_vec::tests::test_replace
PASS [ 0.015s] tidb_query_datatype codec::data_type::bit_vec::tests::test_truncate
PASS [ 0.017s] tidb_query_datatype codec::data_type::chunked_vec_bytes::benches::bench_bytes_append
PASS [ 0.017s] tidb_query_datatype codec::data_type::chunked_vec_bytes::tests::test_append
PASS [ 0.016s] tidb_query_datatype codec::data_type::chunked_vec_bytes::tests::test_slice_vec
PASS [ 0.015s] tidb_query_datatype codec::data_type::chunked_vec_bytes::tests::test_writer
PASS [ 0.015s] tidb_query_datatype codec::data_type::chunked_vec_enum::tests::test_basics
PASS [ 0.018s] tidb_query_datatype codec::data_type::chunked_vec_json::tests::test_append
PASS [ 0.016s] tidb_query_datatype codec::data_type::chunked_vec_json::tests::test_slice_vec
PASS [ 0.014s] tidb_query_datatype codec::data_type::chunked_vec_set::tests::test_append
PASS [ 0.012s] tidb_query_datatype codec::data_type::chunked_vec_set::tests::test_truncate
PASS [ 0.016s] tidb_query_datatype codec::data_type::chunked_vec_sized::benches::bench_iterate
PASS [ 0.017s] tidb_query_datatype codec::data_type::chunked_vec_sized::tests::test_basics
PASS [ 0.015s] tidb_query_datatype codec::data_type::chunked_vec_sized::tests::test_truncate
PASS [ 0.016s] tidb_query_datatype codec::data_type::tests::test_real_as_bool
PASS [ 0.017s] tidb_query_datatype codec::data_type::vector::tests::test_basic
PASS [ 0.015s] tidb_query_datatype codec::datum::tests::test_cast_as_json
PASS [ 0.015s] tidb_query_datatype codec::datum::tests::test_datum_cmp
PASS [ 0.016s] tidb_query_datatype codec::datum::tests::test_datum_into_json
PASS [ 0.015s] tidb_query_datatype codec::datum::tests::test_into_f64
PASS [ 0.015s] tidb_query_datatype codec::datum::tests::test_split_datum
PASS [ 0.015s] tidb_query_datatype codec::mysql::binary_literal::tests::test_binary_literal_from_bit_str
PASS [ 0.015s] tidb_query_datatype codec::mysql::binary_literal::tests::test_binary_literal_from_u64
PASS [ 0.014s] tidb_query_datatype codec::mysql::binary_literal::tests::test_binary_literal_to_string
PASS [ 0.014s] tidb_query_datatype codec::mysql::binary_literal::tests::test_trim_leading_zero_bytes
PASS [ 0.014s] tidb_query_datatype codec::mysql::decimal::tests::test_bytes_to_decimal
PASS [ 0.016s] tidb_query_datatype codec::mysql::decimal::tests::test_chunk_codec
PASS [ 0.014s] tidb_query_datatype codec::mysql::decimal::tests::test_codec
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_div_mod
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_from_f64
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_from_u64
PASS [ 0.011s] tidb_query_datatype codec::mysql::decimal::tests::test_into_result_impl
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_max_or_min_decimal
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_mul_truncated
PASS [ 0.013s] tidb_query_datatype codec::mysql::decimal::tests::test_round
PASS [ 0.017s] tidb_query_datatype codec::mysql::decimal::tests::test_string
PASS [ 0.015s] tidb_query_datatype codec::mysql::decimal::tests::test_to_f64
PASS [ 0.016s] tidb_query_datatype codec::mysql::decimal::tests::test_to_u64
PASS [ 0.015s] tidb_query_datatype codec::mysql::duration::benches::bench_codec
PASS [ 0.015s] tidb_query_datatype codec::mysql::duration::benches::bench_parse
PASS [ 0.016s] tidb_query_datatype codec::mysql::duration::benches::bench_to_decimal
PASS [ 0.017s] tidb_query_datatype codec::mysql::duration::tests::test_codec
PASS [ 0.017s] tidb_query_datatype codec::mysql::duration::tests::test_hours
PASS [ 0.017s] tidb_query_datatype codec::mysql::duration::tests::test_parse_consider_overflow
PASS [ 0.015s] tidb_query_datatype codec::mysql::duration::tests::test_parse_overflow_as_warning
PASS [ 0.016s] tidb_query_datatype codec::mysql::duration::tests::test_secs
PASS [ 0.019s] tidb_query_datatype codec::mysql::duration::tests::test_to_decimal
PASS [ 0.019s] tidb_query_datatype codec::mysql::duration::tests::test_to_numeric_string
PASS [ 0.025s] tidb_query_datatype codec::mysql::enums::tests::test_is_empty
PASS [ 0.020s] tidb_query_datatype codec::mysql::enums::tests::test_read_enum_uint
PASS [ 0.028s] tidb_query_datatype codec::mysql::enums::tests::test_to_string
PASS [ 0.027s] tidb_query_datatype codec::mysql::enums::tests::test_write_enum_to_chunk
PASS [ 0.016s] tidb_query_datatype codec::mysql::enums::tests::test_write_enum_to_chunk_by_payload_uint
PASS [ 0.015s] tidb_query_datatype codec::mysql::json::binary::tests::test_array_get_elem
PASS [ 0.016s] tidb_query_datatype codec::mysql::json::binary::tests::test_type
PASS [ 0.015s] tidb_query_datatype codec::mysql::json::comparison::tests::test_cmp_json_between_json_type
PASS [ 0.016s] tidb_query_datatype codec::mysql::json::json_contains::tests::test_json_contains
PASS [ 0.020s] tidb_query_datatype codec::mysql::json::comparison::tests::test_cmp_json_numberic_type
PASS [ 0.017s] tidb_query_datatype codec::mysql::json::json_extract::tests::test_json_extract
PASS [ 0.017s] tidb_query_datatype codec::mysql::json::json_length::tests::test_json_length
PASS [ 0.017s] tidb_query_datatype codec::mysql::json::json_merge::tests::test_merge
PASS [ 0.018s] tidb_query_datatype codec::mysql::json::json_remove::tests::test_json_remove
PASS [ 0.021s] tidb_query_datatype codec::mysql::json::json_unquote::tests::test_decode_escaped_unicode
PASS [ 0.020s] tidb_query_datatype codec::mysql::json::json_unquote::tests::test_json_unquote_time_duration
PASS [ 0.015s] tidb_query_datatype codec::mysql::json::path_expr::tests::test_parse_json_path_expr_contains_any_asterisk
PASS [ 0.015s] tidb_query_datatype codec::mysql::json::path_expr::tests::test_path_expression_flag
PASS [ 0.013s] tidb_query_datatype codec::mysql::json::serde::tests::test_from_str_for_object
PASS [ 0.013s] tidb_query_datatype codec::mysql::json::tests::test_cast_err_when_json_array_or_object_to_real
PASS [ 0.015s] tidb_query_datatype codec::mysql::json::tests::test_json_array
PASS [ 0.016s] tidb_query_datatype codec::mysql::set::tests::test_is_empty
PASS [ 0.014s] tidb_query_datatype codec::mysql::set::tests::test_to_string
PASS [ 0.014s] tidb_query_datatype codec::mysql::time::tests::test_allow_invalid_date
PASS [ 0.015s] tidb_query_datatype codec::mysql::time::tests::test_codec_datetime
PASS [ 0.017s] tidb_query_datatype codec::mysql::time::tests::test_compare
PASS [ 0.016s] tidb_query_datatype codec::mysql::time::tests::test_date_format
PASS [ 0.017s] tidb_query_datatype codec::mysql::time::tests::test_from_local_time
PASS [ 0.014s] tidb_query_datatype codec::mysql::time::tests::test_no_zero_date
PASS [ 0.016s] tidb_query_datatype codec::mysql::time::tests::test_normalized
PASS [ 0.022s] tidb_query_datatype codec::mysql::time::tests::test_parse_from_i64
PASS [ 0.017s] tidb_query_datatype codec::mysql::time::tests::test_parse_time_with_tz
PASS [ 1.781s] tests::bench/misc storage::incremental_get::bench_table_lookup_mvcc_get
PASS [ 0.015s] tidb_query_datatype codec::mysql::time::tests::test_parse_valid_datetime
PASS [ 0.015s] tidb_query_datatype codec::mysql::time::tests::test_round_frac
PASS [ 0.014s] tidb_query_datatype codec::mysql::time::tests::test_to_numeric_string
PASS [ 0.014s] tidb_query_datatype codec::overflow::tests::test_div
PASS [ 0.014s] tidb_query_datatype codec::row::v2::compat_v1::tests::test_datetime
PASS [ 0.015s] tidb_query_datatype codec::row::v2::compat_v1::tests::test_duration
PASS [ 0.015s] tidb_query_datatype codec::row::v2::compat_v1::tests::test_json
PASS [ 0.015s] tidb_query_datatype codec::row::v2::compat_v1::tests::test_uint
PASS [ 0.014s] tidb_query_datatype codec::row::v2::encoder_for_test::tests::test_encode_big
PASS [ 0.014s] tidb_query_datatype codec::row::v2::encoder_for_test::tests::test_encode_unsigned
PASS [ 0.013s] tidb_query_datatype codec::row::v2::row_slice::benches::bench_search_in_non_null_ids
PASS [ 0.014s] tidb_query_datatype codec::row::v2::row_slice::benches::bench_search_in_non_null_ids_middle
PASS [ 0.014s] tidb_query_datatype codec::row::v2::row_slice::tests::test_decode_with_checksum
PASS [ 0.014s] tidb_query_datatype codec::table::tests::test_check_key_type
PASS [ 0.028s] tidb_query_datatype codec::row::v2::row_slice::tests::test_search_in_non_null_ids
PASS [ 0.018s] tidb_query_datatype codec::table::tests::test_decode_table_id
PASS [ 0.019s] tidb_query_datatype codec::table::tests::test_idx_codec
PASS [ 0.015s] tidb_query_datatype codec::table::tests::test_row_codec
PASS [ 0.014s] tidb_query_datatype def::eval_type::tests::test_fieldtype_to_evaltype
PASS [ 0.014s] tidb_query_datatype def::field_type::tests::test_collate_from_i32
PASS [ 0.014s] tidb_query_datatype def::field_type::tests::test_field_type_from_u8
PASS [ 0.014s] tidb_query_datatype def::field_type::tests::test_need_restored_data
PASS [ 0.014s] tidb_query_datatype expr::ctx::tests::test_handle_invalid_time_error
PASS [ 0.013s] tidb_query_datatype expr::ctx::tests::test_max_warning_cnt
PASS [ 0.015s] tidb_query_executors fast_hash_aggr_executor::tests::test_collation
PASS [ 0.016s] tidb_query_executors fast_hash_aggr_executor::tests::test_group_by_enum_column
PASS [ 0.020s] tidb_query_executors fast_hash_aggr_executor::tests::test_no_aggr_fn
PASS [ 0.018s] tidb_query_executors index_scan_executor::tests::test_basic
PASS [ 0.020s] tidb_query_executors index_scan_executor::tests::test_common_handle_index_latin1_bin
PASS [ 0.014s] tidb_query_executors index_scan_executor::tests::test_index_version
PASS [ 0.015s] tidb_query_executors index_scan_executor::tests::test_int_handle_varchar_index
PASS [ 0.014s] tidb_query_executors index_scan_executor::tests::test_new_collation_non_unique_int_handle_index
PASS [ 0.014s] tidb_query_executors index_scan_executor::tests::test_old_collation_non_unique_common_handle_index
PASS [ 0.017s] tidb_query_executors index_scan_executor::tests::test_unique_common_handle_index
PASS [ 0.016s] tidb_query_executors limit_executor::tests::test_drain_before_limit
PASS [ 0.016s] tidb_query_executors limit_executor::tests::test_error_when_limit
PASS [ 0.014s] tidb_query_executors partition_top_n_executor::tests::test_expr_key1
PASS [ 0.023s] tidb_query_executors limit_executor::tests::test_src_exec_is_scan
PASS [ 0.015s] tidb_query_executors partition_top_n_executor::tests::test_integrated
PASS [ 0.016s] tidb_query_executors partition_top_n_executor::tests::test_no_partition_bytes_1
PASS [ 0.016s] tidb_query_executors partition_top_n_executor::tests::test_no_partition_integration_1
PASS [ 0.027s] tidb_query_executors partition_top_n_executor::tests::test_no_partition_integration_3
PASS [ 0.018s] tidb_query_executors partition_top_n_executor::tests::test_no_partition_top_0
PASS [ 0.030s] tidb_query_executors partition_top_n_executor::tests::test_no_partition_top_unsigned
PASS [ 0.027s] tidb_query_executors partition_top_n_executor::tests::test_paging_limit_oversize_n
PASS [ 0.026s] tidb_query_executors partition_top_n_executor::tests::test_top_0
PASS [ 0.022s] tidb_query_executors partition_top_n_executor::tests::test_without_order_key
PASS [ 0.023s] tidb_query_executors projection_executor::tests::test_empty_rows
PASS [ 0.018s] tidb_query_executors projection_executor::tests::test_projection_error
PASS [ 0.030s] tidb_query_executors selection_executor::tests::test_empty_rows
PASS [ 0.018s] tidb_query_executors selection_executor::tests::test_multiple_predicate_2
PASS [ 0.024s] tidb_query_executors selection_executor::tests::test_predicate_1
PASS [ 0.015s] tidb_query_executors selection_executor::tests::test_predicate_always_false
PASS [ 0.017s] tidb_query_executors simple_aggr_executor::tests::test_it_works_integration
PASS [ 0.014s] tidb_query_executors simple_aggr_executor::tests::test_no_row
PASS [ 0.015s] tidb_query_executors stream_aggr_executor::tests::test_it_works_integration
PASS [ 0.016s] tidb_query_executors table_scan_executor::tests::test_corrupted_data
PASS [ 0.026s] tidb_query_executors table_scan_executor::tests::test_basic
PASS [ 0.019s] tidb_query_executors table_scan_executor::tests::test_locked_data
PASS [ 0.016s] tidb_query_executors table_scan_executor::tests::test_prefix_column_handle
PASS [ 0.017s] tidb_query_executors top_n_executor::tests::test_bytes_2
PASS [ 0.022s] tidb_query_executors top_n_executor::tests::test_integration_2
PASS [ 0.020s] tidb_query_executors top_n_executor::tests::test_no_row
PASS [ 0.019s] tidb_query_executors top_n_executor::tests::test_top_paging
PASS [ 0.020s] tidb_query_executors util::aggr_executor::tests::test_agg_paging
PASS [ 0.020s] tidb_query_expr impl_arithmetic::tests::test_decimal_divide
PASS [ 0.015s] tidb_query_expr impl_arithmetic::tests::test_int_divide_decimal
PASS [ 0.016s] tidb_query_expr impl_arithmetic::tests::test_int_divide_decimal_unsigned_overflow
PASS [ 0.019s] tidb_query_expr impl_arithmetic::tests::test_int_divide_int_overflow
PASS [ 0.020s] tidb_query_expr impl_arithmetic::tests::test_int_uint_multiply
PASS [ 0.017s] tidb_query_expr impl_arithmetic::tests::test_mod_decimal
PASS [ 0.017s] tidb_query_expr impl_arithmetic::tests::test_mod_int_unsigned
PASS [ 0.034s] tidb_query_expr impl_arithmetic::tests::test_minus_int
PASS [ 0.016s] tidb_query_expr impl_arithmetic::tests::test_multiply_decimal
PASS [ 0.016s] tidb_query_expr impl_arithmetic::tests::test_plus_int
PASS [ 0.018s] tidb_query_expr impl_arithmetic::tests::test_real_divide
PASS [ 0.020s] tidb_query_expr impl_cast::tests::test_bytes_as_duration
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_cast_duration_as_time
PASS [ 0.029s] tidb_query_expr impl_arithmetic::tests::test_uint_uint_multiply
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_cast_enum_as_duration
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_cast_int_as_time
PASS [ 0.015s] tidb_query_expr impl_cast::tests::test_cast_string_as_int
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_cast_string_as_time
PASS [ 0.020s] tidb_query_expr impl_cast::tests::test_decimal_as_duration
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_decimal_as_json
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_decimal_as_signed_real
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_decimal_as_uint
PASS [ 0.014s] tidb_query_expr impl_cast::tests::test_decimal_as_unsigned_real
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_duration_as_decimal
PASS [ 0.014s] tidb_query_expr impl_cast::tests::test_duration_as_int
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_duration_as_real
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_enum_as_bytes
PASS [ 0.021s] tidb_query_expr impl_cast::tests::test_enum_as_json
PASS [ 0.020s] tidb_query_expr impl_cast::tests::test_float_real_as_string
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_int_as_duration
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_int_as_json
PASS [ 0.020s] tidb_query_expr impl_cast::tests::test_json_as_decimal
PASS [ 0.021s] tidb_query_expr impl_cast::tests::test_json_as_duration_truncate_wrong_value
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_json_as_json
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_json_as_string
PASS [ 0.021s] tidb_query_expr impl_cast::tests::test_json_as_uint
PASS [ 0.020s] tidb_query_expr impl_cast::tests::test_real_as_duration
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_real_as_json
PASS [ 0.013s] tidb_query_expr impl_cast::tests::test_set_as_int
PASS [ 0.028s] tidb_query_expr impl_cast::tests::test_real_as_uint
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_signed_int_as_signed_real
PASS [ 0.019s] tidb_query_expr impl_cast::tests::test_signed_int_as_unsigned_int
PASS [ 0.015s] tidb_query_expr impl_cast::tests::test_string_as_json
PASS [ 0.015s] tidb_query_expr impl_cast::tests::test_time_as_decimal
PASS [ 0.024s] tidb_query_expr impl_cast::tests::test_string_as_string
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_time_as_int_and_uint
PASS [ 0.016s] tidb_query_expr impl_cast::tests::test_time_as_real
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_time_as_time
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_truncate_when_cast_json_object_or_array_as_decimal
PASS [ 0.018s] tidb_query_expr impl_cast::tests::test_uint_as_string
PASS [ 0.017s] tidb_query_expr impl_cast::tests::test_unsigned_int_as_signed_or_unsigned_real
PASS [ 0.022s] tidb_query_expr impl_compare::tests::test_coalesce
PASS [ 0.022s] tidb_query_expr impl_compare::tests::test_compare_duration
PASS [ 0.025s] tidb_query_expr impl_compare::tests::test_compare_real
PASS [ 0.023s] tidb_query_expr impl_compare::tests::test_greatest_cmp_string_as_date
PASS [ 0.029s] tidb_query_expr impl_compare::tests::test_compare_string
PASS [ 0.027s] tidb_query_expr impl_compare::tests::test_greatest_date
PASS [ 0.018s] tidb_query_expr impl_compare::tests::test_greatest_int
PASS [ 0.023s] tidb_query_expr impl_compare::tests::test_greatest_string
PASS [ 0.021s] tidb_query_expr impl_compare::tests::test_interval_int
PASS [ 0.017s] tidb_query_expr impl_compare::tests::test_least_date
PASS [ 0.019s] tidb_query_expr impl_compare::tests::test_least_int
PASS [ 0.039s] tidb_query_expr impl_compare::tests::test_least_cmp_string_as_date
PASS [ 0.016s] tidb_query_expr impl_compare::tests::test_least_string
PASS [ 0.023s] tidb_query_expr impl_compare_in::tests::bench_compare_in
PASS [ 0.018s] tidb_query_expr impl_compare_in::tests::test_in_complex
PASS [ 0.030s] tidb_query_expr impl_compare_in::tests::test_in_string
PASS [ 0.023s] tidb_query_expr impl_control::tests::test_case_when
PASS [ 0.017s] tidb_query_expr impl_control::tests::test_if
PASS [ 0.023s] tidb_query_expr impl_encryption::tests::test_compress
PASS [ 0.022s] tidb_query_expr impl_encryption::tests::test_password
PASS [ 0.018s] tidb_query_expr impl_encryption::tests::test_uncompress
PASS [ 0.032s] tidb_query_expr impl_encryption::tests::test_sha1
PASS [ 0.018s] tidb_query_expr impl_json::tests::test_json_array
PASS [ 0.020s] tidb_query_expr impl_json::tests::test_json_contains
PASS [ 0.019s] tidb_query_expr impl_json::tests::test_json_extract
PASS [ 0.015s] tidb_query_expr impl_json::tests::test_json_length
PASS [ 0.015s] tidb_query_expr impl_json::tests::test_json_merge
PASS [ 0.018s] tidb_query_expr impl_json::tests::test_json_modify
PASS [ 0.015s] tidb_query_expr impl_json::tests::test_json_quote
PASS [ 0.021s] tidb_query_expr impl_json::tests::test_json_type
PASS [ 0.019s] tidb_query_expr impl_json::tests::test_json_valid
PASS [ 0.026s] tidb_query_expr impl_like::tests::test_like_wide_character
PASS [ 0.025s] tidb_query_expr impl_math::tests::test_abs_int
PASS [ 0.030s] tidb_query_expr impl_math::tests::test_acos
PASS [ 0.024s] tidb_query_expr impl_math::tests::test_atan_1_arg
PASS [ 0.022s] tidb_query_expr impl_math::tests::test_ceil_dec_to_dec
PASS [ 0.017s] tidb_query_expr impl_math::tests::test_ceil_int_to_dec
PASS [ 0.016s] tidb_query_expr impl_math::tests::test_ceil_real
PASS [ 0.019s] tidb_query_expr impl_math::tests::test_cos
PASS [ 0.017s] tidb_query_expr impl_math::tests::test_crc32
PASS [ 0.019s] tidb_query_expr impl_math::tests::test_exp
PASS [ 0.014s] tidb_query_expr impl_math::tests::test_floor_dec_to_int
PASS [ 0.015s] tidb_query_expr impl_math::tests::test_floor_int_to_int
PASS [ 0.013s] tidb_query_expr impl_math::tests::test_log10
PASS [ 0.014s] tidb_query_expr impl_math::tests::test_log_1_arg
PASS [ 0.013s] tidb_query_expr impl_math::tests::test_pi
PASS [ 0.015s] tidb_query_expr impl_math::tests::test_radians
PASS [ 0.014s] tidb_query_expr impl_math::tests::test_rand_with_seed_first_gen
PASS [ 0.016s] tidb_query_expr impl_math::tests::test_round_frac
PASS [ 0.020s] tidb_query_expr impl_math::tests::test_round_real
PASS [ 0.017s] tidb_query_expr impl_math::tests::test_sin
PASS [ 0.020s] tidb_query_expr impl_math::tests::test_tan
PASS [ 0.020s] tidb_query_expr impl_math::tests::test_truncate_int
PASS [ 0.016s] tidb_query_expr impl_math::tests::test_truncate_uint
PASS [ 0.016s] tidb_query_expr impl_miscellaneous::tests::test_duration_any_value
PASS [ 0.017s] tidb_query_expr impl_miscellaneous::tests::test_inet6_ntoa
PASS [ 0.020s] tidb_query_expr impl_miscellaneous::tests::test_inet_ntoa
PASS [ 0.018s] tidb_query_expr impl_miscellaneous::tests::test_is_ipv4
PASS [ 0.117s] tidb_query_expr impl_math::tests::test_rand_new
PASS [ 0.022s] tidb_query_expr impl_miscellaneous::tests::test_is_ipv4_mapped
PASS [ 0.017s] tidb_query_expr impl_miscellaneous::tests::test_json_any_value
PASS [ 0.016s] tidb_query_expr impl_miscellaneous::tests::test_string_any_value
PASS [ 0.015s] tidb_query_expr impl_miscellaneous::tests::test_uuid
PASS [ 0.017s] tidb_query_expr impl_op::tests::test_bit_neg
PASS [ 0.016s] tidb_query_expr impl_op::tests::test_bit_xor
PASS [ 0.017s] tidb_query_expr impl_op::tests::test_is_null
PASS [ 0.015s] tidb_query_expr impl_op::tests::test_left_shift
PASS [ 0.016s] tidb_query_expr impl_op::tests::test_logical_or
PASS [ 0.017s] tidb_query_expr impl_op::tests::test_right_shift
PASS [ 0.019s] tidb_query_expr impl_op::tests::test_unary_minus_int
PASS [ 0.018s] tidb_query_expr impl_op::tests::test_unary_not_decimal
PASS [ 0.018s] tidb_query_expr impl_op::tests::test_unary_not_json
PASS [ 0.019s] tidb_query_expr impl_other::tests::test_bit_count
PASS [ 0.034s] tidb_query_expr impl_regexp::tests::test_regexp_like
PASS [ 0.020s] tidb_query_expr impl_string::tests::test_bin
PASS [ 0.044s] tidb_query_expr impl_regexp::tests::test_regexp_substr
PASS [ 0.026s] tidb_query_expr impl_string::tests::test_char_length
PASS [ 0.021s] tidb_query_expr impl_string::tests::test_concat
PASS [ 0.025s] tidb_query_expr impl_string::tests::test_elt
PASS [ 0.023s] tidb_query_expr impl_string::tests::test_field_real
PASS [ 0.018s] tidb_query_expr impl_string::tests::test_find_in_set
PASS [ 0.026s] tidb_query_expr impl_string::tests::test_gbk_lower_upper
PASS [ 0.022s] tidb_query_expr impl_string::tests::test_hex_int_arg
PASS [ 0.022s] tidb_query_expr impl_string::tests::test_insert
PASS [ 0.019s] tidb_query_expr impl_string::tests::test_instr
PASS [ 0.022s] tidb_query_expr impl_string::tests::test_left
PASS [ 0.019s] tidb_query_expr impl_string::tests::test_length
PASS [ 0.023s] tidb_query_expr impl_string::tests::test_locate_2_args_utf8
PASS [ 0.020s] tidb_query_expr impl_string::tests::test_locate_3_args_utf8
PASS [ 0.028s] tidb_query_expr impl_string::tests::test_lower_utf8
PASS [ 0.018s] tidb_query_expr impl_string::tests::test_lpad_utf8
PASS [ 0.019s] tidb_query_expr impl_string::tests::test_oct_string
PASS [ 0.038s] tidb_query_expr impl_string::tests::test_make_set
PASS [ 0.017s] tidb_query_expr impl_string::tests::test_quote
PASS [ 0.017s] tidb_query_expr impl_string::tests::test_replace
PASS [ 0.019s] tidb_query_expr impl_string::tests::test_reverse_utf8
PASS [ 0.022s] tidb_query_expr impl_string::tests::test_right_utf8
PASS [ 0.022s] tidb_query_expr impl_string::tests::test_rpad_utf8
PASS [ 0.015s] tidb_query_expr impl_string::tests::test_substring_2_args
PASS [ 0.016s] tidb_query_expr impl_string::tests::test_substring_3_args
PASS [ 0.029s] tidb_query_expr impl_string::tests::test_substring_index
PASS [ 0.021s] tidb_query_expr impl_string::tests::test_trim_1_arg
PASS [ 0.017s] tidb_query_expr impl_string::tests::test_trim_3_args
PASS [ 0.018s] tidb_query_expr impl_string::tests::test_upper
PASS [ 0.081s] tidb_query_expr impl_string::tests::test_space
PASS [ 0.018s] tidb_query_expr impl_time::tests::test_add_datetime_and_duration
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_add_duration_and_duration
PASS [ 0.029s] tidb_query_expr impl_string::tests::test_validate_target_len_for_pad
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_add_sub_string_and_duration
PASS [ 0.018s] tidb_query_expr impl_time::tests::test_date
PASS [ 0.029s] tidb_query_expr impl_time::tests::test_date_format
PASS [ 0.020s] tidb_query_expr impl_time::tests::test_day_of_year
PASS [ 0.026s] tidb_query_expr impl_time::tests::test_day_of_month
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_duration_string_time_diff
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_hour_min_sec_micro_sec
PASS [ 0.019s] tidb_query_expr impl_time::tests::test_make_date
PASS [ 0.018s] tidb_query_expr impl_time::tests::test_null_time_diff
PASS [ 0.028s] tidb_query_expr impl_time::tests::test_month
PASS [ 0.023s] tidb_query_expr impl_time::tests::test_period_diff
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_string_duration_time_diff
PASS [ 0.024s] tidb_query_expr impl_time::tests::test_sub_datetime_and_duration
PASS [ 0.022s] tidb_query_expr impl_time::tests::test_sub_duration_and_duration
PASS [ 0.023s] tidb_query_expr impl_time::tests::test_time_to_sec
PASS [ 0.020s] tidb_query_expr impl_time::tests::test_to_seconds
PASS [ 0.021s] tidb_query_expr impl_time::tests::test_week_of_year
PASS [ 0.019s] tidb_query_expr impl_time::tests::test_week_without_mode
PASS [ 0.017s] tidb_query_expr impl_time::tests::test_year_week_with_mode
PASS [ 0.018s] tidb_query_expr types::expr_builder::tests::test_max_columns_check
PASS [ 0.029s] tidb_query_expr types::expr_builder::tests::test_append_rpn_nodes_recursively
PASS [ 0.029s] tidb_query_expr types::expr_builder::tests::test_validator_raw_vargs_fn_with_min_args
PASS [ 0.022s] tidb_query_expr types::expr_builder::tests::test_validator_vargs_fn_with_min_args
PASS [ 0.027s] tidb_query_expr types::expr_eval::benches::bench_int_eval
PASS [ 0.021s] tidb_query_expr types::expr_eval::tests::bench_eval_compare_5_rows
PASS [ 0.020s] tidb_query_expr types::expr_eval::tests::test_eval_binary_function_raw_column
PASS [ 0.017s] tidb_query_expr types::expr_eval::tests::test_eval_binary_function_scalar_vector
PASS [ 0.028s] tidb_query_expr types::expr_eval::tests::test_eval_binary_function_vector_vector
PASS [ 0.023s] tidb_query_expr types::expr_eval::tests::test_eval_fail_1
PASS [ 0.029s] tidb_query_expr types::expr_eval::tests::test_eval_fail_3
PASS [ 0.018s] tidb_query_expr types::expr_eval::tests::test_eval_single_column_node_normal
PASS [ 0.019s] tidb_query_expr types::expr_eval::tests::test_eval_single_fn_call_node
PASS [ 0.015s] tidb_query_expr types::expr_eval::tests::test_eval_unary_function_raw_column
PASS [ 0.024s] tidb_query_expr types::expr_eval::tests::test_eval_unary_function_vector
PASS [ 0.020s] tidb_query_expr types::expr_eval::tests::test_rpn_fn_data
PASS [ 0.024s] tidb_query_expr types::expr_eval::tests::test_merge_nulls_constant_null
PASS [ 0.032s] tikv config::coprocessor_read_pool_test::test_validate
PASS [ 0.031s] tikv config::readpool_tests::test_partially_unified
PASS [ 0.032s] tikv config::readpool_tests::test_unified_enabled
PASS [ 0.023s] tikv config::tests::test_background_job_limits
PASS [ 0.023s] tikv config::tests::test_case_macro
PASS [ 0.039s] tikv config::tests::test_change_log_config
PASS [ 0.047s] tikv config::tests::test_change_resolved_ts_config
PASS [ 0.062s] tikv config::tests::test_change_server_config
PASS [ 56.210s] tests::integrations server::debugger::test_flashback_to_version_with_mismatch_ts
PASS [ 0.058s] tikv config::tests::test_compact_check_default
PASS [ 0.554s] tikv config::tests::test_change_ttl_check_poll_interval
PASS [ 0.614s] tikv config::tests::test_change_store_scheduler_memory_quota
PASS [ 0.047s] tikv config::tests::test_config_template_is_valid
PASS [ 0.046s] tikv config::tests::test_config_template_no_superfluous_keys
PASS [ 0.029s] tikv config::tests::test_dispatch_titan_blob_run_mode_config
PASS [ 0.041s] tikv config::tests::test_flatten_cfg
PASS [ 0.047s] tikv config::tests::test_flow_control_override
PASS [ 0.031s] tikv config::tests::test_keepalive_check
PASS [ 0.023s] tikv config::tests::test_module_from_str
PASS [ 0.020s] tikv config::tests::test_parse_log_level
PASS [ 0.029s] tikv config::tests::test_raft_engine_dir
PASS [ 0.057s] tikv config::tests::test_region_size_config
PASS [ 0.055s] tikv config::tests::test_serde_to_online_config
PASS [ 0.032s] tikv config::tests::test_to_config_change
PASS [ 0.033s] tikv config::tests::test_unrecognized_config_keys
PASS [ 0.026s] tikv config::unified_read_pool_tests::test_validate
PASS [ 0.067s] tikv config::tests::test_validate_tikv_config
PASS [ 0.099s] tikv coprocessor::endpoint::tests::test_channel_size
PASS [ 0.109s] tikv coprocessor::endpoint::tests::test_empty_streaming_response
PASS [ 0.077s] tikv coprocessor::endpoint::tests::test_error_unary_response
PASS [ 0.851s] tikv config::tests::test_compatibility_with_old_config_template
PASS [ 0.027s] tikv coprocessor::endpoint::tests::test_make_error_response
PASS [ 0.108s] tikv coprocessor::endpoint::tests::test_invalid_req_body
PASS [ 0.076s] tikv coprocessor::endpoint::tests::test_special_streaming_handlers
PASS [ 0.021s] tikv coprocessor::statistics::analyze::benches::bench_collect_column
PASS [ 0.021s] tikv coprocessor::statistics::analyze::tests::test_abnormal_sampling
PASS [ 5.227s] tests::integrations storage::test_storage::test_txn_store_txnkv_api_version
PASS [ 1.429s] tikv config::tests::test_change_quota_config
PASS [ 0.190s] tikv coprocessor::statistics::cmsketch::tests::test_cm_sketch
PASS [ 0.273s] tikv coprocessor::statistics::analyze::tests::test_row_reservoir_sample_collector
PASS [ 0.031s] tikv coprocessor::statistics::histogram::tests::test_histogram
PASS [ 0.022s] tikv coprocessor_v2::plugin_registry::tests::load_plugin
PASS [ 0.029s] tikv coprocessor_v2::plugin_registry::tests::registry_load_and_get_plugin
PASS [ 0.028s] tikv coprocessor_v2::plugin_registry::tests::update_plugin_path
PASS [ 0.635s] tikv coprocessor::interceptors::concurrency_limiter::tests::test_limit_concurrency
PASS [ 0.421s] tikv coprocessor::tests::test_deadline_from_req_ctx
PASS [ 0.678s] tikv coprocessor::statistics::fmsketch::tests::test_sketch
PASS [ 0.185s] tikv import::raft_writer::test::test_basic
PASS [ 0.022s] tikv import::sst_service::test::test_collector_huge_write_liveness
PASS [ 0.023s] tikv import::sst_service::test::test_collector_size
PASS [ 0.022s] tikv import::sst_service::test::test_request_collector_with_write_cf
PASS [ 0.026s] tikv read_pool::tests::test_time_slice_inspector_ewma
PASS [ 0.478s] tikv import::duplicate_detect::tests::test_duplicate_detect_incremental
PASS [ 0.707s] tikv coprocessor_v2::raw_storage_impl::test::test_storage_api_batch
PASS [ 0.023s] tikv server::config::tests::test_store_labels
PASS [ 0.041s] tikv server::debug2::tests::test_compact
PASS [ 0.671s] tikv server::debug2::tests::test_divide_regions_uneven
PASS [ 0.045s] tikv server::debug2::tests::test_drop_unapplied_raftlog_2
PASS [ 2.098s] tikv coprocessor::endpoint::tests::test_full
PASS [ 0.848s] tikv read_pool::tests::test_yatp_task_poll_duration_metric
PASS [ 0.049s] tikv server::debug2::tests::test_get_all_regions_in_store
PASS [ 0.022s] tikv server::debug2::tests::test_range_in_region
PASS [ 0.052s] tikv server::debug2::tests::test_tombstone_regions_by_id
PASS [ 0.083s] tikv server::debug2::tests::test_region_size
PASS [ 0.102s] tikv server::debug::tests::test_compact
PASS [ 1.070s] tikv read_pool::tests::test_yatp_scale_down
PASS [ 0.087s] tikv server::debug::tests::test_drop_unapplied_raftlog
PASS [ 0.070s] tikv server::debug::tests::test_mvcc_checker
PASS [ 0.031s] tikv server::debug::tests::test_region_overlap
PASS [ 0.098s] tikv server::debug::tests::test_recreate_region
PASS [ 0.072s] tikv server::debug::tests::test_remove_failed_stores
PASS [ 0.072s] tikv server::debug::tests::test_store_region
PASS [ 0.072s] tikv server::debug::tests::test_tombstone_regions_by_id
PASS [ 0.030s] tikv server::gc_worker::compaction_filter::tests::test_is_compaction_filter_allowed
PASS [ 0.079s] tikv server::engine_factory::tests::test_engine_factory
PASS [ 0.054s] tikv server::gc_worker::gc_manager::tests::test_auto_gc_rewinding
PASS [ 0.130s] tikv server::gc_worker::compaction_filter::tests::test_remove_and_skip_until
PASS [ 0.166s] tikv server::gc_worker::compaction_filter::tests::test_compaction_filter_basic
PASS [ 0.227s] tikv server::gc_worker::gc_manager::tests::test_update_safe_point
PASS [ 0.218s] tikv server::gc_worker::gc_worker::tests::test_gc_for_multi_rocksdb
PASS [ 0.026s] tikv server::gc_worker::gc_worker::tests::test_keys_in_regions_iteration
PASS [ 0.121s] tikv server::gc_worker::gc_worker::tests::test_raw_gc_keys_for_multi_rocksdb
PASS [ 0.085s] tikv server::gc_worker::rawkv_compaction_filter::tests::test_raw_call_gctask
PASS [ 0.312s] tikv server::gc_worker::gc_worker::tests::test_gc_keys_with_region_info_provider
PASS [ 0.026s] tikv server::gc_worker::tests::test_check_need_gc
PASS [ 0.024s] tikv server::lock_manager::deadlock::tests::test_deadlock_generating_wait_chain
PASS [ 0.432s] tikv server::load_statistics::linux::tests::test_thread_load_statistic
PASS [ 0.026s] tikv server::lock_manager::tests::bench_lock_mgr_clone
PASS [ 0.283s] tikv server::lock_manager::waiter_manager::tests::test_delay
PASS [ 0.024s] tikv server::lock_manager::waiter_manager::tests::test_wait_table_add_and_remove
PASS [ 1.221s] tikv server::gc_worker::gc_worker::tests::test_gc_keys_scan_range_limit
PASS [ 0.027s] tikv server::lock_manager::waiter_manager::tests::test_wait_table_to_wait_for_entries
PASS [ 0.126s] tikv server::lock_manager::waiter_manager::tests::test_waiter_on_timeout
PASS [ 0.024s] tikv server::raft_client::tests::test_push_raft_message_cfg_change
PASS [ 0.024s] tikv server::raft_client::tests::test_push_raft_message_with_extra_ctx
PASS [ 0.022s] tikv server::raftkv::tests::test_replica_read_lock_checker_for_single_uuid
PASS [ 0.024s] tikv server::resolve::tests::test_resolve_store_peer_addr
PASS [ 0.023s] tikv server::resolve::tests::test_resolve_store_state_tombstone
PASS [ 0.029s] tikv server::resolve::tests::test_store_address_refresh
PASS [ 0.034s] tikv server::service::diagnostics::log::tests::test_log_iterator
PASS [ 0.021s] tikv server::service::diagnostics::log::tests::test_parse_level
PASS [ 0.021s] tikv server::service::diagnostics::log::tests::test_parse_time_range
PASS [ 0.027s] tikv server::service::diagnostics::log::tests::test_search
PASS [ 0.219s] tikv server::service::diagnostics::sys::tests::test_load_info
PASS [ 0.204s] tikv server::service::diagnostics::sys::tests::test_process_info
PASS [ 0.021s] tikv server::service::kv::tests::test_health_feedback_attacher
PASS [ 0.023s] tikv server::service::kv::tests::test_poll_future_notify_with_slow_source
PASS [ 11.051s] tests::integrations storage::test_storage::test_txn_store_resolve_lock2
PASS [ 2.487s] tikv server::gc_worker::gc_worker::tests::test_destroy_range
PASS [ 0.038s] tikv server::status_server::tests::test_config_endpoint
PASS [ 0.036s] tikv server::status_server::tests::test_get_engine_type
PASS [ 0.038s] tikv server::status_server::tests::test_pprof_heap_service
PASS [ 2.025s] tikv server::lock_manager::deadlock::tests::test_detect_table_expire
PASS [ 0.060s] tikv server::status_server::tests::test_security_status_service_with_cn_fail
PASS [ 0.045s] tikv server::status_server::tests::test_status_service
PASS [ 0.472s] tikv server::status_server::profile::tests::test_profile_guard_concurrency
PASS [ 0.040s] tikv server::status_server::tests::test_status_service_fail_endpoints_can_trigger_fails
PASS [ 0.021s] tikv storage::config::tests::test_adjust_shard_bits
PASS [ 0.031s] tikv storage::config::tests::test_validate_storage_config
PASS [ 0.080s] tikv storage::kv::test_engine_builder::tests::test_prefix_seek_skip_tombstone
PASS [ 0.089s] tikv storage::kv::test_engine_builder::tests::rocksdb_reopen
PASS [ 0.034s] tikv storage::lock_manager::lock_waiting_queue::tests::bench_update_lock_wait_empty
PASS [ 0.056s] tikv storage::kv::test_engine_builder::tests::test_rocksdb_statistic
PASS [ 0.025s] tikv storage::lock_manager::lock_waiting_queue::tests::test_popping_priority
PASS [ 0.028s] tikv storage::lock_manager::lock_waiting_queue::tests::test_simple_push_pop
PASS [ 0.323s] tikv server::status_server::tests::test_pprof_symbol_service
PASS [ 0.061s] tikv storage::mvcc::consistency_check::tests::test_mvcc_info_collector
PASS [ 0.113s] tikv storage::mvcc::reader::point_getter::tests::test_basic_1
PASS [ 0.103s] tikv storage::mvcc::reader::point_getter::tests::test_basic_3
PASS [ 0.345s] tikv storage::kv::test_engine_builder::tests::test_rocksdb_linear
PASS [ 0.078s] tikv storage::mvcc::reader::point_getter::tests::test_get_bypass_locks
PASS [ 0.089s] tikv storage::mvcc::reader::point_getter::tests::test_locked
PASS [ 0.092s] tikv storage::mvcc::reader::point_getter::tests::test_omit_value
PASS [ 0.091s] tikv storage::mvcc::reader::point_getter::tests::test_point_get_check_rc_ts
PASS [ 0.083s] tikv storage::mvcc::reader::point_getter::tests::test_point_get_with_checksum
PASS [ 0.081s] tikv storage::mvcc::reader::point_getter::tests::test_use_prefix_seek
PASS [ 0.060s] tikv storage::mvcc::reader::reader::tests::test_get
PASS [ 0.056s] tikv storage::mvcc::reader::reader::tests::test_get_txn_commit_record
PASS [ 0.067s] tikv storage::mvcc::reader::reader::tests::test_get_write
PASS [ 0.075s] tikv storage::mvcc::reader::reader::tests::test_get_write_second_get
PASS [ 0.064s] tikv storage::mvcc::reader::reader::tests::test_locks_interleaving_rollbacks
PASS [ 0.068s] tikv storage::mvcc::reader::reader::tests::test_scan_latest_user_keys
PASS [ 0.060s] tikv storage::mvcc::reader::reader::tests::test_seek_write
PASS [ 0.065s] tikv storage::mvcc::reader::reader::tests::test_ts_filter
PASS [ 0.631s] tikv storage::lock_manager::lock_waiting_queue::tests::test_delayed_notify_all
PASS [ 2.130s] tikv server::lock_manager::waiter_manager::tests::test_waiter_manager_timeout
PASS [ 0.133s] tikv storage::mvcc::reader::scanner::backward::tests::test_backward_scanner_check_gc_fence
PASS [ 0.156s] tikv storage::mvcc::reader::scanner::backward::tests::test_move_prev_user_key_out_of_bound_2
PASS [ 0.095s] tikv storage::mvcc::reader::scanner::forward::delta_entry_tests::test_get_out_of_bound
PASS [ 0.160s] tikv storage::mvcc::reader::scanner::backward::tests::test_range
PASS [ 0.144s] tikv storage::mvcc::reader::scanner::backward::tests::test_reverse_get_out_of_bound_1
PASS [ 0.088s] tikv storage::mvcc::reader::scanner::forward::delta_entry_tests::test_move_next_user_key_out_of_bound_1
PASS [ 0.093s] tikv storage::mvcc::reader::scanner::forward::delta_entry_tests::test_range
PASS [ 14.692s] tests::integrations storage::test_storage::test_txn_store_gc2_with_many_keys
PASS [ 0.127s] tikv storage::mvcc::reader::scanner::forward::delta_entry_tests::test_old_value_check_gc_fence
PASS [ 0.082s] tikv storage::mvcc::reader::scanner::forward::latest_entry_tests::test_move_next_user_key_out_of_bound_2
PASS [ 0.115s] tikv storage::mvcc::reader::scanner::forward::latest_entry_tests::test_latest_entry_check_gc_fence
PASS [ 0.395s] tikv storage::mvcc::reader::scanner::backward::tests::test_many_tombstones
PASS [ 0.093s] tikv storage::mvcc::reader::scanner::forward::latest_entry_tests::test_range
PASS [ 0.080s] tikv storage::mvcc::reader::scanner::forward::latest_kv_tests::test_move_next_user_key_out_of_bound_2
PASS [ 5.142s] tikv import::raft_writer::test::test_inflight_max
PASS [ 0.091s] tikv storage::mvcc::reader::scanner::forward::latest_kv_tests::test_rc_read_check_ts
PASS [ 0.110s] tikv storage::mvcc::reader::scanner::forward::latest_kv_tests::test_latest_kv_check_gc_fence
PASS [ 0.094s] tikv storage::mvcc::txn::tests::test_async_commit_pushed_min_commit_ts
PASS [ 0.095s] tikv storage::mvcc::txn::tests::test_async_prewrite_primary
PASS [ 0.094s] tikv storage::mvcc::txn::tests::test_commit_pessimistic_lock
PASS [ 0.160s] tikv storage::mvcc::reader::scanner::tests::test_rc_scan_skip_lock
PASS [ 0.148s] tikv storage::mvcc::reader::scanner::tests::test_scan_bypass_locks
PASS [ 0.259s] tikv storage::mvcc::reader::scanner::tests::test_met_newer_ts_data
PASS [ 0.083s] tikv storage::mvcc::txn::tests::test_mvcc_txn_pessimistic_prewrite_check_not_exist
PASS [ 0.082s] tikv storage::mvcc::txn::tests::test_mvcc_txn_prewrite_check_not_exist
PASS [ 0.082s] tikv storage::mvcc::txn::tests::test_mvcc_txn_rollback_after_commit
PASS [ 0.079s] tikv storage::mvcc::txn::tests::test_non_pessimistic_lock_conflict_with_optimistic_txn
PASS [ 0.154s] tikv storage::mvcc::txn::tests::test_mvcc_txn_read
PASS [ 0.085s] tikv storage::mvcc::txn::tests::test_pessimistic_txn_ttl
PASS [ 0.094s] tikv storage::mvcc::txn::tests::test_overlapped_ts_commit_before_rollback
PASS [ 0.094s] tikv storage::mvcc::txn::tests::test_rollback_del
PASS [ 0.243s] tikv storage::mvcc::txn::tests::test_gc_fence
PASS [ 0.098s] tikv storage::mvcc::txn::tests::test_scan_values_in_default
PASS [ 0.130s] tikv storage::mvcc::txn::tests::test_rollback_lock_pessimistic
PASS [ 0.115s] tikv storage::mvcc::txn::tests::test_skip_constraint_check
PASS [ 0.135s] tikv storage::mvcc::txn::tests::test_rollback_while_other_transaction_running
PASS [ 0.074s] tikv storage::raw::raw_mvcc::tests::test_raw_mvcc_snapshot
PASS [ 0.021s] tikv storage::tests::test_check_api_version_ranges
PASS [ 0.167s] tikv storage::mvcc::txn::tests::test_write
PASS [ 50.873s] tests::integrations server::kv_service::test_mvcc_flashback::test_raftstore_must_new_cluster_and_kv_client
PASS [ 0.707s] tikv storage::mvcc::reader::scanner::tests::test_scan_with_lock_and_write
PASS [ 0.517s] tikv storage::tests::test_batch_get
PASS [ 0.483s] tikv storage::tests::test_check_txn_status
PASS [ 0.544s] tikv storage::tests::test_cf_error
PASS [ 0.500s] tikv storage::tests::test_disable_in_memory_pessimistic_locks
PASS [ 0.643s] tikv storage::tests::test_check_memory_locks
PASS [ 0.713s] tikv storage::tests::test_cleanup_check_ttl
PASS [ 0.576s] tikv storage::tests::test_flashback_to_version_deleted_key
PASS [ 0.691s] tikv storage::tests::test_flashback_to_version_lock
PASS [ 0.603s] tikv storage::tests::test_high_priority_get_put
PASS [ 0.618s] tikv storage::tests::test_mvcc_flashback_retry_prepare
PASS [ 0.490s] tikv storage::tests::test_prewrite_cached_committed_transaction_do_not_skip_constraint_check
PASS [ 0.823s] tikv storage::tests::test_raw_get_key_ttl
PASS [ 1.306s] tikv storage::tests::test_raw_batch_get
PASS [ 1.574s] tikv storage::tests::test_pessimistic_lock
PASS [ 1.127s] tikv storage::tests::test_raw_checksum
PASS [ 1.318s] tikv storage::tests::test_raw_scan
PASS [ 0.567s] tikv storage::tests::test_read_access_locks
PASS [ 1.993s] tikv storage::tests::test_pessimistic_rollback_with_scan_first
PASS [ 0.679s] tikv storage::tests::test_scan
PASS [ 1.921s] tikv storage::tests::test_raw_delete
PASS [ 0.919s] tikv storage::tests::test_scan_lock_with_memory_lock
PASS [ 0.116s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_acquire_pessimistic_lock_should_not_exist
PASS [ 0.205s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_check_existence
PASS [ 0.126s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_lock_with_conflict_lock_only_if_exists
PASS [ 0.729s] tikv storage::tests::test_updating_txn_status_cache
PASS [ 0.792s] tikv storage::tests::test_txn
PASS [ 0.521s] tikv storage::tests::test_write_in_memory_pessimistic_locks
PASS [ 0.120s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_old_value_for_update_ts
PASS [ 0.118s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_pessimistic_lock_only_if_exists
PASS [ 0.146s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_pessimistic_lock
PASS [ 0.133s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_repeated_request_check_should_not_exist
PASS [ 0.099s] tikv storage::txn::actions::cleanup::tests::test_cleanup
PASS [ 0.106s] tikv storage::txn::actions::commit::tests::test_inherit_last_change_info_from_lock
PASS [ 0.095s] tikv storage::txn::actions::flashback_to_version::tests::test_duplicated_flashback_write_to_version
PASS [ 0.174s] tikv storage::txn::actions::commit::tests::test_2pc_with_txn_source
PASS [ 0.159s] tikv storage::txn::actions::commit::tests::test_commit_ok
PASS [ 0.100s] tikv storage::txn::actions::flashback_to_version::tests::test_flashback_write_to_version_pessimistic
PASS [ 0.080s] tikv storage::txn::actions::prewrite::tests::test_1pc_check_max_commit_ts
PASS [ 0.148s] tikv storage::txn::actions::flashback_to_version::tests::test_flashback_write_to_version
PASS [ 0.137s] tikv storage::txn::actions::gc::tests::test_gc
PASS [ 0.077s] tikv storage::txn::actions::prewrite::tests::test_async_commit_prewrite_min_commit_ts
PASS [ 0.113s] tikv storage::txn::actions::prewrite::tests::test_async_commit_pessimistic_prewrite_check_max_commit_ts
PASS [ 0.091s] tikv storage::txn::actions::prewrite::tests::test_inherit_last_change_ts_from_pessimistic_lock
PASS [ 0.096s] tikv storage::txn::actions::prewrite::tests::test_pessimistic_amend_txn_calculate_last_change_ts
PASS [ 0.128s] tikv storage::txn::actions::prewrite::tests::test_old_value_rollback_and_lock
PASS [ 0.123s] tikv storage::txn::actions::prewrite::tests::test_prewrite_check_gc_fence
PASS [ 1.464s] tikv storage::tests::test_sched_too_busy
PASS [ 3.164s] tikv storage::tests::test_raw_batch_put
PASS [ 0.145s] tikv storage::txn::actions::prewrite::tests::test_resend_prewrite_non_pessimistic_lock
PASS [ 0.107s] tikv storage::txn::commands::check_txn_status::tests::test_check_txn_status_resolving_pessimistic_lock
PASS [ 0.090s] tikv storage::txn::commands::check_txn_status::tests::test_check_txn_status_rollback_optimistic
PASS [ 0.203s] tikv storage::txn::commands::atomic_store::tests::test_atomic_process_write
PASS [ 0.179s] tikv storage::txn::commands::check_txn_status::tests::test_check_async_commit_txn_status
PASS [ 0.094s] tikv storage::txn::commands::check_txn_status::tests::test_verify_is_primary
PASS [ 0.111s] tikv storage::txn::commands::flush::tests::test_flush_out_of_order
PASS [ 0.091s] tikv storage::txn::commands::flush::tests::test_flush_overwrite_assertion
PASS [ 0.159s] tikv storage::txn::commands::compare_and_swap::tests::test_cas_process_write
PASS [ 0.096s] tikv storage::txn::commands::flush::tests::test_write_conflict
PASS [ 0.143s] tikv storage::txn::commands::prewrite::tests::test_1pc_calculate_last_change_ts
PASS [ 0.088s] tikv storage::txn::commands::prewrite::tests::test_pessimistic_1pc_calculate_last_change_ts
PASS [ 0.085s] tikv storage::txn::commands::prewrite::tests::test_pessimistic_prewrite_committed_transaction
PASS [ 0.112s] tikv storage::txn::commands::prewrite::tests::test_optimistic_prewrite_committed_transaction
PASS [ 0.104s] tikv storage::txn::commands::prewrite::tests::test_prewrite_1pc_with_txn_source
PASS [ 0.091s] tikv storage::txn::commands::prewrite::tests::test_prewrite_pessimsitic_async_commit
PASS [ 0.117s] tikv storage::txn::commands::prewrite::tests::test_prewrite_committed_encounter_newer_lock
PASS [ 0.160s] tikv storage::txn::commands::prewrite::tests::test_repeated_prewrite_commit_ts_too_large
PASS [ 0.192s] tikv storage::txn::commands::prewrite::tests::test_prewrite_should_not_exist
PASS [ 0.197s] tikv storage::txn::commands::prewrite::tests::test_prewrite_skip_too_many_tombstone
PASS [ 0.022s] tikv storage::txn::flow_controller::singleton_flow_controller::tests::test_smoother
PASS [ 0.153s] tikv storage::txn::commands::txn_heart_beat::tests::test_txn_heart_beat
PASS [ 0.029s] tikv storage::txn::flow_controller::tablet_flow_controller::tests::test_tablet_flow_controller_basic
PASS [ 0.035s] tikv storage::txn::flow_controller::tablet_flow_controller::tests::test_tablet_flow_controller_pending_compaction_bytes
PASS [ 0.023s] tikv storage::txn::latch::tests::test_wakeup
PASS [ 0.025s] tikv storage::txn::latch::tests::test_wakeup_by_small_latch_slot
PASS [ 2.642s] tikv storage::tests::test_resolve_lock
PASS [ 0.601s] tikv storage::txn::commands::prewrite::tests::test_response_stage
PASS [ 0.535s] tikv storage::txn::scheduler::tests::test_acquire_latch_deadline
PASS [ 0.548s] tikv storage::txn::scheduler::tests::test_flow_control_trottle_deadline
PASS [ 0.026s] tikv storage::txn::store::benches::bench_fixture_get
PASS [ 0.363s] tikv storage::txn::scheduler::tests::test_pool_available_deadline
PASS [ 0.074s] tikv storage::txn::store::benches::bench_fixture_scanner_next
PASS [ 0.023s] tikv storage::txn::store::tests::test_fixture_get
PASS [ 0.113s] tikv storage::txn::store::tests::test_scan_with_bound
PASS [ 0.130s] tikv storage::txn::store::tests::test_snapshot_store_batch_get
PASS [ 1.029s] tikv storage::txn::flow_controller::singleton_flow_controller::tests::test_flow_controller_pending_compaction_bytes
PASS [ 0.029s] tikv storage::txn::store::tests::test_txn_entry_size
PASS [ 0.138s] tikv storage::txn::store::tests::test_snapshot_store_reverse_scan
PASS [ 0.029s] tikv storage::txn::txn_status_cache::tests::test_evicting_expired
PASS [ 0.027s] tikv storage::txn::txn_status_cache::tests::test_setting_capacity
PASS [ 0.020s] tikv-ctl::bin/tikv-ctl fork_readonly_tikv::tests::test_rocksdb_files_should_copy
PASS [ 0.518s] tikv storage::txn::scheduler::tests::test_schedule_command_with_fail_fast_mode
PASS [ 0.015s] tikv-ctl::bin/tikv-ctl util::tests::test_from_hex
PASS [ 0.018s] tikv_alloc imp::profiling::tests::test_profiling_active
PASS [ 0.020s] tikv_alloc imp::tests::dump_stats
PASS [ 0.016s] tikv_alloc trace::tests::test_id_name
PASS [ 0.014s] tikv_alloc trace::tests::test_mem_trace_macro
PASS [ 0.014s] tikv_kv btree_engine::tests::test_get_not_exist_cf
PASS [ 0.027s] tikv_kv btree_engine::tests::test_bounds_of_btree_engine
PASS [ 0.052s] tikv_kv cursor::tests::test_reverse_iterate
PASS [ 0.017s] tikv_kv unit_tests::test_modifies_to_requests
PASS [ 0.018s] tikv_util buffer_vec::tests::test_basic
PASS [ 0.014s] tikv_util buffer_vec::tests::test_iter
PASS [ 0.013s] tikv_util callback::tests::test_called
PASS [ 0.014s] tikv_util codec::bytes::tests::bench_decode
PASS [ 0.368s] tikv storage::txn::txn_status_cache::tests::bench_get_100000
PASS [ 0.014s] tikv_util codec::bytes::tests::bench_decode_inplace_small
PASS [ 0.014s] tikv_util codec::bytes::tests::bench_encode
PASS [ 0.382s] tikv storage::txn::txn_status_cache::tests::bench_insert_100000
PASS [ 0.017s] tikv_util codec::bytes::tests::bench_is_encoded_from_small
PASS [ 0.012s] tikv_util codec::bytes::tests::test_compact_codec_for_file
PASS [ 0.014s] tikv_util codec::bytes::tests::test_enc_dec_bytes
PASS [ 0.012s] tikv_util codec::number::tests::encode_f64::serialize
PASS [ 0.021s] tikv_util codec::bytes::tests::test_is_encoded_from
PASS [ 0.015s] tikv_util codec::number::tests::encode_f64_desc::serialize
PASS [ 0.012s] tikv_util codec::number::tests::encode_i64::serialize
PASS [ 0.013s] tikv_util codec::number::tests::encode_i64_desc::serialize
PASS [ 0.013s] tikv_util codec::number::tests::encode_u16::serialize
PASS [ 0.012s] tikv_util codec::number::tests::encode_u32::serialize
PASS [ 0.011s] tikv_util codec::number::tests::encode_u64::serialize
PASS [ 0.016s] tikv_util codec::number::tests::encode_u64_desc::serialize
PASS [ 0.013s] tikv_util codec::number::tests::f64_desc_eof
PASS [ 0.020s] tikv_util codec::number::tests::i64_desc_eof
PASS [ 0.018s] tikv_util codec::number::tests::test_var_eof
PASS [ 0.018s] tikv_util codec::number::tests::test_var_u64_codec
PASS [ 1.446s] tikv storage::txn::flow_controller::tablet_flow_controller::tests::test_tablet_flow_controller_life_cycle
PASS [ 0.018s] tikv_util codec::number::tests::u64_eof
PASS [ 0.013s] tikv_util codec::number::tests::var_u16_codec
PASS [ 0.019s] tikv_util codec::number::tests::var_u64_little_endian_codec
PASS [ 0.027s] tikv_util codec::number::tests::var_i64_codec
PASS [ 0.015s] tikv_util codec::stream_event::tests::test_encode_decode
PASS [ 0.025s] tikv_util config::check_data_dir::tests::test_check_data_dir
PASS [ 0.015s] tikv_util config::check_data_dir::tests::test_get_rotational_info
PASS [ 0.019s] tikv_util config::tests::test_check_addrs
PASS [ 0.015s] tikv_util config::tests::test_check_kernel
PASS [ 0.015s] tikv_util config::tests::test_get_file_count
PASS [ 0.015s] tikv_util config::tests::test_must_remove_except
PASS [ 0.015s] tikv_util config::tests::test_parse_readable_size
PASS [ 0.012s] tikv_util config::tests::test_readable_offset_time
PASS [ 0.012s] tikv_util config::tests::test_readable_size
PASS [ 0.015s] tikv_util config::tests::test_update_empty_content
PASS [ 0.016s] tikv_util future::tests::test_try_poll
PASS [ 0.032s] tikv_util config::tests::test_raft_data_migration
PASS [ 0.019s] tikv_util log::tests::test_format_kv
PASS [ 0.013s] tikv_util logger::file_log::tests::test_get_datetime_from_filename
PASS [ 0.012s] tikv_util logger::formatter::tests::test_need_escape
PASS [ 0.014s] tikv_util logger::tests::test_get_level_by_string
PASS [ 0.379s] tikv_kv btree_engine::tests::test_linear_of_btree_engine
PASS [ 0.014s] tikv_util logger::tests::test_global_level_filter
PASS [ 0.019s] tikv_util logger::tests::test_log_format_text
PASS [ 0.021s] tikv_util logger::tests::test_slow_log_dispatcher
PASS [ 0.016s] tikv_util lru::tests::test_empty
PASS [ 0.019s] tikv_util lru::tests::test_insert
PASS [ 0.025s] tikv_util lru::tests::test_oversized
PASS [ 0.021s] tikv_util lru::tests::test_remove
PASS [ 0.013s] tikv_util lru::tests::test_sample
PASS [ 0.013s] tikv_util math::tests::test_monotonic_sequence
PASS [ 0.022s] tikv_util macros::tests::test_box_error
PASS [ 0.013s] tikv_util memory::tests::test_alloc_force
PASS [ 0.014s] tikv_util memory::tests::test_approximate_heap_size
PASS [ 0.015s] tikv_util metrics::tests::test_dump_metrics
PASS [ 0.017s] tikv_util metrics::threads_linux::tests::test_smoke
PASS [ 0.042s] tikv_util memory::tests::test_memory_quota_multi_thread
PASS [ 0.035s] tikv_util mpsc::future::tests::test_batch_receiver
PASS [ 0.014s] tikv_util mpsc::future::tests::test_drop
PASS [ 0.013s] tikv_util mpsc::future::tests::test_switch_between_sender_and_receiver
PASS [ 0.115s] tikv_util mpsc::priority_queue::tests::test_priority
PASS [ 2.029s] tikv storage::txn::flow_controller::singleton_flow_controller::tests::test_flow_controller_l0
PASS [ 0.219s] tikv_util mpsc::tests::test_unbounded
PASS [ 0.015s] tikv_util resource_control::tests::test_task_metadata
PASS [ 0.014s] tikv_util store::peer::tests::test_peer
PASS [ 0.322s] tikv_util mpsc::tests::test_bounded
PASS [ 0.013s] tikv_util store::tests::test_check_region_on_store
PASS [ 0.013s] tikv_util sys::cgroup::tests::test_cgroup_path_with_semicolon
PASS [ 0.013s] tikv_util sys::cgroup::tests::test_conflicting_mountinfo
PASS [ 0.013s] tikv_util sys::cgroup::tests::test_defult_cgroup_sys
PASS [ 0.013s] tikv_util sys::cgroup::tests::test_parse_cpu_cores
PASS [ 0.014s] tikv_util sys::cgroup::tests::test_parse_cpu_quota_v2
PASS [ 0.013s] tikv_util sys::cgroup::tests::test_parse_mountinfos_without_cgroup
PASS [ 0.014s] tikv_util sys::cgroup::tests::test_parse_proc_cgroup_v2
PASS [ 0.015s] tikv_util sys::inspector::tests::test_thread_inspector_disk_stat
PASS [ 0.015s] tikv_util sys::tests::test_get_path_mount_point
PASS [ 0.015s] tikv_util sys::thread::imp::tests::test_set_priority
PASS [ 0.029s] tikv_util sys::thread::tests::test_thread_ids
PASS [ 0.015s] tikv_util tests::test_defer
PASS [ 0.016s] tikv_util tests::test_is_zero
PASS [ 0.015s] tikv_util tests::test_must_consume_vec_dtor_not_abort
PASS [ 0.013s] tikv_util tests::test_panic_mark_file_exists
PASS [ 0.013s] tikv_util tests::test_resource_leak
PASS [ 0.017s] tikv_util tests::test_slices_vec_deque
PASS [ 0.014s] tikv_util time::tests::bench_instant_now
PASS [ 1.016s] tikv_util logger::file_log::tests::test_archive_with_illegal_log_name_will_not_cause_panic
PASS [ 0.014s] tikv_util time::tests::test_instant
PASS [ 0.339s] tikv_util time::tests::test_coarse_instant_on_smp
PASS [ 0.117s] tikv_util timer::tests::test_global_timer
PASS [ 0.020s] tikv_util topn::tests::test_0_capacity
PASS [ 0.013s] tikv_util topn::tests::test_trivial
PASS [ 0.017s] tikv_util worker::future::tests::test_future_worker
PASS [ 0.018s] tikv_util worker::tests::test_pending_capacity
PASS [ 0.227s] tikv_util worker::tests::test_worker
PASS [ 0.029s] tikv_util yatp_pool::future_pool::tests::test_handle_result
PASS [ 0.031s] tikv_util yatp_pool::future_pool::tests::test_scale_pool_size
PASS [ 1.922s] tikv_util logger::file_log::tests::test_archive_by_max_days_after_rotate
PASS [ 1.028s] tikv_util time::tests::test_time_monitor
PASS [ 0.121s] tikv_util yatp_pool::tests::test_record_schedule_wait_duration
PASS [ 0.012s] tikv_util::bench/channel bench_channel::bench_crossbeam_channel
PASS [ 0.016s] tikv_util::bench/channel bench_channel::bench_receiver_stream_unbounded_nobatch
PASS [ 0.013s] tikv_util::bench/channel bench_channel::bench_util_channel
PASS [ 2.041s] tikv_util metrics::threads_linux::tests::test_thread_io_statistics
PASS [ 0.014s] tracker slab::tests::test_basic
PASS [ 0.319s] tikv_util yatp_pool::tests::test_cleanup_in_place_by_default
PASS [ 0.021s] tracker slab::tests::test_tracker_token
PASS [ 0.016s] txn_types lock::tests::test_check_ts_conflict
PASS [ 0.012s] txn_types lock::tests::test_customize_debug
PASS [ 0.018s] txn_types lock::tests::test_lock_type
PASS [ 0.019s] txn_types lock::tests::test_pessimistic_lock_memory_size
PASS [ 0.022s] txn_types timestamp::tests::test_split_ts
PASS [ 0.021s] txn_types types::tests::test_flags
PASS [ 0.027s] txn_types timestamp::tests::test_ts_set
PASS [ 0.022s] txn_types types::tests::test_is_encoded_from
PASS [ 0.016s] txn_types types::tests::test_old_value_resolved
PASS [ 0.014s] txn_types write::tests::test_check_gc_fence
PASS [ 0.015s] txn_types write::tests::test_write
PASS [ 3.229s] tikv_util logger::file_log::tests::test_archive_by_max_backups_after_rotate
PASS [ 5.549s] tikv storage::txn::actions::prewrite::tests::test_old_value_random
PASS [ 4.020s] tikv_util yatp_pool::future_pool::tests::test_tick_multi_thread
PASS [ 5.271s] tikv_util stream::tests::test_failure
PASS [ 11.435s] tikv storage::txn::actions::acquire_pessimistic_lock::tests::test_old_value_random
------------
Summary [ 521.863s] 1986 tests run: 1983 passed (1 slow, 12 flaky), 3 failed, 1970 skipped
FLAKY 2/3 [ 2.365s] file_system rate_limiter::tests::test_rate_limited_hybrid_flow
FLAKY 2/3 [ 1.718s] raftstore-v2::raftstore-v2-integrations test_pd_heartbeat::test_store_heartbeat
FLAKY 2/3 [ 4.518s] tests::failpoints cases::test_disk_full::test_almost_and_already_full_behavior::test_raftstore_new_server_cluster
FLAKY 2/3 [ 3.403s] tests::failpoints cases::test_rawkv::test_raw_put_key_guard
FLAKY 3/3 [ 3.906s] tests::failpoints cases::test_witness::test_witness_not_reported_while_disabled
FLAKY 3/3 [ 7.452s] tests::integrations raftstore::test_compact_log::test_node_compact_log
FLAKY 2/3 [ 6.302s] tests::integrations raftstore::test_conf_change::test_conf_change_safe::test_raftstore_v2_new_node_cluster
FLAKY 2/3 [ 3.514s] tests::integrations raftstore::test_hibernate::test_hibernate_feature_gate
FLAKY 2/3 [ 9.046s] tests::integrations raftstore::test_split_region::test_server_split_region_twice::test_raftstore_new_server_cluster
FLAKY 3/3 [ 4.250s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_on_hibernated_leader
FLAKY 2/3 [ 14.804s] tests::integrations raftstore::test_unsafe_recovery::test_force_leader_twice_on_different_peers::test_raftstore_v2_new_node_cluster
FLAKY 2/3 [ 13.916s] tests::integrations raftstore::test_witness::test_witness_election_priority
TRY 3 FAIL [ 1.851s] tests::failpoints cases::test_import_service::test_delete_sst_after_applied_sst
--- TRY 3 STDOUT: tests::failpoints cases::test_import_service::test_delete_sst_after_applied_sst ---
running 1 test
test cases::test_import_service::test_delete_sst_after_applied_sst ... FAILED
failures:
failures:
cases::test_import_service::test_delete_sst_after_applied_sst
test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 369 filtered out; finished in 1.80s
--- TRY 3 STDERR: tests::failpoints cases::test_import_service::test_delete_sst_after_applied_sst ---
thread 'cases::test_import_service::test_delete_sst_after_applied_sst' panicked at tests/failpoints/cases/test_import_service.rs:303:5:
assertion `left == right` failed
left: 1
right: 0
stack backtrace:
0: rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
1: core::panicking::panic_fmt
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
2: core::panicking::assert_failed_inner
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:342:17
3: core::panicking::assert_failed
4: failpoints::cases::test_import_service::test_delete_sst_after_applied_sst
at /home/jenkins/tikv-src/tests/failpoints/cases/test_import_service.rs:303:5
5: failpoints::cases::test_import_service::test_delete_sst_after_applied_sst::{{closure}}
at /home/jenkins/tikv-src/tests/failpoints/cases/test_import_service.rs:284:39
6: core::ops::function::FnOnce::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/ops/function.rs:250:5
7: test_util::runner::run_test_with_hook::{{closure}}::{{closure}}
8: core::ops::function::FnOnce::call_once{{vtable.shim}}
9: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
TRY 3 ABRT [ 7.534s] tests::failpoints cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state
--- TRY 3 STDOUT: tests::failpoints cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state ---
running 1 test
--- TRY 3 STDERR: tests::failpoints cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state ---
thread 'raftstore-1-0::test_update_apply_index_before_sync_read_state' panicked at /rust/registry/src/index.crates.io-6f17d22bba15001f/fail-0.5.1/src/lib.rs:496:25:
failpoint on_step_read_index_msg panic
stack backtrace:
0: rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
1: core::panicking::panic_fmt
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
2: fail::FailPoint::eval
3: fail::eval
4: raftstore::store::peer::Peer<EK,ER>::step
5: raftstore::store::fsm::peer::PeerFsmDelegate<EK,ER,T>::on_raft_message
6: raftstore::store::fsm::peer::PeerFsmDelegate<EK,ER,T>::handle_msgs
7: <raftstore::store::fsm::store::RaftPoller<EK,ER,T> as batch_system::batch::PollHandler<raftstore::store::fsm::peer::PeerFsm<EK,ER>,raftstore::store::fsm::store::StoreFsm<EK>>>::handle_normal
8: batch_system::batch::Poller<N,C,Handler>::poll
9: batch_system::batch::BatchSystem<N,C>::start_poller::{{closure}}
10: <std::thread::Builder as tikv_util::sys::thread::StdThreadBuildWrapper>::spawn_wrapper::{{closure}}
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
thread 'sched-worker-pool::test_update_apply_index_before_sync_read_state-0' panicked at /home/jenkins/tikv-src/src/storage/txn/scheduler.rs:903:25:
undetermined error: Error(Undetermined("async write on_applied callback is dropped")) cid=4, tag=prewrite, process result=Some(PrewriteResult { result: PrewriteResult { locks: [], min_commit_ts: TimeStamp(0), one_pc_commit_ts: TimeStamp(0) } })
stack backtrace:
0: rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
1: core::panicking::panic_fmt
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
2: tikv::storage::txn::scheduler::TxnScheduler<E,L>::on_write_finished
3: tikv::storage::txn::scheduler::TxnScheduler<E,L>::process_write::{{closure}}
4: tikv::storage::txn::scheduler::TxnScheduler<E,L>::process::{{closure}}::{{closure}}
5: <resource_metering::InTags<T> as core::future::future::Future>::poll
6: tikv::storage::txn::scheduler::TxnScheduler<E,L>::process::{{closure}}
7: tikv::storage::txn::scheduler::TxnScheduler<E,L>::execute::{{closure}}
8: <futures_util::future::future::map::Map<Fut,F> as core::future::future::Future>::poll
9: <futures_util::future::future::Map<Fut,F> as core::future::future::Future>::poll
10: <tracker::tls::TrackedFuture<F> as core::future::future::Future>::poll::{{closure}}
11: std::thread::local::LocalKey<T>::try_with
12: std::thread::local::LocalKey<T>::with
13: <tracker::tls::TrackedFuture<F> as core::future::future::Future>::poll
14: <futures_util::future::future::map::Map<Fut,F> as core::future::future::Future>::poll
15: <futures_util::future::future::Map<Fut,F> as core::future::future::Future>::poll
16: yatp::task::future::RawTask<F>::poll
17: yatp::task::future::TaskCell::poll
18: <yatp::task::future::Runner as yatp::pool::runner::Runner>::handle
19: <tikv_util::yatp_pool::YatpPoolRunner<T> as yatp::pool::runner::Runner>::handle
20: yatp::pool::worker::WorkerThread<T,R>::run
21: yatp::pool::builder::LazyBuilder<T>::build::{{closure}}
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
thread 'cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state' panicked at components/test_raftstore/src/util.rs:1085:59:
called `Result::unwrap()` on an `Err` value: RpcFailure(RpcStatus { code: 1-CANCELLED, message: "CANCELLED", details: [] })
stack backtrace:
0: rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
1: core::panicking::panic_fmt
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
2: core::result::unwrap_failed
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/result.rs:1649:5
3: core::result::Result<T,E>::unwrap
4: test_raftstore::util::must_kv_prewrite_with
5: test_raftstore::util::must_kv_prewrite
6: test_raftstore::util::must_kv_write
7: test_raftstore::util::PeerClient::must_kv_write
8: failpoints::cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state
at /home/jenkins/tikv-src/tests/failpoints/cases/test_replica_stale_read.rs:251:5
9: failpoints::cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state::{{closure}}
at /home/jenkins/tikv-src/tests/failpoints/cases/test_replica_stale_read.rs:215:52
10: core::ops::function::FnOnce::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/ops/function.rs:250:5
11: test_util::runner::run_test_with_hook::{{closure}}::{{closure}}
12: core::ops::function::FnOnce::call_once{{vtable.shim}}
13: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
thread 'cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state' panicked at /rust/git/checkouts/yatp-e704b73c3ee279b6/793be4d/src/pool.rs:72:26:
called `Result::unwrap()` on an `Err` value: Any { .. }
stack backtrace:
0: 0x55744e0752c6 - std::backtrace_rs::backtrace::libunwind::trace::h0c778a97139c185f
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
1: 0x55744e0752c6 - std::backtrace_rs::backtrace::trace_unsynchronized::h49275f7f11d03db8
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
2: 0x55744e0752c6 - std::sys_common::backtrace::_print_fmt::hc6d2af0f9113f87c
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:68:5
3: 0x55744e0752c6 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h4269025391cee804
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:44:22
4: 0x55744e0a6ef0 - core::fmt::rt::Argument::fmt::h47e13179bda442d0
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/fmt/rt.rs:142:9
5: 0x55744e0a6ef0 - core::fmt::write::h0ea06241e192b662
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/fmt/mod.rs:1120:17
6: 0x55744e07156f - std::io::Write::write_fmt::hada0a89348d2eeaf
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/io/mod.rs:1810:15
7: 0x55744e0750a4 - std::sys_common::backtrace::_print::h474b180b0f0cbfaa
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:47:5
8: 0x55744e0750a4 - std::sys_common::backtrace::print::h292cdb95c9f3ed37
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:34:9
9: 0x55744e076c97 - std::panicking::default_hook::{{closure}}::h215c742b61103c6e
10: 0x55744e0769f9 - std::panicking::default_hook::h57e29db39f9afc40
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:292:9
11: 0x55744e077128 - std::panicking::rust_panic_with_hook::hdec91a2b4b229c0a
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:779:13
12: 0x55744e077002 - std::panicking::begin_panic_handler::{{closure}}::h307c36ea28011ec5
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:657:13
13: 0x55744e0757c6 - std::sys_common::backtrace::__rust_end_short_backtrace::h4a40c8d6f1eb7696
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:171:18
14: 0x55744e076d60 - rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
15: 0x557446e63b75 - core::panicking::panic_fmt::h5740899885667996
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
16: 0x557446e641b3 - core::result::unwrap_failed::hede68b820f4ed9a9
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/result.rs:1649:5
17: 0x55744cbe8147 - core::result::Result<T,E>::unwrap::h8d6eb9ff419bb8e8
18: 0x55744cbdb34e - yatp::pool::ThreadPool<T>::shutdown::h6ebb7d5a283ee333
19: 0x55744cbdc4ca - <yatp::pool::ThreadPool<T> as core::ops::drop::Drop>::drop::h6431c1fbc303fdc3
20: 0x55744cbfecd5 - core::ptr::drop_in_place<yatp::pool::ThreadPool<yatp::task::future::TaskCell>>::he90eecd0bdccbff1
21: 0x55744cbfe775 - core::ptr::drop_in_place<tikv_util::yatp_pool::future_pool::PoolInner>::h42cf90395f2c1d61
22: 0x55744cc11459 - alloc::sync::Arc<T,A>::drop_slow::h3f59b0e77dc69eda
23: 0x55744cc11a70 - <alloc::sync::Arc<T,A> as core::ops::drop::Drop>::drop::h26f268301c118d76
24: 0x55744cbff29a - core::ptr::drop_in_place<alloc::sync::Arc<tikv_util::yatp_pool::future_pool::PoolInner>>::hbfdd5975bf8b8e89
25: 0x55744cbfe7ca - core::ptr::drop_in_place<tikv_util::yatp_pool::future_pool::FuturePool>::h0996bfe3f96671ee
26: 0x5574491e7376 - core::ptr::drop_in_place<tikv::storage::txn::sched_pool::VanillaQueue>::he9a6e76f28454700
27: 0x5574491e5805 - core::ptr::drop_in_place<tikv::storage::txn::sched_pool::SchedPool>::h6c31871adfb4e490
28: 0x55744918aef0 - core::ptr::drop_in_place<tikv::storage::txn::scheduler::TxnSchedulerInner<tikv::server::lock_manager::LockManager>>::h3b52977c1494bfae
29: 0x5574492d671c - alloc::sync::Arc<T,A>::drop_slow::hceb841ca120847d6
30: 0x5574492e1fb0 - <alloc::sync::Arc<T,A> as core::ops::drop::Drop>::drop::h19b4e2da26b6fc47
31: 0x5574491964ea - core::ptr::drop_in_place<alloc::sync::Arc<tikv::storage::txn::scheduler::TxnSchedulerInner<tikv::server::lock_manager::LockManager>>>::h9f4b530b6d612ea0
32: 0x5574482f299a - core::ptr::drop_in_place<tikv::storage::txn::scheduler::TxnScheduler<tikv::server::raftkv::RaftKv<engine_rocks::engine::RocksEngine,test_raftstore::transport_simulate::SimulateTransport<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>,engine_rocks::engine::RocksEngine>>,tikv::server::lock_manager::LockManager>>::hf0a89197916be9a4
33: 0x5574482f25ab - core::ptr::drop_in_place<tikv::storage::Storage<tikv::server::raftkv::RaftKv<engine_rocks::engine::RocksEngine,test_raftstore::transport_simulate::SimulateTransport<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>,engine_rocks::engine::RocksEngine>>,tikv::server::lock_manager::LockManager,api_version::ApiV1>>::h04874431328c372f
34: 0x5574482f3f4b - core::ptr::drop_in_place<tikv::server::service::kv::Service<tikv::server::raftkv::RaftKv<engine_rocks::engine::RocksEngine,test_raftstore::transport_simulate::SimulateTransport<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>,engine_rocks::engine::RocksEngine>>,tikv::server::lock_manager::LockManager,api_version::ApiV1>>::h951893d180f7309f
35: 0x55744830a805 - core::ptr::drop_in_place<tikv::server::server::BuilderFactory<tikv::server::service::kv::Service<tikv::server::raftkv::RaftKv<engine_rocks::engine::RocksEngine,test_raftstore::transport_simulate::SimulateTransport<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>,engine_rocks::engine::RocksEngine>>,tikv::server::lock_manager::LockManager,api_version::ApiV1>>>::hc07f44e0b3fb1704
36: 0x5574491f349b - core::ptr::drop_in_place<alloc::boxed::Box<dyn tikv::server::server::GrpcBuilderFactory>>::hd6760294d9ca21c0
37: 0x5574482f112d - core::ptr::drop_in_place<tikv::server::server::Server<tikv::server::resolve::PdStoreAddrResolver,tikv::server::raftkv::RaftKv<engine_rocks::engine::RocksEngine,test_raftstore::transport_simulate::SimulateTransport<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>,engine_rocks::engine::RocksEngine>>>>::hb43dfcb668613a38
38: 0x55744884fc73 - <test_raftstore::server::ServerCluster<EK> as test_raftstore::cluster::Simulator<EK>>::stop_node::h1ecf9b91ee55c53d
39: 0x5574487089e8 - test_raftstore::cluster::Cluster<EK,T>::stop_node::ha0b65159ca2d553a
40: 0x55744870c21d - test_raftstore::cluster::Cluster<EK,T>::shutdown::h077010dfa68164e1
41: 0x55744870d3fc - <test_raftstore::cluster::Cluster<EK,T> as core::ops::drop::Drop>::drop::h2c085679832dbba2
42: 0x5574482c43b5 - core::ptr::drop_in_place<test_raftstore::cluster::Cluster<engine_rocks::engine::RocksEngine,test_raftstore::server::ServerCluster<engine_rocks::engine::RocksEngine>>>::h504517f73744c3db
43: 0x557447129896 - failpoints::cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state::ha5632d8fda76d273
at /home/jenkins/tikv-src/tests/failpoints/cases/test_replica_stale_read.rs:260:1
44: 0x5574471c7b2e - failpoints::cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state::{{closure}}::hf26ca89cc2aa73e9
at /home/jenkins/tikv-src/tests/failpoints/cases/test_replica_stale_read.rs:215:52
45: 0x5574471c7b2e - core::ops::function::FnOnce::call_once::ha4ff23e87d75b0fa
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/ops/function.rs:250:5
46: 0x55744916c33d - test_util::runner::run_test_with_hook::{{closure}}::{{closure}}::hb6993e115065fa3e
47: 0x5574491724e5 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h69f3c126757c090d
48: 0x55744b42280a - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::he244563f3f19158a
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
49: 0x55744b42280a - test::__rust_begin_short_backtrace::h2bee667dfacf6394
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/test/src/lib.rs:627:18
50: 0x55744b421621 - test::run_test_in_process::{{closure}}::h66e90ca3a6483175
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/test/src/lib.rs:650:60
51: 0x55744b421621 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h83ce589675c8e5c4
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panic/unwind_safe.rs:272:9
52: 0x55744b421621 - std::panicking::try::do_call::hde5aba0cea3dc698
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:552:40
53: 0x55744b421621 - std::panicking::try::hcf5248222f90d5ff
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:516:19
54: 0x55744b421621 - std::panic::catch_unwind::h02e247c10aa761d1
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panic.rs:142:14
55: 0x55744b421621 - test::run_test_in_process::h253ae08688d44717
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/test/src/lib.rs:650:27
56: 0x55744b421621 - test::run_test::{{closure}}::h671b269aff1223f2
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/test/src/lib.rs:573:43
57: 0x55744b3e8c96 - test::run_test::{{closure}}::h94f25b04859b081c
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/test/src/lib.rs:601:41
58: 0x55744b3e8c96 - std::sys_common::backtrace::__rust_begin_short_backtrace::ha37bc9836d969f8c
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys_common/backtrace.rs:155:18
59: 0x55744b3edcf7 - std::thread::Builder::spawn_unchecked_::{{closure}}::{{closure}}::h5092bed309bb48ca
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/thread/mod.rs:529:17
60: 0x55744b3edcf7 - <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once::h77b767f13bf8ae8f
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panic/unwind_safe.rs:272:9
61: 0x55744b3edcf7 - std::panicking::try::do_call::h0fe2a261a5fe4c8b
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:552:40
62: 0x55744b3edcf7 - std::panicking::try::h2e1b1d5112b41b7c
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:516:19
63: 0x55744b3edcf7 - std::panic::catch_unwind::h9f0da9903043e48c
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panic.rs:142:14
64: 0x55744b3edcf7 - std::thread::Builder::spawn_unchecked_::{{closure}}::h49204260847051e7
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/thread/mod.rs:528:30
65: 0x55744b3edcf7 - core::ops::function::FnOnce::call_once{{vtable.shim}}::h1d1eb0c62b32e230
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/ops/function.rs:250:5
66: 0x55744e07e0a5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::hc049aa84baee5c22
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
67: 0x55744e07e0a5 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once::hf5846f37b8112bb2
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
68: 0x55744e07e0a5 - std::sys::unix::thread::Thread::new::thread_start::hd01330a228cdd35d
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/sys/unix/thread.rs:108:17
69: 0x7f0186375ea5 - start_thread
70: 0x7f0185d9c9fd - __clone
71: 0x0 - <unknown>
thread 'advance-ts' panicked at /rust/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.25.3/src/runtime/blocking/shutdown.rs:51:21:
Cannot drop a runtime in a context where blocking is not allowed. This happens when a runtime is dropped from within an asynchronous context.
stack backtrace:
0: std::panicking::begin_panic
1: tokio::runtime::blocking::shutdown::Receiver::wait
2: tokio::runtime::blocking::pool::BlockingPool::shutdown
3: <tokio::runtime::blocking::pool::BlockingPool as core::ops::drop::Drop>::drop
4: core::ptr::drop_in_place<tokio::runtime::blocking::pool::BlockingPool>
5: core::ptr::drop_in_place<tokio::runtime::runtime::Runtime>
6: alloc::sync::Arc<T,A>::drop_slow
7: <alloc::sync::Arc<T,A> as core::ops::drop::Drop>::drop
8: core::ptr::drop_in_place<alloc::sync::Arc<tokio::runtime::runtime::Runtime>>
9: core::ptr::drop_in_place<resolved_ts::scanner::ScannerPool<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine>>
10: core::ptr::drop_in_place<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>
11: core::ptr::drop_in_place<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>
12: core::ptr::drop_in_place<tikv_util::worker::pool::RunnableWrapper<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>>
13: core::ptr::drop_in_place<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>
14: core::ptr::drop_in_place<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>
15: core::ptr::drop_in_place<futures_util::future::future::map::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>
16: core::ptr::drop_in_place<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>
17: core::ptr::drop_in_place<core::cell::UnsafeCell<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>
18: core::ptr::drop_in_place<yatp::task::future::RawTask<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>
19: core::ptr::drop_in_place<alloc::boxed::Box<yatp::task::future::RawTask<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>>
20: core::mem::drop
21: yatp::task::future::RawTask<F>::drop
22: <yatp::task::future::TaskCell as core::ops::drop::Drop>::drop
23: core::ptr::drop_in_place<yatp::task::future::TaskCell>
24: core::ptr::drop_in_place<alloc::borrow::Cow<yatp::task::future::TaskCell>>
25: yatp::task::future::wake_task::{{closure}}
26: std::thread::local::LocalKey<T>::try_with
27: std::thread::local::LocalKey<T>::with
28: yatp::task::future::wake_task
29: yatp::task::future::wake_impl
30: yatp::task::future::wake_raw
31: core::task::wake::Waker::wake
32: futures_core::task::__internal::atomic_waker::AtomicWaker::wake
33: futures_channel::mpsc::UnboundedSenderInner<T>::queue_push_and_signal
34: futures_channel::mpsc::UnboundedSender<T>::do_send_nb
35: futures_channel::mpsc::UnboundedSender<T>::unbounded_send
36: tikv_util::worker::pool::Scheduler<T>::schedule_force
37: tikv_util::worker::pool::Scheduler<T>::schedule
38: resolved_ts::advance::AdvanceTsWorker::advance_ts_for_regions::{{closure}}
39: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
40: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
41: tokio::runtime::task::core::Core<T,S>::poll
42: tokio::runtime::task::harness::poll_future::{{closure}}
43: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
44: std::panicking::try::do_call
45: __rust_try
46: std::panicking::try
47: std::panic::catch_unwind
48: tokio::runtime::task::harness::poll_future
49: tokio::runtime::task::harness::Harness<T,S>::poll_inner
50: tokio::runtime::task::harness::Harness<T,S>::poll
51: tokio::runtime::task::raw::poll
52: tokio::runtime::task::raw::RawTask::poll
53: tokio::runtime::task::LocalNotified<S>::run
54: tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}}
55: tokio::runtime::scheduler::multi_thread::worker::Context::run_task
56: tokio::runtime::scheduler::multi_thread::worker::Context::run
57: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}
58: tokio::macros::scoped_tls::ScopedKey<T>::set
59: tokio::runtime::scheduler::multi_thread::worker::run
60: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}
61: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll
62: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
63: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
64: tokio::runtime::task::core::Core<T,S>::poll
65: tokio::runtime::task::harness::poll_future::{{closure}}
66: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
67: std::panicking::try::do_call
68: __rust_try
69: std::panicking::try
70: std::panic::catch_unwind
71: tokio::runtime::task::harness::poll_future
72: tokio::runtime::task::harness::Harness<T,S>::poll_inner
73: tokio::runtime::task::harness::Harness<T,S>::poll
74: tokio::runtime::task::raw::poll
75: tokio::runtime::task::raw::RawTask::poll
76: tokio::runtime::task::UnownedTask<S>::run
77: tokio::runtime::blocking::pool::Task::run
78: tokio::runtime::blocking::pool::Inner::run
79: tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}}
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
thread 'advance-ts' panicked at /rust/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.25.3/src/runtime/blocking/shutdown.rs:51:21:
Cannot drop a runtime in a context where blocking is not allowed. This happens when a runtime is dropped from within an asynchronous context.
stack backtrace:
0: std::panicking::begin_panic
1: tokio::runtime::blocking::shutdown::Receiver::wait
2: tokio::runtime::blocking::pool::BlockingPool::shutdown
3: <tokio::runtime::blocking::pool::BlockingPool as core::ops::drop::Drop>::drop
4: core::ptr::drop_in_place<tokio::runtime::blocking::pool::BlockingPool>
5: core::ptr::drop_in_place<tokio::runtime::runtime::Runtime>
6: alloc::sync::Arc<T,A>::drop_slow
7: <alloc::sync::Arc<T,A> as core::ops::drop::Drop>::drop
8: core::ptr::drop_in_place<alloc::sync::Arc<tokio::runtime::runtime::Runtime>>
9: core::ptr::drop_in_place<resolved_ts::scanner::ScannerPool<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine>>
10: core::ptr::drop_in_place<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>
11: core::ptr::drop_in_place<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>
12: core::ptr::drop_in_place<tikv_util::worker::pool::RunnableWrapper<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>>
13: core::ptr::drop_in_place<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>
14: core::ptr::drop_in_place<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>
15: core::ptr::drop_in_place<futures_util::future::future::map::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>
16: core::ptr::drop_in_place<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>
17: core::ptr::drop_in_place<core::cell::UnsafeCell<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>
18: core::ptr::drop_in_place<yatp::task::future::RawTask<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>
19: core::ptr::drop_in_place<alloc::boxed::Box<yatp::task::future::RawTask<futures_util::future::future::Map<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>,tikv_util::yatp_pool::future_pool::PoolInner::spawn<tracker::tls::TrackedFuture<tikv_util::worker::pool::Worker::start_with_timer_impl<tikv_util::worker::pool::NoTimeoutRunnableWrapper<resolved_ts::endpoint::Endpoint<raftstore::router::CdcRaftRouter<raftstore::router::ServerRaftStoreRouter<engine_rocks::engine::RocksEngine,raft_log_engine::engine::RaftLogEngine>>,engine_rocks::engine::RocksEngine,raftstore::store::fsm::store::StoreMeta>>>::{{closure}}>>::{{closure}}>>>>
20: core::mem::drop
21: yatp::task::future::RawTask<F>::drop
22: <yatp::task::future::TaskCell as core::ops::drop::Drop>::drop
23: core::ptr::drop_in_place<yatp::task::future::TaskCell>
24: core::ptr::drop_in_place<alloc::borrow::Cow<yatp::task::future::TaskCell>>
25: yatp::task::future::wake_task::{{closure}}
26: std::thread::local::LocalKey<T>::try_with
27: std::thread::local::LocalKey<T>::with
28: yatp::task::future::wake_task
29: yatp::task::future::wake_impl
30: yatp::task::future::wake_raw
31: core::task::wake::Waker::wake
32: futures_core::task::__internal::atomic_waker::AtomicWaker::wake
33: futures_channel::mpsc::UnboundedSenderInner<T>::queue_push_and_signal
34: futures_channel::mpsc::UnboundedSender<T>::do_send_nb
35: futures_channel::mpsc::UnboundedSender<T>::unbounded_send
36: tikv_util::worker::pool::Scheduler<T>::schedule_force
37: tikv_util::worker::pool::Scheduler<T>::schedule
38: resolved_ts::advance::AdvanceTsWorker::advance_ts_for_regions::{{closure}}
39: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
40: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
41: tokio::runtime::task::core::Core<T,S>::poll
42: tokio::runtime::task::harness::poll_future::{{closure}}
43: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
44: std::panicking::try::do_call
45: __rust_try
46: std::panicking::try
47: std::panic::catch_unwind
48: tokio::runtime::task::harness::poll_future
49: tokio::runtime::task::harness::Harness<T,S>::poll_inner
50: tokio::runtime::task::harness::Harness<T,S>::poll
51: tokio::runtime::task::raw::poll
52: tokio::runtime::task::raw::RawTask::poll
53: tokio::runtime::task::LocalNotified<S>::run
thread 'cases::test_replica_stale_read::test_update_apply_index_before_sync_read_state ' panicked at library/core/src/panicking.rs54: :tokio163:::runtime::5scheduler:::
multi_threadpanic in a destructor during cleanup::
worker::thread caused non-unwinding panic. aborting.
Context::run_task::{{closure}}
55: tokio::runtime::scheduler::multi_thread::worker::Context::run_task
56: tokio::runtime::scheduler::multi_thread::worker::Context::run
57: tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}
58: tokio::macros::scoped_tls::ScopedKey<T>::set
59: tokio::runtime::scheduler::multi_thread::worker::run
60: tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}
61: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll
62: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
63: tokio::loom::std::unsafe_cell::UnsafeCell<T>::with_mut
TRY 3 FAIL [ 1.362s] tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
--- TRY 3 STDOUT: tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client ---
running 1 test
test server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client ... FAILED
failures:
failures:
server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 841 filtered out; finished in 1.26s
--- TRY 3 STDERR: tests::integrations server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client ---
thread 'server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client' panicked at tests/integrations/server/kv_service.rs:3536:71:
called `Result::unwrap()` on an `Err` value: RpcFinished(Some(RpcStatus { code: 1-CANCELLED, message: "CANCELLED", details: [] }))
stack backtrace:
0: rust_begin_unwind
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/std/src/panicking.rs:645:5
1: core::panicking::panic_fmt
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/panicking.rs:72:14
2: core::result::unwrap_failed
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/result.rs:1649:5
3: core::result::Result<T,E>::unwrap
4: integrations::server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client
at /home/jenkins/tikv-src/tests/integrations/server/kv_service.rs:3536:13
5: integrations::server::kv_service::test_check_cluster_id_for_batch_cmds::test_raftstore_must_new_cluster_and_kv_client::{{closure}}
at /home/jenkins/tikv-src/tests/integrations/server/kv_service.rs:3501:42
6: core::ops::function::FnOnce::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/core/src/ops/function.rs:250:5
7: test_util::runner::run_test_with_hook::{{closure}}::{{closure}}
8: core::ops::function::FnOnce::call_once{{vtable.shim}}
9: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
at /rustc/89e2160c4ca5808657ed55392620ed1dbbce78d1/library/alloc/src/boxed.rs:2015:9
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
error: test run failed
+ gdb -c 'core.*' -batch -ex 'info threads' -ex 'thread apply all bt'
/home/jenkins/agent/tikv-presubmit/unit-test/core.*: No such file or directory.
No threads.
+ exit 1
[Pipeline] }
[Pipeline] // dir
Post stage
[Pipeline] sh
+ ls /home/jenkins/tikv-src/target/
debug
my_test.log
nextest
++ find /home/jenkins/tikv-src/target/ -type f -name '*.log'
+ tar -cvzf log-ut.tar.gz /home/jenkins/tikv-src/target/my_test.log
tar: Removing leading `/' from member names
/home/jenkins/tikv-src/target/my_test.log
+ ls -alh log-ut.tar.gz
-rw-r--r--. 1 jenkins jenkins 446K May 6 18:01 log-ut.tar.gz
[Pipeline] archiveArtifacts
Archiving artifacts
Recording fingerprints
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // container
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // podTemplate
[Pipeline] End of Pipeline
ERROR: script returned exit code 1
Finished: FAILURE
![[Jenkins]](/jenkins/static/62b7ca6c/images/svgs/logo.svg){kind=logo}
