============================= test session starts ============================== platform linux -- Python 3.7.5, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/dyn_shape_dev, inifile: /home/jenkins/sault/virtual_test/virtualenv_001/sault/config/pytest.ini plugins: anyio-3.7.1, forked-1.1.3, xdist-1.32.0 [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:32.309.236 [trace_attr.c:105](tid:11719) platform is 1. [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:32.309.416 [trace_recorder.c:114](tid:11719) use root path: /home/jenkins/ascend/atrace [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:32.309.447 [trace_signal.c:133](tid:11719) register signal handler for signo 2 succeed. [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:32.309.458 [trace_signal.c:133](tid:11719) register signal handler for signo 15 succeed. [INFO] RUNTIME(11719,python3.7):2024-01-11-05:50:32.725.178 [runtime.cc:1159] 11719 GetAicoreNumByLevel: workingDev_=0 [INFO] RUNTIME(11719,python3.7):2024-01-11-05:50:32.725.264 [runtime.cc:4719] 11719 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set collected 2 items test_rank.py [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.052.090 [process_mode_manager.cpp:109][OpenProcess][tid:11719] [ProcessModeManager] enter into open process deviceId[0] rankSize[0] [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.134 [process_mode_manager.cpp:379][InitTsdClient][tid:11719] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.286 [version_verify.cpp:34][SetVersionInfo][tid:11719] VersionVerify: send client version to server [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.317 [version_verify.cpp:50][SetVersionInfo][tid:11719] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.329 [version_verify.cpp:50][SetVersionInfo][tid:11719] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.658 [version_verify.cpp:66][PeerVersionCheck][tid:11719] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.675 [version_verify.cpp:87][ParseVersionInfo][tid:11719] VersionVerify: pass client version info success [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.684 [hdc_client.cpp:276][CheckHdcConnection][tid:11719] Service[2] create hdc success [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.699 [version_verify.cpp:120][SpecialFeatureCheck][tid:11719] VersionVerify: new type[35], supported [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.745 [process_mode_manager.cpp:748][GetDeviceCheckCode][tid:11719] [TsdClient][deviceId=0] [sessionId=1] wait package info respond [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.055.885 [process_mode_manager.cpp:379][InitTsdClient][tid:11719] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.022 [version_verify.cpp:34][SetVersionInfo][tid:11719] VersionVerify: send client version to server [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.034 [version_verify.cpp:50][SetVersionInfo][tid:11719] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.044 [version_verify.cpp:50][SetVersionInfo][tid:11719] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.195 [version_verify.cpp:66][PeerVersionCheck][tid:11719] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.207 [version_verify.cpp:87][ParseVersionInfo][tid:11719] VersionVerify: pass client version info success [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.215 [hdc_client.cpp:276][CheckHdcConnection][tid:11719] Service[2] create hdc success [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.227 [process_mode_manager.cpp:426][ConstructOpenMsg][tid:11719] [TsdClient] tsd get process sign successfully, procpid[11719] signSize[48] [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.261 [version_verify.cpp:112][SpecialFeatureCheck][tid:11719] VersionVerify: previous type[6], supported [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.056.284 [process_mode_manager.cpp:126][OpenProcess][tid:11719] [ProcessModeManager] deviceId[0] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.260.899 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:11719] [TsdClient] it is unnecessary of current mode[0] chiptype[1] to grant queue auth to aicpusd [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.260.934 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:11719] enter into OpenInHost deviceid[0] [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.260.945 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:11719] host cpu not support [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.260.953 [process_mode_manager.cpp:156][OpenProcess][tid:11719] [TsdClient][deviceId=0] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(11719,python3.7):2024-01-11-05:50:37.263.662 [device.cc:340] 11719 Init: isDoubledie:0, topologytype:0 [INFO] RUNTIME(11719,python3.7):2024-01-11-05:50:37.279.913 [npu_driver.cc:5428] 12546 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:37.279.953 [atrace_api.c:28](tid:11719) AtraceCreate start [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:37.280.067 [trace_rb_log.c:84](tid:11719) [RUNTIME_ATRACE_DEV0_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:37.280.082 [atrace_api.c:32](tid:11719) AtraceCreate end [INFO] TDT(11719,python3.7):2024-01-11-05:50:37.280.098 [client_manager.cpp:157][SetProfilingCallback][tid:11719] [TsdClient] set profiling callback success [TRACE] GE(11719,python3.7):2024-01-11-05:50:37.358.641 [status:INIT] [ge_api.cc:144]11719 GEInitializeImpl:GEInitialize start [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:37.568.495 [msprofiler_impl.cpp:156] >>> (tid:11719) ProfNotifySetDevice called, is open: 1, devId: 0 [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:37.568.664 [platform.cpp:38] >>> (tid:11719) Profiling platform version: 1.0. [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:37.568.680 [ai_drv_dev_api.cpp:384] >>> (tid:11719) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(11719,python3.7):2024-01-11-05:50:37.618.073 [status:RUNNING] [ge_api.cc:211]11719 GEInitializeImpl:Initializing environment [INFO] GE(11719,python3.7):2024-01-11-05:50:37.618.132 [gelib.cc:98][EVENT]11719 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(11719,python3.7):2024-01-11-05:50:37.618.406 [gelib.cc:307][EVENT]11719 SystemInitialize:Online infer init GELib success, device id :0 [INFO] DVPP(11719,python3.7):2024-01-11-05:50:37.986.821 [dvpp_engine.cc:41][ENGINE][Initialize:41][tid:11719]dvpp engine do not support [INFO] TUNE(11719,python3.7):2024-01-11-05:50:37.990.484 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:11719]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(11719,python3.7):2024-01-11-05:50:37.990.532 [handle_manager.cpp:115][CANNKB][Tid:11719]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(11719,python3.7):2024-01-11-05:50:37.990.594 [handle_manager.cpp:407][CANNKB][Tid:11719]"Init functions of loading dynamic python lib end!" [INFO] TUNE(11719,python3.7):2024-01-11-05:50:37.990.606 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:11719]"CANN_KB_Py has already been initialized." [INFO] TUNE(11719,python3.7):2024-01-11-05:50:37.990.675 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:11719]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] HCCL(11719,python3.7):2024-01-11-05:50:49.997.161 [plugin_manager.cc:42][11719]hcom running normal mode. [INFO] DVPP(11719,python3.7):2024-01-11-05:50:49.997.616 [dvpp_engine.cc:92][ENGINE][GetOpsKernelInfoStores:92][tid:11719]dvpp ops kernel info store do not support [INFO] DVPP(11719,python3.7):2024-01-11-05:50:49.997.748 [dvpp_engine.cc:69][ENGINE][GetGraphOptimizerObjs:69][tid:11719]dvpp graph optimizer do not support [INFO] DVPP(11719,python3.7):2024-01-11-05:50:50.520.021 [dvpp_ops_kernel_builder.cc:48][ENGINE][Initialize:48][tid:11719]dvpp ops kernel builder do not support [INFO] GE(11719,python3.7):2024-01-11-05:50:50.528.714 [gelib.cc:169][EVENT]11719 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [12910532] micro second. [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.613.285 [status:STOP] [ge_api.cc:255]11719 GEInitializeImpl:GEInitialize finished [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.613.433 [status:INIT] [ge_api.cc:398]11719 Session:Start to construct session. [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.613.451 [status:RUNNING] [ge_api.cc:408]11719 Session:Creating session [INFO] GE(11719,python3.7):2024-01-11-05:50:50.613.843 [graph_var_manager.cc:1445][EVENT]11719 SetMemoryMallocSize:Total memory size is 34357641216 [INFO] GE(11719,python3.7):2024-01-11-05:50:50.613.862 [graph_var_manager.cc:1424][EVENT]11719 SetAllMemoryMaxValue:The graph_mem_max_size is 27915583488 and the var_mem_max_size is 5368381440 [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:50.614.171 [msprofiler_impl.cpp:156] >>> (tid:11719) ProfNotifySetDevice called, is open: 1, devId: 0 [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.614.986 [status:RUNNING] [ge_api.cc:411]11719 Session:Session id is 0 [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.615.012 [status:STOP] [ge_api.cc:420]11719 Session:Session Constructor finished [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:50.624.633 [platform.cpp:38] >>> (tid:11719) Profiling platform version: 1.0. [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:50.624.680 [ai_drv_dev_api.cpp:384] >>> (tid:11719) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(11719,python3.7):2024-01-11-05:50:50.624.879 [status:INIT] [ge_api.cc:144]11719 GEInitializeImpl:GEInitialize start TotalTime = 0.0525807, [20] [parse]: 0.0124526 [symbol_resolve]: 0.0230628, [1] [Cycle 1]: 0.0230091, [1] [resolve]: 0.0229685 [combine_like_graphs]: 1.11e-06 [graph_reusing]: 2.40999e-06 [meta_unpack_prepare]: 6.04e-05 [pre_cconv]: 3.37e-06 [abstract_specialize]: 0.0023517 [pack_expand]: 8.94e-06 [auto_monad]: 5.264e-05 [inline]: 1.3e-06 [pre_auto_parallel]: 1.158e-05 [pipeline_split]: 1.84e-06 [optimize]: 0.00861025, [35] [py_interpret_to_execute]: 3.26e-06 [rewriter_before_opt_a]: 2.921e-05 [opt_a]: 0.00806639, [2] [Cycle 1]: 0.00083769, [30] [expand_dump_flag]: 3.18e-06 [switch_simplify]: 1.504e-05 [a_1]: 0.00016954 [recompute_prepare]: 2.41e-06 [updatestate_depend_eliminate]: 7.5e-06 [updatestate_assign_eliminate]: 3.09e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 3.67e-06 [a_2]: 2.893e-05 [accelerated_algorithm]: 2.43e-06 [pynative_shard]: 1.56e-06 [auto_parallel]: 4.15e-06 [parallel]: 2.058e-05 [merge_comm]: 7.89e-06 [allreduce_fusion]: 1.73e-06 [virtual_dataset]: 3.04e-06 [get_grad_eliminate_]: 1.96999e-06 [virtual_output]: 1.66e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 5.10001e-07 [cell_reuse_handle_not_recompute_node_pass]: 6.73e-06 [meta_fg_expand]: 2.35e-06 [after_resolve]: 4.53999e-06 [a_after_grad]: 2.82e-06 [renormalize]: 0.00032908 [real_op_eliminate]: 3.80001e-06 [auto_monad_grad]: 3.87e-06 [auto_monad_eliminator]: 8.29e-06 [cse]: 2.428e-05 [a_3]: 1.438e-05 [Cycle 2]: 0.00022592, [30] [expand_dump_flag]: 8.09996e-07 [switch_simplify]: 2.17e-06 [a_1]: 1.439e-05 [recompute_prepare]: 1.55e-06 [updatestate_depend_eliminate]: 3.09e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.17e-06 [parameter_eliminate]: 7.2e-07 [a_2]: 2.537e-05 [accelerated_algorithm]: 2.12e-06 [pynative_shard]: 8.59996e-07 [auto_parallel]: 3.51e-06 [parallel]: 3.02e-06 [merge_comm]: 1.66e-06 [allreduce_fusion]: 1.25e-06 [virtual_dataset]: 2.33e-06 [get_grad_eliminate_]: 1.71e-06 [virtual_output]: 1.71e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 3.00002e-07 [cell_reuse_handle_not_recompute_node_pass]: 5.44e-06 [meta_fg_expand]: 1.72e-06 [after_resolve]: 3.6e-06 [a_after_grad]: 2.21e-06 [renormalize]: 7.99992e-08 [real_op_eliminate]: 1.74e-06 [auto_monad_grad]: 7.60003e-07 [auto_monad_eliminator]: 4.37e-06 [cse]: 9.13e-06 [a_3]: 1.226e-05 [py_interpret_to_execute_after_opt_a]: 4.65e-06 [slice_cell_reuse_recomputed_activation]: 1.53e-06 [rewriter_after_opt_a]: 2.936e-05 [convert_after_rewriter]: 5.12e-06 [order_py_execute_after_rewriter]: 3.27999e-06 [opt_b]: 8.725e-05, [1] [Cycle 1]: 8.247e-05, [7] [b_1]: 3.679e-05 [b_2]: 2.98e-06 [updatestate_depend_eliminate]: 2.27e-06 [updatestate_assign_eliminate]: 2.02e-06 [updatestate_loads_eliminate]: 2e-06 [renormalize]: 2.40005e-07 [cse]: 8.54e-06 [cconv]: 2.541e-05 [opt_after_cconv]: 5.061e-05, [1] [Cycle 1]: 4.669e-05, [7] [c_1]: 4.89e-06 [parameter_eliminate]: 5.30003e-07 [updatestate_depend_eliminate]: 2.29e-06 [updatestate_assign_eliminate]: 1.72e-06 [updatestate_loads_eliminate]: 1.63e-06 [cse]: 8.11e-06 [renormalize]: 1.59998e-07 [remove_dup_value]: 8.12e-06 [tuple_transform]: 3.31e-05, [1] [Cycle 1]: 2.973e-05, [3] [d_1]: 1.199e-05 [d_2]: 5.13e-06 [renormalize]: 1.59998e-07 [add_cache_embedding]: 9.78e-06 [add_recomputation]: 5.997e-05 [cse_after_recomputation]: 1.804e-05, [1] [Cycle 1]: 1.372e-05, [1] [cse]: 8.7e-06 [environ_conv]: 1.671e-05 [label_micro_interleaved_index]: 1.57e-06 [label_fine_grained_interleaved_index]: 1.77e-06 [assign_add_opt]: 1.13e-06 [slice_recompute_activation]: 1.32e-06 [micro_interleaved_order_control]: 1.32e-06 [full_micro_interleaved_order_control]: 1.14e-06 [comp_comm_scheduling]: 1.37e-06 [reorder_send_recv_between_fp_bp]: 1.17e-06 [comm_op_add_attrs]: 9e-07 [add_comm_op_reuse_tag]: 5.80003e-07 [overlap_opt_shard_in_pipeline]: 7.09995e-07 [grouped_pairwise_exchange_alltoall]: 8.2e-07 [overlap_recompute_and_grad_model_parallel]: 1.05e-06 [overlap_grad_matmul_and_grad_allreduce]: 4.70005e-07 [split_matmul_comm_elemetwise]: 1.69e-06 [split_layernorm_comm]: 1.37e-06 [process_send_recv_for_ge]: 2.08e-06 [handle_group_info]: 5.80003e-07 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 1.3e-07 [eliminate_special_op_node]: 0.00047779 [validate]: 4.492e-05 [distribtued_split]: 1.02e-06 [task_emit]: 0.00509576 [execute]: 5.86e-06 Sums parse : 0.012453s : 27.87% symbol_resolve.resolve : 0.022968s : 51.41% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000002s : 0.01% meta_unpack_prepare : 0.000060s : 0.14% pre_cconv : 0.000003s : 0.01% abstract_specialize : 0.002352s : 5.26% pack_expand : 0.000009s : 0.02% auto_monad : 0.000053s : 0.12% inline : 0.000001s : 0.00% pre_auto_parallel : 0.000012s : 0.03% pipeline_split : 0.000002s : 0.00% optimize.py_interpret_to_execute : 0.000003s : 0.01% optimize.rewriter_before_opt_a : 0.000029s : 0.07% optimize.opt_a.expand_dump_flag : 0.000004s : 0.01% optimize.opt_a.switch_simplify : 0.000017s : 0.04% optimize.opt_a.a_1 : 0.000184s : 0.41% optimize.opt_a.recompute_prepare : 0.000004s : 0.01% optimize.opt_a.updatestate_depend_eliminate : 0.000011s : 0.02% optimize.opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% optimize.opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% optimize.opt_a.parameter_eliminate : 0.000004s : 0.01% optimize.opt_a.a_2 : 0.000054s : 0.12% optimize.opt_a.accelerated_algorithm : 0.000005s : 0.01% optimize.opt_a.pynative_shard : 0.000002s : 0.01% optimize.opt_a.auto_parallel : 0.000008s : 0.02% optimize.opt_a.parallel : 0.000024s : 0.05% optimize.opt_a.merge_comm : 0.000010s : 0.02% optimize.opt_a.allreduce_fusion : 0.000003s : 0.01% optimize.opt_a.virtual_dataset : 0.000005s : 0.01% optimize.opt_a.get_grad_eliminate_ : 0.000004s : 0.01% optimize.opt_a.virtual_output : 0.000003s : 0.01% optimize.opt_a.merge_forward : 0.000007s : 0.02% optimize.opt_a.cell_reuse_recompute_pass : 0.000001s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000012s : 0.03% optimize.opt_a.meta_fg_expand : 0.000004s : 0.01% optimize.opt_a.after_resolve : 0.000008s : 0.02% optimize.opt_a.a_after_grad : 0.000005s : 0.01% optimize.opt_a.renormalize : 0.000329s : 0.74% optimize.opt_a.real_op_eliminate : 0.000006s : 0.01% optimize.opt_a.auto_monad_grad : 0.000005s : 0.01% optimize.opt_a.auto_monad_eliminator : 0.000013s : 0.03% optimize.opt_a.cse : 0.000033s : 0.07% optimize.opt_a.a_3 : 0.000027s : 0.06% optimize.py_interpret_to_execute_after_opt_a : 0.000005s : 0.01% optimize.slice_cell_reuse_recomputed_activation : 0.000002s : 0.00% optimize.rewriter_after_opt_a : 0.000029s : 0.07% optimize.convert_after_rewriter : 0.000005s : 0.01% optimize.order_py_execute_after_rewriter : 0.000003s : 0.01% optimize.opt_b.b_1 : 0.000037s : 0.08% optimize.opt_b.b_2 : 0.000003s : 0.01% optimize.opt_b.updatestate_depend_eliminate : 0.000002s : 0.01% optimize.opt_b.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000009s : 0.02% optimize.cconv : 0.000025s : 0.06% optimize.opt_after_cconv.c_1 : 0.000005s : 0.01% optimize.opt_after_cconv.parameter_eliminate : 0.000001s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000002s : 0.01% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.cse : 0.000008s : 0.02% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000008s : 0.02% optimize.tuple_transform.d_1 : 0.000012s : 0.03% optimize.tuple_transform.d_2 : 0.000005s : 0.01% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000010s : 0.02% optimize.add_recomputation : 0.000060s : 0.13% optimize.cse_after_recomputation.cse : 0.000009s : 0.02% optimize.environ_conv : 0.000017s : 0.04% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000002s : 0.00% optimize.assign_add_opt : 0.000001s : 0.00% optimize.slice_recompute_activation : 0.000001s : 0.00% optimize.micro_interleaved_order_control : 0.000001s : 0.00% optimize.full_micro_interleaved_order_control : 0.000001s : 0.00% optimize.comp_comm_scheduling : 0.000001s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000001s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000001s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000000s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000001s : 0.00% optimize.process_send_recv_for_ge : 0.000002s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000000s : 0.00% eliminate_special_op_node : 0.000478s : 1.07% validate : 0.000045s : 0.10% distribtued_split : 0.000001s : 0.00% task_emit : 0.005096s : 11.41% execute : 0.000006s : 0.01% Time group info: ------[substitution.] 0.022941 29 99.48% : 0.022821s : 3: substitution.getattr_setattr_resolve 0.01% : 0.000003s : 3: substitution.graph_param_transform 0.37% : 0.000084s : 2: substitution.inline 0.09% : 0.000022s : 11: substitution.meta_unpack_prepare 0.00% : 0.000001s : 3: substitution.partial_unused_args_eliminate 0.00% : 0.000001s : 4: substitution.remove_not_recompute_node 0.01% : 0.000002s : 2: substitution.replace_old_param 0.03% : 0.000007s : 1: substitution.tuple_list_get_item_eliminator ------[renormalize.] 0.000324 2 57.94% : 0.000187s : 1: renormalize.infer 42.06% : 0.000136s : 1: renormalize.specialize ------[replace.] 0.000106 6 72.55% : 0.000077s : 3: replace.getattr_setattr_resolve 20.78% : 0.000022s : 2: replace.inline 6.67% : 0.000007s : 1: replace.tuple_list_get_item_eliminator ------[match.] 0.022913 6 99.60% : 0.022821s : 3: match.getattr_setattr_resolve 0.37% : 0.000084s : 2: match.inline 0.03% : 0.000007s : 1: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.000434 9 65.03% : 0.000282s : 5: func_graph_cloner_run.FuncGraphClonerGraph 34.97% : 0.000152s : 4: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023345 105 0.31% : 0.000073s : 52: opt.transform.opt_a 0.12% : 0.000029s : 23: opt.transform.opt_b 98.31% : 0.022950s : 2: opt.transform.opt_resolve 0.16% : 0.000038s : 1: opt.transforms.meta_unpack_prepare 0.97% : 0.000226s : 20: opt.transforms.opt_a 0.01% : 0.000003s : 1: opt.transforms.opt_after_cconv 0.01% : 0.000002s : 1: opt.transforms.opt_b 0.07% : 0.000016s : 2: opt.transforms.opt_trans_graph 0.03% : 0.000008s : 3: opt.transforms.special_op_eliminate .. ============================== 2 passed in 20.35s ============================== [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.944.285 [status:INIT] [ge_api.cc:463]11719 ~Session:Start to destruct session. [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.944.358 [status:RUNNING] [ge_api.cc:475]11719 ~Session:Session id is 0 [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.944.396 [status:RUNNING] [ge_api.cc:476]11719 ~Session:Destroying session [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.945.397 [status:STOP] [ge_api.cc:491]11719 ~Session:Session Destructor finished [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.945.438 [status:INIT] [ge_api.cc:301]11719 GEFinalize:GEFinalize start [INFO] GE(11719,python3.7):2024-01-11-05:50:52.945.520 [execution_runtime.cc:80][EVENT]11719 FinalizeExecutionRuntime:Execution runtime finalize begin. [INFO] GE(11719,python3.7):2024-01-11-05:50:52.945.542 [execution_runtime.cc:92][EVENT]11719 FinalizeExecutionRuntime:Execution runtime finalized. [TRACE] GE(11719,python3.7):2024-01-11-05:50:52.945.557 [status:RUNNING] [ge_api.cc:313]11719 GEFinalize:Finalizing environment [INFO] TUNE(11719,python3.7):2024-01-11-05:50:53.237.213 [cann_kb_pyfunc_mgr.cpp:127][CANNKB][Tid:11719]"CannKbPyfuncMgr: enter PyObjectDeinit function, reference_[1]" [INFO] TUNE(11719,python3.7):2024-01-11-05:50:53.237.271 [cann_kb_pyfunc_mgr.cpp:138][CANNKB][Tid:11719]"CannKbPyfuncMgr: PyObjectDeinit function end successfully!" [INFO] GE(11719,python3.7):2024-01-11-05:50:53.238.667 [gelib.cc:324][EVENT]11719 SystemFinalize:Online infer finalize GELib success. [TRACE] GE(11719,python3.7):2024-01-11-05:50:53.728.712 [status:STOP] [ge_api.cc:341]11719 GEFinalize:GEFinalize finished [INFO] TDT(11719,python3.7):2024-01-11-05:50:53.758.836 [process_mode_manager.cpp:184][Close][tid:11719] [TsdClient] Close [deviceId=0][sessionId=1] hccp and computer enter [INFO] TDT(11719,python3.7):2024-01-11-05:50:53.758.878 [version_verify.cpp:112][SpecialFeatureCheck][tid:11719] VersionVerify: previous type[7], supported [INFO] TDT(11719,python3.7):2024-01-11-05:50:53.758.937 [process_mode_manager.cpp:192][Close][tid:11719] [TsdClient][deviceId=0] [sessionId=1] wait hccp and computer process close respond [INFO] TDT(11719,python3.7):2024-01-11-05:50:54.596.976 [process_mode_manager.cpp:197][Close][tid:11719] [TsdClient][logicDeviceId_=0]has recv close hccp and computer process respond [INFO] TDT(11719,python3.7):2024-01-11-05:50:54.597.052 [stub_process_mode_nowin.cpp:151][CloseInHost][tid:11719] enter into CloseInHost deviceid[0] [INFO] TDT(11719,python3.7):2024-01-11-05:50:54.597.064 [stub_process_mode_nowin.cpp:154][CloseInHost][tid:11719] host cpu not support [INFO] TDT(11719,python3.7):2024-01-11-05:50:54.597.115 [process_mode_manager.cpp:208][Close][tid:11719] [TsdClient][deviceId=0] [sessionId=1] close hccp and computer process success [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:54.597.157 [atrace_api.c:93](tid:11719) AtraceDestroy start [INFO] ATRACE(11719,python3.7):2024-01-11-05:50:54.597.178 [atrace_api.c:95](tid:11719) AtraceDestroy end [INFO] PROFILING(11719,python3.7):2024-01-11-05:50:54.597.205 [msprofiler_impl.cpp:156] >>> (tid:11719) ProfNotifySetDevice called, is open: 0, devId: 0 [INFO] RUNTIME(11719,python3.7):2024-01-11-05:50:56.195.057 [runtime.cc:1737] 11719 ~Runtime: deconstruct runtime.