============================= test session starts ============================== platform linux -- Python 3.7.5, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/ops/ascend/test_aicpu_ops, inifile: /home/jenkins/sault/virtual_test/virtualenv_004/sault/config/pytest.ini plugins: anyio-3.7.1, forked-1.1.3, xdist-1.32.0 [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:48.828.893 [trace_attr.c:105](tid:130450) platform is 1. [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:48.829.040 [trace_recorder.c:114](tid:130450) use root path: /home/jenkins/ascend/atrace [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:48.829.067 [trace_signal.c:133](tid:130450) register signal handler for signo 2 succeed. [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:48.829.078 [trace_signal.c:133](tid:130450) register signal handler for signo 15 succeed. [INFO] RUNTIME(130450,python3.7):2024-01-11-05:42:49.248.146 [runtime.cc:1159] 130450 GetAicoreNumByLevel: workingDev_=0 [INFO] RUNTIME(130450,python3.7):2024-01-11-05:42:49.248.229 [runtime.cc:4719] 130450 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set collected 2 items test_flatten.py [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.747.529 [process_mode_manager.cpp:109][OpenProcess][tid:130450] [ProcessModeManager] enter into open process deviceId[3] rankSize[0] [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.748.500 [process_mode_manager.cpp:379][InitTsdClient][tid:130450] [TsdClient] deviceId[3] begin to init hdc client [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.748.674 [version_verify.cpp:34][SetVersionInfo][tid:130450] VersionVerify: send client version to server [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.748.724 [version_verify.cpp:50][SetVersionInfo][tid:130450] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.748.738 [version_verify.cpp:50][SetVersionInfo][tid:130450] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.020 [version_verify.cpp:66][PeerVersionCheck][tid:130450] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.040 [version_verify.cpp:87][ParseVersionInfo][tid:130450] VersionVerify: pass client version info success [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.049 [hdc_client.cpp:276][CheckHdcConnection][tid:130450] Service[2] create hdc success [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.065 [version_verify.cpp:120][SpecialFeatureCheck][tid:130450] VersionVerify: new type[35], supported [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.154 [process_mode_manager.cpp:748][GetDeviceCheckCode][tid:130450] [TsdClient][deviceId=3] [sessionId=1] wait package info respond [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.332 [process_mode_manager.cpp:379][InitTsdClient][tid:130450] [TsdClient] deviceId[3] begin to init hdc client [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.412 [version_verify.cpp:34][SetVersionInfo][tid:130450] VersionVerify: send client version to server [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.426 [version_verify.cpp:50][SetVersionInfo][tid:130450] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.436 [version_verify.cpp:50][SetVersionInfo][tid:130450] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.563 [version_verify.cpp:66][PeerVersionCheck][tid:130450] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.575 [version_verify.cpp:87][ParseVersionInfo][tid:130450] VersionVerify: pass client version info success [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.583 [hdc_client.cpp:276][CheckHdcConnection][tid:130450] Service[2] create hdc success [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.594 [process_mode_manager.cpp:426][ConstructOpenMsg][tid:130450] [TsdClient] tsd get process sign successfully, procpid[130450] signSize[48] [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.626 [version_verify.cpp:112][SpecialFeatureCheck][tid:130450] VersionVerify: previous type[6], supported [INFO] TDT(130450,python3.7):2024-01-11-05:42:53.749.650 [process_mode_manager.cpp:126][OpenProcess][tid:130450] [ProcessModeManager] deviceId[3] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(130450,python3.7):2024-01-11-05:42:54.002.006 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:130450] [TsdClient] it is unnecessary of current mode[0] chiptype[1] to grant queue auth to aicpusd [INFO] TDT(130450,python3.7):2024-01-11-05:42:54.002.077 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:130450] enter into OpenInHost deviceid[3] [INFO] TDT(130450,python3.7):2024-01-11-05:42:54.002.089 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:130450] host cpu not support [INFO] TDT(130450,python3.7):2024-01-11-05:42:54.002.097 [process_mode_manager.cpp:156][OpenProcess][tid:130450] [TsdClient][deviceId=3] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(130450,python3.7):2024-01-11-05:42:54.005.158 [device.cc:340] 130450 Init: isDoubledie:0, topologytype:0 [INFO] RUNTIME(130450,python3.7):2024-01-11-05:42:54.019.761 [npu_driver.cc:5428] 131379 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:54.020.160 [atrace_api.c:28](tid:130450) AtraceCreate start [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:54.020.278 [trace_rb_log.c:84](tid:130450) [RUNTIME_ATRACE_DEV3_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(130450,python3.7):2024-01-11-05:42:54.020.295 [atrace_api.c:32](tid:130450) AtraceCreate end [INFO] TDT(130450,python3.7):2024-01-11-05:42:54.020.330 [client_manager.cpp:157][SetProfilingCallback][tid:130450] [TsdClient] set profiling callback success [TRACE] GE(130450,python3.7):2024-01-11-05:42:54.172.532 [status:INIT] [ge_api.cc:144]130450 GEInitializeImpl:GEInitialize start [INFO] PROFILING(130450,python3.7):2024-01-11-05:42:54.407.180 [msprofiler_impl.cpp:156] >>> (tid:130450) ProfNotifySetDevice called, is open: 1, devId: 3 [INFO] PROFILING(130450,python3.7):2024-01-11-05:42:54.407.359 [platform.cpp:38] >>> (tid:130450) Profiling platform version: 1.0. [INFO] PROFILING(130450,python3.7):2024-01-11-05:42:54.407.377 [ai_drv_dev_api.cpp:384] >>> (tid:130450) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(130450,python3.7):2024-01-11-05:42:54.459.728 [status:RUNNING] [ge_api.cc:211]130450 GEInitializeImpl:Initializing environment [INFO] GE(130450,python3.7):2024-01-11-05:42:54.459.788 [gelib.cc:98][EVENT]130450 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(130450,python3.7):2024-01-11-05:42:54.460.116 [gelib.cc:307][EVENT]130450 SystemInitialize:Online infer init GELib success, device id :3 [INFO] DVPP(130450,python3.7):2024-01-11-05:42:54.827.575 [dvpp_engine.cc:41][ENGINE][Initialize:41][tid:130450]dvpp engine do not support [INFO] TUNE(130450,python3.7):2024-01-11-05:42:54.832.472 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:130450]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(130450,python3.7):2024-01-11-05:42:54.832.512 [handle_manager.cpp:115][CANNKB][Tid:130450]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(130450,python3.7):2024-01-11-05:42:54.832.576 [handle_manager.cpp:407][CANNKB][Tid:130450]"Init functions of loading dynamic python lib end!" [INFO] TUNE(130450,python3.7):2024-01-11-05:42:54.832.587 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:130450]"CANN_KB_Py has already been initialized." [INFO] TUNE(130450,python3.7):2024-01-11-05:42:54.832.679 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:130450]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] HCCL(130450,python3.7):2024-01-11-05:43:06.972.363 [plugin_manager.cc:42][130450]hcom running normal mode. [INFO] DVPP(130450,python3.7):2024-01-11-05:43:06.973.050 [dvpp_engine.cc:92][ENGINE][GetOpsKernelInfoStores:92][tid:130450]dvpp ops kernel info store do not support [INFO] DVPP(130450,python3.7):2024-01-11-05:43:06.973.277 [dvpp_engine.cc:69][ENGINE][GetGraphOptimizerObjs:69][tid:130450]dvpp graph optimizer do not support [INFO] DVPP(130450,python3.7):2024-01-11-05:43:07.626.720 [dvpp_ops_kernel_builder.cc:48][ENGINE][Initialize:48][tid:130450]dvpp ops kernel builder do not support [INFO] GE(130450,python3.7):2024-01-11-05:43:07.635.697 [gelib.cc:169][EVENT]130450 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [13175818] micro second. [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.727.064 [status:STOP] [ge_api.cc:255]130450 GEInitializeImpl:GEInitialize finished [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.727.236 [status:INIT] [ge_api.cc:398]130450 Session:Start to construct session. [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.727.255 [status:RUNNING] [ge_api.cc:408]130450 Session:Creating session [INFO] GE(130450,python3.7):2024-01-11-05:43:07.727.717 [graph_var_manager.cc:1445][EVENT]130450 SetMemoryMallocSize:Total memory size is 34359738368 [INFO] GE(130450,python3.7):2024-01-11-05:43:07.727.735 [graph_var_manager.cc:1424][EVENT]130450 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] PROFILING(130450,python3.7):2024-01-11-05:43:07.728.096 [msprofiler_impl.cpp:156] >>> (tid:130450) ProfNotifySetDevice called, is open: 1, devId: 3 [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.728.996 [status:RUNNING] [ge_api.cc:411]130450 Session:Session id is 0 [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.729.019 [status:STOP] [ge_api.cc:420]130450 Session:Session Constructor finished [INFO] PROFILING(130450,python3.7):2024-01-11-05:43:07.738.946 [platform.cpp:38] >>> (tid:130450) Profiling platform version: 1.0. [INFO] PROFILING(130450,python3.7):2024-01-11-05:43:07.738.995 [ai_drv_dev_api.cpp:384] >>> (tid:130450) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(130450,python3.7):2024-01-11-05:43:07.739.266 [status:INIT] [ge_api.cc:144]130450 GEInitializeImpl:GEInitialize start TotalTime = 0.138835, [20] [parse]: 0.0134888 [symbol_resolve]: 0.0477985, [1] [Cycle 1]: 0.0476702, [1] [resolve]: 0.0476355 [combine_like_graphs]: 1.13e-06 [graph_reusing]: 2.84e-06 [meta_unpack_prepare]: 0.00034759 [pre_cconv]: 4.53e-06 [abstract_specialize]: 0.0620926 [pack_expand]: 1.842e-05 [auto_monad]: 0.00011525 [inline]: 2.27e-06 [pre_auto_parallel]: 2.214e-05 [pipeline_split]: 2.51e-06 [optimize]: 0.00812279, [35] [py_interpret_to_execute]: 0.00017346 [rewriter_before_opt_a]: 0.00021794 [opt_a]: 0.00697399, [2] [Cycle 1]: 0.00180862, [30] [expand_dump_flag]: 3.84e-06 [switch_simplify]: 0.00010705 [a_1]: 0.00035032 [recompute_prepare]: 2.74e-06 [updatestate_depend_eliminate]: 7.42e-06 [updatestate_assign_eliminate]: 3.66e-06 [updatestate_loads_eliminate]: 3.83e-06 [parameter_eliminate]: 2.63e-06 [a_2]: 7.343e-05 [accelerated_algorithm]: 2.69e-06 [pynative_shard]: 1.13e-06 [auto_parallel]: 4.18e-06 [parallel]: 1.487e-05 [merge_comm]: 1.33e-05 [allreduce_fusion]: 2.2e-06 [virtual_dataset]: 2.93e-06 [get_grad_eliminate_]: 2.07e-06 [virtual_output]: 1.81e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 5.70006e-07 [cell_reuse_handle_not_recompute_node_pass]: 5.43e-06 [meta_fg_expand]: 2.94e-06 [after_resolve]: 4.08e-06 [a_after_grad]: 2.37999e-06 [renormalize]: 0.00097151 [real_op_eliminate]: 4.63e-06 [auto_monad_grad]: 3.82e-06 [auto_monad_eliminator]: 7.8e-06 [cse]: 3.565e-05 [a_3]: 1.533e-05 [Cycle 2]: 0.00023708, [30] [expand_dump_flag]: 9.29998e-07 [switch_simplify]: 2.03e-06 [a_1]: 1.615e-05 [recompute_prepare]: 1.59e-06 [updatestate_depend_eliminate]: 3.06e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.05e-06 [parameter_eliminate]: 8.60004e-07 [a_2]: 2.593e-05 [accelerated_algorithm]: 2.2e-06 [pynative_shard]: 1.07e-06 [auto_parallel]: 2.99e-06 [parallel]: 2.76999e-06 [merge_comm]: 1.96e-06 [allreduce_fusion]: 1.15e-06 [virtual_dataset]: 2.18e-06 [get_grad_eliminate_]: 1.71e-06 [virtual_output]: 1.6e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 3.30001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.133e-05 [meta_fg_expand]: 2.01001e-06 [after_resolve]: 3.6e-06 [a_after_grad]: 2.37999e-06 [renormalize]: 6.00048e-08 [real_op_eliminate]: 1.78e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 3.97e-06 [cse]: 8.97999e-06 [a_3]: 1.247e-05 [py_interpret_to_execute_after_opt_a]: 7.46e-06 [slice_cell_reuse_recomputed_activation]: 1.98e-06 [rewriter_after_opt_a]: 0.00024495 [convert_after_rewriter]: 5.92e-06 [order_py_execute_after_rewriter]: 3.53e-06 [opt_b]: 9.29e-05, [1] [Cycle 1]: 8.766e-05, [7] [b_1]: 3.918e-05 [b_2]: 3.41e-06 [updatestate_depend_eliminate]: 2.89e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 1.94e-06 [renormalize]: 2.59999e-07 [cse]: 9.44e-06 [cconv]: 2.347e-05 [opt_after_cconv]: 4.675e-05, [1] [Cycle 1]: 4.278e-05, [7] [c_1]: 4.64e-06 [parameter_eliminate]: 6.20006e-07 [updatestate_depend_eliminate]: 2.15e-06 [updatestate_assign_eliminate]: 1.79e-06 [updatestate_loads_eliminate]: 1.8e-06 [cse]: 6.49e-06 [renormalize]: 2.00002e-07 [remove_dup_value]: 7.4e-06 [tuple_transform]: 3.085e-05, [1] [Cycle 1]: 2.725e-05, [3] [d_1]: 1.177e-05 [d_2]: 5.07e-06 [renormalize]: 1.39997e-07 [add_cache_embedding]: 9.09e-06 [add_recomputation]: 4.409e-05 [cse_after_recomputation]: 1.495e-05, [1] [Cycle 1]: 1.099e-05, [1] [cse]: 6.79999e-06 [environ_conv]: 1.698e-05 [label_micro_interleaved_index]: 1.52e-06 [label_fine_grained_interleaved_index]: 1.86e-06 [assign_add_opt]: 2.35e-06 [slice_recompute_activation]: 1.70001e-06 [micro_interleaved_order_control]: 1.34e-06 [full_micro_interleaved_order_control]: 1.14999e-06 [comp_comm_scheduling]: 1.19999e-06 [reorder_send_recv_between_fp_bp]: 1.16e-06 [comm_op_add_attrs]: 6.40001e-07 [add_comm_op_reuse_tag]: 7.59996e-07 [overlap_opt_shard_in_pipeline]: 1.04e-06 [grouped_pairwise_exchange_alltoall]: 8.79998e-07 [overlap_recompute_and_grad_model_parallel]: 1.06e-06 [overlap_grad_matmul_and_grad_allreduce]: 4.89999e-07 [split_matmul_comm_elemetwise]: 1.72e-06 [split_layernorm_comm]: 1.33e-06 [process_send_recv_for_ge]: 1.87e-06 [handle_group_info]: 9.70002e-07 [auto_monad_reorder]: 1.566e-05 [get_jit_bprop_graph]: 5.10001e-07 [eliminate_special_op_node]: 0.00045968 [validate]: 5.619e-05 [distribtued_split]: 8.40002e-07 [task_emit]: 0.00600296 [execute]: 5.41e-06 Sums parse : 0.013489s : 10.15% symbol_resolve.resolve : 0.047635s : 35.83% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000003s : 0.00% meta_unpack_prepare : 0.000348s : 0.26% pre_cconv : 0.000005s : 0.00% abstract_specialize : 0.062093s : 46.71% pack_expand : 0.000018s : 0.01% auto_monad : 0.000115s : 0.09% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000022s : 0.02% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000173s : 0.13% optimize.rewriter_before_opt_a : 0.000218s : 0.16% optimize.opt_a.expand_dump_flag : 0.000005s : 0.00% optimize.opt_a.switch_simplify : 0.000109s : 0.08% optimize.opt_a.a_1 : 0.000366s : 0.28% optimize.opt_a.recompute_prepare : 0.000004s : 0.00% optimize.opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% optimize.opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% optimize.opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% optimize.opt_a.parameter_eliminate : 0.000003s : 0.00% optimize.opt_a.a_2 : 0.000099s : 0.07% optimize.opt_a.accelerated_algorithm : 0.000005s : 0.00% optimize.opt_a.pynative_shard : 0.000002s : 0.00% optimize.opt_a.auto_parallel : 0.000007s : 0.01% optimize.opt_a.parallel : 0.000018s : 0.01% optimize.opt_a.merge_comm : 0.000015s : 0.01% optimize.opt_a.allreduce_fusion : 0.000003s : 0.00% optimize.opt_a.virtual_dataset : 0.000005s : 0.00% optimize.opt_a.get_grad_eliminate_ : 0.000004s : 0.00% optimize.opt_a.virtual_output : 0.000003s : 0.00% optimize.opt_a.merge_forward : 0.000007s : 0.01% optimize.opt_a.cell_reuse_recompute_pass : 0.000001s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% optimize.opt_a.meta_fg_expand : 0.000005s : 0.00% optimize.opt_a.after_resolve : 0.000008s : 0.01% optimize.opt_a.a_after_grad : 0.000005s : 0.00% optimize.opt_a.renormalize : 0.000972s : 0.73% optimize.opt_a.real_op_eliminate : 0.000006s : 0.00% optimize.opt_a.auto_monad_grad : 0.000005s : 0.00% optimize.opt_a.auto_monad_eliminator : 0.000012s : 0.01% optimize.opt_a.cse : 0.000045s : 0.03% optimize.opt_a.a_3 : 0.000028s : 0.02% optimize.py_interpret_to_execute_after_opt_a : 0.000007s : 0.01% optimize.slice_cell_reuse_recomputed_activation : 0.000002s : 0.00% optimize.rewriter_after_opt_a : 0.000245s : 0.18% optimize.convert_after_rewriter : 0.000006s : 0.00% optimize.order_py_execute_after_rewriter : 0.000004s : 0.00% optimize.opt_b.b_1 : 0.000039s : 0.03% optimize.opt_b.b_2 : 0.000003s : 0.00% optimize.opt_b.updatestate_depend_eliminate : 0.000003s : 0.00% optimize.opt_b.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000009s : 0.01% optimize.cconv : 0.000023s : 0.02% optimize.opt_after_cconv.c_1 : 0.000005s : 0.00% optimize.opt_after_cconv.parameter_eliminate : 0.000001s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.cse : 0.000006s : 0.00% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000007s : 0.01% optimize.tuple_transform.d_1 : 0.000012s : 0.01% optimize.tuple_transform.d_2 : 0.000005s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000009s : 0.01% optimize.add_recomputation : 0.000044s : 0.03% optimize.cse_after_recomputation.cse : 0.000007s : 0.01% optimize.environ_conv : 0.000017s : 0.01% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000002s : 0.00% optimize.assign_add_opt : 0.000002s : 0.00% optimize.slice_recompute_activation : 0.000002s : 0.00% optimize.micro_interleaved_order_control : 0.000001s : 0.00% optimize.full_micro_interleaved_order_control : 0.000001s : 0.00% optimize.comp_comm_scheduling : 0.000001s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000001s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000001s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000000s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000001s : 0.00% optimize.process_send_recv_for_ge : 0.000002s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% eliminate_special_op_node : 0.000460s : 0.35% validate : 0.000056s : 0.04% distribtued_split : 0.000001s : 0.00% task_emit : 0.006003s : 4.52% execute : 0.000005s : 0.00% Time group info: ------[substitution.] 0.046628 288 0.00% : 0.000002s : 1: substitution.depend_value_elim 99.36% : 0.046329s : 62: substitution.getattr_setattr_resolve 0.01% : 0.000003s : 3: substitution.graph_param_transform 0.34% : 0.000160s : 11: substitution.inline 0.25% : 0.000119s : 196: substitution.meta_unpack_prepare 0.00% : 0.000001s : 3: substitution.partial_unused_args_eliminate 0.00% : 0.000001s : 4: substitution.remove_not_recompute_node 0.00% : 0.000002s : 2: substitution.replace_old_param 0.01% : 0.000006s : 5: substitution.switch_simplify 0.01% : 0.000006s : 1: substitution.tuple_list_get_item_eliminator ------[renormalize.] 0.000966 2 65.58% : 0.000634s : 1: renormalize.infer 34.42% : 0.000333s : 1: renormalize.specialize ------[replace.] 0.000815 78 0.77% : 0.000006s : 1: replace.depend_value_elim 84.73% : 0.000691s : 60: replace.getattr_setattr_resolve 7.34% : 0.000060s : 11: replace.inline 6.36% : 0.000052s : 5: replace.switch_simplify 0.81% : 0.000007s : 1: replace.tuple_list_get_item_eliminator ------[match.] 0.046316 78 0.00% : 0.000002s : 1: match.depend_value_elim 99.63% : 0.046143s : 60: match.getattr_setattr_resolve 0.35% : 0.000160s : 11: match.inline 0.01% : 0.000006s : 5: match.switch_simplify 0.01% : 0.000006s : 1: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.003066 27 82.56% : 0.002531s : 14: func_graph_cloner_run.FuncGraphClonerGraph 17.44% : 0.000535s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048611 122 0.26% : 0.000128s : 69: opt.transform.opt_a 0.06% : 0.000031s : 23: opt.transform.opt_b 97.91% : 0.047598s : 2: opt.transform.opt_resolve 0.67% : 0.000325s : 1: opt.transforms.meta_unpack_prepare 1.03% : 0.000502s : 20: opt.transforms.opt_a 0.01% : 0.000003s : 1: opt.transforms.opt_after_cconv 0.00% : 0.000002s : 1: opt.transforms.opt_b 0.03% : 0.000015s : 2: opt.transforms.opt_trans_graph 0.02% : 0.000008s : 3: opt.transforms.special_op_eliminate TotalTime = 0.159763, [20] [parse]: 0.00179566 [symbol_resolve]: 0.024231, [1] [Cycle 1]: 0.0240941, [1] [resolve]: 0.0240525 [combine_like_graphs]: 7.29997e-07 [graph_reusing]: 4.14e-06 [meta_unpack_prepare]: 0.00030211 [pre_cconv]: 4.50003e-07 [abstract_specialize]: 0.118996 [pack_expand]: 2.308e-05 [auto_monad]: 0.00047227 [inline]: 2.28e-06 [pre_auto_parallel]: 1.176e-05 [pipeline_split]: 2.67e-06 [optimize]: 0.00820893, [35] [py_interpret_to_execute]: 6.29e-05 [rewriter_before_opt_a]: 0.00035324 [opt_a]: 0.0070806, [2] [Cycle 1]: 0.00429698, [30] [expand_dump_flag]: 5.9e-06 [switch_simplify]: 0.00018776 [a_1]: 0.00067768 [recompute_prepare]: 4.04e-06 [updatestate_depend_eliminate]: 9.59e-06 [updatestate_assign_eliminate]: 4.42e-06 [updatestate_loads_eliminate]: 4.41e-06 [parameter_eliminate]: 2.65001e-06 [a_2]: 9.16e-05 [accelerated_algorithm]: 3.21e-06 [pynative_shard]: 1.36e-06 [auto_parallel]: 3.37e-06 [parallel]: 6.34e-06 [merge_comm]: 3.42e-06 [allreduce_fusion]: 2.23e-06 [virtual_dataset]: 2.69e-06 [get_grad_eliminate_]: 2.26e-06 [virtual_output]: 1.98001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 4.69998e-07 [cell_reuse_handle_not_recompute_node_pass]: 5.69e-06 [meta_fg_expand]: 4.04e-06 [after_resolve]: 4.87e-06 [a_after_grad]: 2.7e-06 [renormalize]: 0.00303513 [real_op_eliminate]: 6.24e-06 [auto_monad_grad]: 4.24e-06 [auto_monad_eliminator]: 1.067e-05 [cse]: 2.676e-05 [a_3]: 1.984e-05 [Cycle 2]: 0.0002618, [30] [expand_dump_flag]: 1.46e-06 [switch_simplify]: 2.7e-06 [a_1]: 2.737e-05 [recompute_prepare]: 1.98e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.29e-06 [parameter_eliminate]: 9.69994e-07 [a_2]: 3.219e-05 [accelerated_algorithm]: 3.22e-06 [pynative_shard]: 1.49e-06 [auto_parallel]: 3.46e-06 [parallel]: 3.74e-06 [merge_comm]: 2.12e-06 [allreduce_fusion]: 1.38e-06 [virtual_dataset]: 3.22e-06 [get_grad_eliminate_]: 1.92e-06 [virtual_output]: 1.82e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 3.79994e-07 [cell_reuse_handle_not_recompute_node_pass]: 5.24e-06 [meta_fg_expand]: 2.26e-06 [after_resolve]: 3.99e-06 [a_after_grad]: 2.72e-06 [renormalize]: 6.99947e-08 [real_op_eliminate]: 2.12e-06 [auto_monad_grad]: 9.5e-07 [auto_monad_eliminator]: 4.81e-06 [cse]: 1.174e-05 [a_3]: 1.419e-05 [py_interpret_to_execute_after_opt_a]: 9.91e-06 [slice_cell_reuse_recomputed_activation]: 1.45e-06 [rewriter_after_opt_a]: 0.00025619 [convert_after_rewriter]: 6.65e-06 [order_py_execute_after_rewriter]: 3.2e-06 [opt_b]: 0.00010033, [1] [Cycle 1]: 9.545e-05, [7] [b_1]: 4.294e-05 [b_2]: 4.23e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.11e-06 [renormalize]: 4.99997e-07 [cse]: 1.245e-05 [cconv]: 2.361e-05 [opt_after_cconv]: 5.426e-05, [1] [Cycle 1]: 5.025e-05, [7] [c_1]: 5.98e-06 [parameter_eliminate]: 8.90002e-07 [updatestate_depend_eliminate]: 2.50999e-06 [updatestate_assign_eliminate]: 2.02e-06 [updatestate_loads_eliminate]: 1.82e-06 [cse]: 8.72e-06 [renormalize]: 2.70004e-07 [remove_dup_value]: 8.46e-06 [tuple_transform]: 3.616e-05, [1] [Cycle 1]: 3.209e-05, [3] [d_1]: 1.492e-05 [d_2]: 5.92e-06 [renormalize]: 1.8e-07 [add_cache_embedding]: 9.93e-06 [add_recomputation]: 4.142e-05 [cse_after_recomputation]: 1.806e-05, [1] [Cycle 1]: 1.403e-05, [1] [cse]: 9.05e-06 [environ_conv]: 5.83e-06 [label_micro_interleaved_index]: 2.19e-06 [label_fine_grained_interleaved_index]: 1.63e-06 [assign_add_opt]: 1.4e-06 [slice_recompute_activation]: 1.3e-06 [micro_interleaved_order_control]: 1.31e-06 [full_micro_interleaved_order_control]: 1.32e-06 [comp_comm_scheduling]: 1.21e-06 [reorder_send_recv_between_fp_bp]: 1.27999e-06 [comm_op_add_attrs]: 9.79999e-07 [add_comm_op_reuse_tag]: 9.29998e-07 [overlap_opt_shard_in_pipeline]: 9.20001e-07 [grouped_pairwise_exchange_alltoall]: 8.90002e-07 [overlap_recompute_and_grad_model_parallel]: 1.06e-06 [overlap_grad_matmul_and_grad_allreduce]: 4.69998e-07 [split_matmul_comm_elemetwise]: 1.47001e-06 [split_layernorm_comm]: 1.33e-06 [process_send_recv_for_ge]: 6.29996e-07 [handle_group_info]: 5.60001e-07 [auto_monad_reorder]: 1.236e-05 [get_jit_bprop_graph]: 2.89998e-07 [eliminate_special_op_node]: 0.000506 [validate]: 2.356e-05 [distribtued_split]: 8.10003e-07 [task_emit]: 0.00491364 [execute]: 6.58999e-06 Sums parse : 0.001796s : 1.15% symbol_resolve.resolve : 0.024053s : 15.38% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000004s : 0.00% meta_unpack_prepare : 0.000302s : 0.19% pre_cconv : 0.000000s : 0.00% abstract_specialize : 0.118996s : 76.11% pack_expand : 0.000023s : 0.01% auto_monad : 0.000472s : 0.30% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000012s : 0.01% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000063s : 0.04% optimize.rewriter_before_opt_a : 0.000353s : 0.23% optimize.opt_a.expand_dump_flag : 0.000007s : 0.00% optimize.opt_a.switch_simplify : 0.000190s : 0.12% optimize.opt_a.a_1 : 0.000705s : 0.45% optimize.opt_a.recompute_prepare : 0.000006s : 0.00% optimize.opt_a.updatestate_depend_eliminate : 0.000013s : 0.01% optimize.opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% optimize.opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% optimize.opt_a.parameter_eliminate : 0.000004s : 0.00% optimize.opt_a.a_2 : 0.000124s : 0.08% optimize.opt_a.accelerated_algorithm : 0.000006s : 0.00% optimize.opt_a.pynative_shard : 0.000003s : 0.00% optimize.opt_a.auto_parallel : 0.000007s : 0.00% optimize.opt_a.parallel : 0.000010s : 0.01% optimize.opt_a.merge_comm : 0.000006s : 0.00% optimize.opt_a.allreduce_fusion : 0.000004s : 0.00% optimize.opt_a.virtual_dataset : 0.000006s : 0.00% optimize.opt_a.get_grad_eliminate_ : 0.000004s : 0.00% optimize.opt_a.virtual_output : 0.000004s : 0.00% optimize.opt_a.merge_forward : 0.000007s : 0.00% optimize.opt_a.cell_reuse_recompute_pass : 0.000001s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000011s : 0.01% optimize.opt_a.meta_fg_expand : 0.000006s : 0.00% optimize.opt_a.after_resolve : 0.000009s : 0.01% optimize.opt_a.a_after_grad : 0.000005s : 0.00% optimize.opt_a.renormalize : 0.003035s : 1.94% optimize.opt_a.real_op_eliminate : 0.000008s : 0.01% optimize.opt_a.auto_monad_grad : 0.000005s : 0.00% optimize.opt_a.auto_monad_eliminator : 0.000015s : 0.01% optimize.opt_a.cse : 0.000038s : 0.02% optimize.opt_a.a_3 : 0.000034s : 0.02% optimize.py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% optimize.slice_cell_reuse_recomputed_activation : 0.000001s : 0.00% optimize.rewriter_after_opt_a : 0.000256s : 0.16% optimize.convert_after_rewriter : 0.000007s : 0.00% optimize.order_py_execute_after_rewriter : 0.000003s : 0.00% optimize.opt_b.b_1 : 0.000043s : 0.03% optimize.opt_b.b_2 : 0.000004s : 0.00% optimize.opt_b.updatestate_depend_eliminate : 0.000003s : 0.00% optimize.opt_b.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000012s : 0.01% optimize.cconv : 0.000024s : 0.02% optimize.opt_after_cconv.c_1 : 0.000006s : 0.00% optimize.opt_after_cconv.parameter_eliminate : 0.000001s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000003s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.cse : 0.000009s : 0.01% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000008s : 0.01% optimize.tuple_transform.d_1 : 0.000015s : 0.01% optimize.tuple_transform.d_2 : 0.000006s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000010s : 0.01% optimize.add_recomputation : 0.000041s : 0.03% optimize.cse_after_recomputation.cse : 0.000009s : 0.01% optimize.environ_conv : 0.000006s : 0.00% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000002s : 0.00% optimize.assign_add_opt : 0.000001s : 0.00% optimize.slice_recompute_activation : 0.000001s : 0.00% optimize.micro_interleaved_order_control : 0.000001s : 0.00% optimize.full_micro_interleaved_order_control : 0.000001s : 0.00% optimize.comp_comm_scheduling : 0.000001s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000001s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000001s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000000s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000001s : 0.00% optimize.split_layernorm_comm : 0.000001s : 0.00% optimize.process_send_recv_for_ge : 0.000001s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000000s : 0.00% eliminate_special_op_node : 0.000506s : 0.32% validate : 0.000024s : 0.02% distribtued_split : 0.000001s : 0.00% task_emit : 0.004914s : 3.14% execute : 0.000007s : 0.00% Time group info: ------[substitution.] 0.023185 313 0.01% : 0.000003s : 2: substitution.depend_value_elim 98.12% : 0.022750s : 62: substitution.getattr_setattr_resolve 0.02% : 0.000004s : 4: substitution.graph_param_transform 1.33% : 0.000308s : 24: substitution.inline 0.32% : 0.000075s : 196: substitution.meta_unpack_prepare 0.00% : 0.000001s : 4: substitution.partial_unused_args_eliminate 0.00% : 0.000001s : 4: substitution.remove_not_recompute_node 0.01% : 0.000002s : 2: substitution.replace_old_param 0.12% : 0.000027s : 3: substitution.reshape_eliminate 0.04% : 0.000010s : 11: substitution.switch_simplify 0.02% : 0.000005s : 1: substitution.tuple_list_get_item_eliminator ------[renormalize.] 0.003030 2 69.50% : 0.002106s : 1: renormalize.infer 30.50% : 0.000924s : 1: renormalize.specialize ------[replace.] 0.000952 98 1.18% : 0.000011s : 2: replace.depend_value_elim 74.82% : 0.000712s : 60: replace.getattr_setattr_resolve 12.91% : 0.000123s : 24: replace.inline 10.28% : 0.000098s : 11: replace.switch_simplify 0.81% : 0.000008s : 1: replace.tuple_list_get_item_eliminator ------[match.] 0.022959 98 0.01% : 0.000003s : 2: match.depend_value_elim 98.59% : 0.022634s : 60: match.getattr_setattr_resolve 1.34% : 0.000308s : 24: match.inline 0.04% : 0.000010s : 11: match.switch_simplify 0.02% : 0.000005s : 1: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.008036 82 83.60% : 0.006718s : 56: func_graph_cloner_run.FuncGraphClonerGraph 16.40% : 0.001318s : 26: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025466 122 0.56% : 0.000142s : 69: opt.transform.opt_a 0.13% : 0.000034s : 23: opt.transform.opt_b 94.42% : 0.024045s : 2: opt.transform.opt_resolve 1.10% : 0.000281s : 1: opt.transforms.meta_unpack_prepare 3.65% : 0.000929s : 20: opt.transforms.opt_a 0.02% : 0.000005s : 1: opt.transforms.opt_after_cconv 0.01% : 0.000003s : 1: opt.transforms.opt_b 0.08% : 0.000019s : 2: opt.transforms.opt_trans_graph 0.03% : 0.000008s : 3: opt.transforms.special_op_eliminate .. ============================== 2 passed in 21.56s ============================== [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.708.960 [status:INIT] [ge_api.cc:463]130450 ~Session:Start to destruct session. [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.709.038 [status:RUNNING] [ge_api.cc:475]130450 ~Session:Session id is 0 [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.709.049 [status:RUNNING] [ge_api.cc:476]130450 ~Session:Destroying session [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.710.092 [status:STOP] [ge_api.cc:491]130450 ~Session:Session Destructor finished [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.710.142 [status:INIT] [ge_api.cc:301]130450 GEFinalize:GEFinalize start [INFO] GE(130450,python3.7):2024-01-11-05:43:10.710.230 [execution_runtime.cc:80][EVENT]130450 FinalizeExecutionRuntime:Execution runtime finalize begin. [INFO] GE(130450,python3.7):2024-01-11-05:43:10.710.251 [execution_runtime.cc:92][EVENT]130450 FinalizeExecutionRuntime:Execution runtime finalized. [TRACE] GE(130450,python3.7):2024-01-11-05:43:10.710.262 [status:RUNNING] [ge_api.cc:313]130450 GEFinalize:Finalizing environment [INFO] TUNE(130450,python3.7):2024-01-11-05:43:11.059.586 [cann_kb_pyfunc_mgr.cpp:127][CANNKB][Tid:130450]"CannKbPyfuncMgr: enter PyObjectDeinit function, reference_[1]" [INFO] TUNE(130450,python3.7):2024-01-11-05:43:11.059.654 [cann_kb_pyfunc_mgr.cpp:138][CANNKB][Tid:130450]"CannKbPyfuncMgr: PyObjectDeinit function end successfully!" [INFO] GE(130450,python3.7):2024-01-11-05:43:11.061.188 [gelib.cc:324][EVENT]130450 SystemFinalize:Online infer finalize GELib success. [TRACE] GE(130450,python3.7):2024-01-11-05:43:11.667.030 [status:STOP] [ge_api.cc:341]130450 GEFinalize:GEFinalize finished [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.351.449 [process_mode_manager.cpp:184][Close][tid:130450] [TsdClient] Close [deviceId=3][sessionId=1] hccp and computer enter [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.351.524 [version_verify.cpp:112][SpecialFeatureCheck][tid:130450] VersionVerify: previous type[7], supported [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.351.573 [process_mode_manager.cpp:192][Close][tid:130450] [TsdClient][deviceId=3] [sessionId=1] wait hccp and computer process close respond [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.372.979 [process_mode_manager.cpp:197][Close][tid:130450] [TsdClient][logicDeviceId_=3]has recv close hccp and computer process respond [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.372.997 [stub_process_mode_nowin.cpp:151][CloseInHost][tid:130450] enter into CloseInHost deviceid[3] [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.373.008 [stub_process_mode_nowin.cpp:154][CloseInHost][tid:130450] host cpu not support [INFO] TDT(130450,python3.7):2024-01-11-05:43:12.373.053 [process_mode_manager.cpp:208][Close][tid:130450] [TsdClient][deviceId=3] [sessionId=1] close hccp and computer process success [INFO] ATRACE(130450,python3.7):2024-01-11-05:43:12.373.066 [atrace_api.c:93](tid:130450) AtraceDestroy start [INFO] ATRACE(130450,python3.7):2024-01-11-05:43:12.373.085 [atrace_api.c:95](tid:130450) AtraceDestroy end [INFO] PROFILING(130450,python3.7):2024-01-11-05:43:12.373.108 [msprofiler_impl.cpp:156] >>> (tid:130450) ProfNotifySetDevice called, is open: 0, devId: 3 [INFO] RUNTIME(130450,python3.7):2024-01-11-05:43:14.196.180 [runtime.cc:1737] 130450 ~Runtime: deconstruct runtime.