============================= test session starts ============================== platform linux -- Python 3.7.5, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/heterogeneous, inifile: /home/jenkins/sault/virtual_test/virtualenv_006/sault/config/pytest.ini plugins: ordering-0.6, anyio-3.7.1, timeout-2.1.0, xdist-1.32.0, forked-1.1.3 [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:07.377.427 [trace_attr.c:105](tid:56855) platform is 1. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:07.377.626 [trace_recorder.c:114](tid:56855) use root path: /home/jenkins/ascend/atrace [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:07.377.655 [trace_signal.c:133](tid:56855) register signal handler for signo 2 succeed. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:07.377.666 [trace_signal.c:133](tid:56855) register signal handler for signo 15 succeed. [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:07.794.443 [runtime.cc:1159] 56855 GetAicoreNumByLevel: workingDev_=0 [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:07.794.511 [runtime.cc:4719] 56855 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set collected 2 items test_heter_control.py [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.483.956 [process_mode_manager.cpp:109][OpenProcess][tid:56855] [ProcessModeManager] enter into open process deviceId[5] rankSize[0] [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.484.968 [process_mode_manager.cpp:379][InitTsdClient][tid:56855] [TsdClient] deviceId[5] begin to init hdc client [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.100 [version_verify.cpp:34][SetVersionInfo][tid:56855] VersionVerify: send client version to server [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.131 [version_verify.cpp:50][SetVersionInfo][tid:56855] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.144 [version_verify.cpp:50][SetVersionInfo][tid:56855] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.443 [version_verify.cpp:66][PeerVersionCheck][tid:56855] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.458 [version_verify.cpp:87][ParseVersionInfo][tid:56855] VersionVerify: pass client version info success [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.468 [hdc_client.cpp:276][CheckHdcConnection][tid:56855] Service[2] create hdc success [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.482 [version_verify.cpp:120][SpecialFeatureCheck][tid:56855] VersionVerify: new type[35], supported [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.522 [process_mode_manager.cpp:748][GetDeviceCheckCode][tid:56855] [TsdClient][deviceId=5] [sessionId=1] wait package info respond [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.647 [process_mode_manager.cpp:379][InitTsdClient][tid:56855] [TsdClient] deviceId[5] begin to init hdc client [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.809 [version_verify.cpp:34][SetVersionInfo][tid:56855] VersionVerify: send client version to server [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.823 [version_verify.cpp:50][SetVersionInfo][tid:56855] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.833 [version_verify.cpp:50][SetVersionInfo][tid:56855] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.974 [version_verify.cpp:66][PeerVersionCheck][tid:56855] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.986 [version_verify.cpp:87][ParseVersionInfo][tid:56855] VersionVerify: pass client version info success [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.485.995 [hdc_client.cpp:276][CheckHdcConnection][tid:56855] Service[2] create hdc success [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.486.006 [process_mode_manager.cpp:426][ConstructOpenMsg][tid:56855] [TsdClient] tsd get process sign successfully, procpid[56855] signSize[48] [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.486.031 [version_verify.cpp:112][SpecialFeatureCheck][tid:56855] VersionVerify: previous type[6], supported [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.486.052 [process_mode_manager.cpp:126][OpenProcess][tid:56855] [ProcessModeManager] deviceId[5] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.705.820 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:56855] [TsdClient] it is unnecessary of current mode[0] chiptype[1] to grant queue auth to aicpusd [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.705.861 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:56855] enter into OpenInHost deviceid[5] [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.705.871 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:56855] host cpu not support [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.705.879 [process_mode_manager.cpp:156][OpenProcess][tid:56855] [TsdClient][deviceId=5] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:12.708.554 [device.cc:340] 56855 Init: isDoubledie:0, topologytype:0 [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:12.723.430 [npu_driver.cc:5428] 58027 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:12.723.458 [atrace_api.c:28](tid:56855) AtraceCreate start [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:12.723.577 [trace_rb_log.c:84](tid:56855) [RUNTIME_ATRACE_DEV5_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:12.723.592 [atrace_api.c:32](tid:56855) AtraceCreate end [INFO] TDT(56855,python3.7):2024-01-10-11:47:12.723.609 [client_manager.cpp:157][SetProfilingCallback][tid:56855] [TsdClient] set profiling callback success [TRACE] GE(56855,python3.7):2024-01-10-11:47:12.874.573 [status:INIT] [ge_api.cc:144]56855 GEInitializeImpl:GEInitialize start [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:13.084.109 [msprofiler_impl.cpp:156] >>> (tid:56855) ProfNotifySetDevice called, is open: 1, devId: 5 [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:13.084.235 [platform.cpp:38] >>> (tid:56855) Profiling platform version: 1.0. [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:13.084.250 [ai_drv_dev_api.cpp:384] >>> (tid:56855) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(56855,python3.7):2024-01-10-11:47:13.132.821 [status:RUNNING] [ge_api.cc:211]56855 GEInitializeImpl:Initializing environment [INFO] GE(56855,python3.7):2024-01-10-11:47:13.132.892 [gelib.cc:98][EVENT]56855 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(56855,python3.7):2024-01-10-11:47:13.133.213 [gelib.cc:307][EVENT]56855 SystemInitialize:Online infer init GELib success, device id :5 [INFO] DVPP(56855,python3.7):2024-01-10-11:47:13.476.875 [dvpp_engine.cc:41][ENGINE][Initialize:41][tid:56855]dvpp engine do not support [INFO] TUNE(56855,python3.7):2024-01-10-11:47:13.480.747 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:56855]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(56855,python3.7):2024-01-10-11:47:13.480.785 [handle_manager.cpp:115][CANNKB][Tid:56855]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(56855,python3.7):2024-01-10-11:47:13.480.847 [handle_manager.cpp:407][CANNKB][Tid:56855]"Init functions of loading dynamic python lib end!" [INFO] TUNE(56855,python3.7):2024-01-10-11:47:13.480.858 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:56855]"CANN_KB_Py has already been initialized." [INFO] TUNE(56855,python3.7):2024-01-10-11:47:13.480.958 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:56855]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] HCCL(56855,python3.7):2024-01-10-11:47:25.387.609 [plugin_manager.cc:42][56855]hcom running normal mode. [INFO] DVPP(56855,python3.7):2024-01-10-11:47:25.388.203 [dvpp_engine.cc:92][ENGINE][GetOpsKernelInfoStores:92][tid:56855]dvpp ops kernel info store do not support [INFO] DVPP(56855,python3.7):2024-01-10-11:47:25.388.340 [dvpp_engine.cc:69][ENGINE][GetGraphOptimizerObjs:69][tid:56855]dvpp graph optimizer do not support [INFO] DVPP(56855,python3.7):2024-01-10-11:47:25.907.561 [dvpp_ops_kernel_builder.cc:48][ENGINE][Initialize:48][tid:56855]dvpp ops kernel builder do not support [INFO] GE(56855,python3.7):2024-01-10-11:47:25.916.272 [gelib.cc:169][EVENT]56855 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [12783327] micro second. [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.007.727 [status:STOP] [ge_api.cc:255]56855 GEInitializeImpl:GEInitialize finished [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.007.863 [status:INIT] [ge_api.cc:398]56855 Session:Start to construct session. [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.007.880 [status:RUNNING] [ge_api.cc:408]56855 Session:Creating session [INFO] GE(56855,python3.7):2024-01-10-11:47:26.008.346 [graph_var_manager.cc:1445][EVENT]56855 SetMemoryMallocSize:Total memory size is 34359738368 [INFO] GE(56855,python3.7):2024-01-10-11:47:26.008.362 [graph_var_manager.cc:1424][EVENT]56855 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:26.008.683 [msprofiler_impl.cpp:156] >>> (tid:56855) ProfNotifySetDevice called, is open: 1, devId: 5 [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.009.448 [status:RUNNING] [ge_api.cc:411]56855 Session:Session id is 0 [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.009.467 [status:STOP] [ge_api.cc:420]56855 Session:Session Constructor finished [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:26.018.984 [platform.cpp:38] >>> (tid:56855) Profiling platform version: 1.0. [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:26.019.010 [ai_drv_dev_api.cpp:384] >>> (tid:56855) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(56855,python3.7):2024-01-10-11:47:26.019.175 [status:INIT] [ge_api.cc:144]56855 GEInitializeImpl:GEInitialize start TotalTime = 13.6261, [20] [parse]: 0.0151693 [symbol_resolve]: 0.00107691, [1] [Cycle 1]: 0.0010209, [1] [resolve]: 0.00100183 [combine_like_graphs]: 1.15e-06 [graph_reusing]: 3.29e-06 [meta_unpack_prepare]: 6.458e-05 [pre_cconv]: 3.63e-06 [abstract_specialize]: 0.0312713 [pack_expand]: 1.929e-05 [auto_monad]: 0.00015383 [inline]: 2.01001e-06 [pre_auto_parallel]: 1.452e-05 [pipeline_split]: 2.97e-06 [optimize]: 0.0115758, [35] [py_interpret_to_execute]: 3.276e-05 [rewriter_before_opt_a]: 0.00010403 [opt_a]: 0.00990161, [2] [Cycle 1]: 0.00325227, [30] [expand_dump_flag]: 4.78001e-06 [switch_simplify]: 8.348e-05 [a_1]: 0.00071648 [recompute_prepare]: 1.286e-05 [updatestate_depend_eliminate]: 1.611e-05 [updatestate_assign_eliminate]: 1.034e-05 [updatestate_loads_eliminate]: 1.039e-05 [parameter_eliminate]: 7.68e-06 [a_2]: 0.00014031 [accelerated_algorithm]: 1.19e-05 [pynative_shard]: 1.68e-06 [auto_parallel]: 4.06001e-06 [parallel]: 2.071e-05 [merge_comm]: 9.69e-06 [allreduce_fusion]: 2.13e-06 [virtual_dataset]: 7.69e-06 [get_grad_eliminate_]: 6.43e-06 [virtual_output]: 6.14e-06 [merge_forward]: 1.17e-05 [cell_reuse_recompute_pass]: 7.7e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [meta_fg_expand]: 8.61e-06 [after_resolve]: 8.47e-06 [a_after_grad]: 8.1e-06 [renormalize]: 0.00178802 [real_op_eliminate]: 1.118e-05 [auto_monad_grad]: 7.25e-06 [auto_monad_eliminator]: 2.64e-05 [cse]: 7.475e-05 [a_3]: 5.969e-05 [Cycle 2]: 0.00061601, [30] [expand_dump_flag]: 1.44e-06 [switch_simplify]: 1.101e-05 [a_1]: 0.00010878 [recompute_prepare]: 1.039e-05 [updatestate_depend_eliminate]: 1.087e-05 [updatestate_assign_eliminate]: 9.51e-06 [updatestate_loads_eliminate]: 8.91e-06 [parameter_eliminate]: 3.18e-06 [a_2]: 0.00012407 [accelerated_algorithm]: 1.028e-05 [pynative_shard]: 1.37e-06 [auto_parallel]: 3.98e-06 [parallel]: 4.45999e-06 [merge_comm]: 2.43e-06 [allreduce_fusion]: 1.55999e-06 [virtual_dataset]: 6.82e-06 [get_grad_eliminate_]: 6.09e-06 [virtual_output]: 6.01e-06 [merge_forward]: 1.066e-05 [cell_reuse_recompute_pass]: 3.89999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.711e-05 [meta_fg_expand]: 6.44e-06 [after_resolve]: 7.13e-06 [a_after_grad]: 7.99e-06 [renormalize]: 6.99947e-08 [real_op_eliminate]: 6.1e-06 [auto_monad_grad]: 2.3e-06 [auto_monad_eliminator]: 1.93e-05 [cse]: 4.136e-05 [a_3]: 5.406e-05 [py_interpret_to_execute_after_opt_a]: 2.271e-05 [slice_cell_reuse_recomputed_activation]: 2.24e-06 [rewriter_after_opt_a]: 0.00030781 [convert_after_rewriter]: 1.872e-05 [order_py_execute_after_rewriter]: 1.274e-05 [opt_b]: 0.00027003, [1] [Cycle 1]: 0.00026425, [7] [b_1]: 0.00015297 [b_2]: 8.39e-06 [updatestate_depend_eliminate]: 1.07e-05 [updatestate_assign_eliminate]: 9.29e-06 [updatestate_loads_eliminate]: 9.03e-06 [renormalize]: 2.99995e-07 [cse]: 4.426e-05 [cconv]: 0.00019201 [opt_after_cconv]: 0.00020038, [1] [Cycle 1]: 0.00019519, [7] [c_1]: 3.218e-05 [parameter_eliminate]: 5.88e-06 [updatestate_depend_eliminate]: 1.426e-05 [updatestate_assign_eliminate]: 1.207e-05 [updatestate_loads_eliminate]: 1.161e-05 [cse]: 8.746e-05 [renormalize]: 3.39998e-07 [remove_dup_value]: 6.01e-05 [tuple_transform]: 0.00011294, [1] [Cycle 1]: 0.00010836, [3] [d_1]: 6.473e-05 [d_2]: 3.055e-05 [renormalize]: 2.09999e-07 [add_cache_embedding]: 2.598e-05 [add_recomputation]: 7.314e-05 [cse_after_recomputation]: 5.97e-05, [1] [Cycle 1]: 5.494e-05, [1] [cse]: 5.006e-05 [environ_conv]: 1.715e-05 [label_micro_interleaved_index]: 2.36e-06 [label_fine_grained_interleaved_index]: 2.26e-06 [assign_add_opt]: 1.57001e-06 [slice_recompute_activation]: 2.75e-06 [micro_interleaved_order_control]: 2.01e-06 [full_micro_interleaved_order_control]: 1.83e-06 [comp_comm_scheduling]: 2.2e-06 [reorder_send_recv_between_fp_bp]: 2.29e-06 [comm_op_add_attrs]: 1.07e-06 [add_comm_op_reuse_tag]: 1.14e-06 [overlap_opt_shard_in_pipeline]: 1.22e-06 [grouped_pairwise_exchange_alltoall]: 1.43e-06 [overlap_recompute_and_grad_model_parallel]: 1.98e-06 [overlap_grad_matmul_and_grad_allreduce]: 7.30004e-07 [split_matmul_comm_elemetwise]: 2.45e-06 [split_layernorm_comm]: 1.68e-06 [process_send_recv_for_ge]: 2.9e-06 [handle_group_info]: 9.80006e-07 [auto_monad_reorder]: 5.543e-05 [get_jit_bprop_graph]: 4.39999e-07 [eliminate_special_op_node]: 0.00051017 [validate]: 6.191e-05 [distribtued_split]: 1.39e-06 [task_emit]: 13.5659 [execute]: 9.98e-06 Sums parse : 0.015169s : 0.11% symbol_resolve.resolve : 0.001002s : 0.01% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000003s : 0.00% meta_unpack_prepare : 0.000065s : 0.00% pre_cconv : 0.000004s : 0.00% abstract_specialize : 0.031271s : 0.23% pack_expand : 0.000019s : 0.00% auto_monad : 0.000154s : 0.00% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000015s : 0.00% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000033s : 0.00% optimize.rewriter_before_opt_a : 0.000104s : 0.00% optimize.opt_a.expand_dump_flag : 0.000006s : 0.00% optimize.opt_a.switch_simplify : 0.000094s : 0.00% optimize.opt_a.a_1 : 0.000825s : 0.01% optimize.opt_a.recompute_prepare : 0.000023s : 0.00% optimize.opt_a.updatestate_depend_eliminate : 0.000027s : 0.00% optimize.opt_a.updatestate_assign_eliminate : 0.000020s : 0.00% optimize.opt_a.updatestate_loads_eliminate : 0.000019s : 0.00% optimize.opt_a.parameter_eliminate : 0.000011s : 0.00% optimize.opt_a.a_2 : 0.000264s : 0.00% optimize.opt_a.accelerated_algorithm : 0.000022s : 0.00% optimize.opt_a.pynative_shard : 0.000003s : 0.00% optimize.opt_a.auto_parallel : 0.000008s : 0.00% optimize.opt_a.parallel : 0.000025s : 0.00% optimize.opt_a.merge_comm : 0.000012s : 0.00% optimize.opt_a.allreduce_fusion : 0.000004s : 0.00% optimize.opt_a.virtual_dataset : 0.000015s : 0.00% optimize.opt_a.get_grad_eliminate_ : 0.000013s : 0.00% optimize.opt_a.virtual_output : 0.000012s : 0.00% optimize.opt_a.merge_forward : 0.000022s : 0.00% optimize.opt_a.cell_reuse_recompute_pass : 0.000001s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.00% optimize.opt_a.meta_fg_expand : 0.000015s : 0.00% optimize.opt_a.after_resolve : 0.000016s : 0.00% optimize.opt_a.a_after_grad : 0.000016s : 0.00% optimize.opt_a.renormalize : 0.001788s : 0.01% optimize.opt_a.real_op_eliminate : 0.000017s : 0.00% optimize.opt_a.auto_monad_grad : 0.000010s : 0.00% optimize.opt_a.auto_monad_eliminator : 0.000046s : 0.00% optimize.opt_a.cse : 0.000116s : 0.00% optimize.opt_a.a_3 : 0.000114s : 0.00% optimize.py_interpret_to_execute_after_opt_a : 0.000023s : 0.00% optimize.slice_cell_reuse_recomputed_activation : 0.000002s : 0.00% optimize.rewriter_after_opt_a : 0.000308s : 0.00% optimize.convert_after_rewriter : 0.000019s : 0.00% optimize.order_py_execute_after_rewriter : 0.000013s : 0.00% optimize.opt_b.b_1 : 0.000153s : 0.00% optimize.opt_b.b_2 : 0.000008s : 0.00% optimize.opt_b.updatestate_depend_eliminate : 0.000011s : 0.00% optimize.opt_b.updatestate_assign_eliminate : 0.000009s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000009s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000044s : 0.00% optimize.cconv : 0.000192s : 0.00% optimize.opt_after_cconv.c_1 : 0.000032s : 0.00% optimize.opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000012s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000012s : 0.00% optimize.opt_after_cconv.cse : 0.000087s : 0.00% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000060s : 0.00% optimize.tuple_transform.d_1 : 0.000065s : 0.00% optimize.tuple_transform.d_2 : 0.000031s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000026s : 0.00% optimize.add_recomputation : 0.000073s : 0.00% optimize.cse_after_recomputation.cse : 0.000050s : 0.00% optimize.environ_conv : 0.000017s : 0.00% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000002s : 0.00% optimize.assign_add_opt : 0.000002s : 0.00% optimize.slice_recompute_activation : 0.000003s : 0.00% optimize.micro_interleaved_order_control : 0.000002s : 0.00% optimize.full_micro_interleaved_order_control : 0.000002s : 0.00% optimize.comp_comm_scheduling : 0.000002s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000002s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000002s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.process_send_recv_for_ge : 0.000003s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000055s : 0.00% get_jit_bprop_graph : 0.000000s : 0.00% eliminate_special_op_node : 0.000510s : 0.00% validate : 0.000062s : 0.00% distribtued_split : 0.000001s : 0.00% task_emit : 13.565858s : 99.61% execute : 0.000010s : 0.00% Time group info: ------[substitution.] 0.001311 245 3.91% : 0.000051s : 12: substitution.arithmetic_simplify 0.96% : 0.000013s : 2: substitution.cast_eliminate 0.74% : 0.000010s : 4: substitution.compare_switch_simplify 1.51% : 0.000020s : 15: substitution.exchange_switch_depend_value 0.21% : 0.000003s : 4: substitution.float_depend_g_call 62.52% : 0.000820s : 6: substitution.getattr_setattr_resolve 1.70% : 0.000022s : 27: substitution.graph_param_transform 0.32% : 0.000004s : 4: substitution.incorporate_call 0.15% : 0.000002s : 4: substitution.incorporate_call_switch 21.26% : 0.000279s : 13: substitution.inline 0.28% : 0.000004s : 2: substitution.less_batch_normalization 1.32% : 0.000017s : 20: substitution.meta_unpack_prepare 0.26% : 0.000003s : 6: substitution.partial_eliminate 0.45% : 0.000006s : 27: substitution.partial_unused_args_eliminate 0.27% : 0.000004s : 28: substitution.remove_not_recompute_node 0.80% : 0.000010s : 16: substitution.replace_applicator 0.16% : 0.000002s : 2: substitution.replace_old_param 0.37% : 0.000005s : 4: substitution.reset_defer_inline 0.32% : 0.000004s : 8: substitution.set_cell_output_no_recompute 0.11% : 0.000001s : 2: substitution.switch_call_monad_eliminater 0.85% : 0.000011s : 15: substitution.switch_defer_inline 1.54% : 0.000020s : 24: substitution.switch_simplify ------[renormalize.] 0.001781 2 73.95% : 0.001317s : 1: renormalize.infer 26.05% : 0.000464s : 1: renormalize.specialize ------[replace.] 0.000232 22 3.85% : 0.000009s : 2: replace.cast_eliminate 37.94% : 0.000088s : 6: replace.getattr_setattr_resolve 44.60% : 0.000103s : 13: replace.inline 13.61% : 0.000032s : 1: replace.switch_simplify ------[match.] 0.001113 22 1.13% : 0.000013s : 2: match.cast_eliminate 73.65% : 0.000820s : 6: match.getattr_setattr_resolve 25.04% : 0.000279s : 13: match.inline 0.18% : 0.000002s : 1: match.switch_simplify ------[func_graph_cloner_run.] 0.000921 24 36.79% : 0.000339s : 3: func_graph_cloner_run.FuncGraphClonerGraph 12.37% : 0.000114s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.84% : 0.000468s : 19: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.002762 105 14.11% : 0.000390s : 52: opt.transform.opt_a 5.19% : 0.000143s : 23: opt.transform.opt_b 35.74% : 0.000987s : 2: opt.transform.opt_resolve 1.58% : 0.000044s : 1: opt.transforms.meta_unpack_prepare 37.54% : 0.001037s : 20: opt.transforms.opt_a 1.11% : 0.000031s : 1: opt.transforms.opt_after_cconv 0.26% : 0.000007s : 1: opt.transforms.opt_b 3.37% : 0.000093s : 2: opt.transforms.opt_trans_graph 1.10% : 0.000030s : 3: opt.transforms.special_op_eliminate [INFO] GE(56855,python3.7):2024-01-10-11:47:26.038.766 [scalable_config.cc:55][EVENT]57988 ScalableConfig:device total max size: 34359738368, page_mem_size_total_thresold: 32641751449, uncacheable_size_threshold: 17179869184 [INFO] GE(56855,python3.7):2024-01-10-11:47:26.122.495 [graph_var_manager.cc:1424][EVENT]57988 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] GE(56855,python3.7):2024-01-10-11:47:26.122.590 [graph_manager.cc:1248][EVENT]57988 PreRun:PreRun start: graph node size 4, session id 1, graph id 0, graph name online. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:26.123.532 [atrace_api.c:28](tid:57988) AtraceCreate start [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:26.123.610 [trace_rb_log.c:84](tid:57988) [RUNTIME_ATRACE_DEV64_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:26.123.624 [atrace_api.c:32](tid:57988) AtraceCreate end [INFO] TDT(56855,python3.7):2024-01-10-11:47:26.123.650 [client_manager.cpp:157][SetProfilingCallback][tid:57988] [TsdClient] set profiling callback success [INFO] GE(56855,python3.7):2024-01-10-11:47:26.124.609 [parallel_partitioner.cc:165][EVENT]57988 DoPipelinePartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::PipelinePartition is [24] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.124.649 [parallel_partitioner.cc:178][EVENT]57988 DoFlowGraphPartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::FlowGraphPartition is [12] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.124.707 [graph_prepare.cc:1378][EVENT]57988 Init:[GEPERFTRACE] The time cost of FileConstantUtils::ConvertFileConstToConst is [9] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.392 [graph_manager.cc:1050][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareInit is [707] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.420 [graph_manager.cc:1052][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.HandleSummaryOp is [7] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.573 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ForToWhilePass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.605 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::SavePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.679 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::NetOutputPass is [61] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.719 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::DataPass is [1] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.778 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of CreateSubGraphWithScopePass is [21] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.793 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of SubgraphMultiDimsClonePass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.840 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of MultiBatchClonePass is [13] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.938 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SplitVariableIntoSubgraphPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.125.959 [graph_manager.cc:1054][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.NormalizeGraph is [526] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.132.333 [graph_manager.cc:1055][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeGraphInit is [6358] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.478 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of AssertPass is [2] micro second, call num is [8] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.504 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [4] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.516 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of MergePass is [5] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.525 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of InferShapePass is [384] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.535 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [17] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.543 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [2] micro second, call num is [8] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.552 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [22] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.560 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [22] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.133.568 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of InferValuePass is [13] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.274 [graph_manager.cc:1056][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphForQuantize is [2906] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.340 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of CondRemovePass is [4] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.358 [graph_prepare.cc:1982][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::ProcessBeforeInfershape is [52] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.783 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [8] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.805 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.816 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of MergePass is [0] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.825 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of InferShapePass is [223] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.834 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.843 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [1] micro second, call num is [8] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.852 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [6] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.869 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.879 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of InferValuePass is [5] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.906 [graph_prepare.cc:1983][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::FormatAndShapeProcess is [533] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.931 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PreRun::MarkForceUnknownForCondPass is [6] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.943 [graph_prepare.cc:1984][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::CtrlFlowPreProcess is [23] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.958 [graph_prepare.cc:1985][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::multibatch::GetDynamicOutputShape is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.976 [graph_prepare.cc:1986][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::InsertAippOpUtil::Instance().UpdateDataNodeByAipp is [7] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.135.989 [graph_prepare.cc:1987][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::SaveOriginalGraphToOmModel is [0] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.007 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ShapeOperateOpRemovePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.020 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ReplaceTransShapePass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.033 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareOptimize::MarkAgnosticPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.123 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.136 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of CondPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.145 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrintOpPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.154 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of NoUseReshapeRemovePass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.162 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DropOutPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.171 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.179 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of TransposeRemovePass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.188 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of UnusedConstPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.196 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of StopGradientPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.204 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of PreventGradientPass is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.212 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of PlaceholderWithDefaultPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.226 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SnapshotPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.235 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of GuaranteeConstPass is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.244 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of VarIsInitializedOpPass is [6] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.252 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ParallelConcatStartOpPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.260 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of IdentityPass is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.283 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareOptimize::PrunePass is [10] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.297 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareOptimize::HcclMemcpyPass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.331 [graph_prepare.cc:1988][EVENT]57988 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::PrepareOptimize is [331] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.136.343 [graph_manager.cc:1065][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareDynShape is [1039] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.149.288 [graph_manager.cc:1077][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraph is [12923] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.149.342 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PrepareRunningFormatRefiner::VariablePrepareOpPass is [7] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.149.391 [graph_manager.cc:1080][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareRunningFormatRefiner is [69] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.041 [graph_manager.cc:1081][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphJudgeInsert is [11632] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.099 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of SubexpressionMigrationPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.116 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of UnusedArgsCleanPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.130 [graph_manager.cc:1082][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::SubexpressionMigration is [40] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.162 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeInputMemcpyPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.178 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SwitchDataEdgesBypass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.193 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::ConstantFuseSamePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.284 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CSEBeforeFuseDataNodesWithCommonInputPass is [81] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.301 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::FuseDataNodesWithCommonInputPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.348 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CommonSubexpressionEliminationPass is [36] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.376 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::PermutePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.430 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SameTransdataBreadthFusionPass is [41] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.449 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::VariableOpPass is [8] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.482 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpWithoutReshapeFusionPass is [23] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.530 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpBreadthFusionPass is [37] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.549 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::DataFlowPreparePass is [7] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.563 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeUnknownShapeNPass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.572 [graph_manager.cc:2700][EVENT]57988 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_1 is [416] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.723 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.738 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of AddNPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.748 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.757 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of SwitchLogicRemovePass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.766 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of MergePass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.774 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of CastRemovePass is [11] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.783 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of TransposeTransDataPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.791 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [5] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.799 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of TransOpSymmetryEliminationPass is [3] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.808 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of TransOpNearbyAllreduceFusionPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.816 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.824 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [6] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.832 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.840 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [5] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.855 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of UselessControlOutRemovePass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.866 [graph_manager.cc:2741][EVENT]57988 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_2 is [274] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.875 [graph_manager.cc:2752][EVENT]57988 OptimizeStage1:[GEPERFTRACE] The time cost of extern constant folding is [0] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.898 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::Migration is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.911 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ArgsClean is [1] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.929 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::PrunePass is [8] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.947 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::NextIterationPass is [5] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.959 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ControlTriggerPass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.971 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MergeToStreamMergePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.161.996 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SwitchToStreamSwitchPass is [15] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.011 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::AttachStreamLabelPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.025 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MultiBatchPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.036 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SubgraphMultiDimsPass is [1] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.061 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::IteratorOpPass is [15] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.073 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::VariableRefUselessControlOutDeletePass is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.092 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ReshapeRecoveryPass is [9] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.105 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::RemoveSameConstPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.114 [graph_manager.cc:2810][EVENT]57988 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_3 is [220] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.145 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of IdentityPass is [2] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.158 [graph_manager.cc:2821][EVENT]57988 OptimizeStage1:[GEPERFTRACE] The time cost of GraphPrepare::node_pass is [35] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.186 [graph_manager.cc:1087][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1 is [1036] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.320 [graph_manager.cc:1088][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeAfterStage1 is [120] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.367 [graph_manager.cc:1089][EVENT]57988 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::GraphUtilsEx::InferShapeInNeed is [21] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.385 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of PreRun::CtrlEdgeTransferPass is [1] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.402 [graph_manager.cc:1097][EVENT]57988 PreRunOptimizeOriginalGraph:PreRun:PreRunOptimizeOriginalGraph success. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.425 [graph_manager.cc:3325][EVENT]57988 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::StagePartition is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.814 [engine_place.cc:144][EVENT]57988 Run:The time cost of AIcoreEngine::CheckSupported is [262] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.838 [engine_place.cc:144][EVENT]57988 Run:The time cost of DNN_VM_GE_LOCAL_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.848 [engine_place.cc:144][EVENT]57988 Run:The time cost of DNN_VM_RTS_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.954 [graph_manager.cc:3351][EVENT]57988 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::GraphPartitionDynamicShape is [515] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.162.974 [graph_manager.cc:3364][EVENT]57988 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::CompositeEngine is [2] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.053 [engine_partitioner.cc:1139][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [21] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.071 [engine_partitioner.cc:1142][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [5] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.231 [engine_partitioner.cc:1148][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [149] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.274 [engine_partitioner.cc:1155][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [30] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.329 [engine_partitioner.cc:1164][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [44] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.366 [graph_manager.cc:3405][EVENT]57988 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::Partition1 is [379] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.163.385 [graph_manager.cc:3412][EVENT]57988 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPreProc is [8] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.341 [graph_manager.cc:3422][EVENT]57988 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubGraph is [166941] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.391 [graph_manager.cc:3428][EVENT]57988 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPostProc is [11] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.538 [graph_manager.cc:3467][EVENT]57988 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::MergeSubGraph is [126] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.556 [graph_manager.cc:3377][EVENT]57988 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::AtomicEngine is [167571] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.573 [graph_manager.cc:1106][EVENT]57988 PreRunOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeSubgraph is [168155] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.596 [graph_manager.cc:1115][EVENT]57988 PreRunOptimizeSubGraph:PreRun:PreRunOptimizeSubGraph success. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.621 [graph_manager.cc:1130][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.ReplacePrecompiledNodeWithOmGraph is [6] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.654 [graph_manager.cc:1131][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeWholeGraph is [19] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.687 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::LinkGenMaskNodesPass is [11] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.704 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::HcclContinuousMemcpyPass is [6] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.714 [graph_manager.cc:2837][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses is [41] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.809 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [17] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.823 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.832 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of CondRemovePass is [4] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.841 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of BitcastPass is [1] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.849 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of AssignRemovePass is [6] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.858 [base_pass.cc:339][EVENT]57988 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [12] micro second, call num is [4] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.868 [graph_manager.cc:2864][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::MergedGraphNameToPasses is [135] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.880 [graph_manager.cc:2872][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::RemoveIsolatedConst is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.902 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::MultiBatchPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.917 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::RefIdentityDeleteOpPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.933 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::VariableRefDeleteOpPass is [6] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.947 [compile_nodes_pass.cc:88][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [3] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.958 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [15] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.330.971 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::SwapSpacePass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.072 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::InputOutputConnectionIdentifyPass is [91] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.111 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::AtomicAddrCleanPass is [22] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.126 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::EndOfSequenceAddControlPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.140 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::SubgraphPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.153 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::AttachStreamLabelPass is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.163 [graph_manager.cc:2927][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize is [265] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.181 [graph_manager.cc:2937][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of ModelBuilder::AssignFunctionalLabels is [9] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.217 [graph_manager.cc:2943][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of MemcpyAddrAsyncPass::Run. is [26] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.331.233 [graph_manager.cc:2950][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of BufferPoolMemoryPass::Run. is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.524 [graph_manager.cc:2958][EVENT]57988 OptimizeStage2:[GEPERFTRACE] The time cost of ParallelGroupPass::Run. is [46] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.571 [graph_manager.cc:1132][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage2 is [10902] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.714 [graph_manager.cc:1135][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::GetCompilerStages(graph_node->GetGraphId()).optimizer.OptimizeGraphBeforeBuild is [128] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.763 [graph_manager.cc:2975][EVENT]57988 MemConflictProc:[GEPERFTRACE] The time cost of HandleMemoryRWConflict is [27] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.902 [graph_manager.cc:2981][EVENT]57988 MemConflictProc:[GEPERFTRACE] The time cost of MemLayoutConflictOptimizer::Run. is [127] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.921 [pass_manager.cc:82][EVENT]57988 Run:[GEPERFTRACE] The time cost of OptimizeStage2::SetFftsPlusAttrPass is [1] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.933 [graph_manager.cc:2986][EVENT]57988 MemConflictProc:[GEPERFTRACE] The time cost of SetFftsPlusAttrPass::last_passes.Run is [15] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.341.943 [graph_manager.cc:1136][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::MemConflictProc is [208] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.081 [graph_manager.cc:3555][EVENT]57988 Build:[GEPERFTRACE] The time cost of GraphManager::RecoverIrDefinitionAndModifyAippData is [106] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.163 [engine_partitioner.cc:1139][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [21] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.180 [engine_partitioner.cc:1142][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [4] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.324 [engine_partitioner.cc:1148][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [134] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.369 [engine_partitioner.cc:1155][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [24] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.414 [engine_partitioner.cc:1164][EVENT]57988 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [34] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.440 [graph_builder.cc:865][EVENT]57988 SecondPartition:[GEPERFTRACE] The time cost of EnginePartitioner::Partition2 is [318] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.524 [graph_builder.cc:288][EVENT]57988 BuildForKnownShapeGraph:[GEPERFTRACE] The time cost of GraphBuilder::PreBuildModel is [66] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.638 [graph_builder.cc:293][EVENT]57988 BuildForKnownShapeGraph:[GEPERFTRACE] The time cost of GraphBuilder::CalcOpParam is [98] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.342.923 [model_builder.cc:1133][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::AssignLogicalStreams is [166] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.263 [block_mem_assigner.cc:4069][EVENT]61000 AssignMemoryWithReuse:Reuse memory open, memory_priority_mode is false. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.265 [block_mem_assigner.cc:4069][EVENT]61001 AssignMemoryWithReuse:Reuse memory open, memory_priority_mode is false. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.722 [graph_mem_assigner.cc:2166][EVENT]57988 SetInputOffset:[IMAS]AfterAssignMemory : online_0 memoffset[1536], memtype[2], theory_min[3072], zero_copy[1536], total_size[1536], no_reuse[1536], streams[1], topo_mode[DFS], mop[], io_reuse[0:0], alloc_mode[] [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.823 [model_builder.cc:1144][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::AssignMemory is [876] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.849 [model_builder.cc:1152][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of SetInputOutputOffsetPass::Run is [10] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.343.865 [model_builder.cc:1157][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::CompileSingleOp is [5] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.010 [model_builder.cc:1167][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::RefreshRealStream is [133] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.029 [model_builder.cc:1174][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::OptimizeStreamedWholeGraph is [5] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.055 [model_builder.cc:1180][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::MergeWeights is [11] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.092 [model_builder.cc:1184][EVENT]57988 BuildModelForGetTask:[GEPERFTRACE] The time cost of GraphBuilder::BuildModelDef is [27] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.112 [graph_builder.cc:304][EVENT]57988 BuildForKnownShapeGraph:[GEPERFTRACE] The time cost of GraphBuilder::BuildModelForGetTask is [1453] micro second. [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:26.344.369 [logger.cc:1071] 57988 ModelBindStream: model_id=576, stream_id=1857, flag=0. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.499 [task_generator.cc:804][EVENT]57988 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::SetStreamCtx is [12] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.344.582 [task_generator.cc:805][EVENT]57988 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::PrepareForGenerateTask is [66] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.408 [task_generator.cc:814][EVENT]57988 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::DoGenerateTask is [810] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.432 [task_generator.cc:954][EVENT]57988 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::GenerateTask is [946] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.505 [task_generator.cc:967][EVENT]57988 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::AddModelTaskToModel is [44] micro second. [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:26.345.526 [logger.cc:1084] 57988 ModelUnbindStream: model_id=576, stream_id=1857, [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.584 [graph_builder.cc:310][EVENT]57988 BuildForKnownShapeGraph:[GEPERFTRACE] The time cost of GraphBuilder::GetTaskInfo is [1458] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.748 [graph_manager.cc:1152][EVENT]57988 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::Build is [3781] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.767 [graph_manager.cc:1164][EVENT]57988 PreRunAfterOptimizeSubGraph:PreRun:PreRunAfterOptimizeSubGraph success. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.808 [graph_manager.cc:1271][EVENT]57988 PreRun:[GEPERFTRACE] The time cost of FlowModelBuild is [221327] micro second. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.345.819 [graph_manager.cc:1272][EVENT]57988 PreRun:[GEPERFTRACE] GE PreRun End [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:26.346.143 [atrace_api.c:93](tid:57988) AtraceDestroy start [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:26.346.165 [atrace_api.c:95](tid:57988) AtraceDestroy end [INFO] GE(56855,python3.7):2024-01-10-11:47:26.346.826 [model_introduction.cc:236][EVENT]57988 ConstructDynamicInfo:there is no case, no dynamic info [INFO] GE(56855,python3.7):2024-01-10-11:47:26.346.846 [model_introduction.cc:294][EVENT]57988 ConstructNameOrder:there is no case, no data name order info. [INFO] GE(56855,python3.7):2024-01-10-11:47:26.346.859 [model_introduction.cc:366][EVENT]57988 Data:model io_info size:153 .. ============================== 2 passed in 21.04s ============================== [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.774.131 [status:INIT] [ge_api.cc:463]56855 ~Session:Start to destruct session. [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.774.186 [status:RUNNING] [ge_api.cc:475]56855 ~Session:Session id is 0 [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.774.197 [status:RUNNING] [ge_api.cc:476]56855 ~Session:Destroying session [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.775.090 [status:STOP] [ge_api.cc:491]56855 ~Session:Session Destructor finished [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.775.122 [status:INIT] [ge_api.cc:301]56855 GEFinalize:GEFinalize start [INFO] GE(56855,python3.7):2024-01-10-11:47:28.775.165 [execution_runtime.cc:80][EVENT]56855 FinalizeExecutionRuntime:Execution runtime finalize begin. [INFO] GE(56855,python3.7):2024-01-10-11:47:28.775.181 [execution_runtime.cc:92][EVENT]56855 FinalizeExecutionRuntime:Execution runtime finalized. [TRACE] GE(56855,python3.7):2024-01-10-11:47:28.775.190 [status:RUNNING] [ge_api.cc:313]56855 GEFinalize:Finalizing environment [INFO] TUNE(56855,python3.7):2024-01-10-11:47:29.054.574 [cann_kb_pyfunc_mgr.cpp:127][CANNKB][Tid:56855]"CannKbPyfuncMgr: enter PyObjectDeinit function, reference_[1]" [INFO] TUNE(56855,python3.7):2024-01-10-11:47:29.054.629 [cann_kb_pyfunc_mgr.cpp:138][CANNKB][Tid:56855]"CannKbPyfuncMgr: PyObjectDeinit function end successfully!" [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.056.814 [process_mode_manager.cpp:184][Close][tid:56855] [TsdClient] Close [deviceId=5][sessionId=1] hccp and computer enter [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.056.849 [version_verify.cpp:112][SpecialFeatureCheck][tid:56855] VersionVerify: previous type[7], supported [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.056.895 [process_mode_manager.cpp:192][Close][tid:56855] [TsdClient][deviceId=5] [sessionId=1] wait hccp and computer process close respond [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.077.900 [process_mode_manager.cpp:197][Close][tid:56855] [TsdClient][logicDeviceId_=5]has recv close hccp and computer process respond [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.077.929 [stub_process_mode_nowin.cpp:151][CloseInHost][tid:56855] enter into CloseInHost deviceid[5] [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.077.940 [stub_process_mode_nowin.cpp:154][CloseInHost][tid:56855] host cpu not support [INFO] TDT(56855,python3.7):2024-01-10-11:47:29.077.980 [process_mode_manager.cpp:208][Close][tid:56855] [TsdClient][deviceId=5] [sessionId=1] close hccp and computer process success [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:29.077.992 [atrace_api.c:93](tid:56855) AtraceDestroy start [INFO] ATRACE(56855,python3.7):2024-01-10-11:47:29.078.010 [atrace_api.c:95](tid:56855) AtraceDestroy end [INFO] PROFILING(56855,python3.7):2024-01-10-11:47:29.078.030 [msprofiler_impl.cpp:156] >>> (tid:56855) ProfNotifySetDevice called, is open: 0, devId: 5 [INFO] GE(56855,python3.7):2024-01-10-11:47:29.203.886 [gelib.cc:324][EVENT]56855 SystemFinalize:Online infer finalize GELib success. [TRACE] GE(56855,python3.7):2024-01-10-11:47:29.417.893 [status:STOP] [ge_api.cc:341]56855 GEFinalize:GEFinalize finished [INFO] RUNTIME(56855,python3.7):2024-01-10-11:47:30.869.677 [runtime.cc:1737] 56855 ~Runtime: deconstruct runtime.