============================= test session starts ============================== platform linux -- Python 3.7.5, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/dyn_shape_dev, inifile: /home/jenkins/sault/virtual_test/virtualenv_006/sault/config/pytest.ini plugins: anyio-3.7.1, xdist-1.32.0, forked-1.1.3 [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:34.331.436 [trace_attr.c:105](tid:102038) platform is 1. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:34.331.617 [trace_recorder.c:114](tid:102038) use root path: /home/jenkins/ascend/atrace [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:34.331.646 [trace_signal.c:133](tid:102038) register signal handler for signo 2 succeed. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:34.331.658 [trace_signal.c:133](tid:102038) register signal handler for signo 15 succeed. [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:34.741.648 [runtime.cc:1159] 102038 GetAicoreNumByLevel: workingDev_=0 [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:34.741.714 [runtime.cc:4719] 102038 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set collected 2 items test_softmax.py [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.212.766 [process_mode_manager.cpp:109][OpenProcess][tid:102038] [ProcessModeManager] enter into open process deviceId[5] rankSize[0] [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.399 [process_mode_manager.cpp:379][InitTsdClient][tid:102038] [TsdClient] deviceId[5] begin to init hdc client [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.558 [version_verify.cpp:34][SetVersionInfo][tid:102038] VersionVerify: send client version to server [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.586 [version_verify.cpp:50][SetVersionInfo][tid:102038] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.599 [version_verify.cpp:50][SetVersionInfo][tid:102038] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.892 [version_verify.cpp:66][PeerVersionCheck][tid:102038] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.908 [version_verify.cpp:87][ParseVersionInfo][tid:102038] VersionVerify: pass client version info success [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.917 [hdc_client.cpp:276][CheckHdcConnection][tid:102038] Service[2] create hdc success [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.931 [version_verify.cpp:120][SpecialFeatureCheck][tid:102038] VersionVerify: new type[35], supported [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.215.978 [process_mode_manager.cpp:748][GetDeviceCheckCode][tid:102038] [TsdClient][deviceId=5] [sessionId=1] wait package info respond [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.167 [process_mode_manager.cpp:379][InitTsdClient][tid:102038] [TsdClient] deviceId[5] begin to init hdc client [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.266 [version_verify.cpp:34][SetVersionInfo][tid:102038] VersionVerify: send client version to server [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.278 [version_verify.cpp:50][SetVersionInfo][tid:102038] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.289 [version_verify.cpp:50][SetVersionInfo][tid:102038] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.419 [version_verify.cpp:66][PeerVersionCheck][tid:102038] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.430 [version_verify.cpp:87][ParseVersionInfo][tid:102038] VersionVerify: pass client version info success [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.439 [hdc_client.cpp:276][CheckHdcConnection][tid:102038] Service[2] create hdc success [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.451 [process_mode_manager.cpp:426][ConstructOpenMsg][tid:102038] [TsdClient] tsd get process sign successfully, procpid[102038] signSize[48] [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.483 [version_verify.cpp:112][SpecialFeatureCheck][tid:102038] VersionVerify: previous type[6], supported [INFO] TDT(102038,python3.7):2024-01-11-05:33:39.216.506 [process_mode_manager.cpp:126][OpenProcess][tid:102038] [ProcessModeManager] deviceId[5] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(102038,python3.7):2024-01-11-05:33:40.322.038 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:102038] [TsdClient] it is unnecessary of current mode[0] chiptype[1] to grant queue auth to aicpusd [INFO] TDT(102038,python3.7):2024-01-11-05:33:40.322.103 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:102038] enter into OpenInHost deviceid[5] [INFO] TDT(102038,python3.7):2024-01-11-05:33:40.322.114 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:102038] host cpu not support [INFO] TDT(102038,python3.7):2024-01-11-05:33:40.322.122 [process_mode_manager.cpp:156][OpenProcess][tid:102038] [TsdClient][deviceId=5] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:40.324.845 [device.cc:340] 102038 Init: isDoubledie:0, topologytype:0 [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:40.342.043 [npu_driver.cc:5428] 103085 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:40.342.084 [atrace_api.c:28](tid:102038) AtraceCreate start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:40.342.190 [trace_rb_log.c:84](tid:102038) [RUNTIME_ATRACE_DEV5_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:40.342.206 [atrace_api.c:32](tid:102038) AtraceCreate end [INFO] TDT(102038,python3.7):2024-01-11-05:33:40.342.221 [client_manager.cpp:157][SetProfilingCallback][tid:102038] [TsdClient] set profiling callback success [TRACE] GE(102038,python3.7):2024-01-11-05:33:40.494.520 [status:INIT] [ge_api.cc:144]102038 GEInitializeImpl:GEInitialize start [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:40.708.898 [msprofiler_impl.cpp:156] >>> (tid:102038) ProfNotifySetDevice called, is open: 1, devId: 5 [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:40.709.055 [platform.cpp:38] >>> (tid:102038) Profiling platform version: 1.0. [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:40.709.070 [ai_drv_dev_api.cpp:384] >>> (tid:102038) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(102038,python3.7):2024-01-11-05:33:40.759.796 [status:RUNNING] [ge_api.cc:211]102038 GEInitializeImpl:Initializing environment [INFO] GE(102038,python3.7):2024-01-11-05:33:40.759.872 [gelib.cc:98][EVENT]102038 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(102038,python3.7):2024-01-11-05:33:40.760.241 [gelib.cc:307][EVENT]102038 SystemInitialize:Online infer init GELib success, device id :5 [INFO] DVPP(102038,python3.7):2024-01-11-05:33:41.146.482 [dvpp_engine.cc:41][ENGINE][Initialize:41][tid:102038]dvpp engine do not support [INFO] TUNE(102038,python3.7):2024-01-11-05:33:41.151.073 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:102038]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(102038,python3.7):2024-01-11-05:33:41.151.115 [handle_manager.cpp:115][CANNKB][Tid:102038]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(102038,python3.7):2024-01-11-05:33:41.151.178 [handle_manager.cpp:407][CANNKB][Tid:102038]"Init functions of loading dynamic python lib end!" [INFO] TUNE(102038,python3.7):2024-01-11-05:33:41.151.189 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:102038]"CANN_KB_Py has already been initialized." [INFO] TUNE(102038,python3.7):2024-01-11-05:33:41.151.358 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:102038]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] HCCL(102038,python3.7):2024-01-11-05:33:53.144.517 [plugin_manager.cc:42][102038]hcom running normal mode. [INFO] DVPP(102038,python3.7):2024-01-11-05:33:53.145.192 [dvpp_engine.cc:92][ENGINE][GetOpsKernelInfoStores:92][tid:102038]dvpp ops kernel info store do not support [INFO] DVPP(102038,python3.7):2024-01-11-05:33:53.145.376 [dvpp_engine.cc:69][ENGINE][GetGraphOptimizerObjs:69][tid:102038]dvpp graph optimizer do not support [INFO] DVPP(102038,python3.7):2024-01-11-05:33:53.673.943 [dvpp_ops_kernel_builder.cc:48][ENGINE][Initialize:48][tid:102038]dvpp ops kernel builder do not support [INFO] GE(102038,python3.7):2024-01-11-05:33:53.682.722 [gelib.cc:169][EVENT]102038 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [12922796] micro second. [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.773.980 [status:STOP] [ge_api.cc:255]102038 GEInitializeImpl:GEInitialize finished [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.774.143 [status:INIT] [ge_api.cc:398]102038 Session:Start to construct session. [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.774.162 [status:RUNNING] [ge_api.cc:408]102038 Session:Creating session [INFO] GE(102038,python3.7):2024-01-11-05:33:53.774.626 [graph_var_manager.cc:1445][EVENT]102038 SetMemoryMallocSize:Total memory size is 34359738368 [INFO] GE(102038,python3.7):2024-01-11-05:33:53.774.644 [graph_var_manager.cc:1424][EVENT]102038 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:53.775.014 [msprofiler_impl.cpp:156] >>> (tid:102038) ProfNotifySetDevice called, is open: 1, devId: 5 [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.775.923 [status:RUNNING] [ge_api.cc:411]102038 Session:Session id is 0 [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.775.946 [status:STOP] [ge_api.cc:420]102038 Session:Session Constructor finished [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:53.786.303 [platform.cpp:38] >>> (tid:102038) Profiling platform version: 1.0. [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:53.786.336 [ai_drv_dev_api.cpp:384] >>> (tid:102038) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(102038,python3.7):2024-01-11-05:33:53.786.516 [status:INIT] [ge_api.cc:144]102038 GEInitializeImpl:GEInitialize start TotalTime = 0.444836, [20] [parse]: 0.228588 [symbol_resolve]: 0.0306235, [1] [Cycle 1]: 0.0305415, [1] [resolve]: 0.0305128 [combine_like_graphs]: 1.11e-06 [graph_reusing]: 2.92e-06 [meta_unpack_prepare]: 0.0001621 [pre_cconv]: 4.65e-06 [abstract_specialize]: 0.00600945 [pack_expand]: 1.704e-05 [auto_monad]: 0.00012264 [inline]: 1.89e-06 [pre_auto_parallel]: 1.975e-05 [pipeline_split]: 3.14e-06 [optimize]: 0.171189, [35] [py_interpret_to_execute]: 3.45e-06 [rewriter_before_opt_a]: 0.00019891 [opt_a]: 0.169749, [4] [Cycle 1]: 0.101289, [30] [expand_dump_flag]: 4.47e-06 [switch_simplify]: 3.076e-05 [a_1]: 0.00046282 [recompute_prepare]: 1.011e-05 [updatestate_depend_eliminate]: 1.151e-05 [updatestate_assign_eliminate]: 6.92e-06 [updatestate_loads_eliminate]: 6.19e-06 [parameter_eliminate]: 5.34e-06 [a_2]: 8.806e-05 [accelerated_algorithm]: 5.84e-06 [pynative_shard]: 2.09999e-06 [auto_parallel]: 3.67e-06 [parallel]: 1.568e-05 [merge_comm]: 1.069e-05 [allreduce_fusion]: 2.13e-06 [virtual_dataset]: 5.52e-06 [get_grad_eliminate_]: 4.25e-06 [virtual_output]: 3.87e-06 [merge_forward]: 9.39e-06 [cell_reuse_recompute_pass]: 1.1e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [meta_fg_expand]: 0.0405798, [1] [Cycle 1]: 0.00568701, [1] [resolve]: 0.00566444 [after_resolve]: 4.666e-05 [a_after_grad]: 0.00012314 [renormalize]: 0.0591694 [real_op_eliminate]: 2.918e-05 [auto_monad_grad]: 4.602e-05 [auto_monad_eliminator]: 5.883e-05 [cse]: 0.00014074 [a_3]: 0.00020808 [Cycle 2]: 0.0573605, [30] [expand_dump_flag]: 3.89e-06 [switch_simplify]: 8.937e-05 [a_1]: 0.00051841 [recompute_prepare]: 1.193e-05 [updatestate_depend_eliminate]: 1.32e-05 [updatestate_assign_eliminate]: 9.56e-06 [updatestate_loads_eliminate]: 9.07001e-06 [parameter_eliminate]: 4.52e-06 [a_2]: 0.00013099 [accelerated_algorithm]: 1.376e-05 [pynative_shard]: 2.28e-06 [auto_parallel]: 6.38e-06 [parallel]: 6.29e-06 [merge_comm]: 3.29001e-06 [allreduce_fusion]: 1.52e-06 [virtual_dataset]: 8.23e-06 [get_grad_eliminate_]: 6.61e-06 [virtual_output]: 6.07e-06 [merge_forward]: 1.106e-05 [cell_reuse_recompute_pass]: 8.79998e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.645e-05 [meta_fg_expand]: 0.0240826, [4] [Cycle 1]: 0.001684, [1] [resolve]: 0.00166274 [Cycle 1]: 0.00035354, [1] [resolve]: 0.0003326 [Cycle 1]: 0.00171197, [1] [resolve]: 0.00169125 [Cycle 1]: 0.00033209, [1] [resolve]: 0.00031247 [after_resolve]: 7.856e-05 [a_after_grad]: 0.0002671 [renormalize]: 0.0310558 [real_op_eliminate]: 4.046e-05 [auto_monad_grad]: 5.874e-05 [auto_monad_eliminator]: 7.955e-05 [cse]: 0.0003005 [a_3]: 0.00033527 [Cycle 3]: 0.00349436, [30] [expand_dump_flag]: 3.78e-06 [switch_simplify]: 0.00011968 [a_1]: 0.00081835 [recompute_prepare]: 1.481e-05 [updatestate_depend_eliminate]: 1.586e-05 [updatestate_assign_eliminate]: 1.211e-05 [updatestate_loads_eliminate]: 1.161e-05 [parameter_eliminate]: 4.35e-06 [a_2]: 0.00018251 [accelerated_algorithm]: 1.799e-05 [pynative_shard]: 1.24e-06 [auto_parallel]: 5.19e-06 [parallel]: 4.63e-06 [merge_comm]: 3.21e-06 [allreduce_fusion]: 1.84e-06 [virtual_dataset]: 1.094e-05 [get_grad_eliminate_]: 9.08e-06 [virtual_output]: 8.43e-06 [merge_forward]: 1.364e-05 [cell_reuse_recompute_pass]: 4.89999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.336e-05 [meta_fg_expand]: 3.773e-05 [after_resolve]: 1.322e-05 [a_after_grad]: 1.569e-05 [renormalize]: 0.001732 [real_op_eliminate]: 1.568e-05 [auto_monad_grad]: 5.62e-06 [auto_monad_eliminator]: 2.668e-05 [cse]: 0.00012027 [a_3]: 8.548e-05 [Cycle 4]: 0.00089302, [30] [expand_dump_flag]: 1.42e-06 [switch_simplify]: 1.059e-05 [a_1]: 0.00017944 [recompute_prepare]: 1.219e-05 [updatestate_depend_eliminate]: 1.517e-05 [updatestate_assign_eliminate]: 1.207e-05 [updatestate_loads_eliminate]: 1.106e-05 [parameter_eliminate]: 2.18e-06 [a_2]: 0.00022494 [accelerated_algorithm]: 1.842e-05 [pynative_shard]: 1.39e-06 [auto_parallel]: 3.31e-06 [parallel]: 3.88e-06 [merge_comm]: 2.7e-06 [allreduce_fusion]: 1.66e-06 [virtual_dataset]: 1.039e-05 [get_grad_eliminate_]: 8.8e-06 [virtual_output]: 8.43e-06 [merge_forward]: 1.392e-05 [cell_reuse_recompute_pass]: 4.20005e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.287e-05 [meta_fg_expand]: 8.92e-06 [after_resolve]: 1.247e-05 [a_after_grad]: 1.603e-05 [renormalize]: 6.99947e-08 [real_op_eliminate]: 8.82e-06 [auto_monad_grad]: 2.35e-06 [auto_monad_eliminator]: 2.406e-05 [cse]: 6.313e-05 [a_3]: 7.669e-05 [py_interpret_to_execute_after_opt_a]: 4.25e-06 [slice_cell_reuse_recomputed_activation]: 2.73999e-06 [rewriter_after_opt_a]: 7.907e-05 [convert_after_rewriter]: 1.934e-05 [order_py_execute_after_rewriter]: 1.346e-05 [opt_b]: 0.00068618, [2] [Cycle 1]: 0.00057636, [7] [b_1]: 0.00050985 [b_2]: 4.89e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.15e-06 [updatestate_loads_eliminate]: 3.08e-06 [renormalize]: 4.49996e-07 [cse]: 1.683e-05 [Cycle 2]: 9.969e-05, [7] [b_1]: 5.126e-05 [b_2]: 3.43e-06 [updatestate_depend_eliminate]: 3.1e-06 [updatestate_assign_eliminate]: 2.6e-06 [updatestate_loads_eliminate]: 2.44e-06 [renormalize]: 7.0002e-08 [cse]: 1.146e-05 [cconv]: 2.249e-05 [opt_after_cconv]: 5.881e-05, [1] [Cycle 1]: 5.457e-05, [7] [c_1]: 7.65e-06 [parameter_eliminate]: 2.24e-06 [updatestate_depend_eliminate]: 2.85e-06 [updatestate_assign_eliminate]: 2.44e-06 [updatestate_loads_eliminate]: 2.3e-06 [cse]: 1.126e-05 [renormalize]: 3.40005e-07 [remove_dup_value]: 1.475e-05 [tuple_transform]: 4.438e-05, [1] [Cycle 1]: 4.076e-05, [3] [d_1]: 2.03e-05 [d_2]: 8.88e-06 [renormalize]: 2.20003e-07 [add_cache_embedding]: 1.194e-05 [add_recomputation]: 6.913e-05 [cse_after_recomputation]: 2.219e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.332e-05 [environ_conv]: 2.247e-05 [label_micro_interleaved_index]: 2.55999e-06 [label_fine_grained_interleaved_index]: 2.87e-06 [assign_add_opt]: 4.8e-06 [slice_recompute_activation]: 2.55e-06 [micro_interleaved_order_control]: 1.84e-06 [full_micro_interleaved_order_control]: 1.91e-06 [comp_comm_scheduling]: 2.56e-06 [reorder_send_recv_between_fp_bp]: 2.32e-06 [comm_op_add_attrs]: 1.11e-06 [add_comm_op_reuse_tag]: 9.70002e-07 [overlap_opt_shard_in_pipeline]: 1.16001e-06 [grouped_pairwise_exchange_alltoall]: 1.34e-06 [overlap_recompute_and_grad_model_parallel]: 1.81e-06 [overlap_grad_matmul_and_grad_allreduce]: 7.59996e-07 [split_matmul_comm_elemetwise]: 2.49e-06 [split_layernorm_comm]: 1.9e-06 [process_send_recv_for_ge]: 2.71e-06 [handle_group_info]: 1.31e-06 [auto_monad_reorder]: 2.672e-05 [get_jit_bprop_graph]: 5.79996e-07 [eliminate_special_op_node]: 0.0005642 [validate]: 6.019e-05 [distribtued_split]: 1.35e-06 [task_emit]: 0.00718904 [execute]: 8.66e-06 Sums parse : 0.228588s : 59.86% symbol_resolve.resolve : 0.030513s : 7.99% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000003s : 0.00% meta_unpack_prepare : 0.000162s : 0.04% pre_cconv : 0.000005s : 0.00% abstract_specialize : 0.006009s : 1.57% pack_expand : 0.000017s : 0.00% auto_monad : 0.000123s : 0.03% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000020s : 0.01% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000003s : 0.00% optimize.rewriter_before_opt_a : 0.000199s : 0.05% optimize.opt_a.expand_dump_flag : 0.000014s : 0.00% optimize.opt_a.switch_simplify : 0.000250s : 0.07% optimize.opt_a.a_1 : 0.001979s : 0.52% optimize.opt_a.recompute_prepare : 0.000049s : 0.01% optimize.opt_a.updatestate_depend_eliminate : 0.000056s : 0.01% optimize.opt_a.updatestate_assign_eliminate : 0.000041s : 0.01% optimize.opt_a.updatestate_loads_eliminate : 0.000038s : 0.01% optimize.opt_a.parameter_eliminate : 0.000016s : 0.00% optimize.opt_a.a_2 : 0.000626s : 0.16% optimize.opt_a.accelerated_algorithm : 0.000056s : 0.01% optimize.opt_a.pynative_shard : 0.000007s : 0.00% optimize.opt_a.auto_parallel : 0.000019s : 0.00% optimize.opt_a.parallel : 0.000030s : 0.01% optimize.opt_a.merge_comm : 0.000020s : 0.01% optimize.opt_a.allreduce_fusion : 0.000007s : 0.00% optimize.opt_a.virtual_dataset : 0.000035s : 0.01% optimize.opt_a.get_grad_eliminate_ : 0.000029s : 0.01% optimize.opt_a.virtual_output : 0.000027s : 0.01% optimize.opt_a.merge_forward : 0.000048s : 0.01% optimize.opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000075s : 0.02% optimize.opt_a.meta_fg_expand : 0.000047s : 0.01% optimize.opt_a.meta_fg_expand.resolve : 0.009663s : 2.53% optimize.opt_a.after_resolve : 0.000151s : 0.04% optimize.opt_a.a_after_grad : 0.000422s : 0.11% optimize.opt_a.renormalize : 0.091957s : 24.08% optimize.opt_a.real_op_eliminate : 0.000094s : 0.02% optimize.opt_a.auto_monad_grad : 0.000113s : 0.03% optimize.opt_a.auto_monad_eliminator : 0.000189s : 0.05% optimize.opt_a.cse : 0.000625s : 0.16% optimize.opt_a.a_3 : 0.000706s : 0.18% optimize.py_interpret_to_execute_after_opt_a : 0.000004s : 0.00% optimize.slice_cell_reuse_recomputed_activation : 0.000003s : 0.00% optimize.rewriter_after_opt_a : 0.000079s : 0.02% optimize.convert_after_rewriter : 0.000019s : 0.01% optimize.order_py_execute_after_rewriter : 0.000013s : 0.00% optimize.opt_b.b_1 : 0.000561s : 0.15% optimize.opt_b.b_2 : 0.000008s : 0.00% optimize.opt_b.updatestate_depend_eliminate : 0.000008s : 0.00% optimize.opt_b.updatestate_assign_eliminate : 0.000006s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000006s : 0.00% optimize.opt_b.renormalize : 0.000001s : 0.00% optimize.opt_b.cse : 0.000028s : 0.01% optimize.cconv : 0.000022s : 0.01% optimize.opt_after_cconv.c_1 : 0.000008s : 0.00% optimize.opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000003s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.cse : 0.000011s : 0.00% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000015s : 0.00% optimize.tuple_transform.d_1 : 0.000020s : 0.01% optimize.tuple_transform.d_2 : 0.000009s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000012s : 0.00% optimize.add_recomputation : 0.000069s : 0.02% optimize.cse_after_recomputation.cse : 0.000013s : 0.00% optimize.environ_conv : 0.000022s : 0.01% optimize.label_micro_interleaved_index : 0.000003s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000003s : 0.00% optimize.assign_add_opt : 0.000005s : 0.00% optimize.slice_recompute_activation : 0.000003s : 0.00% optimize.micro_interleaved_order_control : 0.000002s : 0.00% optimize.full_micro_interleaved_order_control : 0.000002s : 0.00% optimize.comp_comm_scheduling : 0.000003s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000002s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000002s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.process_send_recv_for_ge : 0.000003s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000027s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% eliminate_special_op_node : 0.000564s : 0.15% validate : 0.000060s : 0.02% distribtued_split : 0.000001s : 0.00% task_emit : 0.007189s : 1.88% execute : 0.000009s : 0.00% Time group info: ------[substitution.] 0.039643 539 0.01% : 0.000004s : 5: substitution.float_depend_g_call 0.03% : 0.000012s : 17: substitution.float_tuple_getitem_switch 96.41% : 0.038220s : 67: substitution.getattr_setattr_resolve 0.01% : 0.000006s : 6: substitution.graph_param_transform 0.01% : 0.000004s : 3: substitution.incorporate_call 0.03% : 0.000012s : 3: substitution.incorporate_call_switch 2.39% : 0.000948s : 89: substitution.inline 0.02% : 0.000007s : 12: substitution.less_batch_normalization 0.12% : 0.000046s : 27: substitution.meta_unpack_prepare 0.04% : 0.000014s : 14: substitution.minmaximum_grad 0.01% : 0.000004s : 5: substitution.partial_eliminate 0.00% : 0.000002s : 6: substitution.partial_unused_args_eliminate 0.02% : 0.000007s : 54: substitution.remove_not_recompute_node 0.21% : 0.000085s : 52: substitution.replace_applicator 0.03% : 0.000010s : 32: substitution.replace_old_param 0.01% : 0.000004s : 2: substitution.reset_defer_inline 0.02% : 0.000007s : 8: substitution.set_cell_output_no_recompute 0.02% : 0.000008s : 5: substitution.specialize_transform 0.03% : 0.000012s : 10: substitution.switch_simplify 0.05% : 0.000021s : 5: substitution.transpose_eliminate 0.13% : 0.000052s : 19: substitution.tuple_list_convert_item_index_to_positive 0.05% : 0.000019s : 19: substitution.tuple_list_get_item_const_eliminator 0.07% : 0.000026s : 19: substitution.tuple_list_get_item_depend_reorder 0.22% : 0.000087s : 41: substitution.tuple_list_get_item_eliminator 0.07% : 0.000026s : 19: substitution.tuple_list_get_set_item_eliminator ------[renormalize.] 0.091940 6 94.24% : 0.086640s : 3: renormalize.infer 5.76% : 0.005300s : 3: renormalize.specialize ------[replace.] 0.001317 127 63.37% : 0.000834s : 60: replace.getattr_setattr_resolve 20.68% : 0.000272s : 46: replace.inline 3.65% : 0.000048s : 2: replace.meta_unpack_prepare 7.75% : 0.000102s : 10: replace.switch_simplify 0.36% : 0.000005s : 1: replace.transpose_eliminate 4.20% : 0.000055s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.038792 127 97.93% : 0.037990s : 60: match.getattr_setattr_resolve 1.87% : 0.000727s : 46: match.inline 0.08% : 0.000031s : 2: match.meta_unpack_prepare 0.03% : 0.000012s : 10: match.switch_simplify 0.01% : 0.000005s : 1: match.transpose_eliminate 0.07% : 0.000027s : 8: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.005736 102 69.06% : 0.003961s : 46: func_graph_cloner_run.FuncGraphClonerGraph 30.94% : 0.001775s : 56: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044886 257 3.02% : 0.001356s : 104: opt.transform.opt_a 1.18% : 0.000530s : 92: opt.transform.opt_b 88.57% : 0.039758s : 12: opt.transform.opt_resolve 0.30% : 0.000136s : 1: opt.transforms.meta_unpack_prepare 6.80% : 0.003053s : 40: opt.transforms.opt_a 0.01% : 0.000006s : 1: opt.transforms.opt_after_cconv 0.01% : 0.000006s : 2: opt.transforms.opt_b 0.06% : 0.000027s : 2: opt.transforms.opt_trans_graph 0.03% : 0.000013s : 3: opt.transforms.special_op_eliminate [INFO] GE(102038,python3.7):2024-01-11-05:33:54.343.560 [scalable_config.cc:55][EVENT]105873 ScalableConfig:device total max size: 34359738368, page_mem_size_total_thresold: 32641751449, uncacheable_size_threshold: 17179869184 [INFO] GE(102038,python3.7):2024-01-11-05:33:54.425.048 [graph_var_manager.cc:1424][EVENT]105873 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] GE(102038,python3.7):2024-01-11-05:33:54.425.161 [graph_manager.cc:1248][EVENT]105873 PreRun:PreRun start: graph node size 3, session id 1, graph id 0, graph name online. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.426.120 [atrace_api.c:28](tid:105873) AtraceCreate start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.426.197 [trace_rb_log.c:84](tid:105873) [RUNTIME_ATRACE_DEV64_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.426.212 [atrace_api.c:32](tid:105873) AtraceCreate end [INFO] TDT(102038,python3.7):2024-01-11-05:33:54.426.242 [client_manager.cpp:157][SetProfilingCallback][tid:105873] [TsdClient] set profiling callback success [INFO] GE(102038,python3.7):2024-01-11-05:33:54.427.197 [parallel_partitioner.cc:165][EVENT]105873 DoPipelinePartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::PipelinePartition is [27] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.427.243 [parallel_partitioner.cc:178][EVENT]105873 DoFlowGraphPartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::FlowGraphPartition is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.427.300 [graph_prepare.cc:1378][EVENT]105873 Init:[GEPERFTRACE] The time cost of FileConstantUtils::ConvertFileConstToConst is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.427.973 [graph_manager.cc:1050][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareInit is [695] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.003 [graph_manager.cc:1052][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.HandleSummaryOp is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.195 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ForToWhilePass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.230 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::SavePass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.302 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::NetOutputPass is [60] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.315 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::DataPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.408 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of CreateSubGraphWithScopePass is [21] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.422 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of SubgraphMultiDimsClonePass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.439 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of MultiBatchClonePass is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.562 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitVariableIntoSubgraphPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.428.584 [graph_manager.cc:1054][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.NormalizeGraph is [568] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.436.566 [graph_manager.cc:1055][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeGraphInit is [7967] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.000 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [6] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.030 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.041 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [4] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.051 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferShapePass is [645] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.060 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [17] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.069 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [1] micro second, call num is [6] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.077 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [23] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.085 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [23] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.438.094 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferValuePass is [12] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.440.264 [graph_manager.cc:1056][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphForQuantize is [3658] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.440.333 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondRemovePass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.440.350 [graph_prepare.cc:1982][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::ProcessBeforeInfershape is [49] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.034 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [6] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.063 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.074 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.084 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferShapePass is [491] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.093 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.101 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [1] micro second, call num is [6] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.110 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [7] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.129 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [10] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.139 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferValuePass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.165 [graph_prepare.cc:1983][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::FormatAndShapeProcess is [802] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.188 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreRun::MarkForceUnknownForCondPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.200 [graph_prepare.cc:1984][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::CtrlFlowPreProcess is [20] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.215 [graph_prepare.cc:1985][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::multibatch::GetDynamicOutputShape is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.236 [graph_prepare.cc:1986][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::InsertAippOpUtil::Instance().UpdateDataNodeByAipp is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.248 [graph_prepare.cc:1987][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::SaveOriginalGraphToOmModel is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.264 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ShapeOperateOpRemovePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.276 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ReplaceTransShapePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.290 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::MarkAgnosticPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.372 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.385 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.394 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrintOpPass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.402 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of NoUseReshapeRemovePass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.411 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DropOutPass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.419 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.427 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransposeRemovePass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.435 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of UnusedConstPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.444 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of StopGradientPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.452 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreventGradientPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.460 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PlaceholderWithDefaultPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.468 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SnapshotPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.484 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of GuaranteeConstPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.493 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of VarIsInitializedOpPass is [5] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.501 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ParallelConcatStartOpPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.509 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of IdentityPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.532 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::PrunePass is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.546 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::HcclMemcpyPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.578 [graph_prepare.cc:1988][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::PrepareOptimize is [320] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.441.590 [graph_manager.cc:1065][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareDynShape is [1290] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.454.848 [graph_manager.cc:1077][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraph is [13238] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.454.920 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareRunningFormatRefiner::VariablePrepareOpPass is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.454.968 [graph_manager.cc:1080][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareRunningFormatRefiner is [83] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.628 [graph_manager.cc:1081][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphJudgeInsert is [9644] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.676 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of SubexpressionMigrationPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.692 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of UnusedArgsCleanPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.704 [graph_manager.cc:1082][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::SubexpressionMigration is [37] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.737 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeInputMemcpyPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.753 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SwitchDataEdgesBypass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.768 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::ConstantFuseSamePass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.876 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CSEBeforeFuseDataNodesWithCommonInputPass is [97] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.894 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::FuseDataNodesWithCommonInputPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.943 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CommonSubexpressionEliminationPass is [38] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.464.970 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::PermutePass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.008 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SameTransdataBreadthFusionPass is [27] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.036 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::VariableOpPass is [16] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.058 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpWithoutReshapeFusionPass is [11] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.104 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpBreadthFusionPass is [37] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.124 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::DataFlowPreparePass is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.137 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeUnknownShapeNPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.147 [graph_manager.cc:2700][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_1 is [415] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.264 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of EnterPass is [0] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.279 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AddNPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.290 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.299 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchLogicRemovePass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.308 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.316 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CastRemovePass is [8] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.324 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransposeTransDataPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.333 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [4] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.341 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransOpSymmetryEliminationPass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.349 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransOpNearbyAllreduceFusionPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.357 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [7] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.366 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [5] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.374 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.382 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [4] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.398 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of UselessControlOutRemovePass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.409 [graph_manager.cc:2741][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_2 is [243] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.420 [graph_manager.cc:2752][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of extern constant folding is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.444 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::Migration is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.457 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ArgsClean is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.475 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::PrunePass is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.490 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::NextIterationPass is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.503 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ControlTriggerPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.515 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MergeToStreamMergePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.541 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SwitchToStreamSwitchPass is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.557 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::AttachStreamLabelPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.570 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MultiBatchPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.581 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SubgraphMultiDimsPass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.594 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::IteratorOpPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.605 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::VariableRefUselessControlOutDeletePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.624 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ReshapeRecoveryPass is [9] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.637 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::RemoveSameConstPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.646 [graph_manager.cc:2810][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_3 is [207] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.672 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of IdentityPass is [1] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.685 [graph_manager.cc:2821][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphPrepare::node_pass is [30] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.716 [graph_manager.cc:1087][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1 is [992] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.857 [graph_manager.cc:1088][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeAfterStage1 is [125] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.911 [graph_manager.cc:1089][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::GraphUtilsEx::InferShapeInNeed is [21] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.930 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreRun::CtrlEdgeTransferPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.945 [graph_manager.cc:1097][EVENT]105873 PreRunOptimizeOriginalGraph:PreRun:PreRunOptimizeOriginalGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.465.967 [graph_manager.cc:3325][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::StagePartition is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.466.909 [engine_place.cc:144][EVENT]105873 Run:The time cost of AIcoreEngine::CheckSupported is [806] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.466.939 [engine_place.cc:144][EVENT]105873 Run:The time cost of DNN_VM_GE_LOCAL_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.466.949 [engine_place.cc:144][EVENT]105873 Run:The time cost of DNN_VM_RTS_OP_STORE::CheckSupported is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.037 [graph_manager.cc:3351][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::GraphPartitionDynamicShape is [1057] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.056 [graph_manager.cc:3364][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::CompositeEngine is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.124 [engine_partitioner.cc:1139][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [20] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.141 [engine_partitioner.cc:1142][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.285 [engine_partitioner.cc:1148][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [134] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.329 [engine_partitioner.cc:1155][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [30] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.377 [engine_partitioner.cc:1164][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [36] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.416 [graph_manager.cc:3405][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::Partition1 is [345] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.467.436 [graph_manager.cc:3412][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPreProc is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.651 [graph_manager.cc:3422][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubGraph is [35199] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.707 [graph_manager.cc:3428][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPostProc is [11] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.860 [graph_manager.cc:3467][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::MergeSubGraph is [130] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.879 [graph_manager.cc:3377][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::AtomicEngine is [35810] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.911 [graph_manager.cc:1106][EVENT]105873 PreRunOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeSubgraph is [36951] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.924 [graph_manager.cc:1115][EVENT]105873 PreRunOptimizeSubGraph:PreRun:PreRunOptimizeSubGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.948 [graph_manager.cc:1130][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.ReplacePrecompiledNodeWithOmGraph is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.502.980 [graph_manager.cc:1131][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeWholeGraph is [19] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.012 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::LinkGenMaskNodesPass is [11] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.030 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::HcclContinuousMemcpyPass is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.040 [graph_manager.cc:2837][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses is [43] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.137 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [17] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.151 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.161 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondRemovePass is [3] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.169 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of BitcastPass is [2] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.178 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssignRemovePass is [7] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.187 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [5] micro second, call num is [3] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.197 [graph_manager.cc:2864][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::MergedGraphNameToPasses is [139] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.212 [graph_manager.cc:2872][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::RemoveIsolatedConst is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.231 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::MultiBatchPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.247 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::RefIdentityDeleteOpPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.263 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::VariableRefDeleteOpPass is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.277 [compile_nodes_pass.cc:88][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.287 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [15] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.297 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::SwapSpacePass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.405 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::InputOutputConnectionIdentifyPass is [90] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.438 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::AtomicAddrCleanPass is [20] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.452 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::EndOfSequenceAddControlPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.466 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::SubgraphPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.480 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::AttachStreamLabelPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.490 [graph_manager.cc:2927][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize is [263] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.510 [graph_manager.cc:2937][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of ModelBuilder::AssignFunctionalLabels is [11] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.526 [graph_manager.cc:2943][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of MemcpyAddrAsyncPass::Run. is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.503.538 [graph_manager.cc:2950][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of BufferPoolMemoryPass::Run. is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.123 [graph_manager.cc:2958][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of ParallelGroupPass::Run. is [45] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.178 [graph_manager.cc:1132][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage2 is [11183] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.269 [graph_manager.cc:1135][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::GetCompilerStages(graph_node->GetGraphId()).optimizer.OptimizeGraphBeforeBuild is [75] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.321 [graph_manager.cc:2975][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of HandleMemoryRWConflict is [32] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.364 [graph_manager.cc:2981][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of MemLayoutConflictOptimizer::Run. is [29] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.382 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::SetFftsPlusAttrPass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.395 [graph_manager.cc:2986][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of SetFftsPlusAttrPass::last_passes.Run is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.405 [graph_manager.cc:1136][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::MemConflictProc is [118] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.545 [graph_manager.cc:3555][EVENT]105873 Build:[GEPERFTRACE] The time cost of GraphManager::RecoverIrDefinitionAndModifyAippData is [105] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.659 [engine_partitioner.cc:1139][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [19] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.677 [engine_partitioner.cc:1142][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.796 [engine_partitioner.cc:1148][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [109] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.839 [engine_partitioner.cc:1155][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [21] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.886 [engine_partitioner.cc:1164][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [34] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.514.909 [graph_builder.cc:865][EVENT]105873 SecondPartition:[GEPERFTRACE] The time cost of EnginePartitioner::Partition2 is [288] micro second. [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:54.515.406 [logger.cc:1071] 105873 ModelBindStream: model_id=1600, stream_id=1857, flag=0. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.515.449 [task_generator.cc:804][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::SetStreamCtx is [189] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.515.524 [task_generator.cc:805][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::PrepareForGenerateTask is [61] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.516.427 [task_generator.cc:814][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::DoGenerateTask is [887] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.516.444 [task_generator.cc:954][EVENT]105873 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::GenerateTask is [1185] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.516.510 [task_generator.cc:967][EVENT]105873 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::AddModelTaskToModel is [37] micro second. [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:54.516.529 [logger.cc:1084] 105873 ModelUnbindStream: model_id=1600, stream_id=1857, [INFO] GE(102038,python3.7):2024-01-11-05:33:54.517.218 [graph_manager.cc:1152][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::Build is [2784] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.517.249 [graph_manager.cc:1164][EVENT]105873 PreRunAfterOptimizeSubGraph:PreRun:PreRunAfterOptimizeSubGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.517.296 [graph_manager.cc:1271][EVENT]105873 PreRun:[GEPERFTRACE] The time cost of FlowModelBuild is [90229] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.517.308 [graph_manager.cc:1272][EVENT]105873 PreRun:[GEPERFTRACE] GE PreRun End [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.517.623 [atrace_api.c:93](tid:105873) AtraceDestroy start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.517.649 [atrace_api.c:95](tid:105873) AtraceDestroy end [INFO] GE(102038,python3.7):2024-01-11-05:33:54.526.073 [graph_converter.cc:838][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CreateMainNode is [2565] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.526.254 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [132] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.526.770 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [492] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.526.976 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [179] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.526.999 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [203] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.235 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [224] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.265 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.316 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [23] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.517 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [189] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.601 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [66] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.617 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [82] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.646 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [19] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.657 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.683 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.761 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [68] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.828 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [55] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.839 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [67] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.865 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.875 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.527.888 [graph_converter.cc:849][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::RunAllPass is [1773] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.528.098 [graph_converter.cc:853][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::TopologicalSorting is [200] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.528.887 [graph_converter.cc:857][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::AppendGraphLevelData is [722] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.529.049 [graph_converter.cc:862][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CalculatePriority is [134] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.609.129 [graph_var_manager.cc:1424][EVENT]105873 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] GE(102038,python3.7):2024-01-11-05:33:54.609.228 [graph_manager.cc:1248][EVENT]105873 PreRun:PreRun start: graph node size 4, session id 2, graph id 1, graph name online. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.609.558 [atrace_api.c:28](tid:105873) AtraceCreate start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.609.592 [trace_rb_log.c:84](tid:105873) [RUNTIME_ATRACE_DEV64_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.609.606 [atrace_api.c:32](tid:105873) AtraceCreate end [INFO] TDT(102038,python3.7):2024-01-11-05:33:54.609.620 [client_manager.cpp:157][SetProfilingCallback][tid:105873] [TsdClient] set profiling callback success [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.037 [parallel_partitioner.cc:165][EVENT]105873 DoPipelinePartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::PipelinePartition is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.096 [parallel_partitioner.cc:178][EVENT]105873 DoFlowGraphPartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::FlowGraphPartition is [13] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.146 [graph_prepare.cc:1378][EVENT]105873 Init:[GEPERFTRACE] The time cost of FileConstantUtils::ConvertFileConstToConst is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.316 [graph_manager.cc:1050][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareInit is [188] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.342 [graph_manager.cc:1052][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.HandleSummaryOp is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.498 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ForToWhilePass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.530 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::SavePass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.583 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::NetOutputPass is [40] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.597 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::DataPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.643 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of CreateSubGraphWithScopePass is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.657 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of SubgraphMultiDimsClonePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.675 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of MultiBatchClonePass is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.777 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitVariableIntoSubgraphPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.610.799 [graph_manager.cc:1054][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.NormalizeGraph is [444] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.611.031 [graph_manager.cc:1055][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeGraphInit is [217] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.189 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [3] micro second, call num is [8] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.221 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.232 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.241 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferShapePass is [410] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.250 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [14] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.259 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [3] micro second, call num is [8] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.267 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [17] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.275 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [19] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.612.294 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferValuePass is [7] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.614.489 [graph_manager.cc:1056][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphForQuantize is [3439] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.614.561 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondRemovePass is [4] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.614.581 [graph_prepare.cc:1982][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::ProcessBeforeInfershape is [56] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.036 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [0] micro second, call num is [8] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.061 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.073 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.083 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferShapePass is [268] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.092 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.100 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [0] micro second, call num is [8] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.109 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [6] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.117 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.125 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of InferValuePass is [4] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.151 [graph_prepare.cc:1983][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::FormatAndShapeProcess is [555] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.177 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreRun::MarkForceUnknownForCondPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.188 [graph_prepare.cc:1984][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::CtrlFlowPreProcess is [20] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.202 [graph_prepare.cc:1985][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::multibatch::GetDynamicOutputShape is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.217 [graph_prepare.cc:1986][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::InsertAippOpUtil::Instance().UpdateDataNodeByAipp is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.228 [graph_prepare.cc:1987][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::SaveOriginalGraphToOmModel is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.244 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ShapeOperateOpRemovePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.257 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ReplaceTransShapePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.271 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::MarkAgnosticPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.383 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.397 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondPass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.406 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrintOpPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.415 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of NoUseReshapeRemovePass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.424 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DropOutPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.432 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssertPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.441 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransposeRemovePass is [8] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.449 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of UnusedConstPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.458 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of StopGradientPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.466 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreventGradientPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.474 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of PlaceholderWithDefaultPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.482 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SnapshotPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.490 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of GuaranteeConstPass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.499 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of VarIsInitializedOpPass is [6] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.507 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ParallelConcatStartOpPass is [0] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.515 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of IdentityPass is [4] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.540 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::PrunePass is [12] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.554 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareOptimize::HcclMemcpyPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.589 [graph_prepare.cc:1988][EVENT]105873 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::PrepareOptimize is [350] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.615.603 [graph_manager.cc:1065][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareDynShape is [1080] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.629.548 [graph_manager.cc:1077][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraph is [13922] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.629.629 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PrepareRunningFormatRefiner::VariablePrepareOpPass is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.629.695 [graph_manager.cc:1080][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareRunningFormatRefiner is [103] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.867 [graph_manager.cc:1081][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphJudgeInsert is [4154] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.911 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of SubexpressionMigrationPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.927 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of UnusedArgsCleanPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.939 [graph_manager.cc:1082][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::SubexpressionMigration is [36] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.971 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeInputMemcpyPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.633.987 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SwitchDataEdgesBypass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.001 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::ConstantFuseSamePass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.110 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CSEBeforeFuseDataNodesWithCommonInputPass is [98] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.128 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::FuseDataNodesWithCommonInputPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.185 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CommonSubexpressionEliminationPass is [44] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.202 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::PermutePass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.242 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SameTransdataBreadthFusionPass is [29] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.262 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::VariableOpPass is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.321 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpWithoutReshapeFusionPass is [48] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.356 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpBreadthFusionPass is [24] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.372 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::DataFlowPreparePass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.385 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeUnknownShapeNPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.395 [graph_manager.cc:2700][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_1 is [429] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.536 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of EnterPass is [0] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.551 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AddNPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.561 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.580 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of SwitchLogicRemovePass is [1] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.589 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of MergePass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.598 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CastRemovePass is [24] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.606 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransposeTransDataPass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.614 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.622 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransOpSymmetryEliminationPass is [4] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.631 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of TransOpNearbyAllreduceFusionPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.639 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [8] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.647 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [5] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.655 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [12] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.663 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [4] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.671 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of UselessControlOutRemovePass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.682 [graph_manager.cc:2741][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_2 is [267] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.691 [graph_manager.cc:2752][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of extern constant folding is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.714 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::Migration is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.728 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ArgsClean is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.746 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::PrunePass is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.763 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::NextIterationPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.775 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ControlTriggerPass is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.788 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MergeToStreamMergePass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.809 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SwitchToStreamSwitchPass is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.825 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::AttachStreamLabelPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.846 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MultiBatchPass is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.858 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SubgraphMultiDimsPass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.871 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::IteratorOpPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.883 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::VariableRefUselessControlOutDeletePass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.903 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ReshapeRecoveryPass is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.916 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::RemoveSameConstPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.926 [graph_manager.cc:2810][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_3 is [216] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.957 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of IdentityPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.634.970 [graph_manager.cc:2821][EVENT]105873 OptimizeStage1:[GEPERFTRACE] The time cost of GraphPrepare::node_pass is [35] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.000 [graph_manager.cc:1087][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1 is [1041] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.143 [graph_manager.cc:1088][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeAfterStage1 is [128] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.185 [graph_manager.cc:1089][EVENT]105873 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::GraphUtilsEx::InferShapeInNeed is [21] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.203 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of PreRun::CtrlEdgeTransferPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.218 [graph_manager.cc:1097][EVENT]105873 PreRunOptimizeOriginalGraph:PreRun:PreRunOptimizeOriginalGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.635.240 [graph_manager.cc:3325][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::StagePartition is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.251 [engine_place.cc:144][EVENT]105873 Run:The time cost of AIcoreEngine::CheckSupported is [904] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.282 [engine_place.cc:144][EVENT]105873 Run:The time cost of DNN_VM_GE_LOCAL_OP_STORE::CheckSupported is [10] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.292 [engine_place.cc:144][EVENT]105873 Run:The time cost of DNN_VM_RTS_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.376 [graph_manager.cc:3351][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::GraphPartitionDynamicShape is [1122] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.396 [graph_manager.cc:3364][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::CompositeEngine is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.459 [engine_partitioner.cc:1139][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [18] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.477 [engine_partitioner.cc:1142][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.648 [engine_partitioner.cc:1148][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [151] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.695 [engine_partitioner.cc:1155][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [31] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.745 [engine_partitioner.cc:1164][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [37] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.781 [graph_manager.cc:3405][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::Partition1 is [370] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.636.801 [graph_manager.cc:3412][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPreProc is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.645.793 [graph_manager.cc:3422][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubGraph is [8976] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.645.831 [graph_manager.cc:3428][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPostProc is [8] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.645.965 [graph_manager.cc:3467][EVENT]105873 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::MergeSubGraph is [114] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.645.985 [graph_manager.cc:3377][EVENT]105873 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::AtomicEngine is [9576] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.001 [graph_manager.cc:1106][EVENT]105873 PreRunOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeSubgraph is [10769] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.014 [graph_manager.cc:1115][EVENT]105873 PreRunOptimizeSubGraph:PreRun:PreRunOptimizeSubGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.039 [graph_manager.cc:1130][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.ReplacePrecompiledNodeWithOmGraph is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.069 [graph_manager.cc:1131][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeWholeGraph is [18] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.095 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::LinkGenMaskNodesPass is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.113 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::HcclContinuousMemcpyPass is [7] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.124 [graph_manager.cc:2837][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses is [37] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.210 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [13] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.223 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.233 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of CondRemovePass is [3] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.242 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of BitcastPass is [2] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.261 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of AssignRemovePass is [5] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.270 [base_pass.cc:339][EVENT]105873 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [8] micro second, call num is [4] [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.280 [graph_manager.cc:2864][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::MergedGraphNameToPasses is [138] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.295 [graph_manager.cc:2872][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::RemoveIsolatedConst is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.316 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::MultiBatchPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.333 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::RefIdentityDeleteOpPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.350 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::VariableRefDeleteOpPass is [6] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.365 [compile_nodes_pass.cc:88][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.375 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [15] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.386 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::SwapSpacePass is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.470 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::InputOutputConnectionIdentifyPass is [74] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.500 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::AtomicAddrCleanPass is [18] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.513 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::EndOfSequenceAddControlPass is [2] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.527 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::SubgraphPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.541 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::AttachStreamLabelPass is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.550 [graph_manager.cc:2927][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize is [237] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.562 [graph_manager.cc:2937][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of ModelBuilder::AssignFunctionalLabels is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.576 [graph_manager.cc:2943][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of MemcpyAddrAsyncPass::Run. is [5] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.588 [graph_manager.cc:2950][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of BufferPoolMemoryPass::Run. is [3] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.763 [graph_manager.cc:2958][EVENT]105873 OptimizeStage2:[GEPERFTRACE] The time cost of ParallelGroupPass::Run. is [39] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.796 [graph_manager.cc:1132][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage2 is [712] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.875 [graph_manager.cc:1135][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::GetCompilerStages(graph_node->GetGraphId()).optimizer.OptimizeGraphBeforeBuild is [56] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.908 [graph_manager.cc:2975][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of HandleMemoryRWConflict is [16] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.939 [graph_manager.cc:2981][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of MemLayoutConflictOptimizer::Run. is [18] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.954 [pass_manager.cc:82][EVENT]105873 Run:[GEPERFTRACE] The time cost of OptimizeStage2::SetFftsPlusAttrPass is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.966 [graph_manager.cc:2986][EVENT]105873 MemConflictProc:[GEPERFTRACE] The time cost of SetFftsPlusAttrPass::last_passes.Run is [15] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.646.975 [graph_manager.cc:1136][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::MemConflictProc is [85] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.089 [graph_manager.cc:3555][EVENT]105873 Build:[GEPERFTRACE] The time cost of GraphManager::RecoverIrDefinitionAndModifyAippData is [79] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.181 [engine_partitioner.cc:1139][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [17] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.198 [engine_partitioner.cc:1142][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [4] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.315 [engine_partitioner.cc:1148][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [108] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.347 [engine_partitioner.cc:1155][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [19] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.386 [engine_partitioner.cc:1164][EVENT]105873 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [27] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.409 [graph_builder.cc:865][EVENT]105873 SecondPartition:[GEPERFTRACE] The time cost of EnginePartitioner::Partition2 is [263] micro second. [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:54.647.726 [logger.cc:1071] 105873 ModelBindStream: model_id=576, stream_id=833, flag=0. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.759 [task_generator.cc:804][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::SetStreamCtx is [83] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.647.821 [task_generator.cc:805][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::PrepareForGenerateTask is [50] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.528 [task_generator.cc:814][EVENT]105873 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::DoGenerateTask is [691] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.544 [task_generator.cc:954][EVENT]105873 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::GenerateTask is [869] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.607 [task_generator.cc:967][EVENT]105873 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::AddModelTaskToModel is [35] micro second. [INFO] RUNTIME(102038,python3.7):2024-01-11-05:33:54.648.627 [logger.cc:1084] 105873 ModelUnbindStream: model_id=576, stream_id=833, [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.875 [graph_manager.cc:1152][EVENT]105873 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::Build is [1872] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.908 [graph_manager.cc:1164][EVENT]105873 PreRunAfterOptimizeSubGraph:PreRun:PreRunAfterOptimizeSubGraph success. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.943 [graph_manager.cc:1271][EVENT]105873 PreRun:[GEPERFTRACE] The time cost of FlowModelBuild is [38995] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.648.956 [graph_manager.cc:1272][EVENT]105873 PreRun:[GEPERFTRACE] GE PreRun End [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.649.268 [atrace_api.c:93](tid:105873) AtraceDestroy start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:54.649.286 [atrace_api.c:95](tid:105873) AtraceDestroy end [INFO] GE(102038,python3.7):2024-01-11-05:33:54.655.659 [graph_converter.cc:838][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CreateMainNode is [1930] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.655.834 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [127] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.656.463 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [603] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.656.699 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [205] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.656.723 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [231] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.656.954 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [220] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.656.975 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [1] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.012 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [26] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.251 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [225] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.346 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [74] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.362 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [91] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.395 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [23] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.407 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.437 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of ZeroCopy is [20] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.537 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CEM is [89] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.615 [copy_flow_launch_fuse.cc:395][EVENT]105873 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [64] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.627 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [76] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.657 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [21] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.668 [base_optimizer.cc:70][EVENT]105873 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.682 [graph_converter.cc:849][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::RunAllPass is [1981] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.657.957 [graph_converter.cc:853][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::TopologicalSorting is [255] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.658.801 [graph_converter.cc:857][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::AppendGraphLevelData is [825] micro second. [INFO] GE(102038,python3.7):2024-01-11-05:33:54.658.983 [graph_converter.cc:862][EVENT]105873 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CalculatePriority is [152] micro second. . TotalTime = 0.127298, [20] [parse]: 0.00157509 [symbol_resolve]: 0.0134342, [1] [Cycle 1]: 0.0133576, [1] [resolve]: 0.0133341 [combine_like_graphs]: 1.65e-06 [graph_reusing]: 4.16e-06 [meta_unpack_prepare]: 0.0001911 [pre_cconv]: 1.36e-06 [abstract_specialize]: 0.00548317 [pack_expand]: 1.721e-05 [auto_monad]: 9.782e-05 [inline]: 1.64e-06 [pre_auto_parallel]: 1.088e-05 [pipeline_split]: 3.21e-06 [optimize]: 0.102412, [35] [py_interpret_to_execute]: 4.4e-06 [rewriter_before_opt_a]: 0.0002001 [opt_a]: 0.100994, [4] [Cycle 1]: 0.0430436, [30] [expand_dump_flag]: 4.71e-06 [switch_simplify]: 3.059e-05 [a_1]: 0.00083987 [recompute_prepare]: 9.4e-06 [updatestate_depend_eliminate]: 1.137e-05 [updatestate_assign_eliminate]: 8.14e-06 [updatestate_loads_eliminate]: 6.99e-06 [parameter_eliminate]: 5.16e-06 [a_2]: 7.458e-05 [accelerated_algorithm]: 5.63e-06 [pynative_shard]: 1.76e-06 [auto_parallel]: 3.71e-06 [parallel]: 1.006e-05 [merge_comm]: 4.05e-06 [allreduce_fusion]: 2.08e-06 [virtual_dataset]: 4.92e-06 [get_grad_eliminate_]: 4.31e-06 [virtual_output]: 4.12e-06 [merge_forward]: 8.23e-06 [cell_reuse_recompute_pass]: 9.59997e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.174e-05 [meta_fg_expand]: 0.00749741, [1] [Cycle 1]: 0.00327589, [1] [resolve]: 0.00325553 [after_resolve]: 4.672e-05 [a_after_grad]: 0.00017867 [renormalize]: 0.0336046 [real_op_eliminate]: 3.101e-05 [auto_monad_grad]: 4.576e-05 [auto_monad_eliminator]: 5.946e-05 [cse]: 0.0001395 [a_3]: 0.00020439 [Cycle 2]: 0.0496716, [30] [expand_dump_flag]: 3.04e-06 [switch_simplify]: 0.00010547 [a_1]: 0.00100305 [recompute_prepare]: 1.005e-05 [updatestate_depend_eliminate]: 1.21e-05 [updatestate_assign_eliminate]: 8.68e-06 [updatestate_loads_eliminate]: 8.89001e-06 [parameter_eliminate]: 3.84e-06 [a_2]: 0.00012696 [accelerated_algorithm]: 1.281e-05 [pynative_shard]: 1.81e-06 [auto_parallel]: 5.38e-06 [parallel]: 4.44e-06 [merge_comm]: 2.69e-06 [allreduce_fusion]: 1.60999e-06 [virtual_dataset]: 8.15e-06 [get_grad_eliminate_]: 7.12e-06 [virtual_output]: 6.68001e-06 [merge_forward]: 1.097e-05 [cell_reuse_recompute_pass]: 5.19998e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [meta_fg_expand]: 0.0149259, [4] [Cycle 1]: 0.00166178, [1] [resolve]: 0.00164054 [Cycle 1]: 0.00032808, [1] [resolve]: 0.00030894 [Cycle 1]: 0.00170009, [1] [resolve]: 0.00167911 [Cycle 1]: 0.00032591, [1] [resolve]: 0.00030607 [after_resolve]: 8.144e-05 [a_after_grad]: 0.00024429 [renormalize]: 0.0320123 [real_op_eliminate]: 5.244e-05 [auto_monad_grad]: 6.438e-05 [auto_monad_eliminator]: 8.346e-05 [cse]: 0.00032186 [a_3]: 0.00032642 [Cycle 3]: 0.00470854, [30] [expand_dump_flag]: 5.63001e-06 [switch_simplify]: 0.00018928 [a_1]: 0.00156918 [recompute_prepare]: 1.368e-05 [updatestate_depend_eliminate]: 1.818e-05 [updatestate_assign_eliminate]: 1.315e-05 [updatestate_loads_eliminate]: 1.256e-05 [parameter_eliminate]: 4.9e-06 [a_2]: 0.00018226 [accelerated_algorithm]: 1.848e-05 [pynative_shard]: 1.96e-06 [auto_parallel]: 8.35001e-06 [parallel]: 7.91e-06 [merge_comm]: 4.76e-06 [allreduce_fusion]: 2.56e-06 [virtual_dataset]: 1.084e-05 [get_grad_eliminate_]: 9.56e-06 [virtual_output]: 9.04e-06 [merge_forward]: 1.399e-05 [cell_reuse_recompute_pass]: 6.50005e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.296e-05 [meta_fg_expand]: 4.625e-05 [after_resolve]: 1.511e-05 [a_after_grad]: 2.284e-05 [renormalize]: 0.00208632 [real_op_eliminate]: 1.71e-05 [auto_monad_grad]: 6.07e-06 [auto_monad_eliminator]: 2.642e-05 [cse]: 0.00012263 [a_3]: 8.402e-05 [Cycle 4]: 0.00113622, [30] [expand_dump_flag]: 1.35e-06 [switch_simplify]: 9.81001e-06 [a_1]: 0.00046976 [recompute_prepare]: 1.173e-05 [updatestate_depend_eliminate]: 1.522e-05 [updatestate_assign_eliminate]: 1.194e-05 [updatestate_loads_eliminate]: 1.114e-05 [parameter_eliminate]: 2.11e-06 [a_2]: 0.00017541 [accelerated_algorithm]: 1.677e-05 [pynative_shard]: 1.35e-06 [auto_parallel]: 3.96e-06 [parallel]: 4.07e-06 [merge_comm]: 2.68e-06 [allreduce_fusion]: 1.73999e-06 [virtual_dataset]: 1.037e-05 [get_grad_eliminate_]: 9.43e-06 [virtual_output]: 8.96e-06 [merge_forward]: 1.354e-05 [cell_reuse_recompute_pass]: 4.59993e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.218e-05 [meta_fg_expand]: 8.93e-06 [after_resolve]: 1.27e-05 [a_after_grad]: 2.301e-05 [renormalize]: 7.99992e-08 [real_op_eliminate]: 9.31e-06 [auto_monad_grad]: 2.22e-06 [auto_monad_eliminator]: 2.354e-05 [cse]: 6.205e-05 [a_3]: 7.69e-05 [py_interpret_to_execute_after_opt_a]: 4.93e-06 [slice_cell_reuse_recomputed_activation]: 2.58e-06 [rewriter_after_opt_a]: 8.205e-05 [convert_after_rewriter]: 1.844e-05 [order_py_execute_after_rewriter]: 1.374e-05 [opt_b]: 0.00068601, [2] [Cycle 1]: 0.00057702, [7] [b_1]: 0.00051131 [b_2]: 4.16e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.95e-06 [renormalize]: 3.89999e-07 [cse]: 1.743e-05 [Cycle 2]: 9.818e-05, [7] [b_1]: 5.04e-05 [b_2]: 2.79e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.62e-06 [updatestate_loads_eliminate]: 2.45e-06 [renormalize]: 7.99992e-08 [cse]: 1.183e-05 [cconv]: 2.253e-05 [opt_after_cconv]: 7.19e-05, [1] [Cycle 1]: 6.727e-05, [7] [c_1]: 1.826e-05 [parameter_eliminate]: 1.91e-06 [updatestate_depend_eliminate]: 3.02e-06 [updatestate_assign_eliminate]: 2.57e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 1.136e-05 [renormalize]: 3.89999e-07 [remove_dup_value]: 1.558e-05 [tuple_transform]: 5.723e-05, [1] [Cycle 1]: 5.348e-05, [3] [d_1]: 3.273e-05 [d_2]: 8.68e-06 [renormalize]: 1.89997e-07 [add_cache_embedding]: 1.262e-05 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.165e-05, [1] [Cycle 1]: 1.648e-05, [1] [cse]: 1.209e-05 [environ_conv]: 9.46e-06 [label_micro_interleaved_index]: 2.29e-06 [label_fine_grained_interleaved_index]: 2.41e-06 [assign_add_opt]: 1.72e-06 [slice_recompute_activation]: 2.22999e-06 [micro_interleaved_order_control]: 1.94e-06 [full_micro_interleaved_order_control]: 1.92e-06 [comp_comm_scheduling]: 2.71e-06 [reorder_send_recv_between_fp_bp]: 2.72e-06 [comm_op_add_attrs]: 1.11001e-06 [add_comm_op_reuse_tag]: 9.70002e-07 [overlap_opt_shard_in_pipeline]: 1.06001e-06 [grouped_pairwise_exchange_alltoall]: 1.45e-06 [overlap_recompute_and_grad_model_parallel]: 1.95e-06 [overlap_grad_matmul_and_grad_allreduce]: 7.79997e-07 [split_matmul_comm_elemetwise]: 2.78e-06 [split_layernorm_comm]: 1.88e-06 [process_send_recv_for_ge]: 8.79998e-07 [handle_group_info]: 1.32e-06 [auto_monad_reorder]: 2.01e-05 [get_jit_bprop_graph]: 4.73e-06 [eliminate_special_op_node]: 0.00059582 [validate]: 3.834e-05 [distribtued_split]: 1.22e-06 [task_emit]: 0.00318457 [execute]: 6.88e-06 Sums parse : 0.001575s : 1.45% symbol_resolve.resolve : 0.013334s : 12.30% combine_like_graphs : 0.000002s : 0.00% graph_reusing : 0.000004s : 0.00% meta_unpack_prepare : 0.000191s : 0.18% pre_cconv : 0.000001s : 0.00% abstract_specialize : 0.005483s : 5.06% pack_expand : 0.000017s : 0.02% auto_monad : 0.000098s : 0.09% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000011s : 0.01% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000004s : 0.00% optimize.rewriter_before_opt_a : 0.000200s : 0.18% optimize.opt_a.expand_dump_flag : 0.000015s : 0.01% optimize.opt_a.switch_simplify : 0.000335s : 0.31% optimize.opt_a.a_1 : 0.003882s : 3.58% optimize.opt_a.recompute_prepare : 0.000045s : 0.04% optimize.opt_a.updatestate_depend_eliminate : 0.000057s : 0.05% optimize.opt_a.updatestate_assign_eliminate : 0.000042s : 0.04% optimize.opt_a.updatestate_loads_eliminate : 0.000040s : 0.04% optimize.opt_a.parameter_eliminate : 0.000016s : 0.01% optimize.opt_a.a_2 : 0.000559s : 0.52% optimize.opt_a.accelerated_algorithm : 0.000054s : 0.05% optimize.opt_a.pynative_shard : 0.000007s : 0.01% optimize.opt_a.auto_parallel : 0.000021s : 0.02% optimize.opt_a.parallel : 0.000026s : 0.02% optimize.opt_a.merge_comm : 0.000014s : 0.01% optimize.opt_a.allreduce_fusion : 0.000008s : 0.01% optimize.opt_a.virtual_dataset : 0.000034s : 0.03% optimize.opt_a.get_grad_eliminate_ : 0.000030s : 0.03% optimize.opt_a.virtual_output : 0.000029s : 0.03% optimize.opt_a.merge_forward : 0.000047s : 0.04% optimize.opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000073s : 0.07% optimize.opt_a.meta_fg_expand : 0.000055s : 0.05% optimize.opt_a.meta_fg_expand.resolve : 0.007190s : 6.63% optimize.opt_a.after_resolve : 0.000156s : 0.14% optimize.opt_a.a_after_grad : 0.000469s : 0.43% optimize.opt_a.renormalize : 0.067703s : 62.44% optimize.opt_a.real_op_eliminate : 0.000110s : 0.10% optimize.opt_a.auto_monad_grad : 0.000118s : 0.11% optimize.opt_a.auto_monad_eliminator : 0.000193s : 0.18% optimize.opt_a.cse : 0.000646s : 0.60% optimize.opt_a.a_3 : 0.000692s : 0.64% optimize.py_interpret_to_execute_after_opt_a : 0.000005s : 0.00% optimize.slice_cell_reuse_recomputed_activation : 0.000003s : 0.00% optimize.rewriter_after_opt_a : 0.000082s : 0.08% optimize.convert_after_rewriter : 0.000018s : 0.02% optimize.order_py_execute_after_rewriter : 0.000014s : 0.01% optimize.opt_b.b_1 : 0.000562s : 0.52% optimize.opt_b.b_2 : 0.000007s : 0.01% optimize.opt_b.updatestate_depend_eliminate : 0.000007s : 0.01% optimize.opt_b.updatestate_assign_eliminate : 0.000006s : 0.01% optimize.opt_b.updatestate_loads_eliminate : 0.000005s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000029s : 0.03% optimize.cconv : 0.000023s : 0.02% optimize.opt_after_cconv.c_1 : 0.000018s : 0.02% optimize.opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000003s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% optimize.opt_after_cconv.cse : 0.000011s : 0.01% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000016s : 0.01% optimize.tuple_transform.d_1 : 0.000033s : 0.03% optimize.tuple_transform.d_2 : 0.000009s : 0.01% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000013s : 0.01% optimize.add_recomputation : 0.000054s : 0.05% optimize.cse_after_recomputation.cse : 0.000012s : 0.01% optimize.environ_conv : 0.000009s : 0.01% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000002s : 0.00% optimize.assign_add_opt : 0.000002s : 0.00% optimize.slice_recompute_activation : 0.000002s : 0.00% optimize.micro_interleaved_order_control : 0.000002s : 0.00% optimize.full_micro_interleaved_order_control : 0.000002s : 0.00% optimize.comp_comm_scheduling : 0.000003s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000003s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000002s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000003s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.process_send_recv_for_ge : 0.000001s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000005s : 0.00% eliminate_special_op_node : 0.000596s : 0.55% validate : 0.000038s : 0.04% distribtued_split : 0.000001s : 0.00% task_emit : 0.003185s : 2.94% execute : 0.000007s : 0.01% Time group info: ------[substitution.] 0.020082 607 0.02% : 0.000004s : 6: substitution.float_depend_g_call 0.06% : 0.000012s : 17: substitution.float_tuple_getitem_switch 92.76% : 0.018628s : 67: substitution.getattr_setattr_resolve 0.03% : 0.000006s : 6: substitution.graph_param_transform 0.02% : 0.000003s : 3: substitution.incorporate_call 0.01% : 0.000002s : 3: substitution.incorporate_call_switch 4.83% : 0.000970s : 95: substitution.inline 0.04% : 0.000008s : 12: substitution.less_batch_normalization 0.21% : 0.000043s : 50: substitution.meta_unpack_prepare 0.08% : 0.000017s : 19: substitution.minmaximum_grad 0.02% : 0.000004s : 6: substitution.partial_eliminate 0.01% : 0.000002s : 6: substitution.partial_unused_args_eliminate 0.04% : 0.000007s : 54: substitution.remove_not_recompute_node 0.44% : 0.000089s : 58: substitution.replace_applicator 0.05% : 0.000010s : 32: substitution.replace_old_param 0.02% : 0.000004s : 2: substitution.reset_defer_inline 0.03% : 0.000007s : 8: substitution.set_cell_output_no_recompute 0.05% : 0.000009s : 5: substitution.specialize_transform 0.07% : 0.000014s : 10: substitution.switch_simplify 0.09% : 0.000017s : 6: substitution.transpose_eliminate 0.26% : 0.000053s : 24: substitution.tuple_list_convert_item_index_to_positive 0.12% : 0.000023s : 24: substitution.tuple_list_get_item_const_eliminator 0.15% : 0.000031s : 24: substitution.tuple_list_get_item_depend_reorder 0.44% : 0.000087s : 46: substitution.tuple_list_get_item_eliminator 0.15% : 0.000031s : 24: substitution.tuple_list_get_set_item_eliminator ------[renormalize.] 0.067685 6 92.03% : 0.062292s : 3: renormalize.infer 7.97% : 0.005394s : 3: renormalize.specialize ------[replace.] 0.001319 127 62.44% : 0.000824s : 60: replace.getattr_setattr_resolve 20.58% : 0.000272s : 46: replace.inline 4.20% : 0.000055s : 2: replace.meta_unpack_prepare 8.13% : 0.000107s : 10: replace.switch_simplify 0.45% : 0.000006s : 1: replace.transpose_eliminate 4.20% : 0.000055s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.019218 127 95.95% : 0.018439s : 60: match.getattr_setattr_resolve 3.74% : 0.000718s : 46: match.inline 0.10% : 0.000019s : 2: match.meta_unpack_prepare 0.07% : 0.000014s : 10: match.switch_simplify 0.03% : 0.000005s : 1: match.transpose_eliminate 0.12% : 0.000022s : 8: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.005682 102 68.52% : 0.003893s : 46: func_graph_cloner_run.FuncGraphClonerGraph 31.48% : 0.001789s : 56: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027186 587 0.61% : 0.000166s : 2: opt.transform.meta_unpack_prepare 23.06% : 0.006269s : 461: opt.transform.opt_a 0.05% : 0.000014s : 7: opt.transform.opt_after_cconv 1.97% : 0.000535s : 94: opt.transform.opt_b 74.13% : 0.020151s : 12: opt.transform.opt_resolve 0.13% : 0.000036s : 8: opt.transform.opt_trans_graph 0.05% : 0.000014s : 3: opt.transform.special_op_eliminate . ============================== 2 passed in 22.02s ============================== [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.372.182 [status:INIT] [ge_api.cc:463]102038 ~Session:Start to destruct session. [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.372.271 [status:RUNNING] [ge_api.cc:475]102038 ~Session:Session id is 0 [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.372.282 [status:RUNNING] [ge_api.cc:476]102038 ~Session:Destroying session [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.373.465 [status:STOP] [ge_api.cc:491]102038 ~Session:Session Destructor finished [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.373.521 [status:INIT] [ge_api.cc:301]102038 GEFinalize:GEFinalize start [INFO] GE(102038,python3.7):2024-01-11-05:33:57.373.606 [execution_runtime.cc:80][EVENT]102038 FinalizeExecutionRuntime:Execution runtime finalize begin. [INFO] GE(102038,python3.7):2024-01-11-05:33:57.373.625 [execution_runtime.cc:92][EVENT]102038 FinalizeExecutionRuntime:Execution runtime finalized. [TRACE] GE(102038,python3.7):2024-01-11-05:33:57.373.637 [status:RUNNING] [ge_api.cc:313]102038 GEFinalize:Finalizing environment [INFO] TUNE(102038,python3.7):2024-01-11-05:33:57.748.175 [cann_kb_pyfunc_mgr.cpp:127][CANNKB][Tid:102038]"CannKbPyfuncMgr: enter PyObjectDeinit function, reference_[1]" [INFO] TUNE(102038,python3.7):2024-01-11-05:33:57.748.228 [cann_kb_pyfunc_mgr.cpp:138][CANNKB][Tid:102038]"CannKbPyfuncMgr: PyObjectDeinit function end successfully!" [INFO] GE(102038,python3.7):2024-01-11-05:33:57.750.192 [gelib.cc:324][EVENT]102038 SystemFinalize:Online infer finalize GELib success. [TRACE] GE(102038,python3.7):2024-01-11-05:33:58.160.909 [status:STOP] [ge_api.cc:341]102038 GEFinalize:GEFinalize finished [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.239.254 [process_mode_manager.cpp:184][Close][tid:102038] [TsdClient] Close [deviceId=5][sessionId=1] hccp and computer enter [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.239.305 [version_verify.cpp:112][SpecialFeatureCheck][tid:102038] VersionVerify: previous type[7], supported [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.239.360 [process_mode_manager.cpp:192][Close][tid:102038] [TsdClient][deviceId=5] [sessionId=1] wait hccp and computer process close respond [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.270.259 [process_mode_manager.cpp:197][Close][tid:102038] [TsdClient][logicDeviceId_=5]has recv close hccp and computer process respond [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.270.276 [stub_process_mode_nowin.cpp:151][CloseInHost][tid:102038] enter into CloseInHost deviceid[5] [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.270.288 [stub_process_mode_nowin.cpp:154][CloseInHost][tid:102038] host cpu not support [INFO] TDT(102038,python3.7):2024-01-11-05:33:58.270.335 [process_mode_manager.cpp:208][Close][tid:102038] [TsdClient][deviceId=5] [sessionId=1] close hccp and computer process success [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:58.270.348 [atrace_api.c:93](tid:102038) AtraceDestroy start [INFO] ATRACE(102038,python3.7):2024-01-11-05:33:58.270.365 [atrace_api.c:95](tid:102038) AtraceDestroy end [INFO] PROFILING(102038,python3.7):2024-01-11-05:33:58.270.388 [msprofiler_impl.cpp:156] >>> (tid:102038) ProfNotifySetDevice called, is open: 0, devId: 5 [INFO] RUNTIME(102038,python3.7):2024-01-11-05:34:00.318.474 [runtime.cc:1737] 102038 ~Runtime: deconstruct runtime.