============================= test session starts ============================== platform linux -- Python 3.7.5, pytest-5.4.3, py-1.8.1, pluggy-0.13.1 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/dyn_shape_dev, inifile: /home/jenkins/sault/virtual_test/virtualenv_008/sault/config/pytest.ini plugins: anyio-3.7.1, forked-1.1.3, xdist-1.32.0 [INFO] ATRACE(41774,python3.7):2024-01-11-05:34:59.649.409 [trace_attr.c:105](tid:41774) platform is 1. [INFO] ATRACE(41774,python3.7):2024-01-11-05:34:59.649.590 [trace_recorder.c:114](tid:41774) use root path: /home/jenkins/ascend/atrace [INFO] ATRACE(41774,python3.7):2024-01-11-05:34:59.649.614 [trace_signal.c:133](tid:41774) register signal handler for signo 2 succeed. [INFO] ATRACE(41774,python3.7):2024-01-11-05:34:59.649.626 [trace_signal.c:133](tid:41774) register signal handler for signo 15 succeed. [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:00.037.787 [runtime.cc:1159] 41774 GetAicoreNumByLevel: workingDev_=0 [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:00.037.845 [runtime.cc:4719] 41774 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set collected 2 items test_add.py [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.344.562 [process_mode_manager.cpp:109][OpenProcess][tid:41774] [ProcessModeManager] enter into open process deviceId[7] rankSize[0] [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.346.387 [process_mode_manager.cpp:379][InitTsdClient][tid:41774] [TsdClient] deviceId[7] begin to init hdc client [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.346.527 [version_verify.cpp:34][SetVersionInfo][tid:41774] VersionVerify: send client version to server [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.346.552 [version_verify.cpp:50][SetVersionInfo][tid:41774] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.346.565 [version_verify.cpp:50][SetVersionInfo][tid:41774] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.346.997 [version_verify.cpp:66][PeerVersionCheck][tid:41774] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.010 [version_verify.cpp:87][ParseVersionInfo][tid:41774] VersionVerify: pass client version info success [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.019 [hdc_client.cpp:276][CheckHdcConnection][tid:41774] Service[2] create hdc success [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.031 [version_verify.cpp:120][SpecialFeatureCheck][tid:41774] VersionVerify: new type[35], supported [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.074 [process_mode_manager.cpp:748][GetDeviceCheckCode][tid:41774] [TsdClient][deviceId=7] [sessionId=1] wait package info respond [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.209 [process_mode_manager.cpp:379][InitTsdClient][tid:41774] [TsdClient] deviceId[7] begin to init hdc client [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.399 [version_verify.cpp:34][SetVersionInfo][tid:41774] VersionVerify: send client version to server [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.411 [version_verify.cpp:50][SetVersionInfo][tid:41774] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.421 [version_verify.cpp:50][SetVersionInfo][tid:41774] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.589 [version_verify.cpp:66][PeerVersionCheck][tid:41774] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.601 [version_verify.cpp:87][ParseVersionInfo][tid:41774] VersionVerify: pass client version info success [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.609 [hdc_client.cpp:276][CheckHdcConnection][tid:41774] Service[2] create hdc success [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.620 [process_mode_manager.cpp:426][ConstructOpenMsg][tid:41774] [TsdClient] tsd get process sign successfully, procpid[41774] signSize[48] [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.645 [version_verify.cpp:112][SpecialFeatureCheck][tid:41774] VersionVerify: previous type[6], supported [INFO] TDT(41774,python3.7):2024-01-11-05:35:04.347.666 [process_mode_manager.cpp:126][OpenProcess][tid:41774] [ProcessModeManager] deviceId[7] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(41774,python3.7):2024-01-11-05:35:05.943.391 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:41774] [TsdClient] it is unnecessary of current mode[0] chiptype[1] to grant queue auth to aicpusd [INFO] TDT(41774,python3.7):2024-01-11-05:35:05.943.433 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:41774] enter into OpenInHost deviceid[7] [INFO] TDT(41774,python3.7):2024-01-11-05:35:05.943.445 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:41774] host cpu not support [INFO] TDT(41774,python3.7):2024-01-11-05:35:05.943.453 [process_mode_manager.cpp:156][OpenProcess][tid:41774] [TsdClient][deviceId=7] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:05.946.155 [device.cc:340] 41774 Init: isDoubledie:0, topologytype:0 [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:05.962.083 [npu_driver.cc:5428] 43519 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:05.962.117 [atrace_api.c:28](tid:41774) AtraceCreate start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:05.962.207 [trace_rb_log.c:84](tid:41774) [RUNTIME_ATRACE_DEV7_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:05.962.223 [atrace_api.c:32](tid:41774) AtraceCreate end [INFO] TDT(41774,python3.7):2024-01-11-05:35:05.962.236 [client_manager.cpp:157][SetProfilingCallback][tid:41774] [TsdClient] set profiling callback success [TRACE] GE(41774,python3.7):2024-01-11-05:35:06.111.192 [status:INIT] [ge_api.cc:144]41774 GEInitializeImpl:GEInitialize start [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:06.324.419 [msprofiler_impl.cpp:156] >>> (tid:41774) ProfNotifySetDevice called, is open: 1, devId: 7 [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:06.324.557 [platform.cpp:38] >>> (tid:41774) Profiling platform version: 1.0. [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:06.324.574 [ai_drv_dev_api.cpp:384] >>> (tid:41774) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(41774,python3.7):2024-01-11-05:35:06.374.156 [status:RUNNING] [ge_api.cc:211]41774 GEInitializeImpl:Initializing environment [INFO] GE(41774,python3.7):2024-01-11-05:35:06.374.214 [gelib.cc:98][EVENT]41774 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(41774,python3.7):2024-01-11-05:35:06.374.432 [gelib.cc:307][EVENT]41774 SystemInitialize:Online infer init GELib success, device id :7 [INFO] DVPP(41774,python3.7):2024-01-11-05:35:06.726.162 [dvpp_engine.cc:41][ENGINE][Initialize:41][tid:41774]dvpp engine do not support [INFO] TUNE(41774,python3.7):2024-01-11-05:35:06.729.221 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:41774]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(41774,python3.7):2024-01-11-05:35:06.729.257 [handle_manager.cpp:115][CANNKB][Tid:41774]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(41774,python3.7):2024-01-11-05:35:06.729.312 [handle_manager.cpp:407][CANNKB][Tid:41774]"Init functions of loading dynamic python lib end!" [INFO] TUNE(41774,python3.7):2024-01-11-05:35:06.729.323 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:41774]"CANN_KB_Py has already been initialized." [INFO] TUNE(41774,python3.7):2024-01-11-05:35:06.729.401 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:41774]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] HCCL(41774,python3.7):2024-01-11-05:35:18.702.576 [plugin_manager.cc:42][41774]hcom running normal mode. [INFO] DVPP(41774,python3.7):2024-01-11-05:35:18.703.199 [dvpp_engine.cc:92][ENGINE][GetOpsKernelInfoStores:92][tid:41774]dvpp ops kernel info store do not support [INFO] DVPP(41774,python3.7):2024-01-11-05:35:18.703.366 [dvpp_engine.cc:69][ENGINE][GetGraphOptimizerObjs:69][tid:41774]dvpp graph optimizer do not support [INFO] DVPP(41774,python3.7):2024-01-11-05:35:19.225.942 [dvpp_ops_kernel_builder.cc:48][ENGINE][Initialize:48][tid:41774]dvpp ops kernel builder do not support [INFO] GE(41774,python3.7):2024-01-11-05:35:19.234.513 [gelib.cc:169][EVENT]41774 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [12860255] micro second. [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.315.976 [status:STOP] [ge_api.cc:255]41774 GEInitializeImpl:GEInitialize finished [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.316.114 [status:INIT] [ge_api.cc:398]41774 Session:Start to construct session. [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.316.132 [status:RUNNING] [ge_api.cc:408]41774 Session:Creating session [INFO] GE(41774,python3.7):2024-01-11-05:35:19.316.552 [graph_var_manager.cc:1445][EVENT]41774 SetMemoryMallocSize:Total memory size is 34359738368 [INFO] GE(41774,python3.7):2024-01-11-05:35:19.316.568 [graph_var_manager.cc:1424][EVENT]41774 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:19.316.859 [msprofiler_impl.cpp:156] >>> (tid:41774) ProfNotifySetDevice called, is open: 1, devId: 7 [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.317.678 [status:RUNNING] [ge_api.cc:411]41774 Session:Session id is 0 [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.317.699 [status:STOP] [ge_api.cc:420]41774 Session:Session Constructor finished [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:19.327.211 [platform.cpp:38] >>> (tid:41774) Profiling platform version: 1.0. [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:19.327.252 [ai_drv_dev_api.cpp:384] >>> (tid:41774) Succeeded to DrvGetApiVersion version: 0x72313 [TRACE] GE(41774,python3.7):2024-01-11-05:35:19.327.435 [status:INIT] [ge_api.cc:144]41774 GEInitializeImpl:GEInitialize start TotalTime = 0.451228, [20] [parse]: 0.0148158 [symbol_resolve]: 0.0256509, [1] [Cycle 1]: 0.025573, [1] [resolve]: 0.0255386 [combine_like_graphs]: 1.43e-06 [graph_reusing]: 3.82e-06 [meta_unpack_prepare]: 0.00013049 [pre_cconv]: 4.89e-06 [abstract_specialize]: 0.00428492 [pack_expand]: 1.413e-05 [auto_monad]: 0.00010115 [inline]: 1.5e-06 [pre_auto_parallel]: 2.558e-05 [pipeline_split]: 2.92e-06 [optimize]: 0.399234, [35] [py_interpret_to_execute]: 3.63e-06 [rewriter_before_opt_a]: 0.0001249 [opt_a]: 0.398094, [3] [Cycle 1]: 0.387116, [30] [expand_dump_flag]: 5.06e-06 [switch_simplify]: 2.552e-05 [a_1]: 0.00034238 [recompute_prepare]: 6.57e-06 [updatestate_depend_eliminate]: 1.131e-05 [updatestate_assign_eliminate]: 6.14e-06 [updatestate_loads_eliminate]: 5.41e-06 [parameter_eliminate]: 6.96e-06 [a_2]: 6.623e-05 [accelerated_algorithm]: 7.65e-06 [pynative_shard]: 1.85001e-06 [auto_parallel]: 6.31e-06 [parallel]: 2.277e-05 [merge_comm]: 1.523e-05 [allreduce_fusion]: 2.12e-06 [virtual_dataset]: 4.72e-06 [get_grad_eliminate_]: 3.45e-06 [virtual_output]: 3.22e-06 [merge_forward]: 7.74e-06 [cell_reuse_recompute_pass]: 1.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.6e-06 [meta_fg_expand]: 0.120892, [1] [Cycle 1]: 0.0771067, [1] [resolve]: 0.0770659 [after_resolve]: 0.00015353 [a_after_grad]: 0.00065286 [renormalize]: 0.263985 [real_op_eliminate]: 3.645e-05 [auto_monad_grad]: 4.674e-05 [auto_monad_eliminator]: 6.203e-05 [cse]: 0.00028302 [a_3]: 0.00023055 [Cycle 2]: 0.00265192, [30] [expand_dump_flag]: 4.62e-06 [switch_simplify]: 9.507e-05 [a_1]: 0.00064455 [recompute_prepare]: 9.63e-06 [updatestate_depend_eliminate]: 1.287e-05 [updatestate_assign_eliminate]: 9.67e-06 [updatestate_loads_eliminate]: 8.61999e-06 [parameter_eliminate]: 4.08e-06 [a_2]: 0.00012637 [accelerated_algorithm]: 1.437e-05 [pynative_shard]: 2e-06 [auto_parallel]: 9.44e-06 [parallel]: 7.39e-06 [merge_comm]: 4.69e-06 [allreduce_fusion]: 2.27e-06 [virtual_dataset]: 7.4e-06 [get_grad_eliminate_]: 6.48e-06 [virtual_output]: 5.79e-06 [merge_forward]: 1.1e-05 [cell_reuse_recompute_pass]: 7.90002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [meta_fg_expand]: 2.45e-05 [after_resolve]: 1.099e-05 [a_after_grad]: 1.011e-05 [renormalize]: 0.00127357 [real_op_eliminate]: 1.111e-05 [auto_monad_grad]: 4.63e-06 [auto_monad_eliminator]: 1.958e-05 [cse]: 8.372e-05 [a_3]: 5.61e-05 [Cycle 3]: 0.00061149, [30] [expand_dump_flag]: 1.39e-06 [switch_simplify]: 6.64e-06 [a_1]: 0.00011993 [recompute_prepare]: 7.98e-06 [updatestate_depend_eliminate]: 1.101e-05 [updatestate_assign_eliminate]: 8.48e-06 [updatestate_loads_eliminate]: 7.99e-06 [parameter_eliminate]: 1.68e-06 [a_2]: 0.00012039 [accelerated_algorithm]: 1.176e-05 [pynative_shard]: 1.28e-06 [auto_parallel]: 3.24e-06 [parallel]: 3.51e-06 [merge_comm]: 2.46e-06 [allreduce_fusion]: 1.79e-06 [virtual_dataset]: 6.76e-06 [get_grad_eliminate_]: 6.1e-06 [virtual_output]: 5.62e-06 [merge_forward]: 9.77e-06 [cell_reuse_recompute_pass]: 4.49996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [meta_fg_expand]: 7.14e-06 [after_resolve]: 1.002e-05 [a_after_grad]: 9.99e-06 [renormalize]: 6.99947e-08 [real_op_eliminate]: 6.01e-06 [auto_monad_grad]: 1.91e-06 [auto_monad_eliminator]: 1.636e-05 [cse]: 3.937e-05 [a_3]: 4.983e-05 [py_interpret_to_execute_after_opt_a]: 4.27e-06 [slice_cell_reuse_recomputed_activation]: 2.45e-06 [rewriter_after_opt_a]: 5.531e-05 [convert_after_rewriter]: 1.47e-05 [order_py_execute_after_rewriter]: 1.088e-05 [opt_b]: 0.0004933, [2] [Cycle 1]: 0.0004029, [7] [b_1]: 0.00034668 [b_2]: 3.8e-06 [updatestate_depend_eliminate]: 3.59e-06 [updatestate_assign_eliminate]: 2.82e-06 [updatestate_loads_eliminate]: 2.69e-06 [renormalize]: 3.6e-07 [cse]: 1.065e-05 [Cycle 2]: 8.033e-05, [7] [b_1]: 3.844e-05 [b_2]: 2.17e-06 [updatestate_depend_eliminate]: 2.4e-06 [updatestate_assign_eliminate]: 2.11001e-06 [updatestate_loads_eliminate]: 2.02e-06 [renormalize]: 6.00048e-08 [cse]: 6.96e-06 [cconv]: 2.192e-05 [opt_after_cconv]: 5.381e-05, [1] [Cycle 1]: 4.946e-05, [7] [c_1]: 5.45e-06 [parameter_eliminate]: 1.75e-06 [updatestate_depend_eliminate]: 2.46e-06 [updatestate_assign_eliminate]: 2.06e-06 [updatestate_loads_eliminate]: 2.02e-06 [cse]: 7.96001e-06 [renormalize]: 1.8e-07 [remove_dup_value]: 1.159e-05 [tuple_transform]: 3.665e-05, [1] [Cycle 1]: 3.281e-05, [3] [d_1]: 1.451e-05 [d_2]: 6.69e-06 [renormalize]: 1.50001e-07 [add_cache_embedding]: 1.11e-05 [add_recomputation]: 5.244e-05 [cse_after_recomputation]: 1.661e-05, [1] [Cycle 1]: 1.243e-05, [1] [cse]: 8.12001e-06 [environ_conv]: 2.156e-05 [label_micro_interleaved_index]: 2.31e-06 [label_fine_grained_interleaved_index]: 2.57e-06 [assign_add_opt]: 2.52e-06 [slice_recompute_activation]: 2.601e-05 [micro_interleaved_order_control]: 1.86e-06 [full_micro_interleaved_order_control]: 1.9e-06 [comp_comm_scheduling]: 2.03e-06 [reorder_send_recv_between_fp_bp]: 2.19e-06 [comm_op_add_attrs]: 1.25e-06 [add_comm_op_reuse_tag]: 9.90003e-07 [overlap_opt_shard_in_pipeline]: 1.09e-06 [grouped_pairwise_exchange_alltoall]: 1.42e-06 [overlap_recompute_and_grad_model_parallel]: 2.1e-06 [overlap_grad_matmul_and_grad_allreduce]: 1.12e-06 [split_matmul_comm_elemetwise]: 2.4e-06 [split_layernorm_comm]: 1.72e-06 [process_send_recv_for_ge]: 2.63e-06 [handle_group_info]: 1.04e-06 [auto_monad_reorder]: 2.122e-05 [get_jit_bprop_graph]: 4.69998e-07 [eliminate_special_op_node]: 0.00053439 [validate]: 5.168e-05 [distribtued_split]: 1.52001e-06 [task_emit]: 0.00596693 [execute]: 8.16e-06 Sums parse : 0.014816s : 3.72% symbol_resolve.resolve : 0.025539s : 6.41% combine_like_graphs : 0.000001s : 0.00% graph_reusing : 0.000004s : 0.00% meta_unpack_prepare : 0.000130s : 0.03% pre_cconv : 0.000005s : 0.00% abstract_specialize : 0.004285s : 1.08% pack_expand : 0.000014s : 0.00% auto_monad : 0.000101s : 0.03% inline : 0.000002s : 0.00% pre_auto_parallel : 0.000026s : 0.01% pipeline_split : 0.000003s : 0.00% optimize.py_interpret_to_execute : 0.000004s : 0.00% optimize.rewriter_before_opt_a : 0.000125s : 0.03% optimize.opt_a.expand_dump_flag : 0.000011s : 0.00% optimize.opt_a.switch_simplify : 0.000127s : 0.03% optimize.opt_a.a_1 : 0.001107s : 0.28% optimize.opt_a.recompute_prepare : 0.000024s : 0.01% optimize.opt_a.updatestate_depend_eliminate : 0.000035s : 0.01% optimize.opt_a.updatestate_assign_eliminate : 0.000024s : 0.01% optimize.opt_a.updatestate_loads_eliminate : 0.000022s : 0.01% optimize.opt_a.parameter_eliminate : 0.000013s : 0.00% optimize.opt_a.a_2 : 0.000313s : 0.08% optimize.opt_a.accelerated_algorithm : 0.000034s : 0.01% optimize.opt_a.pynative_shard : 0.000005s : 0.00% optimize.opt_a.auto_parallel : 0.000019s : 0.00% optimize.opt_a.parallel : 0.000034s : 0.01% optimize.opt_a.merge_comm : 0.000022s : 0.01% optimize.opt_a.allreduce_fusion : 0.000006s : 0.00% optimize.opt_a.virtual_dataset : 0.000019s : 0.00% optimize.opt_a.get_grad_eliminate_ : 0.000016s : 0.00% optimize.opt_a.virtual_output : 0.000015s : 0.00% optimize.opt_a.merge_forward : 0.000029s : 0.01% optimize.opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% optimize.opt_a.meta_fg_expand : 0.000032s : 0.01% optimize.opt_a.meta_fg_expand.resolve : 0.077066s : 19.34% optimize.opt_a.after_resolve : 0.000175s : 0.04% optimize.opt_a.a_after_grad : 0.000673s : 0.17% optimize.opt_a.renormalize : 0.265259s : 66.57% optimize.opt_a.real_op_eliminate : 0.000054s : 0.01% optimize.opt_a.auto_monad_grad : 0.000053s : 0.01% optimize.opt_a.auto_monad_eliminator : 0.000098s : 0.02% optimize.opt_a.cse : 0.000406s : 0.10% optimize.opt_a.a_3 : 0.000336s : 0.08% optimize.py_interpret_to_execute_after_opt_a : 0.000004s : 0.00% optimize.slice_cell_reuse_recomputed_activation : 0.000002s : 0.00% optimize.rewriter_after_opt_a : 0.000055s : 0.01% optimize.convert_after_rewriter : 0.000015s : 0.00% optimize.order_py_execute_after_rewriter : 0.000011s : 0.00% optimize.opt_b.b_1 : 0.000385s : 0.10% optimize.opt_b.b_2 : 0.000006s : 0.00% optimize.opt_b.updatestate_depend_eliminate : 0.000006s : 0.00% optimize.opt_b.updatestate_assign_eliminate : 0.000005s : 0.00% optimize.opt_b.updatestate_loads_eliminate : 0.000005s : 0.00% optimize.opt_b.renormalize : 0.000000s : 0.00% optimize.opt_b.cse : 0.000018s : 0.00% optimize.cconv : 0.000022s : 0.01% optimize.opt_after_cconv.c_1 : 0.000005s : 0.00% optimize.opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% optimize.opt_after_cconv.cse : 0.000008s : 0.00% optimize.opt_after_cconv.renormalize : 0.000000s : 0.00% optimize.remove_dup_value : 0.000012s : 0.00% optimize.tuple_transform.d_1 : 0.000015s : 0.00% optimize.tuple_transform.d_2 : 0.000007s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.add_cache_embedding : 0.000011s : 0.00% optimize.add_recomputation : 0.000052s : 0.01% optimize.cse_after_recomputation.cse : 0.000008s : 0.00% optimize.environ_conv : 0.000022s : 0.01% optimize.label_micro_interleaved_index : 0.000002s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000003s : 0.00% optimize.assign_add_opt : 0.000003s : 0.00% optimize.slice_recompute_activation : 0.000026s : 0.01% optimize.micro_interleaved_order_control : 0.000002s : 0.00% optimize.full_micro_interleaved_order_control : 0.000002s : 0.00% optimize.comp_comm_scheduling : 0.000002s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000002s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000001s : 0.00% optimize.grouped_pairwise_exchange_alltoall : 0.000001s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000002s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.process_send_recv_for_ge : 0.000003s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000000s : 0.00% eliminate_special_op_node : 0.000534s : 0.13% validate : 0.000052s : 0.01% distribtued_split : 0.000002s : 0.00% task_emit : 0.005967s : 1.50% execute : 0.000008s : 0.00% Time group info: ------[substitution.] 0.101417 373 0.04% : 0.000042s : 7: substitution.arithmetic_simplify 0.00% : 0.000002s : 2: substitution.float_depend_g_call 0.01% : 0.000007s : 9: substitution.float_tuple_getitem_switch 98.76% : 0.100164s : 83: substitution.getattr_setattr_resolve 0.00% : 0.000005s : 4: substitution.graph_param_transform 0.00% : 0.000002s : 1: substitution.incorporate_call 0.00% : 0.000001s : 1: substitution.incorporate_call_switch 0.92% : 0.000932s : 66: substitution.inline 0.01% : 0.000007s : 9: substitution.less_batch_normalization 0.04% : 0.000042s : 15: substitution.meta_unpack_prepare 0.01% : 0.000007s : 6: substitution.minmaximum_grad 0.02% : 0.000016s : 2: substitution.partial_eliminate 0.00% : 0.000001s : 4: substitution.partial_unused_args_eliminate 0.00% : 0.000004s : 25: substitution.remove_not_recompute_node 0.04% : 0.000038s : 20: substitution.replace_applicator 0.01% : 0.000014s : 52: substitution.replace_old_param 0.00% : 0.000003s : 1: substitution.reset_defer_inline 0.00% : 0.000004s : 3: substitution.set_cell_output_no_recompute 0.00% : 0.000004s : 2: substitution.specialize_transform 0.01% : 0.000007s : 4: substitution.switch_simplify 0.01% : 0.000007s : 1: substitution.transpose_eliminate 0.02% : 0.000022s : 9: substitution.tuple_list_convert_item_index_to_positive 0.01% : 0.000011s : 9: substitution.tuple_list_get_item_const_eliminator 0.01% : 0.000013s : 9: substitution.tuple_list_get_item_depend_reorder 0.05% : 0.000048s : 20: substitution.tuple_list_get_item_eliminator 0.01% : 0.000014s : 9: substitution.tuple_list_get_set_item_eliminator ------[renormalize.] 0.265245 4 98.95% : 0.262459s : 2: renormalize.infer 1.05% : 0.002786s : 2: renormalize.specialize ------[replace.] 0.001486 101 81.28% : 0.001207s : 72: replace.getattr_setattr_resolve 9.96% : 0.000148s : 18: replace.inline 2.37% : 0.000035s : 1: replace.meta_unpack_prepare 3.16% : 0.000047s : 4: replace.switch_simplify 0.37% : 0.000006s : 1: replace.transpose_eliminate 2.86% : 0.000043s : 5: replace.tuple_list_get_item_eliminator ------[match.] 0.100266 101 99.49% : 0.099755s : 72: match.getattr_setattr_resolve 0.44% : 0.000444s : 18: match.inline 0.03% : 0.000033s : 1: match.meta_unpack_prepare 0.01% : 0.000007s : 4: match.switch_simplify 0.01% : 0.000007s : 1: match.transpose_eliminate 0.02% : 0.000019s : 5: match.tuple_list_get_item_eliminator ------[func_graph_cloner_run.] 0.002787 44 66.24% : 0.001846s : 21: func_graph_cloner_run.FuncGraphClonerGraph 33.76% : 0.000941s : 23: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105667 213 0.61% : 0.000650s : 78: opt.transform.opt_a 0.33% : 0.000352s : 92: opt.transform.opt_b 96.83% : 0.102313s : 4: opt.transform.opt_resolve 0.10% : 0.000104s : 1: opt.transforms.meta_unpack_prepare 2.09% : 0.002212s : 30: opt.transforms.opt_a 0.00% : 0.000004s : 1: opt.transforms.opt_after_cconv 0.00% : 0.000004s : 2: opt.transforms.opt_b 0.02% : 0.000020s : 2: opt.transforms.opt_trans_graph 0.01% : 0.000009s : 3: opt.transforms.special_op_eliminate [INFO] GE(41774,python3.7):2024-01-11-05:35:19.912.528 [scalable_config.cc:55][EVENT]45932 ScalableConfig:device total max size: 34359738368, page_mem_size_total_thresold: 32641751449, uncacheable_size_threshold: 17179869184 [INFO] GE(41774,python3.7):2024-01-11-05:35:19.991.369 [graph_var_manager.cc:1424][EVENT]45932 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] GE(41774,python3.7):2024-01-11-05:35:19.991.468 [graph_manager.cc:1248][EVENT]45932 PreRun:PreRun start: graph node size 4, session id 1, graph id 0, graph name online. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:19.992.331 [atrace_api.c:28](tid:45932) AtraceCreate start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:19.992.398 [trace_rb_log.c:84](tid:45932) [RUNTIME_ATRACE_DEV64_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:19.992.412 [atrace_api.c:32](tid:45932) AtraceCreate end [INFO] TDT(41774,python3.7):2024-01-11-05:35:19.992.444 [client_manager.cpp:157][SetProfilingCallback][tid:45932] [TsdClient] set profiling callback success [INFO] GE(41774,python3.7):2024-01-11-05:35:19.993.431 [parallel_partitioner.cc:165][EVENT]45932 DoPipelinePartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::PipelinePartition is [22] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.993.474 [parallel_partitioner.cc:178][EVENT]45932 DoFlowGraphPartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::FlowGraphPartition is [14] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.993.518 [graph_prepare.cc:1378][EVENT]45932 Init:[GEPERFTRACE] The time cost of FileConstantUtils::ConvertFileConstToConst is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.181 [graph_manager.cc:1050][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareInit is [680] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.210 [graph_manager.cc:1052][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.HandleSummaryOp is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.347 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ForToWhilePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.372 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::SavePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.436 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::NetOutputPass is [51] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.449 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::DataPass is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.535 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of CreateSubGraphWithScopePass is [19] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.550 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of SubgraphMultiDimsClonePass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.567 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of MultiBatchClonePass is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.665 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SplitVariableIntoSubgraphPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:19.994.684 [graph_manager.cc:1054][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.NormalizeGraph is [461] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.002.228 [graph_manager.cc:1055][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeGraphInit is [7529] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.232 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [8] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.261 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.272 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of MergePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.282 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of InferShapePass is [291] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.291 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [14] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.300 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [1] micro second, call num is [8] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.308 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [22] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.329 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [18] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.003.338 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of InferValuePass is [5] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.335 [graph_manager.cc:1056][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphForQuantize is [3070] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.396 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of CondRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.414 [graph_prepare.cc:1982][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::ProcessBeforeInfershape is [46] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.846 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of AssertPass is [0] micro second, call num is [8] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.871 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.882 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of MergePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.891 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of InferShapePass is [244] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.900 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [9] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.908 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [0] micro second, call num is [8] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.917 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [6] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.925 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [9] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.934 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of InferValuePass is [4] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.976 [graph_prepare.cc:1983][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::FormatAndShapeProcess is [549] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.005.998 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PreRun::MarkForceUnknownForCondPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.011 [graph_prepare.cc:1984][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::CtrlFlowPreProcess is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.024 [graph_prepare.cc:1985][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::multibatch::GetDynamicOutputShape is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.049 [graph_prepare.cc:1986][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::InsertAippOpUtil::Instance().UpdateDataNodeByAipp is [14] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.061 [graph_prepare.cc:1987][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::SaveOriginalGraphToOmModel is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.075 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ShapeOperateOpRemovePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.088 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ReplaceTransShapePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.112 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareOptimize::MarkAgnosticPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.188 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.201 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of CondPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.209 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrintOpPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.218 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of NoUseReshapeRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.226 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DropOutPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.235 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of AssertPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.243 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of TransposeRemovePass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.252 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of UnusedConstPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.260 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of StopGradientPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.268 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of PreventGradientPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.276 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of PlaceholderWithDefaultPass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.284 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SnapshotPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.292 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of GuaranteeConstPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.300 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of VarIsInitializedOpPass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.308 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ParallelConcatStartOpPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.317 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of IdentityPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.337 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareOptimize::PrunePass is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.350 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareOptimize::HcclMemcpyPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.380 [graph_prepare.cc:1988][EVENT]45932 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::PrepareOptimize is [310] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.006.392 [graph_manager.cc:1065][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareDynShape is [1025] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.021.454 [graph_manager.cc:1077][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraph is [15042] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.021.565 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PrepareRunningFormatRefiner::VariablePrepareOpPass is [5] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.021.610 [graph_manager.cc:1080][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareRunningFormatRefiner is [110] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.373 [graph_manager.cc:1081][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphJudgeInsert is [11746] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.423 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of SubexpressionMigrationPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.439 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of UnusedArgsCleanPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.452 [graph_manager.cc:1082][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::SubexpressionMigration is [36] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.480 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeInputMemcpyPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.496 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SwitchDataEdgesBypass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.510 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::ConstantFuseSamePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.609 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CSEBeforeFuseDataNodesWithCommonInputPass is [88] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.625 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::FuseDataNodesWithCommonInputPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.678 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CommonSubexpressionEliminationPass is [41] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.693 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::PermutePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.733 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SameTransdataBreadthFusionPass is [29] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.753 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::VariableOpPass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.770 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpWithoutReshapeFusionPass is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.815 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpBreadthFusionPass is [33] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.835 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::DataFlowPreparePass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.847 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeUnknownShapeNPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.857 [graph_manager.cc:2700][EVENT]45932 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_1 is [381] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.033.985 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of EnterPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.000 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of AddNPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.022 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.032 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of SwitchLogicRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.041 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of MergePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.050 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of CastRemovePass is [9] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.058 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of TransposeTransDataPass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.067 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.075 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of TransOpSymmetryEliminationPass is [5] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.083 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of TransOpNearbyAllreduceFusionPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.091 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.100 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [8] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.108 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [12] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.116 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [4] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.124 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of UselessControlOutRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.133 [graph_manager.cc:2741][EVENT]45932 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_2 is [260] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.142 [graph_manager.cc:2752][EVENT]45932 OptimizeStage1:[GEPERFTRACE] The time cost of extern constant folding is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.161 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::Migration is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.174 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ArgsClean is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.193 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::PrunePass is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.206 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::NextIterationPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.217 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ControlTriggerPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.229 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MergeToStreamMergePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.254 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SwitchToStreamSwitchPass is [13] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.269 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::AttachStreamLabelPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.288 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MultiBatchPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.299 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SubgraphMultiDimsPass is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.310 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::IteratorOpPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.321 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::VariableRefUselessControlOutDeletePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.337 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ReshapeRecoveryPass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.351 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::RemoveSameConstPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.361 [graph_manager.cc:2810][EVENT]45932 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_3 is [204] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.389 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of IdentityPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.401 [graph_manager.cc:2821][EVENT]45932 OptimizeStage1:[GEPERFTRACE] The time cost of GraphPrepare::node_pass is [32] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.424 [graph_manager.cc:1087][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1 is [953] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.562 [graph_manager.cc:1088][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeAfterStage1 is [123] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.603 [graph_manager.cc:1089][EVENT]45932 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::GraphUtilsEx::InferShapeInNeed is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.623 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of PreRun::CtrlEdgeTransferPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.638 [graph_manager.cc:1097][EVENT]45932 PreRunOptimizeOriginalGraph:PreRun:PreRunOptimizeOriginalGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.034.658 [graph_manager.cc:3325][EVENT]45932 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::StagePartition is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.017 [engine_place.cc:144][EVENT]45932 Run:The time cost of AIcoreEngine::CheckSupported is [248] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.043 [engine_place.cc:144][EVENT]45932 Run:The time cost of DNN_VM_GE_LOCAL_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.053 [engine_place.cc:144][EVENT]45932 Run:The time cost of DNN_VM_RTS_OP_STORE::CheckSupported is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.116 [graph_manager.cc:3351][EVENT]45932 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::GraphPartitionDynamicShape is [444] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.135 [graph_manager.cc:3364][EVENT]45932 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::CompositeEngine is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.195 [engine_partitioner.cc:1139][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [19] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.219 [engine_partitioner.cc:1142][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.375 [engine_partitioner.cc:1148][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [146] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.410 [engine_partitioner.cc:1155][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.455 [engine_partitioner.cc:1164][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [32] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.480 [graph_manager.cc:3405][EVENT]45932 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::Partition1 is [332] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.035.499 [graph_manager.cc:3412][EVENT]45932 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPreProc is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.466 [graph_manager.cc:3422][EVENT]45932 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubGraph is [18952] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.512 [graph_manager.cc:3428][EVENT]45932 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPostProc is [9] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.631 [graph_manager.cc:3467][EVENT]45932 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::MergeSubGraph is [99] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.651 [graph_manager.cc:3377][EVENT]45932 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::AtomicEngine is [19503] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.666 [graph_manager.cc:1106][EVENT]45932 PreRunOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeSubgraph is [20014] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.678 [graph_manager.cc:1115][EVENT]45932 PreRunOptimizeSubGraph:PreRun:PreRunOptimizeSubGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.698 [graph_manager.cc:1130][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.ReplacePrecompiledNodeWithOmGraph is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.730 [graph_manager.cc:1131][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeWholeGraph is [18] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.758 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::LinkGenMaskNodesPass is [10] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.775 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::HcclContinuousMemcpyPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.786 [graph_manager.cc:2837][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses is [40] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.864 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [14] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.877 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.886 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of CondRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.895 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of BitcastPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.917 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of AssignRemovePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.926 [base_pass.cc:339][EVENT]45932 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [6] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.936 [graph_manager.cc:2864][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::MergedGraphNameToPasses is [135] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.947 [graph_manager.cc:2872][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::RemoveIsolatedConst is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.964 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::MultiBatchPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.978 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::RefIdentityDeleteOpPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.054.991 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::VariableRefDeleteOpPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.004 [compile_nodes_pass.cc:88][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.013 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [12] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.023 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::SwapSpacePass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.105 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::InputOutputConnectionIdentifyPass is [73] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.136 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::AtomicAddrCleanPass is [17] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.149 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::EndOfSequenceAddControlPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.162 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::SubgraphPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.174 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::AttachStreamLabelPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.184 [graph_manager.cc:2927][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize is [222] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.196 [graph_manager.cc:2937][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of ModelBuilder::AssignFunctionalLabels is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.211 [graph_manager.cc:2943][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of MemcpyAddrAsyncPass::Run. is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.055.227 [graph_manager.cc:2950][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of BufferPoolMemoryPass::Run. is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.716 [graph_manager.cc:2958][EVENT]45932 OptimizeStage2:[GEPERFTRACE] The time cost of ParallelGroupPass::Run. is [40] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.764 [graph_manager.cc:1132][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage2 is [10020] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.874 [graph_manager.cc:1135][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::GetCompilerStages(graph_node->GetGraphId()).optimizer.OptimizeGraphBeforeBuild is [82] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.920 [graph_manager.cc:2975][EVENT]45932 MemConflictProc:[GEPERFTRACE] The time cost of HandleMemoryRWConflict is [28] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.958 [graph_manager.cc:2981][EVENT]45932 MemConflictProc:[GEPERFTRACE] The time cost of MemLayoutConflictOptimizer::Run. is [23] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.974 [pass_manager.cc:82][EVENT]45932 Run:[GEPERFTRACE] The time cost of OptimizeStage2::SetFftsPlusAttrPass is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.984 [graph_manager.cc:2986][EVENT]45932 MemConflictProc:[GEPERFTRACE] The time cost of SetFftsPlusAttrPass::last_passes.Run is [14] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.064.994 [graph_manager.cc:1136][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::MemConflictProc is [102] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.139 [graph_manager.cc:3555][EVENT]45932 Build:[GEPERFTRACE] The time cost of GraphManager::RecoverIrDefinitionAndModifyAippData is [111] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.240 [engine_partitioner.cc:1139][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [18] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.257 [engine_partitioner.cc:1142][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.393 [engine_partitioner.cc:1148][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [126] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.428 [engine_partitioner.cc:1155][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.475 [engine_partitioner.cc:1164][EVENT]45932 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [35] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.501 [graph_builder.cc:865][EVENT]45932 SecondPartition:[GEPERFTRACE] The time cost of EnginePartitioner::Partition2 is [297] micro second. [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:20.065.955 [logger.cc:1071] 45932 ModelBindStream: model_id=832, stream_id=1089, flag=0. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.065.995 [task_generator.cc:804][EVENT]45932 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::SetStreamCtx is [175] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.066.066 [task_generator.cc:805][EVENT]45932 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::PrepareForGenerateTask is [58] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.066.880 [task_generator.cc:814][EVENT]45932 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::DoGenerateTask is [797] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.066.895 [task_generator.cc:954][EVENT]45932 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::GenerateTask is [1075] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.066.935 [task_generator.cc:967][EVENT]45932 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::AddModelTaskToModel is [20] micro second. [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:20.066.954 [logger.cc:1084] 45932 ModelUnbindStream: model_id=832, stream_id=1089, [INFO] GE(41774,python3.7):2024-01-11-05:35:20.068.001 [graph_manager.cc:1152][EVENT]45932 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::Build is [2982] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.068.043 [graph_manager.cc:1164][EVENT]45932 PreRunAfterOptimizeSubGraph:PreRun:PreRunAfterOptimizeSubGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.068.075 [graph_manager.cc:1271][EVENT]45932 PreRun:[GEPERFTRACE] The time cost of FlowModelBuild is [74751] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.068.087 [graph_manager.cc:1272][EVENT]45932 PreRun:[GEPERFTRACE] GE PreRun End [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.068.399 [atrace_api.c:93](tid:45932) AtraceDestroy start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.068.427 [atrace_api.c:95](tid:45932) AtraceDestroy end [INFO] GE(41774,python3.7):2024-01-11-05:35:20.079.510 [graph_converter.cc:838][EVENT]45932 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CreateMainNode is [3403] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.079.656 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of ZeroCopy is [100] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.150 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CEM is [470] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.350 [copy_flow_launch_fuse.cc:395][EVENT]45932 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [174] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.373 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [198] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.580 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [196] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.612 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [11] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.648 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of ZeroCopy is [23] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.836 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CEM is [176] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.920 [copy_flow_launch_fuse.cc:395][EVENT]45932 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [66] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.933 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [80] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.962 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [19] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.080.973 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.000 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of ZeroCopy is [17] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.075 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CEM is [64] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.160 [copy_flow_launch_fuse.cc:395][EVENT]45932 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [74] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.174 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [87] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.201 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [19] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.212 [base_optimizer.cc:70][EVENT]45932 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.223 [graph_converter.cc:849][EVENT]45932 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::RunAllPass is [1670] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.081.462 [graph_converter.cc:853][EVENT]45932 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::TopologicalSorting is [214] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.082.158 [graph_converter.cc:857][EVENT]45932 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::AppendGraphLevelData is [680] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.082.312 [graph_converter.cc:862][EVENT]45932 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CalculatePriority is [128] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.170.702 [graph_var_manager.cc:1424][EVENT]41774 SetAllMemoryMaxValue:The graph_mem_max_size is 27917287424 and the var_mem_max_size is 5368709120 [INFO] GE(41774,python3.7):2024-01-11-05:35:20.170.776 [graph_manager.cc:1248][EVENT]41774 PreRun:PreRun start: graph node size 4, session id 2, graph id 1, graph name online. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.171.654 [atrace_api.c:28](tid:41774) AtraceCreate start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.171.724 [trace_rb_log.c:84](tid:41774) [RUNTIME_ATRACE_DEV64_TS0] create ring buffer success, buffer size : 131152. [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.171.738 [atrace_api.c:32](tid:41774) AtraceCreate end [INFO] TDT(41774,python3.7):2024-01-11-05:35:20.171.749 [client_manager.cpp:157][SetProfilingCallback][tid:41774] [TsdClient] set profiling callback success [INFO] GE(41774,python3.7):2024-01-11-05:35:20.172.503 [parallel_partitioner.cc:165][EVENT]41774 DoPipelinePartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::PipelinePartition is [16] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.172.540 [parallel_partitioner.cc:178][EVENT]41774 DoFlowGraphPartition:[GEPERFTRACE] The time cost of OptimizeSubgraph::FlowGraphPartition is [10] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.172.581 [graph_prepare.cc:1378][EVENT]41774 Init:[GEPERFTRACE] The time cost of FileConstantUtils::ConvertFileConstToConst is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.170 [graph_manager.cc:1050][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareInit is [603] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.199 [graph_manager.cc:1052][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.HandleSummaryOp is [5] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.305 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ForToWhilePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.330 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::SavePass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.368 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::NetOutputPass is [25] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.382 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of ProcessNetOutput::DataPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.421 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of CreateSubGraphWithScopePass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.434 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of SubgraphMultiDimsClonePass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.451 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of MultiBatchClonePass is [5] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.547 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SplitVariableIntoSubgraphPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.586 [graph_manager.cc:1054][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.NormalizeGraph is [371] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.173.757 [graph_manager.cc:1055][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeGraphInit is [157] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.655 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.684 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of MergePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.695 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of InferShapePass is [277] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.705 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [12] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.714 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.723 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [12] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.732 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.174.740 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of InferValuePass is [7] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.176.731 [graph_manager.cc:1056][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphForQuantize is [2953] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.176.792 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of CondRemovePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.176.811 [graph_prepare.cc:1982][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::ProcessBeforeInfershape is [48] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.281 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.308 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of MergePass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.319 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of InferShapePass is [292] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.328 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.337 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SplitShapeNPass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.345 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [6] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.354 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [11] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.362 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of InferValuePass is [5] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.386 [graph_prepare.cc:1983][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::FormatAndShapeProcess is [562] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.421 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PreRun::MarkForceUnknownForCondPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.434 [graph_prepare.cc:1984][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::CtrlFlowPreProcess is [21] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.447 [graph_prepare.cc:1985][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::multibatch::GetDynamicOutputShape is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.467 [graph_prepare.cc:1986][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::InsertAippOpUtil::Instance().UpdateDataNodeByAipp is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.478 [graph_prepare.cc:1987][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::SaveOriginalGraphToOmModel is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.492 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ShapeOperateOpRemovePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.504 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareOptimize::ReplaceTransShapePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.517 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareOptimize::MarkAgnosticPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.589 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of EnterPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.602 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of CondPass is [4] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.611 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrintOpPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.620 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of NoUseReshapeRemovePass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.628 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of TransposeRemovePass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.637 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of UnusedConstPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.645 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of StopGradientPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.653 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of PreventGradientPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.661 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of PlaceholderWithDefaultPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.670 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SnapshotPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.678 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of GuaranteeConstPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.686 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of VarIsInitializedOpPass is [5] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.695 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ParallelConcatStartOpPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.703 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of IdentityPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.722 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareOptimize::PrunePass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.744 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareOptimize::HcclMemcpyPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.777 [graph_prepare.cc:1988][EVENT]41774 PrepareDynShape:[GEPERFTRACE] The time cost of Prepare::PrepareOptimize is [289] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.177.791 [graph_manager.cc:1065][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareDynShape is [1028] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.192.264 [graph_manager.cc:1077][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraph is [14453] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.192.335 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PrepareRunningFormatRefiner::VariablePrepareOpPass is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.192.359 [graph_manager.cc:1080][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.preparer.PrepareRunningFormatRefiner is [58] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.578 [graph_manager.cc:1081][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeOriginalGraphJudgeInsert is [8203] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.625 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of SubexpressionMigrationPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.641 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of UnusedArgsCleanPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.654 [graph_manager.cc:1082][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::SubexpressionMigration is [36] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.683 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeInputMemcpyPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.699 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SwitchDataEdgesBypass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.713 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::ConstantFuseSamePass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.816 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CSEBeforeFuseDataNodesWithCommonInputPass is [92] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.833 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::FuseDataNodesWithCommonInputPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.888 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::CommonSubexpressionEliminationPass is [43] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.903 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::PermutePass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.942 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::SameTransdataBreadthFusionPass is [26] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.962 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::VariableOpPass is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.200.982 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpWithoutReshapeFusionPass is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.008 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::TransOpBreadthFusionPass is [17] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.037 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::DataFlowPreparePass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.049 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_1::MergeUnknownShapeNPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.059 [graph_manager.cc:2700][EVENT]41774 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_1 is [381] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.197 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of EnterPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.214 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of AddNPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.224 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SwitchDeadBranchElimination is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.233 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of SwitchLogicRemovePass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.241 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of MergePass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.250 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of CastRemovePass is [10] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.259 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of TransposeTransDataPass is [0] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.267 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.276 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of TransOpSymmetryEliminationPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.284 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of TransOpNearbyAllreduceFusionPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.292 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ReplaceWithEmptyConstPass is [10] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.300 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of DimensionComputePass is [7] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.308 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [14] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.316 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [3] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.324 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of UselessControlOutRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.335 [graph_manager.cc:2741][EVENT]41774 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_2 is [258] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.346 [graph_manager.cc:2752][EVENT]41774 OptimizeStage1:[GEPERFTRACE] The time cost of extern constant folding is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.367 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::Migration is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.380 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ArgsClean is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.399 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::PrunePass is [9] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.422 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::NextIterationPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.433 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ControlTriggerPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.446 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MergeToStreamMergePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.461 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SwitchToStreamSwitchPass is [6] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.474 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::AttachStreamLabelPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.485 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::MultiBatchPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.495 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::SubgraphMultiDimsPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.507 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::IteratorOpPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.518 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::VariableRefUselessControlOutDeletePass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.535 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::ReshapeRecoveryPass is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.546 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage1_3::RemoveSameConstPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.557 [graph_manager.cc:2810][EVENT]41774 OptimizeStage1:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1_3 is [193] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.585 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of IdentityPass is [1] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.598 [graph_manager.cc:2821][EVENT]41774 OptimizeStage1:[GEPERFTRACE] The time cost of GraphPrepare::node_pass is [32] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.621 [graph_manager.cc:1087][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage1 is [949] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.757 [graph_manager.cc:1088][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeAfterStage1 is [120] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.797 [graph_manager.cc:1089][EVENT]41774 PreRunOptimizeOriginalGraph:[GEPERFTRACE] The time cost of GraphManager::GraphUtilsEx::InferShapeInNeed is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.816 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of PreRun::CtrlEdgeTransferPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.831 [graph_manager.cc:1097][EVENT]41774 PreRunOptimizeOriginalGraph:PreRun:PreRunOptimizeOriginalGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.201.852 [graph_manager.cc:3325][EVENT]41774 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::StagePartition is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.204 [engine_place.cc:144][EVENT]41774 Run:The time cost of AIcoreEngine::CheckSupported is [263] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.231 [engine_place.cc:144][EVENT]41774 Run:The time cost of DNN_VM_GE_LOCAL_OP_STORE::CheckSupported is [9] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.250 [engine_place.cc:144][EVENT]41774 Run:The time cost of DNN_VM_RTS_OP_STORE::CheckSupported is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.313 [graph_manager.cc:3351][EVENT]41774 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::GraphPartitionDynamicShape is [448] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.331 [graph_manager.cc:3364][EVENT]41774 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::CompositeEngine is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.383 [engine_partitioner.cc:1139][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [14] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.400 [engine_partitioner.cc:1142][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.558 [engine_partitioner.cc:1148][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [146] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.599 [engine_partitioner.cc:1155][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [26] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.641 [engine_partitioner.cc:1164][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [30] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.669 [graph_manager.cc:3405][EVENT]41774 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::Partition1 is [324] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.202.689 [graph_manager.cc:3412][EVENT]41774 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPreProc is [7] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.218.880 [graph_manager.cc:3422][EVENT]41774 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubGraph is [16176] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.218.934 [graph_manager.cc:3428][EVENT]41774 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::SetSubgraphPostProc is [8] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.060 [graph_manager.cc:3467][EVENT]41774 SubgraphPartitionAndOptimization:[GEPERFTRACE] The time cost of OptimizeSubgraph::MergeSubGraph is [104] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.079 [graph_manager.cc:3377][EVENT]41774 OptimizeSubgraph:[GEPERFTRACE] The time cost of OptimizeSubgraph::SubgraphPartitionAndOptimization::AtomicEngine is [16735] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.096 [graph_manager.cc:1106][EVENT]41774 PreRunOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeSubgraph is [17250] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.109 [graph_manager.cc:1115][EVENT]41774 PreRunOptimizeSubGraph:PreRun:PreRunOptimizeSubGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.129 [graph_manager.cc:1130][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.ReplacePrecompiledNodeWithOmGraph is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.161 [graph_manager.cc:1131][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::stages.optimizer.OptimizeWholeGraph is [18] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.184 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::LinkGenMaskNodesPass is [5] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.201 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::HcclContinuousMemcpyPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.225 [graph_manager.cc:2837][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses is [49] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.308 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ConstantFoldingPass is [13] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.322 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of ReshapeRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.331 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of CondRemovePass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.339 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of BitcastPass is [2] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.348 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of AssignRemovePass is [4] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.356 [base_pass.cc:339][EVENT]41774 Run:[GEPERFTRACE] The time cost of DimensionAdjustPass is [7] micro second, call num is [4] [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.365 [graph_manager.cc:2864][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::MergedGraphNameToPasses is [126] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.376 [graph_manager.cc:2872][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::RemoveIsolatedConst is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.394 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::FlowCtrlPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.408 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::MultiBatchPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.421 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::RefIdentityDeleteOpPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.434 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::VariableRefDeleteOpPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.446 [compile_nodes_pass.cc:88][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.456 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::CompileNodesPass is [12] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.466 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::SwapSpacePass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.534 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::InputOutputConnectionIdentifyPass is [60] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.553 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::AtomicAddrCleanPass is [5] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.567 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::AfterMergePasses::EndOfSequenceAddControlPass is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.579 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::SubgraphPass is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.594 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize::AttachStreamLabelPass is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.612 [graph_manager.cc:2927][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of OptimizeStage2::ControlAttrOptimize is [220] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.623 [graph_manager.cc:2937][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of ModelBuilder::AssignFunctionalLabels is [2] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.636 [graph_manager.cc:2943][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of MemcpyAddrAsyncPass::Run. is [4] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.649 [graph_manager.cc:2950][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of BufferPoolMemoryPass::Run. is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.823 [graph_manager.cc:2958][EVENT]41774 OptimizeStage2:[GEPERFTRACE] The time cost of ParallelGroupPass::Run. is [32] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.855 [graph_manager.cc:1132][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::OptimizeStage2 is [680] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.927 [graph_manager.cc:1135][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::GetCompilerStages(graph_node->GetGraphId()).optimizer.OptimizeGraphBeforeBuild is [56] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.964 [graph_manager.cc:2975][EVENT]41774 MemConflictProc:[GEPERFTRACE] The time cost of HandleMemoryRWConflict is [20] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.219.995 [graph_manager.cc:2981][EVENT]41774 MemConflictProc:[GEPERFTRACE] The time cost of MemLayoutConflictOptimizer::Run. is [17] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.010 [pass_manager.cc:82][EVENT]41774 Run:[GEPERFTRACE] The time cost of OptimizeStage2::SetFftsPlusAttrPass is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.022 [graph_manager.cc:2986][EVENT]41774 MemConflictProc:[GEPERFTRACE] The time cost of SetFftsPlusAttrPass::last_passes.Run is [14] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.031 [graph_manager.cc:1136][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::MemConflictProc is [88] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.153 [graph_manager.cc:3555][EVENT]41774 Build:[GEPERFTRACE] The time cost of GraphManager::RecoverIrDefinitionAndModifyAippData is [90] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.237 [engine_partitioner.cc:1139][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionInitialize is [17] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.254 [engine_partitioner.cc:1142][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionMarkClusters is [3] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.378 [engine_partitioner.cc:1148][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSplitSubGraphs is [111] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.410 [engine_partitioner.cc:1155][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionSortSubGraphs is [18] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.450 [engine_partitioner.cc:1164][EVENT]41774 PartitionSubGraph:[GEPERFTRACE] The time cost of EnginePartitioner::PartitionAddPartitionsToGraphNode is [29] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.472 [graph_builder.cc:865][EVENT]41774 SecondPartition:[GEPERFTRACE] The time cost of EnginePartitioner::Partition2 is [269] micro second. [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:20.220.883 [logger.cc:1071] 41774 ModelBindStream: model_id=64, stream_id=321, flag=0. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.914 [task_generator.cc:804][EVENT]41774 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::SetStreamCtx is [177] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.220.981 [task_generator.cc:805][EVENT]41774 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::PrepareForGenerateTask is [46] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.221.795 [task_generator.cc:814][EVENT]41774 GenerateTask:[GEPERFTRACE] The time cost of TaskGenerator::DoGenerateTask is [799] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.221.815 [task_generator.cc:954][EVENT]41774 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::GenerateTask is [1077] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.221.858 [task_generator.cc:967][EVENT]41774 GetTaskInfo:[GEPERFTRACE] The time cost of TaskGenerator::AddModelTaskToModel is [20] micro second. [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:20.221.876 [logger.cc:1084] 41774 ModelUnbindStream: model_id=64, stream_id=321, [INFO] GE(41774,python3.7):2024-01-11-05:35:20.222.922 [graph_manager.cc:1152][EVENT]41774 PreRunAfterOptimizeSubGraph:[GEPERFTRACE] The time cost of GraphManager::Build is [2864] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.222.954 [graph_manager.cc:1164][EVENT]41774 PreRunAfterOptimizeSubGraph:PreRun:PreRunAfterOptimizeSubGraph success. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.222.985 [graph_manager.cc:1271][EVENT]41774 PreRun:[GEPERFTRACE] The time cost of FlowModelBuild is [50550] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.222.997 [graph_manager.cc:1272][EVENT]41774 PreRun:[GEPERFTRACE] GE PreRun End [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.223.306 [atrace_api.c:93](tid:41774) AtraceDestroy start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:20.223.320 [atrace_api.c:95](tid:41774) AtraceDestroy end [INFO] GE(41774,python3.7):2024-01-11-05:35:20.234.248 [graph_converter.cc:838][EVENT]41774 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CreateMainNode is [3384] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.234.400 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of ZeroCopy is [102] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.234.904 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CEM is [480] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.110 [copy_flow_launch_fuse.cc:395][EVENT]41774 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [181] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.132 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [204] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.335 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [191] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.354 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.392 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of ZeroCopy is [26] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.585 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CEM is [180] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.676 [copy_flow_launch_fuse.cc:395][EVENT]41774 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [72] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.691 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [87] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.722 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [21] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.732 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [0] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.759 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of ZeroCopy is [18] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.848 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CEM is [66] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.920 [copy_flow_launch_fuse.cc:395][EVENT]41774 Run:[GEPERFTRACE] The time cost of Pass::CopyFlowLaunchFuse is [60] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.933 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of CopyFlowLaunch is [74] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.961 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of TrustOutTensor is [19] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.972 [base_optimizer.cc:70][EVENT]41774 Run:[GEPERFTRACE] The time cost of AicpuFuseHostInputs is [1] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.235.984 [graph_converter.cc:849][EVENT]41774 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::RunAllPass is [1690] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.236.220 [graph_converter.cc:853][EVENT]41774 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::TopologicalSorting is [227] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.236.934 [graph_converter.cc:857][EVENT]41774 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::AppendGraphLevelData is [699] micro second. [INFO] GE(41774,python3.7):2024-01-11-05:35:20.237.083 [graph_converter.cc:862][EVENT]41774 ConvertComputeGraphToExecuteGraph:[GEPERFTRACE] The time cost of ConvertComputeGraphToExecuteGraph::CalculatePriority is [122] micro second. .. ============================== 2 passed in 21.96s ============================== [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.957.107 [status:INIT] [ge_api.cc:463]41774 ~Session:Start to destruct session. [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.957.231 [status:RUNNING] [ge_api.cc:475]41774 ~Session:Session id is 0 [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.957.242 [status:RUNNING] [ge_api.cc:476]41774 ~Session:Destroying session [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.958.146 [status:STOP] [ge_api.cc:491]41774 ~Session:Session Destructor finished [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.958.175 [status:INIT] [ge_api.cc:301]41774 GEFinalize:GEFinalize start [INFO] GE(41774,python3.7):2024-01-11-05:35:21.958.227 [execution_runtime.cc:80][EVENT]41774 FinalizeExecutionRuntime:Execution runtime finalize begin. [INFO] GE(41774,python3.7):2024-01-11-05:35:21.958.243 [execution_runtime.cc:92][EVENT]41774 FinalizeExecutionRuntime:Execution runtime finalized. [TRACE] GE(41774,python3.7):2024-01-11-05:35:21.958.255 [status:RUNNING] [ge_api.cc:313]41774 GEFinalize:Finalizing environment [INFO] TUNE(41774,python3.7):2024-01-11-05:35:22.252.547 [cann_kb_pyfunc_mgr.cpp:127][CANNKB][Tid:41774]"CannKbPyfuncMgr: enter PyObjectDeinit function, reference_[1]" [INFO] TUNE(41774,python3.7):2024-01-11-05:35:22.252.608 [cann_kb_pyfunc_mgr.cpp:138][CANNKB][Tid:41774]"CannKbPyfuncMgr: PyObjectDeinit function end successfully!" [INFO] GE(41774,python3.7):2024-01-11-05:35:22.254.768 [gelib.cc:324][EVENT]41774 SystemFinalize:Online infer finalize GELib success. [TRACE] GE(41774,python3.7):2024-01-11-05:35:22.480.983 [status:STOP] [ge_api.cc:341]41774 GEFinalize:GEFinalize finished [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.783.983 [process_mode_manager.cpp:184][Close][tid:41774] [TsdClient] Close [deviceId=7][sessionId=1] hccp and computer enter [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.784.045 [version_verify.cpp:112][SpecialFeatureCheck][tid:41774] VersionVerify: previous type[7], supported [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.784.092 [process_mode_manager.cpp:192][Close][tid:41774] [TsdClient][deviceId=7] [sessionId=1] wait hccp and computer process close respond [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.805.731 [process_mode_manager.cpp:197][Close][tid:41774] [TsdClient][logicDeviceId_=7]has recv close hccp and computer process respond [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.805.779 [stub_process_mode_nowin.cpp:151][CloseInHost][tid:41774] enter into CloseInHost deviceid[7] [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.805.790 [stub_process_mode_nowin.cpp:154][CloseInHost][tid:41774] host cpu not support [INFO] TDT(41774,python3.7):2024-01-11-05:35:22.805.834 [process_mode_manager.cpp:208][Close][tid:41774] [TsdClient][deviceId=7] [sessionId=1] close hccp and computer process success [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:22.805.847 [atrace_api.c:93](tid:41774) AtraceDestroy start [INFO] ATRACE(41774,python3.7):2024-01-11-05:35:22.805.862 [atrace_api.c:95](tid:41774) AtraceDestroy end [INFO] PROFILING(41774,python3.7):2024-01-11-05:35:22.805.886 [msprofiler_impl.cpp:156] >>> (tid:41774) ProfNotifySetDevice called, is open: 0, devId: 7 [INFO] RUNTIME(41774,python3.7):2024-01-11-05:35:24.353.651 [runtime.cc:1737] 41774 ~Runtime: deconstruct runtime.