[WARNING] ME(163641:281473434586928,MainProcess):2026-01-29-17:37:45.896.477 [mindspore/graph/_mark_deprecated.py:40] Module 'mindspore.common.api' is deprecated from version 2.9.0 and will be removed in a future version, use 'mindspore.graph.api' instead. ==================================================Ascend ============================= test session starts ============================== platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/mint/optim, configfile: ../../../../../../../sault/virtual_test/virtualenv_002/sault/config/pytest.ini plugins: mock-3.14.0, hydra-core-1.3.2, forked-1.6.0, anyio-4.9.0, xdist-1.32.0 collected 2 items test_fused_adamw.py .......................[WARNING] ANALYZER(163641,ffffa4150f30,python3.9):2026-01-29-17:44:11.491.829 [mindspore/ccsrc/frontend/jit/ps/static_analysis/auto_monad.cc:1601] ClearIsolatedNodes] Some side effect nodes were eliminated by mistake. The node is:@2_train_step_40:_{[0]: ValueNode 147__tuple_getitem_by_number_41, [1]: CNode_42, [2]: ValueNode 1} TotalTime = 2.64675, [30] [bootstrap]: 0.00083196 [type_inference]: 2.17972 [event_method]: 0.00041821 [auto_monad]: 0.00267418 [graph_reusing]: 0.00017848 [pre_auto_parallel]: 4.905e-05 [py_interpret_to_execute]: 0.0171231 [rewriter_before_opt_a]: 0.00658957 [expand_dump_flag]: 7.071e-05 [jit_opt_a]: 0.412164, [4] [Cycle 1]: 0.308275, [27] [switch_simplify]: 0.00155218 [loop_unroll]: 0.00068535 [a_1]: 0.0320988 [with_stream_mark]: 0.00020786 [recompute_prepare]: 0.00012513 [updatestate_depend_eliminate]: 0.00061768 [updatestate_assign_eliminate]: 5.482e-05 [updatestate_loads_eliminate]: 0.0245113 [parameter_eliminate]: 1.109e-05 [specialize_transform]: 0.00012645 [updatestate_useless_node_eliminater]: 0.00011127 [accelerated_algorithm]: 0.00015607 [meta_shard_fg_expand]: 6.783e-05 [get_grad_eliminate_]: 6.165e-05 [merge_forward]: 3.939e-05 [cell_reuse_recompute_pass]: 4.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00012779 [j_node_and_user_rematch]: 0.0001206 [meta_fg_expand]: 0.060796 [replace_old_param]: 0.00040364 [inline_without_move]: 0.00039739 [renormalize]: 0.166153 [add_forward_monad_depend]: 0.00030501 [auto_monad_grad]: 4.905e-05 [auto_monad_eliminator]: 0.000608 [cse]: 0.00124814 [replace_applicator]: 0.0170485 [Cycle 2]: 0.0405131, [27] [switch_simplify]: 0.00048274 [loop_unroll]: 0.00032759 [a_1]: 0.0229466 [with_stream_mark]: 0.00032941 [recompute_prepare]: 8.432e-05 [updatestate_depend_eliminate]: 9.115e-05 [updatestate_assign_eliminate]: 3.937e-05 [updatestate_loads_eliminate]: 0.00012849 [parameter_eliminate]: 3.09001e-06 [specialize_transform]: 5.895e-05 [updatestate_useless_node_eliminater]: 7.626e-05 [accelerated_algorithm]: 5.887e-05 [meta_shard_fg_expand]: 3.223e-05 [get_grad_eliminate_]: 4.88e-05 [merge_forward]: 3.28e-05 [cell_reuse_recompute_pass]: 4.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.453e-05 [j_node_and_user_rematch]: 7.983e-05 [meta_fg_expand]: 0.00129413 [replace_old_param]: 9.73e-05 [inline_without_move]: 5.199e-05 [renormalize]: 0.0130883 [add_forward_monad_depend]: 1.436e-05 [auto_monad_grad]: 3.25002e-06 [auto_monad_eliminator]: 0.00026183 [cse]: 0.0003205 [replace_applicator]: 7.684e-05 [Cycle 3]: 0.0521792, [27] [switch_simplify]: 5.118e-05 [loop_unroll]: 4.715e-05 [a_1]: 0.00146933 [with_stream_mark]: 4.966e-05 [recompute_prepare]: 4.525e-05 [updatestate_depend_eliminate]: 3.361e-05 [updatestate_assign_eliminate]: 3.197e-05 [updatestate_loads_eliminate]: 3.366e-05 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 4.663e-05 [updatestate_useless_node_eliminater]: 6.181e-05 [accelerated_algorithm]: 5.453e-05 [meta_shard_fg_expand]: 1.436e-05 [get_grad_eliminate_]: 4.209e-05 [merge_forward]: 2.689e-05 [cell_reuse_recompute_pass]: 4.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.425e-05 [j_node_and_user_rematch]: 7.404e-05 [meta_fg_expand]: 1.837e-05 [replace_old_param]: 5.497e-05 [inline_without_move]: 4.375e-05 [renormalize]: 0.0492285 [add_forward_monad_depend]: 1.175e-05 [auto_monad_grad]: 3.48e-06 [auto_monad_eliminator]: 0.00013417 [cse]: 0.00020951 [replace_applicator]: 6.991e-05 [Cycle 4]: 0.00258806, [27] [switch_simplify]: 4.531e-05 [loop_unroll]: 4.265e-05 [a_1]: 0.00131154 [with_stream_mark]: 4.957e-05 [recompute_prepare]: 4.631e-05 [updatestate_depend_eliminate]: 3.304e-05 [updatestate_assign_eliminate]: 3.15e-05 [updatestate_loads_eliminate]: 3.222e-05 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 4.616e-05 [updatestate_useless_node_eliminater]: 6.504e-05 [accelerated_algorithm]: 5.588e-05 [meta_shard_fg_expand]: 1.293e-05 [get_grad_eliminate_]: 4.259e-05 [merge_forward]: 2.881e-05 [cell_reuse_recompute_pass]: 5.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.395e-05 [j_node_and_user_rematch]: 7.494e-05 [meta_fg_expand]: 1.902e-05 [replace_old_param]: 5.554e-05 [inline_without_move]: 4.258e-05 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 3.21001e-06 [auto_monad_grad]: 1.66998e-06 [auto_monad_eliminator]: 8.962e-05 [cse]: 0.00014635 [replace_applicator]: 4.493e-05 [py_interpret_to_execute_after_opt_a]: 9.278e-05 [rewriter_after_opt_a]: 0.0004726 [convert_after_rewriter]: 4.402e-05 [order_py_execute_after_rewriter]: 2.623e-05 [mutable_eliminate]: 0.00110807 [jit_opt_b]: 0.00027744, [1] [Cycle 1]: 0.00026757, [2] [frontend_op_eliminate]: 0.00013304 [inline_after_opt_a]: 0.00011913 [cconv]: 5.396e-05 [loop_unroll]: 0.00054354 [jit_opt_after_cconv]: 0.00083729, [1] [Cycle 1]: 0.00082718, [11] [c_1]: 0.00027026 [parameter_eliminate]: 5.42001e-06 [updatestate_depend_eliminate]: 4.164e-05 [updatestate_assign_eliminate]: 3.548e-05 [updatestate_loads_eliminate]: 3.338e-05 [cse]: 0.00017197 [call_graph_tuple_transform]: 0.00011037 [tuple_list_get_item_eliminator]: 4.55e-05 [none_parameter_eliminate]: 2.30002e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 4.277e-05 [remove_dup_value]: 0.00016866 [partial_unused_args_eliminate]: 3.44001e-06 [environ_conv]: 4.741e-05 [add_recomputation]: 0.020644 [cse_after_recomputation]: 0.00025883, [1] [Cycle 1]: 0.0002428, [1] [cse]: 0.00021699 [auto_monad_reorder]: 0.00015487 [get_jit_bprop_graph]: 2.79001e-06 [rewriter_after_jit_bprop_graph]: 7.18998e-06 [opt_after_jit_grad]: 0.00100885 [symbol_engine_optimizer]: 0.00033612, [1] [Cycle 1]: 0.00032821, [6] [build]: 3.441e-05 [elim_shapecalc]: 4.941e-05 [elim_not_effective]: 8.613e-05 [opt_reshape]: 4.77e-05 [fold_const_symbol]: 7.304e-05 [renormalize]: 7.2e-07 [validate]: 0.0002403 Sums bootstrap : 0.000832s : 0.03% type_inference : 2.179718s : 82.69% event_method : 0.000418s : 0.02% auto_monad : 0.002674s : 0.10% graph_reusing : 0.000178s : 0.01% pre_auto_parallel : 0.000049s : 0.00% py_interpret_to_execute : 0.017123s : 0.65% rewriter_before_opt_a : 0.006590s : 0.25% expand_dump_flag : 0.000071s : 0.00% jit_opt_a.switch_simplify : 0.002131s : 0.08% jit_opt_a.loop_unroll : 0.001103s : 0.04% jit_opt_a.a_1 : 0.057826s : 2.19% jit_opt_a.with_stream_mark : 0.000637s : 0.02% jit_opt_a.recompute_prepare : 0.000301s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000775s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000158s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.024706s : 0.94% jit_opt_a.parameter_eliminate : 0.000019s : 0.00% jit_opt_a.specialize_transform : 0.000278s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000314s : 0.01% jit_opt_a.accelerated_algorithm : 0.000325s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000127s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000195s : 0.01% jit_opt_a.merge_forward : 0.000128s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000018s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000391s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000349s : 0.01% jit_opt_a.meta_fg_expand : 0.062127s : 2.36% jit_opt_a.replace_old_param : 0.000611s : 0.02% jit_opt_a.inline_without_move : 0.000536s : 0.02% jit_opt_a.renormalize : 0.228470s : 8.67% jit_opt_a.add_forward_monad_depend : 0.000334s : 0.01% jit_opt_a.auto_monad_grad : 0.000057s : 0.00% jit_opt_a.auto_monad_eliminator : 0.001094s : 0.04% jit_opt_a.cse : 0.001925s : 0.07% jit_opt_a.replace_applicator : 0.017240s : 0.65% py_interpret_to_execute_after_opt_a : 0.000093s : 0.00% rewriter_after_opt_a : 0.000473s : 0.02% convert_after_rewriter : 0.000044s : 0.00% order_py_execute_after_rewriter : 0.000026s : 0.00% mutable_eliminate : 0.001108s : 0.04% jit_opt_b.frontend_op_eliminate : 0.000133s : 0.01% jit_opt_b.inline_after_opt_a : 0.000119s : 0.00% cconv : 0.000054s : 0.00% loop_unroll : 0.000544s : 0.02% jit_opt_after_cconv.c_1 : 0.000270s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000042s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000035s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000033s : 0.00% jit_opt_after_cconv.cse : 0.000172s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000110s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000045s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000043s : 0.00% remove_dup_value : 0.000169s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000047s : 0.00% add_recomputation : 0.020644s : 0.78% cse_after_recomputation.cse : 0.000217s : 0.01% auto_monad_reorder : 0.000155s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.001009s : 0.04% symbol_engine_optimizer.build : 0.000034s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000049s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000086s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000048s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000073s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000240s : 0.01% Time group info: ------[substitution.] 0.028363 1515 0.41% : 0.000117s : 5: substitution.arithmetic_simplify 0.10% : 0.000028s : 3: substitution.cast_eliminate 0.46% : 0.000130s : 50: substitution.depend_value_elim 0.04% : 0.000011s : 32: substitution.elim_not_effective 0.03% : 0.000010s : 4: substitution.environ_get_add_eliminate 0.02% : 0.000005s : 2: substitution.environ_get_depend_swap 0.04% : 0.000010s : 4: substitution.environ_get_eliminate 0.12% : 0.000033s : 4: substitution.environ_get_set_eliminate 0.04% : 0.000011s : 32: substitution.fold_const_symbol 5.82% : 0.001650s : 8: substitution.getattr_setattr_resolve 0.10% : 0.000029s : 43: substitution.graph_param_transform 26.37% : 0.007481s : 170: substitution.inline 0.34% : 0.000098s : 12: substitution.inline_without_move 0.24% : 0.000069s : 147: substitution.j_node_and_user_rematch 0.31% : 0.000088s : 17: substitution.less_batch_normalization 0.12% : 0.000035s : 1: substitution.list_to_tuple_eliminator_ 0.12% : 0.000034s : 30: substitution.load_eliminater 0.35% : 0.000098s : 66: substitution.minmaximum_grad 0.00% : 0.000001s : 1: substitution.opt_reshape 0.21% : 0.000060s : 12: substitution.partial_eliminate 0.11% : 0.000031s : 6: substitution.reduce_eliminate 0.03% : 0.000008s : 4: substitution.redundant_stop_gradient_eliminater 0.29% : 0.000082s : 147: substitution.remove_not_recompute_node 57.53% : 0.016318s : 55: substitution.replace_applicator 0.19% : 0.000053s : 72: substitution.replace_old_param 0.35% : 0.000099s : 14: substitution.reshape_eliminate 0.02% : 0.000005s : 1: substitution.set_cell_output_no_recompute 0.02% : 0.000006s : 3: substitution.split_environ_get_set_with_tuple_value 0.29% : 0.000082s : 33: substitution.switch_simplify 0.02% : 0.000007s : 1: substitution.tile_eliminate 1.23% : 0.000348s : 76: substitution.tuple_list_convert_item_index_to_positive 1.24% : 0.000352s : 83: substitution.tuple_list_get_item_depend_reorder 1.80% : 0.000511s : 160: substitution.tuple_list_get_item_eliminator 0.48% : 0.000135s : 97: substitution.updatestate_pure_node_eliminater 1.16% : 0.000328s : 120: substitution.updatestate_useless_node_eliminater ------[type_inference.] 2.178603 2 95.74% : 2.085784s : 1: type_inference.infer 4.26% : 0.092819s : 1: type_inference.specialize ------[replace.] 0.004114 312 0.34% : 0.000014s : 1: replace.arithmetic_simplify 0.63% : 0.000026s : 3: replace.cast_eliminate 1.15% : 0.000047s : 5: replace.depend_value_elim 1.05% : 0.000043s : 2: replace.environ_get_set_eliminate 3.30% : 0.000136s : 6: replace.getattr_setattr_resolve 43.32% : 0.001782s : 170: replace.inline 0.59% : 0.000024s : 1: replace.list_to_tuple_eliminator_ 0.97% : 0.000040s : 2: replace.partial_eliminate 4.51% : 0.000186s : 3: replace.replace_applicator 0.20% : 0.000008s : 1: replace.reshape_eliminate 12.34% : 0.000508s : 33: replace.switch_simplify 3.99% : 0.000164s : 7: replace.tuple_list_get_item_depend_reorder 27.06% : 0.001113s : 77: replace.tuple_list_get_item_eliminator 0.54% : 0.000022s : 1: replace.updatestate_useless_node_eliminater ------[match.] 0.009679 312 0.57% : 0.000055s : 1: match.arithmetic_simplify 0.27% : 0.000026s : 3: match.cast_eliminate 0.06% : 0.000006s : 5: match.depend_value_elim 0.28% : 0.000027s : 2: match.environ_get_set_eliminate 16.05% : 0.001554s : 6: match.getattr_setattr_resolve 76.20% : 0.007376s : 170: match.inline 0.35% : 0.000034s : 1: match.list_to_tuple_eliminator_ 0.39% : 0.000038s : 2: match.partial_eliminate 0.68% : 0.000066s : 3: match.replace_applicator 0.03% : 0.000003s : 1: match.reshape_eliminate 0.68% : 0.000066s : 33: match.switch_simplify 1.81% : 0.000175s : 7: match.tuple_list_get_item_depend_reorder 2.45% : 0.000237s : 77: match.tuple_list_get_item_eliminator 0.18% : 0.000018s : 1: match.updatestate_useless_node_eliminater ------[predicate.] 0.005244 33167 1.49% : 0.000078s : 566: predicate.accumulaten_eliminater 0.24% : 0.000012s : 43: predicate.ad_related_special_op_eliminate 1.42% : 0.000075s : 566: predicate.addn_check_dump 1.47% : 0.000077s : 566: predicate.addn_zero_filter 2.13% : 0.000112s : 567: predicate.arithmetic_simplify 1.65% : 0.000086s : 571: predicate.cast_eliminate 0.11% : 0.000006s : 43: predicate.check_bprop_eliminate 1.41% : 0.000074s : 566: predicate.compare_switch_simplify 1.66% : 0.000087s : 566: predicate.depend_value_elim 1.45% : 0.000076s : 573: predicate.dict_get_item_const_eliminator 1.55% : 0.000081s : 573: predicate.dict_get_item_eliminator 1.46% : 0.000077s : 573: predicate.dict_set_item_eliminator 0.14% : 0.000007s : 43: predicate.dumpgradient_eliminate 0.07% : 0.000004s : 43: predicate.elim_not_effective 0.13% : 0.000007s : 43: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000076s : 571: predicate.environ_add_const_eliminate 1.44% : 0.000076s : 573: predicate.environ_get_add_eliminate 1.43% : 0.000075s : 571: predicate.environ_get_depend_swap 1.54% : 0.000081s : 573: predicate.environ_get_eliminate 1.45% : 0.000076s : 573: predicate.environ_get_set_eliminate 0.06% : 0.000003s : 43: predicate.fold_const_symbol 0.55% : 0.000029s : 198: predicate.get_grad_eliminate 0.29% : 0.000015s : 40: predicate.getattr_setattr_resolve 0.06% : 0.000003s : 43: predicate.graph_param_transform 4.33% : 0.000227s : 917: predicate.inline 1.36% : 0.000071s : 404: predicate.inline_without_move 0.26% : 0.000014s : 198: predicate.j_node_and_user_rematch 0.71% : 0.000037s : 208: predicate.less_batch_normalization 2.77% : 0.000145s : 658: predicate.list_to_tuple_eliminator_ 1.91% : 0.000100s : 703: predicate.load_eliminater 0.20% : 0.000010s : 43: predicate.loop_unroll_after_grad 3.90% : 0.000205s : 1143: predicate.loop_unroll_before_grad 1.59% : 0.000083s : 623: predicate.make_slice_get_slice_eliminator 1.42% : 0.000074s : 566: predicate.merge_addn 1.48% : 0.000078s : 567: predicate.minmaximum_grad 0.24% : 0.000013s : 43: predicate.mutable_eliminate 0.12% : 0.000006s : 43: predicate.opt_reshape 2.28% : 0.000119s : 703: predicate.partial_eliminate 1.48% : 0.000078s : 561: predicate.print_const_string_wrapper 1.95% : 0.000102s : 567: predicate.reduce_eliminate 1.73% : 0.000091s : 660: predicate.redundant_stop_gradient_eliminater 0.29% : 0.000015s : 198: predicate.remove_not_recompute_node 2.16% : 0.000113s : 1142: predicate.replace_applicator 0.58% : 0.000031s : 404: predicate.replace_old_param 0.07% : 0.000004s : 43: predicate.reset_defer_inline 1.52% : 0.000079s : 568: predicate.reshape_eliminate 1.50% : 0.000078s : 561: predicate.row_tensor_add_zeros_like 0.14% : 0.000007s : 43: predicate.row_tensor_eliminate 1.45% : 0.000076s : 561: predicate.same_eliminate 0.36% : 0.000019s : 240: predicate.set_cell_output_no_recompute 0.25% : 0.000013s : 86: predicate.special_op_eliminate 0.87% : 0.000045s : 198: predicate.specialize_transform 2.63% : 0.000138s : 561: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000076s : 561: predicate.stack_unstack_eliminate 0.12% : 0.000006s : 43: predicate.switch_call_monad_eliminater 4.33% : 0.000227s : 831: predicate.switch_defer_inline 2.43% : 0.000127s : 831: predicate.switch_layer_defer_inline 7.56% : 0.000396s : 2083: predicate.switch_simplify 1.51% : 0.000079s : 567: predicate.tile_eliminate 1.46% : 0.000076s : 567: predicate.transpose_eliminate 2.13% : 0.000112s : 573: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000091s : 580: predicate.tuple_list_get_item_depend_reorder 2.91% : 0.000153s : 743: predicate.tuple_list_get_item_eliminator 1.81% : 0.000095s : 580: predicate.tuple_list_set_item_eliminator 1.68% : 0.000088s : 657: predicate.tuple_to_list_eliminator_ 1.94% : 0.000101s : 703: predicate.updatestate_pure_node_eliminater 2.68% : 0.000140s : 902: predicate.updatestate_useless_node_eliminater 1.85% : 0.000097s : 561: predicate.value_based_eliminate 0.11% : 0.000006s : 43: predicate.virtual_view_grad_eliminate 0.14% : 0.000007s : 43: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.141924 407 56.81% : 0.080631s : 208: func_graph_cloner_run.FuncGraphClonerGraph 43.19% : 0.061293s : 199: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 2.959244 106 0.70% : 0.020677s : 1: add_recomputation 0.09% : 0.002691s : 1: auto_monad 0.01% : 0.000159s : 1: auto_monad_reorder 0.03% : 0.000871s : 1: bootstrap 0.00% : 0.000057s : 1: cconv 0.00% : 0.000048s : 1: convert_after_rewriter 0.01% : 0.000265s : 1: cse_after_recomputation 0.00% : 0.000050s : 1: environ_conv 0.01% : 0.000429s : 1: event_method 0.00% : 0.000076s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000187s : 1: graph_reusing 13.93% : 0.412170s : 1: jit_opt_a 0.03% : 0.000841s : 1: jit_opt_after_cconv 0.01% : 0.000281s : 1: jit_opt_b 0.02% : 0.000553s : 1: loop_unroll 0.04% : 0.001122s : 1: mutable_eliminate 2.75% : 0.081437s : 52: opt.transform.jit_opt_a 0.02% : 0.000463s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000244s : 4: opt.transform.jit_opt_b 0.00% : 0.000061s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000070s : 1: opt.transform.mutable_eliminate 0.01% : 0.000166s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.001917s : 4: opt.transform.opt_resolve 0.01% : 0.000252s : 4: opt.transform.symbol_engine_opt 0.03% : 0.001019s : 1: opt_after_jit_grad 0.00% : 0.000029s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000053s : 1: pre_auto_parallel 0.58% : 0.017162s : 1: py_interpret_to_execute 0.00% : 0.000099s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000174s : 1: remove_dup_value 5.89% : 0.174401s : 3: renormalize.infer 1.83% : 0.054010s : 3: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000481s : 1: rewriter_after_opt_a 0.22% : 0.006620s : 1: rewriter_before_opt_a 0.01% : 0.000339s : 1: symbol_engine_optimizer 73.66% : 2.179749s : 1: type_inference . TotalTime = 0.264553, [21] [bootstrap]: 0.00088522 [type_inference]: 0.175023 [event_method]: 0.00032844 [auto_monad]: 0.00056675 [graph_reusing]: 1.105e-05 [inline]: 3.24001e-06 [add_attr]: 0.0620758, [1] [add_attr_with_inline]: 0.0620265, [1] [Cycle 1]: 0.00015822, [2] [tag_attr]: 9.179e-05 [meta_addattr_fg_expand]: 1.222e-05 [parallel-infer-symbol]: 3.68e-06 [pre_auto_parallel]: 9.325e-05 [insert-virtual-dataset]: 2.58003e-06 [parallel-infer-symbol-second]: 7.59988e-07 [dataset_repeat_opt]: 2.48e-06 [pipeline_split]: 1.68997e-06 [optimize]: 0.0243061, [53] [py_interpret_to_execute]: 6.94e-05 [rewriter_before_opt_a]: 0.00017355 [opt_a]: 0.00803413, [2] [Cycle 1]: 0.00645165, [45] [expand_dump_flag]: 4.32998e-06 [switch_simplify]: 0.00017668 [loop_unroll]: 5.722e-05 [a_1]: 0.00193763 [with_stream_mark]: 3.424e-05 [recompute_prepare]: 3.114e-05 [updatestate_depend_eliminate]: 8.654e-05 [updatestate_assign_eliminate]: 9.34e-06 [updatestate_loads_eliminate]: 7.333e-05 [parameter_eliminate]: 3.01001e-06 [a_2]: 0.00025581 [accelerated_algorithm]: 4.694e-05 [shard]: 2.39001e-06 [meta_shard_fg_expand]: 5.25001e-06 [shard_inline]: 1.741e-05 [merge_send_recv]: 1.554e-05 [auto_parallel]: 1.561e-05 [parallel]: 9.844e-05 [flash_sp]: 1.402e-05 [merge_comm]: 1.17e-05 [allreduce_fusion]: 8.50001e-06 [matmul_add_comm_reduction]: 1.859e-05 [allreduce_slice_to_reducescatter]: 8.49977e-07 [virtual_shard_identity]: 2.308e-05 [virtual_dataset]: 1.534e-05 [get_grad_eliminate_]: 1.479e-05 [virtual_output]: 1.572e-05 [merge_forward]: 1.006e-05 [cell_reuse_recompute_pass]: 2.71e-06 [offload_activation]: 2.143e-05 [cell_reuse_handle_not_recompute_node_pass]: 3.417e-05 [merge_recompute_call_nodes]: 1.49998e-06 [before_grad]: 2.663e-05 [set_forward_comm_id_for_comm_node_pass]: 1.07e-05 [meta_fg_expand]: 8.09002e-06 [flash_sp_send_recv_attached]: 4.89003e-06 [receive_attached]: 2.37001e-06 [after_resolve]: 2.371e-05 [a_after_grad]: 2.359e-05 [renormalize]: 0.00252703 [add_forward_monad_depend]: 1.088e-05 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 6.014e-05 [cse]: 0.00020282 [a_3]: 0.00012077 [Cycle 2]: 0.00156631, [45] [expand_dump_flag]: 3.18e-06 [switch_simplify]: 1.849e-05 [loop_unroll]: 1.525e-05 [a_1]: 0.00045382 [with_stream_mark]: 2.711e-05 [recompute_prepare]: 1.585e-05 [updatestate_depend_eliminate]: 9.93998e-06 [updatestate_assign_eliminate]: 1.214e-05 [updatestate_loads_eliminate]: 1.45e-05 [parameter_eliminate]: 2.19001e-06 [a_2]: 0.00021099 [accelerated_algorithm]: 2.36e-05 [shard]: 2.12001e-06 [meta_shard_fg_expand]: 4.82e-06 [shard_inline]: 1.482e-05 [merge_send_recv]: 1.588e-05 [auto_parallel]: 1.436e-05 [parallel]: 8.54e-06 [flash_sp]: 4.48999e-06 [merge_comm]: 8.59e-06 [allreduce_fusion]: 8.27e-06 [matmul_add_comm_reduction]: 1.812e-05 [allreduce_slice_to_reducescatter]: 7.39994e-07 [virtual_shard_identity]: 1.868e-05 [virtual_dataset]: 1.486e-05 [get_grad_eliminate_]: 1.358e-05 [virtual_output]: 1.329e-05 [merge_forward]: 9.89999e-06 [cell_reuse_recompute_pass]: 3.86001e-06 [offload_activation]: 1.752e-05 [cell_reuse_handle_not_recompute_node_pass]: 3.079e-05 [merge_recompute_call_nodes]: 1.34998e-06 [before_grad]: 2.509e-05 [set_forward_comm_id_for_comm_node_pass]: 9.29e-06 [meta_fg_expand]: 7.26999e-06 [flash_sp_send_recv_attached]: 2.27001e-06 [receive_attached]: 2.24999e-06 [after_resolve]: 2.187e-05 [a_after_grad]: 2.308e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 3.33e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 4.38e-05 [cse]: 5.52e-05 [a_3]: 9.408e-05 [py_interpret_to_execute_after_opt_a]: 2.797e-05 [slice_cell_reuse_recomputed_activation]: 2.58003e-06 [rewriter_after_opt_a]: 0.00020728 [convert_after_rewriter]: 1.784e-05 [order_py_execute_after_rewriter]: 1.018e-05 [mutable_eliminate]: 0.00085125 [opt_b]: 0.00051955, [1] [Cycle 1]: 0.00050896, [7] [b_1]: 0.00034455 [b_2]: 1.714e-05 [updatestate_depend_eliminate]: 1.575e-05 [updatestate_assign_eliminate]: 9.61e-06 [updatestate_loads_eliminate]: 1.446e-05 [renormalize]: 7.60017e-07 [cse]: 6.191e-05 [optimize_parallel_all_gather_comm]: 0.0001156 [overlap_param_gather]: 4.11001e-06 [cconv]: 4.003e-05 [loop_unroll]: 0.0005734 [opt_after_cconv]: 0.012356, [1] [Cycle 1]: 0.0123405, [7] [c_1]: 0.00010968 [parameter_eliminate]: 5.35999e-06 [updatestate_depend_eliminate]: 1.463e-05 [updatestate_assign_eliminate]: 8.95999e-06 [updatestate_loads_eliminate]: 1.208e-05 [cse]: 5.418e-05 [renormalize]: 1.63997e-06 [remove_dup_value]: 0.00010673 [tuple_transform]: 0.00020802, [1] [Cycle 1]: 0.00019771, [4] [d_1]: 0.0001489 [none_parameter_eliminate]: 6.31e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 1.749e-05 [partial_unused_args_eliminate]: 2.54001e-06 [add_recomputation]: 0.00019036 [cse_after_recomputation]: 7.757e-05, [1] [Cycle 1]: 7.19e-05, [1] [cse]: 6.481e-05 [environ_conv]: 1.749e-05 [swap_dp_allreduce_reducescatter]: 1.308e-05 [bias_add_comm_swap]: 3.60998e-06 [label_micro_interleaved_index]: 9.16002e-06 [label_fine_grained_interleaved_index]: 3.08e-06 [merge_cast_opt]: 1.96e-06 [slice_recompute_activation]: 2.26e-06 [micro_interleaved_order_control]: 2.71e-06 [assign_add_opt]: 1.96e-06 [ForceFp32Comm]: 9.30013e-07 [remove_cast_before_assign_add]: 1.11997e-06 [full_micro_interleaved_order_control]: 2.28998e-06 [reorder_send_recv_between_fp_bp]: 3.09001e-06 [comm_op_add_attrs]: 1.08001e-06 [add_comm_op_reuse_tag]: 1.15001e-06 [interleave_split_concat_branches]: 1.22e-06 [interleave_parallel_branches]: 1.17e-06 [overlap_opt_shard_in_pipeline]: 3.427e-05 [overlap_opt_shard_grad_in_pipeline]: 1.92001e-06 [control_data_broadcast_order]: 3.343e-05 [grouped_pairwise_exchange_alltoall]: 1.89e-06 [offloading_packed_experts]: 7.9e-06 [overlap_recompute_and_grad_model_parallel]: 8.95001e-06 [overlap_grad_matmul_and_grad_allreduce]: 1.62999e-06 [overlap_recompute_allgather_and_fa_grad]: 1.47001e-06 [overlap_recompute_comm]: 2.91999e-06 [overlap_grad_ring_attention]: 2.253e-05 [overlap_grad_flash_sp]: 4.126e-05 [begin_end_overlap_inline]: 5.89993e-07 [split_matmul_comm_elemetwise]: 2.27999e-06 [split_layernorm_comm]: 2.08002e-06 [handle_group_info]: 1.07e-06 [symbol_engine_optimizer]: 0.00014709, [1] [Cycle 1]: 0.000142, [6] [build]: 1.279e-05 [elim_shapecalc]: 2.456e-05 [elim_not_effective]: 3.007e-05 [opt_reshape]: 1.589e-05 [fold_const_symbol]: 2.521e-05 [renormalize]: 3.19997e-07 [detach_backward]: 2.34001e-06 [pipeline_parallel_scheduler]: 1.50999e-06 [auto_monad_reorder]: 6.039e-05 [get_jit_bprop_graph]: 1.62999e-06 [rewriter_after_jit_bprop_graph]: 7.92003e-06 [opt_after_jit_grad]: 0.00083134 [validate]: 7.434e-05 Sums bootstrap : 0.000885s : 0.47% type_inference : 0.175023s : 92.58% event_method : 0.000328s : 0.17% auto_monad : 0.000567s : 0.30% graph_reusing : 0.000011s : 0.01% inline : 0.000003s : 0.00% add_attr.add_attr_with_inline.tag_attr : 0.000092s : 0.05% add_attr.add_attr_with_inline.meta_addattr_fg_expand : 0.000012s : 0.01% parallel-infer-symbol : 0.000004s : 0.00% pre_auto_parallel : 0.000093s : 0.05% insert-virtual-dataset : 0.000003s : 0.00% parallel-infer-symbol-second : 0.000001s : 0.00% dataset_repeat_opt : 0.000002s : 0.00% pipeline_split : 0.000002s : 0.00% optimize.py_interpret_to_execute : 0.000069s : 0.04% optimize.rewriter_before_opt_a : 0.000174s : 0.09% optimize.opt_a.expand_dump_flag : 0.000008s : 0.00% optimize.opt_a.switch_simplify : 0.000195s : 0.10% optimize.opt_a.loop_unroll : 0.000072s : 0.04% optimize.opt_a.a_1 : 0.002391s : 1.26% optimize.opt_a.with_stream_mark : 0.000061s : 0.03% optimize.opt_a.recompute_prepare : 0.000047s : 0.02% optimize.opt_a.updatestate_depend_eliminate : 0.000096s : 0.05% optimize.opt_a.updatestate_assign_eliminate : 0.000021s : 0.01% optimize.opt_a.updatestate_loads_eliminate : 0.000088s : 0.05% optimize.opt_a.parameter_eliminate : 0.000005s : 0.00% optimize.opt_a.a_2 : 0.000467s : 0.25% optimize.opt_a.accelerated_algorithm : 0.000071s : 0.04% optimize.opt_a.shard : 0.000005s : 0.00% optimize.opt_a.meta_shard_fg_expand : 0.000010s : 0.01% optimize.opt_a.shard_inline : 0.000032s : 0.02% optimize.opt_a.merge_send_recv : 0.000031s : 0.02% optimize.opt_a.auto_parallel : 0.000030s : 0.02% optimize.opt_a.parallel : 0.000107s : 0.06% optimize.opt_a.flash_sp : 0.000019s : 0.01% optimize.opt_a.merge_comm : 0.000020s : 0.01% optimize.opt_a.allreduce_fusion : 0.000017s : 0.01% optimize.opt_a.matmul_add_comm_reduction : 0.000037s : 0.02% optimize.opt_a.allreduce_slice_to_reducescatter : 0.000002s : 0.00% optimize.opt_a.virtual_shard_identity : 0.000042s : 0.02% optimize.opt_a.virtual_dataset : 0.000030s : 0.02% optimize.opt_a.get_grad_eliminate_ : 0.000028s : 0.02% optimize.opt_a.virtual_output : 0.000029s : 0.02% optimize.opt_a.merge_forward : 0.000020s : 0.01% optimize.opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% optimize.opt_a.offload_activation : 0.000039s : 0.02% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.03% optimize.opt_a.merge_recompute_call_nodes : 0.000003s : 0.00% optimize.opt_a.before_grad : 0.000052s : 0.03% optimize.opt_a.set_forward_comm_id_for_comm_node_pass : 0.000020s : 0.01% optimize.opt_a.meta_fg_expand : 0.000015s : 0.01% optimize.opt_a.flash_sp_send_recv_attached : 0.000007s : 0.00% optimize.opt_a.receive_attached : 0.000005s : 0.00% optimize.opt_a.after_resolve : 0.000046s : 0.02% optimize.opt_a.a_after_grad : 0.000047s : 0.02% optimize.opt_a.renormalize : 0.002527s : 1.34% optimize.opt_a.add_forward_monad_depend : 0.000014s : 0.01% optimize.opt_a.auto_monad_grad : 0.000005s : 0.00% optimize.opt_a.auto_monad_eliminator : 0.000104s : 0.05% optimize.opt_a.cse : 0.000258s : 0.14% optimize.opt_a.a_3 : 0.000215s : 0.11% optimize.py_interpret_to_execute_after_opt_a : 0.000028s : 0.01% optimize.slice_cell_reuse_recomputed_activation : 0.000003s : 0.00% optimize.rewriter_after_opt_a : 0.000207s : 0.11% optimize.convert_after_rewriter : 0.000018s : 0.01% optimize.order_py_execute_after_rewriter : 0.000010s : 0.01% optimize.mutable_eliminate : 0.000851s : 0.45% optimize.opt_b.b_1 : 0.000345s : 0.18% optimize.opt_b.b_2 : 0.000017s : 0.01% optimize.opt_b.updatestate_depend_eliminate : 0.000016s : 0.01% optimize.opt_b.updatestate_assign_eliminate : 0.000010s : 0.01% optimize.opt_b.updatestate_loads_eliminate : 0.000014s : 0.01% optimize.opt_b.renormalize : 0.000001s : 0.00% optimize.opt_b.cse : 0.000062s : 0.03% optimize.optimize_parallel_all_gather_comm : 0.000116s : 0.06% optimize.overlap_param_gather : 0.000004s : 0.00% optimize.cconv : 0.000040s : 0.02% optimize.loop_unroll : 0.000573s : 0.30% optimize.opt_after_cconv.c_1 : 0.000110s : 0.06% optimize.opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.01% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000009s : 0.00% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000012s : 0.01% optimize.opt_after_cconv.cse : 0.000054s : 0.03% optimize.opt_after_cconv.renormalize : 0.000002s : 0.00% optimize.remove_dup_value : 0.000107s : 0.06% optimize.tuple_transform.d_1 : 0.000149s : 0.08% optimize.tuple_transform.none_parameter_eliminate : 0.000006s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.tuple_transform.switch_simplify : 0.000017s : 0.01% optimize.partial_unused_args_eliminate : 0.000003s : 0.00% optimize.add_recomputation : 0.000190s : 0.10% optimize.cse_after_recomputation.cse : 0.000065s : 0.03% optimize.environ_conv : 0.000017s : 0.01% optimize.swap_dp_allreduce_reducescatter : 0.000013s : 0.01% optimize.bias_add_comm_swap : 0.000004s : 0.00% optimize.label_micro_interleaved_index : 0.000009s : 0.00% optimize.label_fine_grained_interleaved_index : 0.000003s : 0.00% optimize.merge_cast_opt : 0.000002s : 0.00% optimize.slice_recompute_activation : 0.000002s : 0.00% optimize.micro_interleaved_order_control : 0.000003s : 0.00% optimize.assign_add_opt : 0.000002s : 0.00% optimize.ForceFp32Comm : 0.000001s : 0.00% optimize.remove_cast_before_assign_add : 0.000001s : 0.00% optimize.full_micro_interleaved_order_control : 0.000002s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000003s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.interleave_split_concat_branches : 0.000001s : 0.00% optimize.interleave_parallel_branches : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000034s : 0.02% optimize.overlap_opt_shard_grad_in_pipeline : 0.000002s : 0.00% optimize.control_data_broadcast_order : 0.000033s : 0.02% optimize.grouped_pairwise_exchange_alltoall : 0.000002s : 0.00% optimize.offloading_packed_experts : 0.000008s : 0.00% optimize.overlap_recompute_and_grad_model_parallel : 0.000009s : 0.00% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000002s : 0.00% optimize.overlap_recompute_allgather_and_fa_grad : 0.000001s : 0.00% optimize.overlap_recompute_comm : 0.000003s : 0.00% optimize.overlap_grad_ring_attention : 0.000023s : 0.01% optimize.overlap_grad_flash_sp : 0.000041s : 0.02% optimize.begin_end_overlap_inline : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% optimize.symbol_engine_optimizer.build : 0.000013s : 0.01% optimize.symbol_engine_optimizer.elim_shapecalc : 0.000025s : 0.01% optimize.symbol_engine_optimizer.elim_not_effective : 0.000030s : 0.02% optimize.symbol_engine_optimizer.opt_reshape : 0.000016s : 0.01% optimize.symbol_engine_optimizer.fold_const_symbol : 0.000025s : 0.01% optimize.symbol_engine_optimizer.renormalize : 0.000000s : 0.00% detach_backward : 0.000002s : 0.00% pipeline_parallel_scheduler : 0.000002s : 0.00% auto_monad_reorder : 0.000060s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000831s : 0.44% validate : 0.000074s : 0.04% Time group info: ------[substitution.] 0.000680 165 1.73% : 0.000012s : 2: substitution.depend_value_elim 0.68% : 0.000005s : 9: substitution.elim_not_effective 0.54% : 0.000004s : 9: substitution.fold_const_symbol 1.94% : 0.000013s : 12: substitution.graph_param_transform 62.95% : 0.000428s : 11: substitution.inline 1.39% : 0.000009s : 18: substitution.j_node_and_user_rematch 3.77% : 0.000026s : 4: substitution.less_batch_normalization 1.24% : 0.000008s : 12: substitution.load_eliminater 2.23% : 0.000015s : 18: substitution.remove_not_recompute_node 1.25% : 0.000008s : 6: substitution.replace_old_param 1.75% : 0.000012s : 2: substitution.switch_simplify 5.23% : 0.000036s : 30: substitution.updatestate_pure_node_eliminater 15.31% : 0.000104s : 32: substitution.updatestate_useless_node_eliminater ------[type_inference.] 0.174894 2 98.37% : 0.172036s : 1: type_inference.infer 1.63% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000172 13 62.73% : 0.000108s : 11: replace.inline 37.27% : 0.000064s : 2: replace.switch_simplify ------[match.] 0.000431 13 97.53% : 0.000421s : 11: match.inline 2.47% : 0.000011s : 2: match.switch_simplify ------[predicate.] 0.000620 4059 1.26% : 0.000008s : 49: predicate.accumulaten_eliminater 0.63% : 0.000004s : 12: predicate.ad_related_special_op_eliminate 0.51% : 0.000003s : 24: predicate.addn_check_dump 1.10% : 0.000007s : 49: predicate.addn_zero_filter 1.03% : 0.000006s : 49: predicate.adjust_all_reduce_mul_add 2.16% : 0.000013s : 73: predicate.arithmetic_simplify 1.18% : 0.000007s : 49: predicate.cast_eliminate 0.55% : 0.000003s : 24: predicate.check_bprop_eliminate 0.55% : 0.000003s : 24: predicate.compare_switch_simplify 0.15% : 0.000001s : 12: predicate.const_output_eliminate 0.54% : 0.000003s : 24: predicate.depend_value_elim 1.17% : 0.000007s : 49: predicate.dict_get_item_const_eliminator 1.19% : 0.000007s : 49: predicate.dict_get_item_eliminator 1.08% : 0.000007s : 49: predicate.dict_set_item_eliminator 0.72% : 0.000004s : 24: predicate.dumpgradient_eliminate 0.16% : 0.000001s : 12: predicate.elim_not_effective 0.37% : 0.000002s : 12: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000008s : 61: predicate.environ_add_const_eliminate 1.37% : 0.000009s : 61: predicate.environ_get_add_eliminate 1.32% : 0.000008s : 61: predicate.environ_get_depend_swap 1.83% : 0.000011s : 85: predicate.environ_get_eliminate 1.33% : 0.000008s : 61: predicate.environ_get_set_eliminate 1.33% : 0.000008s : 60: predicate.exchange_switch_depend_value 2.05% : 0.000013s : 60: predicate.float_depend_g_call 0.53% : 0.000003s : 24: predicate.float_environ_get_switch 0.76% : 0.000005s : 36: predicate.float_tuple_getitem_switch 0.15% : 0.000001s : 12: predicate.fold_const_symbol 0.60% : 0.000004s : 24: predicate.get_grad_eliminate 0.32% : 0.000002s : 12: predicate.graph_param_transform 0.52% : 0.000003s : 24: predicate.incorporate_call 0.50% : 0.000003s : 24: predicate.incorporate_call_switch 5.70% : 0.000035s : 181: predicate.inline 0.78% : 0.000005s : 24: predicate.inline_without_move 0.28% : 0.000002s : 24: predicate.j_node_and_user_rematch 0.94% : 0.000006s : 24: predicate.less_batch_normalization 1.97% : 0.000012s : 73: predicate.list_to_tuple_eliminator_ 2.78% : 0.000017s : 122: predicate.load_eliminater 0.65% : 0.000004s : 12: predicate.loop_unroll_after_grad 1.80% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.69% : 0.000010s : 73: predicate.make_slice_get_slice_eliminator 0.57% : 0.000004s : 24: predicate.merge_addn 0.52% : 0.000003s : 24: predicate.micro_step_allgather_replace 0.53% : 0.000003s : 24: predicate.mini_step_allgather_replace 1.04% : 0.000006s : 49: predicate.minmaximum_grad 0.72% : 0.000004s : 12: predicate.mutable_eliminate 0.30% : 0.000002s : 12: predicate.opt_reshape 0.33% : 0.000002s : 12: predicate.parallel_virtual_node 1.77% : 0.000011s : 60: predicate.partial_defer_inline 1.53% : 0.000009s : 61: predicate.partial_eliminate 1.05% : 0.000007s : 49: predicate.print_const_string_wrapper 0.59% : 0.000004s : 24: predicate.reduce_all_const_elim 1.38% : 0.000009s : 49: predicate.reduce_eliminate 2.62% : 0.000016s : 122: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000002s : 24: predicate.remove_not_recompute_node 1.19% : 0.000007s : 73: predicate.replace_applicator 0.41% : 0.000003s : 24: predicate.replace_old_param 0.26% : 0.000002s : 12: predicate.reset_defer_inline 1.09% : 0.000007s : 49: predicate.reshape_eliminate 0.62% : 0.000004s : 24: predicate.row_tensor_add_zeros_like 0.35% : 0.000002s : 12: predicate.row_tensor_eliminate 0.73% : 0.000004s : 24: predicate.same_eliminate 0.50% : 0.000003s : 32: predicate.set_cell_output_no_recompute 0.73% : 0.000005s : 24: predicate.shard_identity_eliminate 0.61% : 0.000004s : 24: predicate.special_op_eliminate 0.72% : 0.000004s : 24: predicate.specialize_transform 0.81% : 0.000005s : 24: predicate.split_environ_get_set_with_tuple_value 0.72% : 0.000004s : 24: predicate.stack_unstack_eliminate 0.29% : 0.000002s : 12: predicate.switch_call_monad_eliminater 1.44% : 0.000009s : 60: predicate.switch_defer_inline 1.90% : 0.000012s : 84: predicate.switch_layer_defer_inline 4.49% : 0.000028s : 178: predicate.switch_simplify 1.15% : 0.000007s : 49: predicate.tile_eliminate 1.09% : 0.000007s : 49: predicate.transpose_eliminate 1.87% : 0.000012s : 73: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000011s : 73: predicate.tuple_list_get_item_const_eliminator 1.64% : 0.000010s : 73: predicate.tuple_list_get_item_depend_reorder 2.96% : 0.000018s : 97: predicate.tuple_list_get_item_eliminator 1.71% : 0.000011s : 73: predicate.tuple_list_get_set_item_eliminator 2.47% : 0.000015s : 97: predicate.tuple_list_set_item_eliminator 1.67% : 0.000010s : 73: predicate.tuple_to_list_eliminator_ 2.73% : 0.000017s : 122: predicate.updatestate_pure_node_eliminater 3.59% : 0.000022s : 146: predicate.updatestate_useless_node_eliminater 0.35% : 0.000002s : 12: predicate.value_based_eliminate 0.73% : 0.000005s : 24: predicate.virtual_dataset_eliminate 0.55% : 0.000003s : 24: predicate.virtual_output_eliminate 0.28% : 0.000002s : 12: predicate.virtual_view_grad_eliminate 0.34% : 0.000002s : 12: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001557 18 41.30% : 0.000643s : 5: func_graph_cloner_run.FuncGraphClonerGraph 58.70% : 0.000914s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.357635 192 0.00% : 0.000004s : 1: ForceFp32Comm 17.36% : 0.062085s : 1: add_attr 17.34% : 0.062031s : 1: add_attr_with_inline 0.00% : 0.000004s : 1: add_comm_op_reuse_tag 0.05% : 0.000196s : 1: add_recomputation 0.00% : 0.000005s : 1: assign_add_opt 0.16% : 0.000584s : 1: auto_monad 0.02% : 0.000065s : 1: auto_monad_reorder 0.00% : 0.000003s : 1: begin_end_overlap_inline 0.00% : 0.000007s : 1: bias_add_comm_swap 0.26% : 0.000920s : 1: bootstrap 0.01% : 0.000044s : 1: cconv 0.00% : 0.000005s : 1: comm_op_add_attrs 0.01% : 0.000037s : 1: control_data_broadcast_order 0.01% : 0.000023s : 1: convert_after_rewriter 0.02% : 0.000081s : 1: cse_after_recomputation 0.00% : 0.000006s : 1: dataset_repeat_opt 0.00% : 0.000006s : 1: detach_backward 0.01% : 0.000022s : 1: environ_conv 0.10% : 0.000346s : 1: event_method 0.00% : 0.000005s : 1: full_micro_interleaved_order_control 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000017s : 1: graph_reusing 0.00% : 0.000005s : 1: grouped_pairwise_exchange_alltoall 0.00% : 0.000004s : 1: handle_group_info 0.00% : 0.000007s : 1: inline 0.00% : 0.000006s : 1: insert-virtual-dataset 0.00% : 0.000004s : 1: interleave_parallel_branches 0.00% : 0.000004s : 1: interleave_split_concat_branches 0.00% : 0.000007s : 1: label_fine_grained_interleaved_index 0.00% : 0.000012s : 1: label_micro_interleaved_index 0.16% : 0.000587s : 1: loop_unroll 0.00% : 0.000005s : 1: merge_cast_opt 0.00% : 0.000007s : 1: micro_interleaved_order_control 0.24% : 0.000867s : 1: mutable_eliminate 0.00% : 0.000011s : 1: offloading_packed_experts 0.01% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000034s : 1: opt.transform.mutable_eliminate 1.04% : 0.003708s : 78: opt.transform.opt_a 0.03% : 0.000107s : 1: opt.transform.opt_after_cconv 0.01% : 0.000053s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000330s : 28: opt.transform.opt_b 0.04% : 0.000159s : 2: opt.transform.opt_trans_graph 0.03% : 0.000091s : 4: opt.transform.symbol_engine_opt 2.25% : 0.008038s : 1: opt_a 3.46% : 0.012364s : 1: opt_after_cconv 0.24% : 0.000843s : 1: opt_after_jit_grad 0.15% : 0.000524s : 1: opt_b 6.80% : 0.024314s : 1: optimize 0.03% : 0.000123s : 1: optimize_parallel_all_gather_comm 0.00% : 0.000014s : 1: order_py_execute_after_rewriter 0.01% : 0.000045s : 1: overlap_grad_flash_sp 0.00% : 0.000005s : 1: overlap_grad_matmul_and_grad_allreduce 0.01% : 0.000027s : 1: overlap_grad_ring_attention 0.00% : 0.000005s : 1: overlap_opt_shard_grad_in_pipeline 0.01% : 0.000038s : 1: overlap_opt_shard_in_pipeline 0.00% : 0.000009s : 1: overlap_param_gather 0.00% : 0.000005s : 1: overlap_recompute_allgather_and_fa_grad 0.00% : 0.000012s : 1: overlap_recompute_and_grad_model_parallel 0.00% : 0.000006s : 1: overlap_recompute_comm 0.00% : 0.000008s : 1: parallel-infer-symbol 0.00% : 0.000004s : 1: parallel-infer-symbol-second 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pipeline_parallel_scheduler 0.00% : 0.000005s : 1: pipeline_split 0.03% : 0.000098s : 1: pre_auto_parallel 0.02% : 0.000074s : 1: py_interpret_to_execute 0.01% : 0.000033s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000004s : 1: remove_cast_before_assign_add 0.03% : 0.000114s : 1: remove_dup_value 0.40% : 0.001447s : 1: renormalize.infer 0.30% : 0.001065s : 1: renormalize.specialize 0.00% : 0.000006s : 1: reorder_send_recv_between_fp_bp 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000216s : 1: rewriter_after_opt_a 0.05% : 0.000179s : 1: rewriter_before_opt_a 0.00% : 0.000006s : 1: slice_cell_reuse_recomputed_activation 0.00% : 0.000005s : 1: slice_recompute_activation 0.00% : 0.000006s : 1: split_layernorm_comm 0.00% : 0.000005s : 1: split_matmul_comm_elemetwise 0.00% : 0.000016s : 1: swap_dp_allreduce_reducescatter 0.04% : 0.000151s : 1: symbol_engine_optimizer 0.06% : 0.000211s : 1: tuple_transform 48.95% : 0.175052s : 1: type_inference [WARNING] ME(163641:281473434586928,MainProcess):2026-01-29-17:44:28.802.928 [mindspore/graph/api.py:128] The function "train_step" at the file "/home/jenkins/mindspore/testcases/testcases/tests/st/mint/optim/test_fused_adamw.py", line 217 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. [WARNING] ANALYZER(163641,ffffa4150f30,python3.9):2026-01-29-17:44:30.686.274 [mindspore/ccsrc/frontend/jit/ps/static_analysis/auto_monad.cc:1601] ClearIsolatedNodes] Some side effect nodes were eliminated by mistake. The node is:@214_train_step_70:_{[0]: ValueNode 359__tuple_getitem_by_number_71, [1]: CNode_72, [2]: ValueNode 1} TotalTime = 2.20987, [30] [bootstrap]: 0.00031576 [type_inference]: 1.83224 [event_method]: 0.00038059 [auto_monad]: 0.0509438 [graph_reusing]: 0.00017424 [pre_auto_parallel]: 3.118e-05 [py_interpret_to_execute]: 0.00085285 [rewriter_before_opt_a]: 0.00530164 [expand_dump_flag]: 6.132e-05 [jit_opt_a]: 0.313234, [4] [Cycle 1]: 0.276223, [27] [switch_simplify]: 0.00146993 [loop_unroll]: 0.0327835 [a_1]: 0.0851606 [with_stream_mark]: 0.00028891 [recompute_prepare]: 0.00012832 [updatestate_depend_eliminate]: 0.00058655 [updatestate_assign_eliminate]: 5.929e-05 [updatestate_loads_eliminate]: 0.00012502 [parameter_eliminate]: 5.40999e-06 [specialize_transform]: 7.59e-05 [updatestate_useless_node_eliminater]: 9.595e-05 [accelerated_algorithm]: 0.00012869 [meta_shard_fg_expand]: 4.916e-05 [get_grad_eliminate_]: 6.321e-05 [merge_forward]: 3.782e-05 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.0001189 [j_node_and_user_rematch]: 0.00010805 [meta_fg_expand]: 0.0444432 [replace_old_param]: 0.00040855 [inline_without_move]: 0.00036784 [renormalize]: 0.102825 [add_forward_monad_depend]: 6.044e-05 [auto_monad_grad]: 4.108e-05 [auto_monad_eliminator]: 0.00435683 [cse]: 0.00124268 [replace_applicator]: 0.00067614 [Cycle 2]: 0.02301, [27] [switch_simplify]: 0.00033361 [loop_unroll]: 0.00031142 [a_1]: 0.00971975 [with_stream_mark]: 0.00016853 [recompute_prepare]: 6.831e-05 [updatestate_depend_eliminate]: 9.531e-05 [updatestate_assign_eliminate]: 3.787e-05 [updatestate_loads_eliminate]: 0.00010847 [parameter_eliminate]: 3.45e-06 [specialize_transform]: 5.717e-05 [updatestate_useless_node_eliminater]: 7.146e-05 [accelerated_algorithm]: 5.877e-05 [meta_shard_fg_expand]: 2.286e-05 [get_grad_eliminate_]: 4.926e-05 [merge_forward]: 2.943e-05 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.116e-05 [j_node_and_user_rematch]: 8.173e-05 [meta_fg_expand]: 0.00087979 [replace_old_param]: 8.067e-05 [inline_without_move]: 5.059e-05 [renormalize]: 0.00987819 [add_forward_monad_depend]: 1.444e-05 [auto_monad_grad]: 3.91999e-06 [auto_monad_eliminator]: 0.00019337 [cse]: 0.00021142 [replace_applicator]: 7.775e-05 [Cycle 3]: 0.00610501, [27] [switch_simplify]: 4.746e-05 [loop_unroll]: 4.435e-05 [a_1]: 0.00146814 [with_stream_mark]: 4.862e-05 [recompute_prepare]: 4.572e-05 [updatestate_depend_eliminate]: 3.265e-05 [updatestate_assign_eliminate]: 3.047e-05 [updatestate_loads_eliminate]: 3.427e-05 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 4.676e-05 [updatestate_useless_node_eliminater]: 6.413e-05 [accelerated_algorithm]: 5.477e-05 [meta_shard_fg_expand]: 1.955e-05 [get_grad_eliminate_]: 4.316e-05 [merge_forward]: 2.729e-05 [cell_reuse_recompute_pass]: 3.72002e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.634e-05 [j_node_and_user_rematch]: 7.411e-05 [meta_fg_expand]: 1.987e-05 [replace_old_param]: 5.717e-05 [inline_without_move]: 4.436e-05 [renormalize]: 0.00317708 [add_forward_monad_depend]: 5.793e-05 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 0.00011369 [cse]: 0.00018077 [replace_applicator]: 6.727e-05 [Cycle 4]: 0.00268941, [27] [switch_simplify]: 4.635e-05 [loop_unroll]: 4.552e-05 [a_1]: 0.00143093 [with_stream_mark]: 5.022e-05 [recompute_prepare]: 4.678e-05 [updatestate_depend_eliminate]: 3.333e-05 [updatestate_assign_eliminate]: 2.975e-05 [updatestate_loads_eliminate]: 2.898e-05 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 4.624e-05 [updatestate_useless_node_eliminater]: 6.126e-05 [accelerated_algorithm]: 5.641e-05 [meta_shard_fg_expand]: 1.855e-05 [get_grad_eliminate_]: 4.267e-05 [merge_forward]: 2.724e-05 [cell_reuse_recompute_pass]: 2.99001e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.493e-05 [j_node_and_user_rematch]: 7.475e-05 [meta_fg_expand]: 1.866e-05 [replace_old_param]: 5.798e-05 [inline_without_move]: 4.421e-05 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 4.27e-06 [auto_monad_grad]: 1.71e-06 [auto_monad_eliminator]: 8.573e-05 [cse]: 0.00014662 [replace_applicator]: 4.568e-05 [py_interpret_to_execute_after_opt_a]: 5.968e-05 [rewriter_after_opt_a]: 0.00044376 [convert_after_rewriter]: 4.074e-05 [order_py_execute_after_rewriter]: 2.556e-05 [mutable_eliminate]: 0.00086738 [jit_opt_b]: 0.00029397, [1] [Cycle 1]: 0.00028478, [2] [frontend_op_eliminate]: 0.00014724 [inline_after_opt_a]: 0.0001218 [cconv]: 0.00028133 [loop_unroll]: 0.00076048 [jit_opt_after_cconv]: 0.00086778, [1] [Cycle 1]: 0.00085651, [11] [c_1]: 0.00029496 [parameter_eliminate]: 4.27998e-06 [updatestate_depend_eliminate]: 4.354e-05 [updatestate_assign_eliminate]: 3.263e-05 [updatestate_loads_eliminate]: 3.116e-05 [cse]: 0.00015931 [call_graph_tuple_transform]: 0.00012001 [tuple_list_get_item_eliminator]: 4.712e-05 [none_parameter_eliminate]: 3.43e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.022e-05 [remove_dup_value]: 0.00015706 [partial_unused_args_eliminate]: 3.38e-06 [environ_conv]: 3.979e-05 [add_recomputation]: 0.00029195 [cse_after_recomputation]: 0.00015905, [1] [Cycle 1]: 0.00014965, [1] [cse]: 0.00013654 [auto_monad_reorder]: 0.00012048 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 7.77002e-06 [opt_after_jit_grad]: 0.00085658 [symbol_engine_optimizer]: 0.00033823, [1] [Cycle 1]: 0.00033021, [6] [build]: 3.357e-05 [elim_shapecalc]: 5.251e-05 [elim_not_effective]: 8.365e-05 [opt_reshape]: 4.902e-05 [fold_const_symbol]: 7.436e-05 [renormalize]: 4.2998e-07 [validate]: 0.00021412 Sums bootstrap : 0.000316s : 0.01% type_inference : 1.832243s : 83.18% event_method : 0.000381s : 0.02% auto_monad : 0.050944s : 2.31% graph_reusing : 0.000174s : 0.01% pre_auto_parallel : 0.000031s : 0.00% py_interpret_to_execute : 0.000853s : 0.04% rewriter_before_opt_a : 0.005302s : 0.24% expand_dump_flag : 0.000061s : 0.00% jit_opt_a.switch_simplify : 0.001897s : 0.09% jit_opt_a.loop_unroll : 0.033185s : 1.51% jit_opt_a.a_1 : 0.097779s : 4.44% jit_opt_a.with_stream_mark : 0.000556s : 0.03% jit_opt_a.recompute_prepare : 0.000289s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000748s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000157s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000297s : 0.01% jit_opt_a.parameter_eliminate : 0.000014s : 0.00% jit_opt_a.specialize_transform : 0.000226s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000293s : 0.01% jit_opt_a.accelerated_algorithm : 0.000299s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000110s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000198s : 0.01% jit_opt_a.merge_forward : 0.000122s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000010s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000381s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000339s : 0.02% jit_opt_a.meta_fg_expand : 0.045361s : 2.06% jit_opt_a.replace_old_param : 0.000604s : 0.03% jit_opt_a.inline_without_move : 0.000507s : 0.02% jit_opt_a.renormalize : 0.115880s : 5.26% jit_opt_a.add_forward_monad_depend : 0.000137s : 0.01% jit_opt_a.auto_monad_grad : 0.000049s : 0.00% jit_opt_a.auto_monad_eliminator : 0.004750s : 0.22% jit_opt_a.cse : 0.001781s : 0.08% jit_opt_a.replace_applicator : 0.000867s : 0.04% py_interpret_to_execute_after_opt_a : 0.000060s : 0.00% rewriter_after_opt_a : 0.000444s : 0.02% convert_after_rewriter : 0.000041s : 0.00% order_py_execute_after_rewriter : 0.000026s : 0.00% mutable_eliminate : 0.000867s : 0.04% jit_opt_b.frontend_op_eliminate : 0.000147s : 0.01% jit_opt_b.inline_after_opt_a : 0.000122s : 0.01% cconv : 0.000281s : 0.01% loop_unroll : 0.000760s : 0.03% jit_opt_after_cconv.c_1 : 0.000295s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000044s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000033s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000031s : 0.00% jit_opt_after_cconv.cse : 0.000159s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000120s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000047s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000050s : 0.00% remove_dup_value : 0.000157s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000040s : 0.00% add_recomputation : 0.000292s : 0.01% cse_after_recomputation.cse : 0.000137s : 0.01% auto_monad_reorder : 0.000120s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000857s : 0.04% symbol_engine_optimizer.build : 0.000034s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000053s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000084s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000049s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000074s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000214s : 0.01% Time group info: ------[substitution.] 0.075830 1520 0.14% : 0.000103s : 5: substitution.arithmetic_simplify 0.04% : 0.000030s : 3: substitution.cast_eliminate 0.18% : 0.000134s : 50: substitution.depend_value_elim 0.02% : 0.000012s : 32: substitution.elim_not_effective 0.02% : 0.000013s : 4: substitution.environ_get_add_eliminate 0.01% : 0.000006s : 2: substitution.environ_get_depend_swap 0.01% : 0.000009s : 4: substitution.environ_get_eliminate 0.03% : 0.000023s : 4: substitution.environ_get_set_eliminate 0.01% : 0.000011s : 32: substitution.fold_const_symbol 2.50% : 0.001899s : 8: substitution.getattr_setattr_resolve 0.04% : 0.000030s : 44: substitution.graph_param_transform 93.46% : 0.070873s : 170: substitution.inline 0.11% : 0.000086s : 12: substitution.inline_without_move 0.07% : 0.000057s : 147: substitution.j_node_and_user_rematch 0.08% : 0.000061s : 17: substitution.less_batch_normalization 0.05% : 0.000036s : 1: substitution.list_to_tuple_eliminator_ 0.04% : 0.000032s : 30: substitution.load_eliminater 0.13% : 0.000099s : 66: substitution.minmaximum_grad 0.00% : 0.000001s : 1: substitution.opt_reshape 0.06% : 0.000043s : 12: substitution.partial_eliminate 0.04% : 0.000028s : 6: substitution.reduce_eliminate 0.01% : 0.000007s : 4: substitution.redundant_stop_gradient_eliminater 0.11% : 0.000082s : 147: substitution.remove_not_recompute_node 0.24% : 0.000181s : 55: substitution.replace_applicator 0.07% : 0.000051s : 76: substitution.replace_old_param 0.12% : 0.000095s : 14: substitution.reshape_eliminate 0.01% : 0.000005s : 1: substitution.set_cell_output_no_recompute 0.01% : 0.000005s : 3: substitution.split_environ_get_set_with_tuple_value 0.10% : 0.000077s : 33: substitution.switch_simplify 0.01% : 0.000007s : 1: substitution.tile_eliminate 0.43% : 0.000324s : 76: substitution.tuple_list_convert_item_index_to_positive 0.35% : 0.000265s : 83: substitution.tuple_list_get_item_depend_reorder 0.96% : 0.000727s : 160: substitution.tuple_list_get_item_eliminator 0.17% : 0.000131s : 97: substitution.updatestate_pure_node_eliminater 0.38% : 0.000288s : 120: substitution.updatestate_useless_node_eliminater ------[type_inference.] 1.831433 2 94.69% : 1.734242s : 1: type_inference.infer 5.31% : 0.097191s : 1: type_inference.specialize ------[replace.] 0.003721 312 0.36% : 0.000013s : 1: replace.arithmetic_simplify 0.66% : 0.000025s : 3: replace.cast_eliminate 1.24% : 0.000046s : 5: replace.depend_value_elim 0.81% : 0.000030s : 2: replace.environ_get_set_eliminate 3.27% : 0.000122s : 6: replace.getattr_setattr_resolve 47.87% : 0.001781s : 170: replace.inline 0.65% : 0.000024s : 1: replace.list_to_tuple_eliminator_ 1.11% : 0.000041s : 2: replace.partial_eliminate 2.49% : 0.000093s : 3: replace.replace_applicator 0.20% : 0.000007s : 1: replace.reshape_eliminate 12.46% : 0.000464s : 33: replace.switch_simplify 3.09% : 0.000115s : 7: replace.tuple_list_get_item_depend_reorder 25.37% : 0.000944s : 77: replace.tuple_list_get_item_eliminator 0.43% : 0.000016s : 1: replace.updatestate_useless_node_eliminater ------[match.] 0.073409 312 0.07% : 0.000055s : 1: match.arithmetic_simplify 0.04% : 0.000027s : 3: match.cast_eliminate 0.01% : 0.000007s : 5: match.depend_value_elim 0.02% : 0.000018s : 2: match.environ_get_set_eliminate 2.45% : 0.001802s : 6: match.getattr_setattr_resolve 96.40% : 0.070766s : 170: match.inline 0.05% : 0.000035s : 1: match.list_to_tuple_eliminator_ 0.03% : 0.000026s : 2: match.partial_eliminate 0.05% : 0.000034s : 3: match.replace_applicator 0.00% : 0.000003s : 1: match.reshape_eliminate 0.08% : 0.000062s : 33: match.switch_simplify 0.14% : 0.000102s : 7: match.tuple_list_get_item_depend_reorder 0.62% : 0.000459s : 77: match.tuple_list_get_item_eliminator 0.02% : 0.000013s : 1: match.updatestate_useless_node_eliminater ------[predicate.] 0.037336 33426 0.22% : 0.000080s : 570: predicate.accumulaten_eliminater 0.04% : 0.000016s : 44: predicate.ad_related_special_op_eliminate 0.24% : 0.000090s : 570: predicate.addn_check_dump 0.22% : 0.000083s : 570: predicate.addn_zero_filter 0.31% : 0.000117s : 571: predicate.arithmetic_simplify 0.22% : 0.000083s : 575: predicate.cast_eliminate 0.02% : 0.000006s : 44: predicate.check_bprop_eliminate 0.21% : 0.000077s : 570: predicate.compare_switch_simplify 0.22% : 0.000083s : 570: predicate.depend_value_elim 0.21% : 0.000079s : 577: predicate.dict_get_item_const_eliminator 0.21% : 0.000080s : 577: predicate.dict_get_item_eliminator 0.21% : 0.000077s : 577: predicate.dict_set_item_eliminator 0.02% : 0.000008s : 44: predicate.dumpgradient_eliminate 0.01% : 0.000004s : 44: predicate.elim_not_effective 0.02% : 0.000007s : 44: predicate.elim_shapecalc_of_broadcastargs 0.21% : 0.000079s : 575: predicate.environ_add_const_eliminate 0.21% : 0.000077s : 577: predicate.environ_get_add_eliminate 0.20% : 0.000075s : 575: predicate.environ_get_depend_swap 0.22% : 0.000081s : 577: predicate.environ_get_eliminate 0.21% : 0.000078s : 577: predicate.environ_get_set_eliminate 0.01% : 0.000003s : 44: predicate.fold_const_symbol 0.08% : 0.000029s : 202: predicate.get_grad_eliminate 0.04% : 0.000015s : 40: predicate.getattr_setattr_resolve 0.01% : 0.000003s : 44: predicate.graph_param_transform 0.60% : 0.000223s : 923: predicate.inline 0.18% : 0.000068s : 408: predicate.inline_without_move 0.04% : 0.000015s : 202: predicate.j_node_and_user_rematch 0.10% : 0.000036s : 212: predicate.less_batch_normalization 0.25% : 0.000093s : 662: predicate.list_to_tuple_eliminator_ 0.28% : 0.000104s : 708: predicate.load_eliminater 0.05% : 0.000019s : 44: predicate.loop_unroll_after_grad 86.46% : 0.032281s : 1151: predicate.loop_unroll_before_grad 0.24% : 0.000088s : 628: predicate.make_slice_get_slice_eliminator 0.20% : 0.000074s : 570: predicate.merge_addn 0.21% : 0.000079s : 571: predicate.minmaximum_grad 0.05% : 0.000017s : 44: predicate.mutable_eliminate 0.02% : 0.000007s : 44: predicate.opt_reshape 0.32% : 0.000120s : 708: predicate.partial_eliminate 0.20% : 0.000075s : 565: predicate.print_const_string_wrapper 0.58% : 0.000218s : 571: predicate.reduce_eliminate 0.25% : 0.000092s : 664: predicate.redundant_stop_gradient_eliminater 0.04% : 0.000015s : 202: predicate.remove_not_recompute_node 0.30% : 0.000111s : 1150: predicate.replace_applicator 0.08% : 0.000031s : 408: predicate.replace_old_param 0.01% : 0.000004s : 44: predicate.reset_defer_inline 0.21% : 0.000078s : 572: predicate.reshape_eliminate 0.21% : 0.000077s : 565: predicate.row_tensor_add_zeros_like 0.02% : 0.000008s : 44: predicate.row_tensor_eliminate 0.23% : 0.000086s : 565: predicate.same_eliminate 0.05% : 0.000020s : 244: predicate.set_cell_output_no_recompute 0.03% : 0.000012s : 88: predicate.special_op_eliminate 0.09% : 0.000032s : 202: predicate.specialize_transform 0.24% : 0.000090s : 565: predicate.split_environ_get_set_with_tuple_value 0.22% : 0.000082s : 565: predicate.stack_unstack_eliminate 0.02% : 0.000007s : 44: predicate.switch_call_monad_eliminater 0.54% : 0.000203s : 835: predicate.switch_defer_inline 0.35% : 0.000132s : 835: predicate.switch_layer_defer_inline 0.92% : 0.000345s : 2096: predicate.switch_simplify 0.21% : 0.000079s : 571: predicate.tile_eliminate 0.20% : 0.000076s : 571: predicate.transpose_eliminate 0.27% : 0.000101s : 577: predicate.tuple_list_convert_item_index_to_positive 0.25% : 0.000095s : 584: predicate.tuple_list_get_item_depend_reorder 0.43% : 0.000160s : 749: predicate.tuple_list_get_item_eliminator 0.26% : 0.000097s : 584: predicate.tuple_list_set_item_eliminator 0.28% : 0.000106s : 661: predicate.tuple_to_list_eliminator_ 0.27% : 0.000102s : 708: predicate.updatestate_pure_node_eliminater 0.37% : 0.000139s : 911: predicate.updatestate_useless_node_eliminater 0.26% : 0.000097s : 565: predicate.value_based_eliminate 0.02% : 0.000006s : 44: predicate.virtual_view_grad_eliminate 0.02% : 0.000008s : 44: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.106473 407 74.38% : 0.079191s : 208: func_graph_cloner_run.FuncGraphClonerGraph 25.62% : 0.027282s : 199: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 2.465485 106 0.01% : 0.000297s : 1: add_recomputation 2.07% : 0.050965s : 1: auto_monad 0.01% : 0.000124s : 1: auto_monad_reorder 0.01% : 0.000351s : 1: bootstrap 0.01% : 0.000290s : 1: cconv 0.00% : 0.000045s : 1: convert_after_rewriter 0.01% : 0.000162s : 1: cse_after_recomputation 0.00% : 0.000043s : 1: environ_conv 0.02% : 0.000390s : 1: event_method 0.00% : 0.000068s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000181s : 1: graph_reusing 12.70% : 0.313239s : 1: jit_opt_a 0.04% : 0.000872s : 1: jit_opt_after_cconv 0.01% : 0.000297s : 1: jit_opt_b 0.03% : 0.000773s : 1: loop_unroll 0.04% : 0.000880s : 1: mutable_eliminate 5.55% : 0.136751s : 52: opt.transform.jit_opt_a 0.02% : 0.000506s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000259s : 4: opt.transform.jit_opt_b 0.00% : 0.000084s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000078s : 1: opt.transform.mutable_eliminate 0.01% : 0.000173s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.002143s : 4: opt.transform.opt_resolve 0.01% : 0.000255s : 4: opt.transform.symbol_engine_opt 0.04% : 0.000868s : 1: opt_after_jit_grad 0.00% : 0.000028s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000034s : 1: pre_auto_parallel 0.04% : 0.000865s : 1: py_interpret_to_execute 0.00% : 0.000063s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000162s : 1: remove_dup_value 3.09% : 0.076166s : 3: renormalize.infer 1.61% : 0.039660s : 3: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000450s : 1: rewriter_after_opt_a 0.22% : 0.005334s : 1: rewriter_before_opt_a 0.01% : 0.000341s : 1: symbol_engine_optimizer 74.32% : 1.832267s : 1: type_inference TotalTime = 0.118419, [21] [bootstrap]: 0.00096928 [type_inference]: 0.0909921 [event_method]: 0.00015549 [auto_monad]: 0.00045524 [graph_reusing]: 1.066e-05 [inline]: 2.77002e-06 [add_attr]: 0.00374292, [1] [add_attr_with_inline]: 0.00373172, [1] [Cycle 1]: 0.00014209, [2] [tag_attr]: 9.533e-05 [meta_addattr_fg_expand]: 1.079e-05 [parallel-infer-symbol]: 3.77998e-06 [pre_auto_parallel]: 6.562e-05 [insert-virtual-dataset]: 3.19001e-06 [parallel-infer-symbol-second]: 7.50006e-07 [dataset_repeat_opt]: 2.10002e-06 [pipeline_split]: 1.97001e-06 [optimize]: 0.0209296, [53] [py_interpret_to_execute]: 5.357e-05 [rewriter_before_opt_a]: 0.00015438 [opt_a]: 0.0168813, [2] [Cycle 1]: 0.0151606, [45] [expand_dump_flag]: 4.14002e-06 [switch_simplify]: 0.00017832 [loop_unroll]: 7.89e-05 [a_1]: 0.00185475 [with_stream_mark]: 3.097e-05 [recompute_prepare]: 2.59e-05 [updatestate_depend_eliminate]: 7.785e-05 [updatestate_assign_eliminate]: 1.006e-05 [updatestate_loads_eliminate]: 5.465e-05 [parameter_eliminate]: 2.89999e-06 [a_2]: 0.0002276 [accelerated_algorithm]: 3.918e-05 [shard]: 2.32001e-06 [meta_shard_fg_expand]: 5.37001e-06 [shard_inline]: 1.492e-05 [merge_send_recv]: 1.385e-05 [auto_parallel]: 1.41e-05 [parallel]: 2.684e-05 [flash_sp]: 1.229e-05 [merge_comm]: 8.77999e-06 [allreduce_fusion]: 8.15e-06 [matmul_add_comm_reduction]: 1.659e-05 [allreduce_slice_to_reducescatter]: 6.50005e-07 [virtual_shard_identity]: 1.929e-05 [virtual_dataset]: 1.733e-05 [get_grad_eliminate_]: 1.555e-05 [virtual_output]: 1.588e-05 [merge_forward]: 8.94e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [offload_activation]: 1.988e-05 [cell_reuse_handle_not_recompute_node_pass]: 3.144e-05 [merge_recompute_call_nodes]: 1.54e-06 [before_grad]: 2.554e-05 [set_forward_comm_id_for_comm_node_pass]: 9.22999e-06 [meta_fg_expand]: 7.5e-06 [flash_sp_send_recv_attached]: 5.27999e-06 [receive_attached]: 2.11998e-06 [after_resolve]: 2.234e-05 [a_after_grad]: 2.447e-05 [renormalize]: 0.0114895 [add_forward_monad_depend]: 1.138e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 6.119e-05 [cse]: 0.00020683 [a_3]: 0.00012562 [Cycle 2]: 0.00170645, [45] [expand_dump_flag]: 2.74001e-06 [switch_simplify]: 1.902e-05 [loop_unroll]: 1.53e-05 [a_1]: 0.00051282 [with_stream_mark]: 2.887e-05 [recompute_prepare]: 1.784e-05 [updatestate_depend_eliminate]: 1.149e-05 [updatestate_assign_eliminate]: 1.26e-05 [updatestate_loads_eliminate]: 1.448e-05 [parameter_eliminate]: 2.74999e-06 [a_2]: 0.00022402 [accelerated_algorithm]: 2.437e-05 [shard]: 2.54999e-06 [meta_shard_fg_expand]: 5.22e-06 [shard_inline]: 1.593e-05 [merge_send_recv]: 1.572e-05 [auto_parallel]: 1.599e-05 [parallel]: 1.057e-05 [flash_sp]: 4.58001e-06 [merge_comm]: 9.64999e-06 [allreduce_fusion]: 8.52e-06 [matmul_add_comm_reduction]: 1.896e-05 [allreduce_slice_to_reducescatter]: 9.30013e-07 [virtual_shard_identity]: 1.953e-05 [virtual_dataset]: 1.477e-05 [get_grad_eliminate_]: 1.476e-05 [virtual_output]: 1.451e-05 [merge_forward]: 9.32001e-06 [cell_reuse_recompute_pass]: 4.05998e-06 [offload_activation]: 1.967e-05 [cell_reuse_handle_not_recompute_node_pass]: 3.145e-05 [merge_recompute_call_nodes]: 1.86e-06 [before_grad]: 2.552e-05 [set_forward_comm_id_for_comm_node_pass]: 9.06002e-06 [meta_fg_expand]: 6.74001e-06 [flash_sp_send_recv_attached]: 2.17999e-06 [receive_attached]: 2.47001e-06 [after_resolve]: 2.352e-05 [a_after_grad]: 2.48e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 3.3e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 4.545e-05 [cse]: 5.939e-05 [a_3]: 0.0001045 [py_interpret_to_execute_after_opt_a]: 2.961e-05 [slice_cell_reuse_recomputed_activation]: 2.76e-06 [rewriter_after_opt_a]: 0.000252 [convert_after_rewriter]: 1.801e-05 [order_py_execute_after_rewriter]: 1.18e-05 [mutable_eliminate]: 0.00085224 [opt_b]: 0.00056043, [1] [Cycle 1]: 0.00055033, [7] [b_1]: 0.0003692 [b_2]: 1.827e-05 [updatestate_depend_eliminate]: 1.598e-05 [updatestate_assign_eliminate]: 1.079e-05 [updatestate_loads_eliminate]: 1.387e-05 [renormalize]: 7.2e-07 [cse]: 7.359e-05 [optimize_parallel_all_gather_comm]: 3.432e-05 [overlap_param_gather]: 2.07999e-06 [cconv]: 4.082e-05 [loop_unroll]: 0.00058959 [opt_after_cconv]: 0.00034917, [1] [Cycle 1]: 0.00033972, [7] [c_1]: 0.00011209 [parameter_eliminate]: 6.01e-06 [updatestate_depend_eliminate]: 1.566e-05 [updatestate_assign_eliminate]: 9.81e-06 [updatestate_loads_eliminate]: 1.334e-05 [cse]: 6.017e-05 [renormalize]: 5.89993e-07 [remove_dup_value]: 6.911e-05 [tuple_transform]: 0.00016668, [1] [Cycle 1]: 0.00015986, [4] [d_1]: 0.00011195 [none_parameter_eliminate]: 2.78e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 1.743e-05 [partial_unused_args_eliminate]: 2.58998e-06 [add_recomputation]: 0.00012302 [cse_after_recomputation]: 5.811e-05, [1] [Cycle 1]: 5.178e-05, [1] [cse]: 4.386e-05 [environ_conv]: 1.74e-05 [swap_dp_allreduce_reducescatter]: 1.43e-05 [bias_add_comm_swap]: 2.84999e-06 [label_micro_interleaved_index]: 6.34001e-06 [label_fine_grained_interleaved_index]: 3.31001e-06 [merge_cast_opt]: 1.55999e-06 [slice_recompute_activation]: 2.58e-06 [micro_interleaved_order_control]: 2.73e-06 [assign_add_opt]: 1.53002e-06 [ForceFp32Comm]: 1.27999e-06 [remove_cast_before_assign_add]: 1.17e-06 [full_micro_interleaved_order_control]: 2.75997e-06 [reorder_send_recv_between_fp_bp]: 3.06999e-06 [comm_op_add_attrs]: 1.22999e-06 [add_comm_op_reuse_tag]: 1.15001e-06 [interleave_split_concat_branches]: 1.24998e-06 [interleave_parallel_branches]: 1.15999e-06 [overlap_opt_shard_in_pipeline]: 1.77999e-06 [overlap_opt_shard_grad_in_pipeline]: 1.87999e-06 [control_data_broadcast_order]: 3.529e-05 [grouped_pairwise_exchange_alltoall]: 1.75001e-06 [offloading_packed_experts]: 1.057e-05 [overlap_recompute_and_grad_model_parallel]: 1.14e-05 [overlap_grad_matmul_and_grad_allreduce]: 1.44e-06 [overlap_recompute_allgather_and_fa_grad]: 1.66e-06 [overlap_recompute_comm]: 2.63e-06 [overlap_grad_ring_attention]: 1.034e-05 [overlap_grad_flash_sp]: 5.008e-05 [begin_end_overlap_inline]: 6.19999e-07 [split_matmul_comm_elemetwise]: 2.49999e-06 [split_layernorm_comm]: 2.04999e-06 [handle_group_info]: 1.24e-06 [symbol_engine_optimizer]: 0.00017763, [1] [Cycle 1]: 0.00017142, [6] [build]: 1.498e-05 [elim_shapecalc]: 2.569e-05 [elim_not_effective]: 3.71e-05 [opt_reshape]: 2.047e-05 [fold_const_symbol]: 3.177e-05 [renormalize]: 3.00002e-07 [detach_backward]: 3.03e-06 [pipeline_parallel_scheduler]: 1.77001e-06 [auto_monad_reorder]: 7.708e-05 [get_jit_bprop_graph]: 2.86999e-06 [rewriter_after_jit_bprop_graph]: 5.89e-06 [opt_after_jit_grad]: 0.00069361 [validate]: 8.197e-05 Sums bootstrap : 0.000969s : 0.85% type_inference : 0.090992s : 80.26% event_method : 0.000155s : 0.14% auto_monad : 0.000455s : 0.40% graph_reusing : 0.000011s : 0.01% inline : 0.000003s : 0.00% add_attr.add_attr_with_inline.tag_attr : 0.000095s : 0.08% add_attr.add_attr_with_inline.meta_addattr_fg_expand : 0.000011s : 0.01% parallel-infer-symbol : 0.000004s : 0.00% pre_auto_parallel : 0.000066s : 0.06% insert-virtual-dataset : 0.000003s : 0.00% parallel-infer-symbol-second : 0.000001s : 0.00% dataset_repeat_opt : 0.000002s : 0.00% pipeline_split : 0.000002s : 0.00% optimize.py_interpret_to_execute : 0.000054s : 0.05% optimize.rewriter_before_opt_a : 0.000154s : 0.14% optimize.opt_a.expand_dump_flag : 0.000007s : 0.01% optimize.opt_a.switch_simplify : 0.000197s : 0.17% optimize.opt_a.loop_unroll : 0.000094s : 0.08% optimize.opt_a.a_1 : 0.002368s : 2.09% optimize.opt_a.with_stream_mark : 0.000060s : 0.05% optimize.opt_a.recompute_prepare : 0.000044s : 0.04% optimize.opt_a.updatestate_depend_eliminate : 0.000089s : 0.08% optimize.opt_a.updatestate_assign_eliminate : 0.000023s : 0.02% optimize.opt_a.updatestate_loads_eliminate : 0.000069s : 0.06% optimize.opt_a.parameter_eliminate : 0.000006s : 0.00% optimize.opt_a.a_2 : 0.000452s : 0.40% optimize.opt_a.accelerated_algorithm : 0.000064s : 0.06% optimize.opt_a.shard : 0.000005s : 0.00% optimize.opt_a.meta_shard_fg_expand : 0.000011s : 0.01% optimize.opt_a.shard_inline : 0.000031s : 0.03% optimize.opt_a.merge_send_recv : 0.000030s : 0.03% optimize.opt_a.auto_parallel : 0.000030s : 0.03% optimize.opt_a.parallel : 0.000037s : 0.03% optimize.opt_a.flash_sp : 0.000017s : 0.01% optimize.opt_a.merge_comm : 0.000018s : 0.02% optimize.opt_a.allreduce_fusion : 0.000017s : 0.01% optimize.opt_a.matmul_add_comm_reduction : 0.000036s : 0.03% optimize.opt_a.allreduce_slice_to_reducescatter : 0.000002s : 0.00% optimize.opt_a.virtual_shard_identity : 0.000039s : 0.03% optimize.opt_a.virtual_dataset : 0.000032s : 0.03% optimize.opt_a.get_grad_eliminate_ : 0.000030s : 0.03% optimize.opt_a.virtual_output : 0.000030s : 0.03% optimize.opt_a.merge_forward : 0.000018s : 0.02% optimize.opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% optimize.opt_a.offload_activation : 0.000040s : 0.03% optimize.opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.06% optimize.opt_a.merge_recompute_call_nodes : 0.000003s : 0.00% optimize.opt_a.before_grad : 0.000051s : 0.05% optimize.opt_a.set_forward_comm_id_for_comm_node_pass : 0.000018s : 0.02% optimize.opt_a.meta_fg_expand : 0.000014s : 0.01% optimize.opt_a.flash_sp_send_recv_attached : 0.000007s : 0.01% optimize.opt_a.receive_attached : 0.000005s : 0.00% optimize.opt_a.after_resolve : 0.000046s : 0.04% optimize.opt_a.a_after_grad : 0.000049s : 0.04% optimize.opt_a.renormalize : 0.011490s : 10.13% optimize.opt_a.add_forward_monad_depend : 0.000015s : 0.01% optimize.opt_a.auto_monad_grad : 0.000005s : 0.00% optimize.opt_a.auto_monad_eliminator : 0.000107s : 0.09% optimize.opt_a.cse : 0.000266s : 0.23% optimize.opt_a.a_3 : 0.000230s : 0.20% optimize.py_interpret_to_execute_after_opt_a : 0.000030s : 0.03% optimize.slice_cell_reuse_recomputed_activation : 0.000003s : 0.00% optimize.rewriter_after_opt_a : 0.000252s : 0.22% optimize.convert_after_rewriter : 0.000018s : 0.02% optimize.order_py_execute_after_rewriter : 0.000012s : 0.01% optimize.mutable_eliminate : 0.000852s : 0.75% optimize.opt_b.b_1 : 0.000369s : 0.33% optimize.opt_b.b_2 : 0.000018s : 0.02% optimize.opt_b.updatestate_depend_eliminate : 0.000016s : 0.01% optimize.opt_b.updatestate_assign_eliminate : 0.000011s : 0.01% optimize.opt_b.updatestate_loads_eliminate : 0.000014s : 0.01% optimize.opt_b.renormalize : 0.000001s : 0.00% optimize.opt_b.cse : 0.000074s : 0.06% optimize.optimize_parallel_all_gather_comm : 0.000034s : 0.03% optimize.overlap_param_gather : 0.000002s : 0.00% optimize.cconv : 0.000041s : 0.04% optimize.loop_unroll : 0.000590s : 0.52% optimize.opt_after_cconv.c_1 : 0.000112s : 0.10% optimize.opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% optimize.opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.01% optimize.opt_after_cconv.updatestate_assign_eliminate : 0.000010s : 0.01% optimize.opt_after_cconv.updatestate_loads_eliminate : 0.000013s : 0.01% optimize.opt_after_cconv.cse : 0.000060s : 0.05% optimize.opt_after_cconv.renormalize : 0.000001s : 0.00% optimize.remove_dup_value : 0.000069s : 0.06% optimize.tuple_transform.d_1 : 0.000112s : 0.10% optimize.tuple_transform.none_parameter_eliminate : 0.000003s : 0.00% optimize.tuple_transform.renormalize : 0.000000s : 0.00% optimize.tuple_transform.switch_simplify : 0.000017s : 0.02% optimize.partial_unused_args_eliminate : 0.000003s : 0.00% optimize.add_recomputation : 0.000123s : 0.11% optimize.cse_after_recomputation.cse : 0.000044s : 0.04% optimize.environ_conv : 0.000017s : 0.02% optimize.swap_dp_allreduce_reducescatter : 0.000014s : 0.01% optimize.bias_add_comm_swap : 0.000003s : 0.00% optimize.label_micro_interleaved_index : 0.000006s : 0.01% optimize.label_fine_grained_interleaved_index : 0.000003s : 0.00% optimize.merge_cast_opt : 0.000002s : 0.00% optimize.slice_recompute_activation : 0.000003s : 0.00% optimize.micro_interleaved_order_control : 0.000003s : 0.00% optimize.assign_add_opt : 0.000002s : 0.00% optimize.ForceFp32Comm : 0.000001s : 0.00% optimize.remove_cast_before_assign_add : 0.000001s : 0.00% optimize.full_micro_interleaved_order_control : 0.000003s : 0.00% optimize.reorder_send_recv_between_fp_bp : 0.000003s : 0.00% optimize.comm_op_add_attrs : 0.000001s : 0.00% optimize.add_comm_op_reuse_tag : 0.000001s : 0.00% optimize.interleave_split_concat_branches : 0.000001s : 0.00% optimize.interleave_parallel_branches : 0.000001s : 0.00% optimize.overlap_opt_shard_in_pipeline : 0.000002s : 0.00% optimize.overlap_opt_shard_grad_in_pipeline : 0.000002s : 0.00% optimize.control_data_broadcast_order : 0.000035s : 0.03% optimize.grouped_pairwise_exchange_alltoall : 0.000002s : 0.00% optimize.offloading_packed_experts : 0.000011s : 0.01% optimize.overlap_recompute_and_grad_model_parallel : 0.000011s : 0.01% optimize.overlap_grad_matmul_and_grad_allreduce : 0.000001s : 0.00% optimize.overlap_recompute_allgather_and_fa_grad : 0.000002s : 0.00% optimize.overlap_recompute_comm : 0.000003s : 0.00% optimize.overlap_grad_ring_attention : 0.000010s : 0.01% optimize.overlap_grad_flash_sp : 0.000050s : 0.04% optimize.begin_end_overlap_inline : 0.000001s : 0.00% optimize.split_matmul_comm_elemetwise : 0.000002s : 0.00% optimize.split_layernorm_comm : 0.000002s : 0.00% optimize.handle_group_info : 0.000001s : 0.00% optimize.symbol_engine_optimizer.build : 0.000015s : 0.01% optimize.symbol_engine_optimizer.elim_shapecalc : 0.000026s : 0.02% optimize.symbol_engine_optimizer.elim_not_effective : 0.000037s : 0.03% optimize.symbol_engine_optimizer.opt_reshape : 0.000020s : 0.02% optimize.symbol_engine_optimizer.fold_const_symbol : 0.000032s : 0.03% optimize.symbol_engine_optimizer.renormalize : 0.000000s : 0.00% detach_backward : 0.000003s : 0.00% pipeline_parallel_scheduler : 0.000002s : 0.00% auto_monad_reorder : 0.000077s : 0.07% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000694s : 0.61% validate : 0.000082s : 0.07% Time group info: ------[substitution.] 0.000566 165 1.94% : 0.000011s : 2: substitution.depend_value_elim 1.03% : 0.000006s : 9: substitution.elim_not_effective 0.82% : 0.000005s : 9: substitution.fold_const_symbol 1.96% : 0.000011s : 12: substitution.graph_param_transform 59.66% : 0.000338s : 11: substitution.inline 1.59% : 0.000009s : 18: substitution.j_node_and_user_rematch 3.77% : 0.000021s : 4: substitution.less_batch_normalization 1.63% : 0.000009s : 12: substitution.load_eliminater 2.45% : 0.000014s : 18: substitution.remove_not_recompute_node 1.33% : 0.000008s : 6: substitution.replace_old_param 1.96% : 0.000011s : 2: substitution.switch_simplify 5.47% : 0.000031s : 30: substitution.updatestate_pure_node_eliminater 16.40% : 0.000093s : 32: substitution.updatestate_useless_node_eliminater ------[type_inference.] 0.090893 2 97.06% : 0.088221s : 1: type_inference.infer 2.94% : 0.002671s : 1: type_inference.specialize ------[replace.] 0.000149 13 59.66% : 0.000089s : 11: replace.inline 40.34% : 0.000060s : 2: replace.switch_simplify ------[match.] 0.000341 13 97.20% : 0.000331s : 11: match.inline 2.80% : 0.000010s : 2: match.switch_simplify ------[predicate.] 0.000649 4059 1.04% : 0.000007s : 49: predicate.accumulaten_eliminater 0.72% : 0.000005s : 12: predicate.ad_related_special_op_eliminate 0.52% : 0.000003s : 24: predicate.addn_check_dump 1.19% : 0.000008s : 49: predicate.addn_zero_filter 1.03% : 0.000007s : 49: predicate.adjust_all_reduce_mul_add 2.11% : 0.000014s : 73: predicate.arithmetic_simplify 1.18% : 0.000008s : 49: predicate.cast_eliminate 0.55% : 0.000004s : 24: predicate.check_bprop_eliminate 0.51% : 0.000003s : 24: predicate.compare_switch_simplify 0.17% : 0.000001s : 12: predicate.const_output_eliminate 0.53% : 0.000003s : 24: predicate.depend_value_elim 1.15% : 0.000007s : 49: predicate.dict_get_item_const_eliminator 1.17% : 0.000008s : 49: predicate.dict_get_item_eliminator 1.09% : 0.000007s : 49: predicate.dict_set_item_eliminator 0.88% : 0.000006s : 24: predicate.dumpgradient_eliminate 0.18% : 0.000001s : 12: predicate.elim_not_effective 0.37% : 0.000002s : 12: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000009s : 61: predicate.environ_add_const_eliminate 1.28% : 0.000008s : 61: predicate.environ_get_add_eliminate 1.30% : 0.000008s : 61: predicate.environ_get_depend_swap 1.82% : 0.000012s : 85: predicate.environ_get_eliminate 1.30% : 0.000008s : 61: predicate.environ_get_set_eliminate 1.33% : 0.000009s : 60: predicate.exchange_switch_depend_value 1.85% : 0.000012s : 60: predicate.float_depend_g_call 0.50% : 0.000003s : 24: predicate.float_environ_get_switch 0.74% : 0.000005s : 36: predicate.float_tuple_getitem_switch 0.16% : 0.000001s : 12: predicate.fold_const_symbol 0.56% : 0.000004s : 24: predicate.get_grad_eliminate 0.21% : 0.000001s : 12: predicate.graph_param_transform 0.58% : 0.000004s : 24: predicate.incorporate_call 0.48% : 0.000003s : 24: predicate.incorporate_call_switch 5.37% : 0.000035s : 181: predicate.inline 0.77% : 0.000005s : 24: predicate.inline_without_move 0.27% : 0.000002s : 24: predicate.j_node_and_user_rematch 0.78% : 0.000005s : 24: predicate.less_batch_normalization 1.70% : 0.000011s : 73: predicate.list_to_tuple_eliminator_ 2.75% : 0.000018s : 122: predicate.load_eliminater 0.68% : 0.000004s : 12: predicate.loop_unroll_after_grad 1.74% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.80% : 0.000012s : 73: predicate.make_slice_get_slice_eliminator 0.54% : 0.000004s : 24: predicate.merge_addn 0.54% : 0.000003s : 24: predicate.micro_step_allgather_replace 0.54% : 0.000003s : 24: predicate.mini_step_allgather_replace 1.00% : 0.000007s : 49: predicate.minmaximum_grad 0.72% : 0.000005s : 12: predicate.mutable_eliminate 0.33% : 0.000002s : 12: predicate.opt_reshape 0.33% : 0.000002s : 12: predicate.parallel_virtual_node 1.53% : 0.000010s : 60: predicate.partial_defer_inline 1.51% : 0.000010s : 61: predicate.partial_eliminate 1.03% : 0.000007s : 49: predicate.print_const_string_wrapper 0.53% : 0.000003s : 24: predicate.reduce_all_const_elim 1.33% : 0.000009s : 49: predicate.reduce_eliminate 2.58% : 0.000017s : 122: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000002s : 24: predicate.remove_not_recompute_node 1.20% : 0.000008s : 73: predicate.replace_applicator 0.38% : 0.000002s : 24: predicate.replace_old_param 0.27% : 0.000002s : 12: predicate.reset_defer_inline 1.08% : 0.000007s : 49: predicate.reshape_eliminate 0.60% : 0.000004s : 24: predicate.row_tensor_add_zeros_like 0.33% : 0.000002s : 12: predicate.row_tensor_eliminate 0.69% : 0.000005s : 24: predicate.same_eliminate 0.41% : 0.000003s : 32: predicate.set_cell_output_no_recompute 0.67% : 0.000004s : 24: predicate.shard_identity_eliminate 0.66% : 0.000004s : 24: predicate.special_op_eliminate 0.69% : 0.000004s : 24: predicate.specialize_transform 0.91% : 0.000006s : 24: predicate.split_environ_get_set_with_tuple_value 0.66% : 0.000004s : 24: predicate.stack_unstack_eliminate 0.28% : 0.000002s : 12: predicate.switch_call_monad_eliminater 1.42% : 0.000009s : 60: predicate.switch_defer_inline 1.87% : 0.000012s : 84: predicate.switch_layer_defer_inline 6.99% : 0.000045s : 178: predicate.switch_simplify 1.05% : 0.000007s : 49: predicate.tile_eliminate 1.06% : 0.000007s : 49: predicate.transpose_eliminate 1.76% : 0.000011s : 73: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000011s : 73: predicate.tuple_list_get_item_const_eliminator 1.67% : 0.000011s : 73: predicate.tuple_list_get_item_depend_reorder 2.68% : 0.000017s : 97: predicate.tuple_list_get_item_eliminator 1.71% : 0.000011s : 73: predicate.tuple_list_get_set_item_eliminator 2.45% : 0.000016s : 97: predicate.tuple_list_set_item_eliminator 1.62% : 0.000010s : 73: predicate.tuple_to_list_eliminator_ 2.80% : 0.000018s : 122: predicate.updatestate_pure_node_eliminater 3.66% : 0.000024s : 146: predicate.updatestate_useless_node_eliminater 0.35% : 0.000002s : 12: predicate.value_based_eliminate 0.58% : 0.000004s : 24: predicate.virtual_dataset_eliminate 0.57% : 0.000004s : 24: predicate.virtual_output_eliminate 0.28% : 0.000002s : 12: predicate.virtual_view_grad_eliminate 0.32% : 0.000002s : 12: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001493 18 39.55% : 0.000591s : 5: func_graph_cloner_run.FuncGraphClonerGraph 60.45% : 0.000903s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158899 192 0.00% : 0.000004s : 1: ForceFp32Comm 2.36% : 0.003749s : 1: add_attr 2.35% : 0.003736s : 1: add_attr_with_inline 0.00% : 0.000004s : 1: add_comm_op_reuse_tag 0.08% : 0.000130s : 1: add_recomputation 0.00% : 0.000004s : 1: assign_add_opt 0.30% : 0.000471s : 1: auto_monad 0.05% : 0.000084s : 1: auto_monad_reorder 0.00% : 0.000004s : 1: begin_end_overlap_inline 0.00% : 0.000006s : 1: bias_add_comm_swap 0.63% : 0.001000s : 1: bootstrap 0.03% : 0.000045s : 1: cconv 0.00% : 0.000005s : 1: comm_op_add_attrs 0.03% : 0.000040s : 1: control_data_broadcast_order 0.01% : 0.000024s : 1: convert_after_rewriter 0.04% : 0.000061s : 1: cse_after_recomputation 0.00% : 0.000005s : 1: dataset_repeat_opt 0.00% : 0.000007s : 1: detach_backward 0.01% : 0.000022s : 1: environ_conv 0.11% : 0.000170s : 1: event_method 0.00% : 0.000006s : 1: full_micro_interleaved_order_control 0.00% : 0.000008s : 1: get_jit_bprop_graph 0.01% : 0.000016s : 1: graph_reusing 0.00% : 0.000005s : 1: grouped_pairwise_exchange_alltoall 0.00% : 0.000005s : 1: handle_group_info 0.00% : 0.000007s : 1: inline 0.00% : 0.000007s : 1: insert-virtual-dataset 0.00% : 0.000004s : 1: interleave_parallel_branches 0.00% : 0.000004s : 1: interleave_split_concat_branches 0.00% : 0.000007s : 1: label_fine_grained_interleaved_index 0.01% : 0.000010s : 1: label_micro_interleaved_index 0.38% : 0.000602s : 1: loop_unroll 0.00% : 0.000004s : 1: merge_cast_opt 0.00% : 0.000007s : 1: micro_interleaved_order_control 0.55% : 0.000866s : 1: mutable_eliminate 0.01% : 0.000014s : 1: offloading_packed_experts 0.02% : 0.000032s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000037s : 1: opt.transform.mutable_eliminate 2.33% : 0.003703s : 78: opt.transform.opt_a 0.07% : 0.000110s : 1: opt.transform.opt_after_cconv 0.04% : 0.000066s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000352s : 28: opt.transform.opt_b 0.08% : 0.000126s : 2: opt.transform.opt_trans_graph 0.07% : 0.000109s : 4: opt.transform.symbol_engine_opt 10.63% : 0.016886s : 1: opt_a 0.22% : 0.000354s : 1: opt_after_cconv 0.45% : 0.000709s : 1: opt_after_jit_grad 0.36% : 0.000565s : 1: opt_b 13.18% : 0.020937s : 1: optimize 0.02% : 0.000039s : 1: optimize_parallel_all_gather_comm 0.01% : 0.000016s : 1: order_py_execute_after_rewriter 0.03% : 0.000055s : 1: overlap_grad_flash_sp 0.00% : 0.000005s : 1: overlap_grad_matmul_and_grad_allreduce 0.01% : 0.000016s : 1: overlap_grad_ring_attention 0.00% : 0.000005s : 1: overlap_opt_shard_grad_in_pipeline 0.00% : 0.000005s : 1: overlap_opt_shard_in_pipeline 0.00% : 0.000007s : 1: overlap_param_gather 0.00% : 0.000005s : 1: overlap_recompute_allgather_and_fa_grad 0.01% : 0.000016s : 1: overlap_recompute_and_grad_model_parallel 0.00% : 0.000006s : 1: overlap_recompute_comm 0.01% : 0.000008s : 1: parallel-infer-symbol 0.00% : 0.000004s : 1: parallel-infer-symbol-second 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pipeline_parallel_scheduler 0.00% : 0.000005s : 1: pipeline_split 0.04% : 0.000071s : 1: pre_auto_parallel 0.04% : 0.000058s : 1: py_interpret_to_execute 0.02% : 0.000035s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000004s : 1: remove_cast_before_assign_add 0.05% : 0.000074s : 1: remove_dup_value 6.46% : 0.010259s : 1: renormalize.infer 0.76% : 0.001214s : 1: renormalize.specialize 0.00% : 0.000006s : 1: reorder_send_recv_between_fp_bp 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000264s : 1: rewriter_after_opt_a 0.10% : 0.000159s : 1: rewriter_before_opt_a 0.00% : 0.000006s : 1: slice_cell_reuse_recomputed_activation 0.00% : 0.000005s : 1: slice_recompute_activation 0.00% : 0.000005s : 1: split_layernorm_comm 0.00% : 0.000006s : 1: split_matmul_comm_elemetwise 0.01% : 0.000018s : 1: swap_dp_allreduce_reducescatter 0.11% : 0.000181s : 1: symbol_engine_optimizer 0.11% : 0.000170s : 1: tuple_transform 57.28% : 0.091019s : 1: type_inference . [hook] pytest_runtest_teardown:test_mint_optim_fused_adamw_basic_maximize[0] tests/st/mint/optim/test_fused_adamw.py::test_mint_optim_fused_adamw_basic_maximize[0],max_mem:20.0M [WARNING] ME(163641:281473434586928,MainProcess):2026-01-29-17:44:33.288.291 [mindspore/graph/api.py:128] The function "train_step" at the file "/home/jenkins/mindspore/testcases/testcases/tests/st/mint/optim/test_fused_adamw.py", line 217 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. [WARNING] ANALYZER(163641,ffffa4150f30,python3.9):2026-01-29-17:44:34.518.954 [mindspore/ccsrc/frontend/jit/ps/static_analysis/auto_monad.cc:1601] ClearIsolatedNodes] Some side effect nodes were eliminated by mistake. The node is:@426_train_step_101:_{[0]: ValueNode 575__tuple_getitem_by_number_102, [1]: CNode_103, [2]: ValueNode 1} TotalTime = 1.66452, [30] [bootstrap]: 0.00060002 [type_inference]: 1.22729 [event_method]: 0.00036084 [auto_monad]: 0.00362324 [graph_reusing]: 0.00014307 [pre_auto_parallel]: 2.247e-05 [py_interpret_to_execute]: 0.00067832 [rewriter_before_opt_a]: 0.0059023 [expand_dump_flag]: 4.905e-05 [jit_opt_a]: 0.419991, [4] [Cycle 1]: 0.276855, [27] [switch_simplify]: 0.00149628 [loop_unroll]: 0.0430101 [a_1]: 0.0692959 [with_stream_mark]: 0.00021377 [recompute_prepare]: 0.00012791 [updatestate_depend_eliminate]: 0.00059926 [updatestate_assign_eliminate]: 5.14e-05 [updatestate_loads_eliminate]: 0.00012597 [parameter_eliminate]: 4.99e-06 [specialize_transform]: 8.331e-05 [updatestate_useless_node_eliminater]: 9.732e-05 [accelerated_algorithm]: 0.00012961 [meta_shard_fg_expand]: 4.26e-05 [get_grad_eliminate_]: 6.279e-05 [merge_forward]: 3.649e-05 [cell_reuse_recompute_pass]: 2.73998e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00012185 [j_node_and_user_rematch]: 0.00010885 [meta_fg_expand]: 0.040206 [replace_old_param]: 0.00035589 [inline_without_move]: 0.00041577 [renormalize]: 0.117165 [add_forward_monad_depend]: 7.766e-05 [auto_monad_grad]: 4.403e-05 [auto_monad_eliminator]: 0.00058986 [cse]: 0.00115393 [replace_applicator]: 0.00069073 [Cycle 2]: 0.0633919, [27] [switch_simplify]: 0.00032451 [loop_unroll]: 0.0003134 [a_1]: 0.0502388 [with_stream_mark]: 0.00020888 [recompute_prepare]: 7.162e-05 [updatestate_depend_eliminate]: 0.00010272 [updatestate_assign_eliminate]: 3.915e-05 [updatestate_loads_eliminate]: 0.00011783 [parameter_eliminate]: 3.13e-06 [specialize_transform]: 5.747e-05 [updatestate_useless_node_eliminater]: 8.007e-05 [accelerated_algorithm]: 5.868e-05 [meta_shard_fg_expand]: 2.275e-05 [get_grad_eliminate_]: 4.804e-05 [merge_forward]: 2.991e-05 [cell_reuse_recompute_pass]: 2.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.258e-05 [j_node_and_user_rematch]: 8.099e-05 [meta_fg_expand]: 0.00108164 [replace_old_param]: 8.325e-05 [inline_without_move]: 6.256e-05 [renormalize]: 0.00934489 [add_forward_monad_depend]: 1.501e-05 [auto_monad_grad]: 3.76999e-06 [auto_monad_eliminator]: 0.00017387 [cse]: 0.00021571 [replace_applicator]: 0.00013261 [Cycle 3]: 0.00600624, [27] [switch_simplify]: 4.869e-05 [loop_unroll]: 4.402e-05 [a_1]: 0.00144209 [with_stream_mark]: 4.798e-05 [recompute_prepare]: 4.632e-05 [updatestate_depend_eliminate]: 3.168e-05 [updatestate_assign_eliminate]: 3.111e-05 [updatestate_loads_eliminate]: 3.432e-05 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 4.57e-05 [updatestate_useless_node_eliminater]: 6.138e-05 [accelerated_algorithm]: 5.289e-05 [meta_shard_fg_expand]: 1.181e-05 [get_grad_eliminate_]: 4.271e-05 [merge_forward]: 2.698e-05 [cell_reuse_recompute_pass]: 3.83001e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.438e-05 [j_node_and_user_rematch]: 7.401e-05 [meta_fg_expand]: 1.938e-05 [replace_old_param]: 5.689e-05 [inline_without_move]: 4.438e-05 [renormalize]: 0.00312023 [add_forward_monad_depend]: 1.261e-05 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 0.00012419 [cse]: 0.00019716 [replace_applicator]: 6.806e-05 [Cycle 4]: 0.0680875, [27] [switch_simplify]: 4.515e-05 [loop_unroll]: 4.404e-05 [a_1]: 0.066688 [with_stream_mark]: 7.889e-05 [recompute_prepare]: 5.25e-05 [updatestate_depend_eliminate]: 3.39e-05 [updatestate_assign_eliminate]: 3.081e-05 [updatestate_loads_eliminate]: 3.289e-05 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 4.54e-05 [updatestate_useless_node_eliminater]: 6.393e-05 [accelerated_algorithm]: 5.563e-05 [meta_shard_fg_expand]: 2.284e-05 [get_grad_eliminate_]: 4.306e-05 [merge_forward]: 2.748e-05 [cell_reuse_recompute_pass]: 4.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.603e-05 [j_node_and_user_rematch]: 7.544e-05 [meta_fg_expand]: 1.912e-05 [replace_old_param]: 5.636e-05 [inline_without_move]: 4.311e-05 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 4.73001e-06 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 0.00011198 [cse]: 0.0001724 [replace_applicator]: 4.551e-05 [py_interpret_to_execute_after_opt_a]: 5.62e-05 [rewriter_after_opt_a]: 0.00043364 [convert_after_rewriter]: 3.862e-05 [order_py_execute_after_rewriter]: 2.597e-05 [mutable_eliminate]: 0.00084277 [jit_opt_b]: 0.00030809, [1] [Cycle 1]: 0.00029879, [2] [frontend_op_eliminate]: 0.00016191 [inline_after_opt_a]: 0.00012036 [cconv]: 5.399e-05 [loop_unroll]: 0.0005074 [jit_opt_after_cconv]: 0.0007915, [1] [Cycle 1]: 0.00078262, [11] [c_1]: 0.00026422 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 3.857e-05 [updatestate_assign_eliminate]: 3.589e-05 [updatestate_loads_eliminate]: 3.099e-05 [cse]: 0.0001471 [call_graph_tuple_transform]: 0.00010801 [tuple_list_get_item_eliminator]: 4.381e-05 [none_parameter_eliminate]: 2.19001e-06 [renormalize]: 1.04998e-06 [switch_simplify]: 4.369e-05 [remove_dup_value]: 0.00015033 [partial_unused_args_eliminate]: 3.31001e-06 [environ_conv]: 3.228e-05 [add_recomputation]: 0.00028465 [cse_after_recomputation]: 0.00014094, [1] [Cycle 1]: 0.0001336, [1] [cse]: 0.0001232 [auto_monad_reorder]: 0.00011761 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 0.00032689 [opt_after_jit_grad]: 0.00075817 [symbol_engine_optimizer]: 0.00032075, [1] [Cycle 1]: 0.00031297, [6] [build]: 2.471e-05 [elim_shapecalc]: 5.067e-05 [elim_not_effective]: 8.064e-05 [opt_reshape]: 4.786e-05 [fold_const_symbol]: 7.31e-05 [renormalize]: 7.00005e-07 [validate]: 0.00016343 Sums bootstrap : 0.000600s : 0.04% type_inference : 1.227294s : 74.07% event_method : 0.000361s : 0.02% auto_monad : 0.003623s : 0.22% graph_reusing : 0.000143s : 0.01% pre_auto_parallel : 0.000022s : 0.00% py_interpret_to_execute : 0.000678s : 0.04% rewriter_before_opt_a : 0.005902s : 0.36% expand_dump_flag : 0.000049s : 0.00% jit_opt_a.switch_simplify : 0.001915s : 0.12% jit_opt_a.loop_unroll : 0.043412s : 2.62% jit_opt_a.a_1 : 0.187665s : 11.33% jit_opt_a.with_stream_mark : 0.000550s : 0.03% jit_opt_a.recompute_prepare : 0.000298s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000768s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000152s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000311s : 0.02% jit_opt_a.parameter_eliminate : 0.000013s : 0.00% jit_opt_a.specialize_transform : 0.000232s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000303s : 0.02% jit_opt_a.accelerated_algorithm : 0.000297s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000100s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000197s : 0.01% jit_opt_a.merge_forward : 0.000121s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000014s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000385s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000339s : 0.02% jit_opt_a.meta_fg_expand : 0.041326s : 2.49% jit_opt_a.replace_old_param : 0.000552s : 0.03% jit_opt_a.inline_without_move : 0.000566s : 0.03% jit_opt_a.renormalize : 0.129631s : 7.82% jit_opt_a.add_forward_monad_depend : 0.000110s : 0.01% jit_opt_a.auto_monad_grad : 0.000054s : 0.00% jit_opt_a.auto_monad_eliminator : 0.001000s : 0.06% jit_opt_a.cse : 0.001739s : 0.10% jit_opt_a.replace_applicator : 0.000937s : 0.06% py_interpret_to_execute_after_opt_a : 0.000056s : 0.00% rewriter_after_opt_a : 0.000434s : 0.03% convert_after_rewriter : 0.000039s : 0.00% order_py_execute_after_rewriter : 0.000026s : 0.00% mutable_eliminate : 0.000843s : 0.05% jit_opt_b.frontend_op_eliminate : 0.000162s : 0.01% jit_opt_b.inline_after_opt_a : 0.000120s : 0.01% cconv : 0.000054s : 0.00% loop_unroll : 0.000507s : 0.03% jit_opt_after_cconv.c_1 : 0.000264s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000039s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000036s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000031s : 0.00% jit_opt_after_cconv.cse : 0.000147s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000108s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000044s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000044s : 0.00% remove_dup_value : 0.000150s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000032s : 0.00% add_recomputation : 0.000285s : 0.02% cse_after_recomputation.cse : 0.000123s : 0.01% auto_monad_reorder : 0.000118s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000327s : 0.02% opt_after_jit_grad : 0.000758s : 0.05% symbol_engine_optimizer.build : 0.000025s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000051s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000081s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000048s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000073s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000163s : 0.01% Time group info: ------[substitution.] 0.099741 1549 0.10% : 0.000096s : 5: substitution.arithmetic_simplify 0.03% : 0.000031s : 3: substitution.cast_eliminate 0.14% : 0.000140s : 51: substitution.depend_value_elim 0.01% : 0.000011s : 32: substitution.elim_not_effective 0.01% : 0.000010s : 4: substitution.environ_get_add_eliminate 0.00% : 0.000004s : 2: substitution.environ_get_depend_swap 0.01% : 0.000010s : 4: substitution.environ_get_eliminate 0.02% : 0.000022s : 4: substitution.environ_get_set_eliminate 0.01% : 0.000010s : 32: substitution.fold_const_symbol 1.71% : 0.001710s : 8: substitution.getattr_setattr_resolve 0.03% : 0.000029s : 43: substitution.graph_param_transform 95.29% : 0.095046s : 174: substitution.inline 0.13% : 0.000135s : 12: substitution.inline_without_move 0.06% : 0.000057s : 147: substitution.j_node_and_user_rematch 0.06% : 0.000062s : 17: substitution.less_batch_normalization 0.03% : 0.000033s : 1: substitution.list_to_tuple_eliminator_ 0.03% : 0.000035s : 30: substitution.load_eliminater 0.10% : 0.000102s : 69: substitution.minmaximum_grad 0.00% : 0.000002s : 1: substitution.opt_reshape 0.04% : 0.000040s : 12: substitution.partial_eliminate 0.03% : 0.000029s : 6: substitution.reduce_eliminate 0.01% : 0.000007s : 5: substitution.redundant_stop_gradient_eliminater 0.08% : 0.000082s : 147: substitution.remove_not_recompute_node 0.19% : 0.000194s : 55: substitution.replace_applicator 0.05% : 0.000051s : 72: substitution.replace_old_param 0.09% : 0.000094s : 14: substitution.reshape_eliminate 0.01% : 0.000005s : 1: substitution.set_cell_output_no_recompute 0.00% : 0.000005s : 3: substitution.split_environ_get_set_with_tuple_value 0.08% : 0.000079s : 34: substitution.switch_simplify 0.01% : 0.000006s : 1: substitution.tile_eliminate 0.34% : 0.000340s : 79: substitution.tuple_list_convert_item_index_to_positive 0.30% : 0.000295s : 88: substitution.tuple_list_get_item_depend_reorder 0.51% : 0.000508s : 167: substitution.tuple_list_get_item_eliminator 0.15% : 0.000145s : 101: substitution.updatestate_pure_node_eliminater 0.32% : 0.000317s : 125: substitution.updatestate_useless_node_eliminater ------[type_inference.] 1.226501 2 92.18% : 1.130540s : 1: type_inference.infer 7.82% : 0.095962s : 1: type_inference.specialize ------[replace.] 0.003831 322 0.37% : 0.000014s : 1: replace.arithmetic_simplify 0.93% : 0.000036s : 3: replace.cast_eliminate 1.18% : 0.000045s : 5: replace.depend_value_elim 0.93% : 0.000036s : 2: replace.environ_get_set_eliminate 3.72% : 0.000143s : 6: replace.getattr_setattr_resolve 47.75% : 0.001830s : 174: replace.inline 0.58% : 0.000022s : 1: replace.list_to_tuple_eliminator_ 0.92% : 0.000035s : 2: replace.partial_eliminate 2.70% : 0.000103s : 3: replace.replace_applicator 0.15% : 0.000006s : 1: replace.reshape_eliminate 12.29% : 0.000471s : 34: replace.switch_simplify 3.57% : 0.000137s : 9: replace.tuple_list_get_item_depend_reorder 24.36% : 0.000933s : 79: replace.tuple_list_get_item_eliminator 0.54% : 0.000021s : 2: replace.updatestate_useless_node_eliminater ------[match.] 0.057052 322 0.08% : 0.000044s : 1: match.arithmetic_simplify 0.05% : 0.000029s : 3: match.cast_eliminate 0.02% : 0.000011s : 5: match.depend_value_elim 0.03% : 0.000018s : 2: match.environ_get_set_eliminate 2.82% : 0.001610s : 6: match.getattr_setattr_resolve 96.12% : 0.054838s : 174: match.inline 0.06% : 0.000032s : 1: match.list_to_tuple_eliminator_ 0.03% : 0.000019s : 2: match.partial_eliminate 0.06% : 0.000034s : 3: match.replace_applicator 0.00% : 0.000002s : 1: match.reshape_eliminate 0.11% : 0.000062s : 34: match.switch_simplify 0.21% : 0.000121s : 9: match.tuple_list_get_item_depend_reorder 0.38% : 0.000215s : 79: match.tuple_list_get_item_eliminator 0.03% : 0.000017s : 2: match.updatestate_useless_node_eliminater ------[predicate.] 0.005337 34229 1.58% : 0.000084s : 587: predicate.accumulaten_eliminater 0.22% : 0.000012s : 43: predicate.ad_related_special_op_eliminate 1.44% : 0.000077s : 587: predicate.addn_check_dump 1.58% : 0.000084s : 587: predicate.addn_zero_filter 1.98% : 0.000106s : 588: predicate.arithmetic_simplify 1.56% : 0.000083s : 592: predicate.cast_eliminate 0.11% : 0.000006s : 43: predicate.check_bprop_eliminate 1.49% : 0.000079s : 587: predicate.compare_switch_simplify 1.61% : 0.000086s : 587: predicate.depend_value_elim 1.45% : 0.000077s : 594: predicate.dict_get_item_const_eliminator 1.58% : 0.000085s : 594: predicate.dict_get_item_eliminator 1.48% : 0.000079s : 594: predicate.dict_set_item_eliminator 0.15% : 0.000008s : 43: predicate.dumpgradient_eliminate 0.07% : 0.000004s : 43: predicate.elim_not_effective 0.12% : 0.000006s : 43: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000079s : 592: predicate.environ_add_const_eliminate 1.45% : 0.000078s : 594: predicate.environ_get_add_eliminate 1.45% : 0.000077s : 592: predicate.environ_get_depend_swap 1.52% : 0.000081s : 594: predicate.environ_get_eliminate 1.47% : 0.000079s : 594: predicate.environ_get_set_eliminate 0.06% : 0.000003s : 43: predicate.fold_const_symbol 0.54% : 0.000029s : 198: predicate.get_grad_eliminate 0.29% : 0.000015s : 40: predicate.getattr_setattr_resolve 0.06% : 0.000003s : 43: predicate.graph_param_transform 4.22% : 0.000225s : 947: predicate.inline 1.34% : 0.000071s : 404: predicate.inline_without_move 0.27% : 0.000014s : 198: predicate.j_node_and_user_rematch 0.66% : 0.000035s : 208: predicate.less_batch_normalization 1.74% : 0.000093s : 683: predicate.list_to_tuple_eliminator_ 1.92% : 0.000102s : 728: predicate.load_eliminater 0.18% : 0.000010s : 43: predicate.loop_unroll_after_grad 5.29% : 0.000282s : 1170: predicate.loop_unroll_before_grad 1.78% : 0.000095s : 646: predicate.make_slice_get_slice_eliminator 1.46% : 0.000078s : 587: predicate.merge_addn 1.48% : 0.000079s : 588: predicate.minmaximum_grad 0.19% : 0.000010s : 43: predicate.mutable_eliminate 0.12% : 0.000006s : 43: predicate.opt_reshape 2.27% : 0.000121s : 728: predicate.partial_eliminate 1.44% : 0.000077s : 582: predicate.print_const_string_wrapper 1.88% : 0.000100s : 588: predicate.reduce_eliminate 1.77% : 0.000094s : 685: predicate.redundant_stop_gradient_eliminater 0.28% : 0.000015s : 198: predicate.remove_not_recompute_node 3.93% : 0.000210s : 1167: predicate.replace_applicator 0.59% : 0.000031s : 404: predicate.replace_old_param 0.07% : 0.000004s : 43: predicate.reset_defer_inline 1.51% : 0.000081s : 589: predicate.reshape_eliminate 1.52% : 0.000081s : 582: predicate.row_tensor_add_zeros_like 0.13% : 0.000007s : 43: predicate.row_tensor_eliminate 1.51% : 0.000081s : 582: predicate.same_eliminate 0.37% : 0.000020s : 243: predicate.set_cell_output_no_recompute 0.24% : 0.000013s : 86: predicate.special_op_eliminate 0.60% : 0.000032s : 198: predicate.specialize_transform 1.71% : 0.000091s : 582: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000077s : 582: predicate.stack_unstack_eliminate 0.12% : 0.000006s : 43: predicate.switch_call_monad_eliminater 4.02% : 0.000214s : 861: predicate.switch_defer_inline 2.52% : 0.000135s : 861: predicate.switch_layer_defer_inline 6.45% : 0.000344s : 2142: predicate.switch_simplify 1.64% : 0.000087s : 588: predicate.tile_eliminate 1.46% : 0.000078s : 588: predicate.transpose_eliminate 1.96% : 0.000104s : 594: predicate.tuple_list_convert_item_index_to_positive 1.83% : 0.000098s : 603: predicate.tuple_list_get_item_depend_reorder 3.10% : 0.000165s : 768: predicate.tuple_list_get_item_eliminator 1.92% : 0.000102s : 603: predicate.tuple_list_set_item_eliminator 1.71% : 0.000091s : 682: predicate.tuple_to_list_eliminator_ 1.91% : 0.000102s : 728: predicate.updatestate_pure_node_eliminater 2.63% : 0.000140s : 928: predicate.updatestate_useless_node_eliminater 1.88% : 0.000100s : 582: predicate.value_based_eliminate 0.11% : 0.000006s : 43: predicate.virtual_view_grad_eliminate 0.13% : 0.000007s : 43: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.039940 415 71.15% : 0.028417s : 212: func_graph_cloner_run.FuncGraphClonerGraph 28.85% : 0.011523s : 203: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 2.033942 106 0.01% : 0.000289s : 1: add_recomputation 0.18% : 0.003638s : 1: auto_monad 0.01% : 0.000122s : 1: auto_monad_reorder 0.03% : 0.000624s : 1: bootstrap 0.00% : 0.000057s : 1: cconv 0.00% : 0.000042s : 1: convert_after_rewriter 0.01% : 0.000144s : 1: cse_after_recomputation 0.00% : 0.000035s : 1: environ_conv 0.02% : 0.000370s : 1: event_method 0.00% : 0.000057s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000150s : 1: graph_reusing 20.65% : 0.419995s : 1: jit_opt_a 0.04% : 0.000795s : 1: jit_opt_after_cconv 0.02% : 0.000311s : 1: jit_opt_b 0.03% : 0.000517s : 1: loop_unroll 0.04% : 0.000852s : 1: mutable_eliminate 11.65% : 0.236968s : 52: opt.transform.jit_opt_a 0.02% : 0.000455s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000274s : 4: opt.transform.jit_opt_b 0.00% : 0.000056s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000061s : 1: opt.transform.mutable_eliminate 0.01% : 0.000194s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.001985s : 4: opt.transform.opt_resolve 0.01% : 0.000248s : 4: opt.transform.symbol_engine_opt 0.04% : 0.000770s : 1: opt_after_jit_grad 0.00% : 0.000029s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000026s : 1: pre_auto_parallel 0.03% : 0.000687s : 1: py_interpret_to_execute 0.00% : 0.000059s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000155s : 1: remove_dup_value 3.92% : 0.079638s : 3: renormalize.infer 2.46% : 0.049937s : 3: renormalize.specialize 0.02% : 0.000332s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000439s : 1: rewriter_after_opt_a 0.29% : 0.005980s : 1: rewriter_before_opt_a 0.02% : 0.000324s : 1: symbol_engine_optimizer 60.34% : 1.227316s : 1: type_inference [WARNING] ME(163641:281473434586928,MainProcess):2026-01-29-17:44:36.248.747 [mindspore/graph/api.py:128] The function "train_step" at the file "/home/jenkins/mindspore/testcases/testcases/tests/st/mint/optim/test_fused_adamw.py", line 217 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. [WARNING] ANALYZER(163641,ffffa4150f30,python3.9):2026-01-29-17:44:37.473.071 [mindspore/ccsrc/frontend/jit/ps/static_analysis/auto_monad.cc:1601] ClearIsolatedNodes] Some side effect nodes were eliminated by mistake. The node is:@629_train_step_126:_{[0]: ValueNode 778__tuple_getitem_by_number_127, [1]: CNode_128, [2]: ValueNode 1} TotalTime = 1.75927, [30] [bootstrap]: 0.00030814 [type_inference]: 1.22162 [event_method]: 0.0004588 [auto_monad]: 0.00274006 [graph_reusing]: 0.00019312 [pre_auto_parallel]: 2.942e-05 [py_interpret_to_execute]: 0.0008856 [rewriter_before_opt_a]: 0.00509916 [expand_dump_flag]: 5.776e-05 [jit_opt_a]: 0.52224, [4] [Cycle 1]: 0.306337, [27] [switch_simplify]: 0.00147736 [loop_unroll]: 0.00064605 [a_1]: 0.0435811 [with_stream_mark]: 0.00022154 [recompute_prepare]: 0.00012848 [updatestate_depend_eliminate]: 0.00059352 [updatestate_assign_eliminate]: 5.501e-05 [updatestate_loads_eliminate]: 0.00012203 [parameter_eliminate]: 5.40999e-06 [specialize_transform]: 0.0401169 [updatestate_useless_node_eliminater]: 0.00013106 [accelerated_algorithm]: 0.00014683 [meta_shard_fg_expand]: 5.349e-05 [get_grad_eliminate_]: 6.235e-05 [merge_forward]: 4.405e-05 [cell_reuse_recompute_pass]: 4.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00011931 [j_node_and_user_rematch]: 0.00010907 [meta_fg_expand]: 0.0387427 [replace_old_param]: 0.00036385 [inline_without_move]: 0.00040965 [renormalize]: 0.176386 [add_forward_monad_depend]: 6.778e-05 [auto_monad_grad]: 3.967e-05 [auto_monad_eliminator]: 0.0005564 [cse]: 0.00100684 [replace_applicator]: 0.00064916 [Cycle 2]: 0.130284, [27] [switch_simplify]: 0.00032379 [loop_unroll]: 0.00030945 [a_1]: 0.094184 [with_stream_mark]: 0.00018447 [recompute_prepare]: 7.109e-05 [updatestate_depend_eliminate]: 8.125e-05 [updatestate_assign_eliminate]: 3.809e-05 [updatestate_loads_eliminate]: 0.00011432 [parameter_eliminate]: 3.22002e-06 [specialize_transform]: 5.582e-05 [updatestate_useless_node_eliminater]: 7.409e-05 [accelerated_algorithm]: 5.85e-05 [meta_shard_fg_expand]: 2.234e-05 [get_grad_eliminate_]: 4.745e-05 [merge_forward]: 2.999e-05 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.243e-05 [j_node_and_user_rematch]: 8.067e-05 [meta_fg_expand]: 0.0252461 [replace_old_param]: 0.00011795 [inline_without_move]: 5.144e-05 [renormalize]: 0.00831581 [add_forward_monad_depend]: 1.237e-05 [auto_monad_grad]: 3.11001e-06 [auto_monad_eliminator]: 0.00016172 [cse]: 0.00019566 [replace_applicator]: 7.107e-05 [Cycle 3]: 0.00559019, [27] [switch_simplify]: 4.662e-05 [loop_unroll]: 4.486e-05 [a_1]: 0.0014329 [with_stream_mark]: 4.317e-05 [recompute_prepare]: 4.474e-05 [updatestate_depend_eliminate]: 3.151e-05 [updatestate_assign_eliminate]: 2.978e-05 [updatestate_loads_eliminate]: 3.182e-05 [parameter_eliminate]: 2.85002e-06 [specialize_transform]: 4.524e-05 [updatestate_useless_node_eliminater]: 5.951e-05 [accelerated_algorithm]: 5.244e-05 [meta_shard_fg_expand]: 1.081e-05 [get_grad_eliminate_]: 4.327e-05 [merge_forward]: 2.653e-05 [cell_reuse_recompute_pass]: 3.8e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.317e-05 [j_node_and_user_rematch]: 7.355e-05 [meta_fg_expand]: 1.795e-05 [replace_old_param]: 5.767e-05 [inline_without_move]: 4.373e-05 [renormalize]: 0.00284522 [add_forward_monad_depend]: 7.05998e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 0.0001002 [cse]: 0.00016485 [replace_applicator]: 5.929e-05 [Cycle 4]: 0.00258104, [27] [switch_simplify]: 4.603e-05 [loop_unroll]: 4.34e-05 [a_1]: 0.00141018 [with_stream_mark]: 3.911e-05 [recompute_prepare]: 4.371e-05 [updatestate_depend_eliminate]: 2.996e-05 [updatestate_assign_eliminate]: 2.863e-05 [updatestate_loads_eliminate]: 2.855e-05 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 4.52e-05 [updatestate_useless_node_eliminater]: 6.125e-05 [accelerated_algorithm]: 5.135e-05 [meta_shard_fg_expand]: 1.216e-05 [get_grad_eliminate_]: 4.283e-05 [merge_forward]: 2.572e-05 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.11e-05 [j_node_and_user_rematch]: 7.334e-05 [meta_fg_expand]: 1.813e-05 [replace_old_param]: 5.49e-05 [inline_without_move]: 4.291e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.62001e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 7.339e-05 [cse]: 0.00013039 [replace_applicator]: 4.586e-05 [py_interpret_to_execute_after_opt_a]: 5.205e-05 [rewriter_after_opt_a]: 0.00040976 [convert_after_rewriter]: 3.711e-05 [order_py_execute_after_rewriter]: 2.564e-05 [mutable_eliminate]: 0.00078963 [jit_opt_b]: 0.00027639, [1] [Cycle 1]: 0.00026762, [2] [frontend_op_eliminate]: 0.00013678 [inline_after_opt_a]: 0.00011759 [cconv]: 4.328e-05 [loop_unroll]: 0.00048971 [jit_opt_after_cconv]: 0.00081667, [1] [Cycle 1]: 0.00080689, [11] [c_1]: 0.00029508 [parameter_eliminate]: 3.33e-06 [updatestate_depend_eliminate]: 3.629e-05 [updatestate_assign_eliminate]: 3.086e-05 [updatestate_loads_eliminate]: 3.052e-05 [cse]: 0.00013948 [call_graph_tuple_transform]: 0.00011217 [tuple_list_get_item_eliminator]: 4.347e-05 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 4.641e-05 [remove_dup_value]: 0.00013153 [partial_unused_args_eliminate]: 2.98e-06 [environ_conv]: 3.074e-05 [add_recomputation]: 0.00025521 [cse_after_recomputation]: 0.00014651, [1] [Cycle 1]: 0.00013658, [1] [cse]: 0.00012282 [auto_monad_reorder]: 0.0001199 [get_jit_bprop_graph]: 3.01001e-06 [rewriter_after_jit_bprop_graph]: 0.00032318 [opt_after_jit_grad]: 0.0007227 [symbol_engine_optimizer]: 0.00033067, [1] [Cycle 1]: 0.00032215, [6] [build]: 2.616e-05 [elim_shapecalc]: 5.135e-05 [elim_not_effective]: 8.045e-05 [opt_reshape]: 4.929e-05 [fold_const_symbol]: 7.671e-05 [renormalize]: 7.50006e-07 [validate]: 0.000173 Sums bootstrap : 0.000308s : 0.02% type_inference : 1.221625s : 72.71% event_method : 0.000459s : 0.03% auto_monad : 0.002740s : 0.16% graph_reusing : 0.000193s : 0.01% pre_auto_parallel : 0.000029s : 0.00% py_interpret_to_execute : 0.000886s : 0.05% rewriter_before_opt_a : 0.005099s : 0.30% expand_dump_flag : 0.000058s : 0.00% jit_opt_a.switch_simplify : 0.001894s : 0.11% jit_opt_a.loop_unroll : 0.001044s : 0.06% jit_opt_a.a_1 : 0.140608s : 8.37% jit_opt_a.with_stream_mark : 0.000488s : 0.03% jit_opt_a.recompute_prepare : 0.000288s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000736s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000152s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000297s : 0.02% jit_opt_a.parameter_eliminate : 0.000013s : 0.00% jit_opt_a.specialize_transform : 0.040263s : 2.40% jit_opt_a.updatestate_useless_node_eliminater : 0.000326s : 0.02% jit_opt_a.accelerated_algorithm : 0.000309s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000099s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000196s : 0.01% jit_opt_a.merge_forward : 0.000126s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000013s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000376s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000337s : 0.02% jit_opt_a.meta_fg_expand : 0.064025s : 3.81% jit_opt_a.replace_old_param : 0.000594s : 0.04% jit_opt_a.inline_without_move : 0.000548s : 0.03% jit_opt_a.renormalize : 0.187547s : 11.16% jit_opt_a.add_forward_monad_depend : 0.000090s : 0.01% jit_opt_a.auto_monad_grad : 0.000047s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000892s : 0.05% jit_opt_a.cse : 0.001498s : 0.09% jit_opt_a.replace_applicator : 0.000825s : 0.05% py_interpret_to_execute_after_opt_a : 0.000052s : 0.00% rewriter_after_opt_a : 0.000410s : 0.02% convert_after_rewriter : 0.000037s : 0.00% order_py_execute_after_rewriter : 0.000026s : 0.00% mutable_eliminate : 0.000790s : 0.05% jit_opt_b.frontend_op_eliminate : 0.000137s : 0.01% jit_opt_b.inline_after_opt_a : 0.000118s : 0.01% cconv : 0.000043s : 0.00% loop_unroll : 0.000490s : 0.03% jit_opt_after_cconv.c_1 : 0.000295s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000036s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000031s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000031s : 0.00% jit_opt_after_cconv.cse : 0.000139s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000112s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000043s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000046s : 0.00% remove_dup_value : 0.000132s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000031s : 0.00% add_recomputation : 0.000255s : 0.02% cse_after_recomputation.cse : 0.000123s : 0.01% auto_monad_reorder : 0.000120s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000323s : 0.02% opt_after_jit_grad : 0.000723s : 0.04% symbol_engine_optimizer.build : 0.000026s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000051s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000080s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000049s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000077s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000173s : 0.01% Time group info: ------[substitution.] 0.094766 1554 0.10% : 0.000095s : 5: substitution.arithmetic_simplify 0.03% : 0.000031s : 3: substitution.cast_eliminate 88.79% : 0.084143s : 51: substitution.depend_value_elim 0.01% : 0.000011s : 32: substitution.elim_not_effective 0.01% : 0.000010s : 4: substitution.environ_get_add_eliminate 0.00% : 0.000004s : 2: substitution.environ_get_depend_swap 0.01% : 0.000009s : 4: substitution.environ_get_eliminate 0.03% : 0.000024s : 4: substitution.environ_get_set_eliminate 0.01% : 0.000010s : 32: substitution.fold_const_symbol 1.51% : 0.001426s : 8: substitution.getattr_setattr_resolve 0.03% : 0.000029s : 44: substitution.graph_param_transform 6.80% : 0.006442s : 174: substitution.inline 0.14% : 0.000134s : 12: substitution.inline_without_move 0.06% : 0.000056s : 147: substitution.j_node_and_user_rematch 0.08% : 0.000074s : 17: substitution.less_batch_normalization 0.04% : 0.000037s : 1: substitution.list_to_tuple_eliminator_ 0.04% : 0.000033s : 30: substitution.load_eliminater 0.10% : 0.000096s : 69: substitution.minmaximum_grad 0.00% : 0.000001s : 1: substitution.opt_reshape 0.03% : 0.000030s : 12: substitution.partial_eliminate 0.03% : 0.000025s : 6: substitution.reduce_eliminate 0.01% : 0.000008s : 5: substitution.redundant_stop_gradient_eliminater 0.09% : 0.000082s : 147: substitution.remove_not_recompute_node 0.19% : 0.000183s : 55: substitution.replace_applicator 0.06% : 0.000052s : 76: substitution.replace_old_param 0.09% : 0.000084s : 14: substitution.reshape_eliminate 0.01% : 0.000006s : 1: substitution.set_cell_output_no_recompute 0.00% : 0.000005s : 3: substitution.split_environ_get_set_with_tuple_value 0.08% : 0.000074s : 34: substitution.switch_simplify 0.01% : 0.000006s : 1: substitution.tile_eliminate 0.36% : 0.000345s : 79: substitution.tuple_list_convert_item_index_to_positive 0.28% : 0.000270s : 88: substitution.tuple_list_get_item_depend_reorder 0.52% : 0.000494s : 167: substitution.tuple_list_get_item_eliminator 0.14% : 0.000133s : 101: substitution.updatestate_pure_node_eliminater 0.32% : 0.000300s : 125: substitution.updatestate_useless_node_eliminater ------[type_inference.] 1.220220 2 88.04% : 1.074342s : 1: type_inference.infer 11.96% : 0.145878s : 1: type_inference.specialize ------[replace.] 0.003643 322 0.47% : 0.000017s : 1: replace.arithmetic_simplify 0.96% : 0.000035s : 3: replace.cast_eliminate 1.11% : 0.000040s : 5: replace.depend_value_elim 0.99% : 0.000036s : 2: replace.environ_get_set_eliminate 3.12% : 0.000114s : 6: replace.getattr_setattr_resolve 46.55% : 0.001696s : 174: replace.inline 0.72% : 0.000026s : 1: replace.list_to_tuple_eliminator_ 0.80% : 0.000029s : 2: replace.partial_eliminate 2.50% : 0.000091s : 3: replace.replace_applicator 0.15% : 0.000005s : 1: replace.reshape_eliminate 12.56% : 0.000457s : 34: replace.switch_simplify 3.00% : 0.000109s : 9: replace.tuple_list_get_item_depend_reorder 26.43% : 0.000963s : 79: replace.tuple_list_get_item_eliminator 0.65% : 0.000024s : 2: replace.updatestate_useless_node_eliminater ------[match.] 0.008269 322 0.58% : 0.000048s : 1: match.arithmetic_simplify 0.35% : 0.000029s : 3: match.cast_eliminate 0.08% : 0.000007s : 5: match.depend_value_elim 0.23% : 0.000019s : 2: match.environ_get_set_eliminate 16.19% : 0.001339s : 6: match.getattr_setattr_resolve 76.73% : 0.006345s : 174: match.inline 0.43% : 0.000036s : 1: match.list_to_tuple_eliminator_ 0.15% : 0.000013s : 2: match.partial_eliminate 0.43% : 0.000035s : 3: match.replace_applicator 0.03% : 0.000002s : 1: match.reshape_eliminate 0.73% : 0.000060s : 34: match.switch_simplify 1.17% : 0.000096s : 9: match.tuple_list_get_item_depend_reorder 2.70% : 0.000223s : 79: match.tuple_list_get_item_eliminator 0.20% : 0.000016s : 2: match.updatestate_useless_node_eliminater ------[predicate.] 0.045159 34488 0.18% : 0.000081s : 591: predicate.accumulaten_eliminater 0.02% : 0.000011s : 44: predicate.ad_related_special_op_eliminate 0.17% : 0.000075s : 591: predicate.addn_check_dump 0.18% : 0.000079s : 591: predicate.addn_zero_filter 0.24% : 0.000108s : 592: predicate.arithmetic_simplify 0.18% : 0.000081s : 596: predicate.cast_eliminate 0.01% : 0.000006s : 44: predicate.check_bprop_eliminate 0.17% : 0.000076s : 591: predicate.compare_switch_simplify 0.18% : 0.000082s : 591: predicate.depend_value_elim 0.17% : 0.000078s : 598: predicate.dict_get_item_const_eliminator 0.19% : 0.000088s : 598: predicate.dict_get_item_eliminator 0.17% : 0.000077s : 598: predicate.dict_set_item_eliminator 0.02% : 0.000008s : 44: predicate.dumpgradient_eliminate 0.01% : 0.000004s : 44: predicate.elim_not_effective 0.02% : 0.000007s : 44: predicate.elim_shapecalc_of_broadcastargs 0.17% : 0.000078s : 596: predicate.environ_add_const_eliminate 0.17% : 0.000077s : 598: predicate.environ_get_add_eliminate 0.17% : 0.000077s : 596: predicate.environ_get_depend_swap 0.19% : 0.000085s : 598: predicate.environ_get_eliminate 0.17% : 0.000078s : 598: predicate.environ_get_set_eliminate 0.01% : 0.000004s : 44: predicate.fold_const_symbol 0.06% : 0.000029s : 202: predicate.get_grad_eliminate 0.03% : 0.000012s : 40: predicate.getattr_setattr_resolve 0.01% : 0.000003s : 44: predicate.graph_param_transform 0.51% : 0.000230s : 953: predicate.inline 0.15% : 0.000069s : 408: predicate.inline_without_move 0.03% : 0.000015s : 202: predicate.j_node_and_user_rematch 0.08% : 0.000035s : 212: predicate.less_batch_normalization 0.21% : 0.000093s : 687: predicate.list_to_tuple_eliminator_ 0.22% : 0.000101s : 733: predicate.load_eliminater 0.02% : 0.000010s : 44: predicate.loop_unroll_after_grad 0.40% : 0.000183s : 1178: predicate.loop_unroll_before_grad 0.20% : 0.000088s : 651: predicate.make_slice_get_slice_eliminator 0.17% : 0.000076s : 591: predicate.merge_addn 0.17% : 0.000079s : 592: predicate.minmaximum_grad 0.02% : 0.000011s : 44: predicate.mutable_eliminate 0.02% : 0.000007s : 44: predicate.opt_reshape 0.28% : 0.000125s : 733: predicate.partial_eliminate 0.17% : 0.000078s : 586: predicate.print_const_string_wrapper 0.22% : 0.000101s : 592: predicate.reduce_eliminate 0.21% : 0.000093s : 689: predicate.redundant_stop_gradient_eliminater 0.03% : 0.000015s : 202: predicate.remove_not_recompute_node 0.25% : 0.000111s : 1175: predicate.replace_applicator 0.07% : 0.000032s : 408: predicate.replace_old_param 0.01% : 0.000004s : 44: predicate.reset_defer_inline 0.17% : 0.000078s : 593: predicate.reshape_eliminate 0.17% : 0.000077s : 586: predicate.row_tensor_add_zeros_like 0.02% : 0.000007s : 44: predicate.row_tensor_eliminate 0.17% : 0.000077s : 586: predicate.same_eliminate 0.05% : 0.000021s : 247: predicate.set_cell_output_no_recompute 0.03% : 0.000013s : 88: predicate.special_op_eliminate 88.68% : 0.040048s : 202: predicate.specialize_transform 0.20% : 0.000091s : 586: predicate.split_environ_get_set_with_tuple_value 0.17% : 0.000077s : 586: predicate.stack_unstack_eliminate 0.01% : 0.000007s : 44: predicate.switch_call_monad_eliminater 0.44% : 0.000199s : 865: predicate.switch_defer_inline 0.29% : 0.000130s : 865: predicate.switch_layer_defer_inline 0.75% : 0.000338s : 2155: predicate.switch_simplify 0.17% : 0.000078s : 592: predicate.tile_eliminate 0.17% : 0.000078s : 592: predicate.transpose_eliminate 0.22% : 0.000101s : 598: predicate.tuple_list_convert_item_index_to_positive 0.21% : 0.000093s : 607: predicate.tuple_list_get_item_depend_reorder 0.36% : 0.000162s : 774: predicate.tuple_list_get_item_eliminator 0.24% : 0.000109s : 607: predicate.tuple_list_set_item_eliminator 0.35% : 0.000158s : 686: predicate.tuple_to_list_eliminator_ 0.23% : 0.000102s : 733: predicate.updatestate_pure_node_eliminater 0.32% : 0.000145s : 937: predicate.updatestate_useless_node_eliminater 0.22% : 0.000099s : 586: predicate.value_based_eliminate 0.01% : 0.000006s : 44: predicate.virtual_view_grad_eliminate 0.02% : 0.000007s : 44: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.062127 415 82.00% : 0.050944s : 212: func_graph_cloner_run.FuncGraphClonerGraph 18.00% : 0.011183s : 203: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 2.136775 106 0.01% : 0.000260s : 1: add_recomputation 0.13% : 0.002763s : 1: auto_monad 0.01% : 0.000126s : 1: auto_monad_reorder 0.02% : 0.000329s : 1: bootstrap 0.00% : 0.000046s : 1: cconv 0.00% : 0.000041s : 1: convert_after_rewriter 0.01% : 0.000149s : 1: cse_after_recomputation 0.00% : 0.000033s : 1: environ_conv 0.02% : 0.000473s : 1: event_method 0.00% : 0.000064s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000201s : 1: graph_reusing 24.44% : 0.522245s : 1: jit_opt_a 0.04% : 0.000820s : 1: jit_opt_after_cconv 0.01% : 0.000279s : 1: jit_opt_b 0.02% : 0.000499s : 1: loop_unroll 0.04% : 0.000799s : 1: mutable_eliminate 8.77% : 0.187489s : 52: opt.transform.jit_opt_a 0.02% : 0.000492s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000246s : 4: opt.transform.jit_opt_b 0.00% : 0.000057s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000062s : 1: opt.transform.mutable_eliminate 0.01% : 0.000160s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.001645s : 4: opt.transform.opt_resolve 0.01% : 0.000254s : 4: opt.transform.symbol_engine_opt 0.03% : 0.000733s : 1: opt_after_jit_grad 0.00% : 0.000029s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000033s : 1: pre_auto_parallel 0.04% : 0.000900s : 1: py_interpret_to_execute 0.00% : 0.000055s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000136s : 1: remove_dup_value 7.08% : 0.151302s : 3: renormalize.infer 1.69% : 0.036194s : 3: renormalize.specialize 0.02% : 0.000328s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000415s : 1: rewriter_after_opt_a 0.24% : 0.005124s : 1: rewriter_before_opt_a 0.02% : 0.000334s : 1: symbol_engine_optimizer 57.17% : 1.221650s : 1: type_inference . [hook] pytest_runtest_teardown:test_mint_optim_fused_adamw_basic_maximize[1] tests/st/mint/optim/test_fused_adamw.py::test_mint_optim_fused_adamw_basic_maximize[1],max_mem:20.0M =============================== warnings summary =============================== ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B """ ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c """ ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c """ ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for type is zero. setattr(self, word, getattr(machar, word).flat[0]) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for type is zero. return self._float_to_str(self.smallest_subnormal) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for type is zero. setattr(self, word, getattr(machar, word).flat[0]) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for type is zero. return self._float_to_str(self.smallest_subnormal) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2_grad_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul_grad_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_perchannel_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_per_layer") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_per_layer_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("minmax_update_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("minmax_update_perlayer") test_fused_adamw.py::test_mint_optim_fused_adamw_basic_maximize[0] /usr/local/Ascend/cann-8.5.0/python/site-packages/asc_op_compile_base/asc_op_compiler/ascendc_compile_gen_code.py:161: DeprecationWarning: invalid escape sequence \w match = re.search(f'{option}=(\w+)', ' '.join(compile_options)) -- Docs: https://docs.pytest.org/en/stable/warnings.html ================== 2 passed, 26 warnings in 473.65s (0:07:53) ==================